2023-10-05T15:03:25.211 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T15:03:25.211 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983 --verbose -- /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/orig.config.yaml 2023-10-05T15:03:25.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T15:03:25.365 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983 branch: wip-61009-wo-1 description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} email: vshankar@redhat.com first_in_suite: false job_id: '7411983' kernel: flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-61009-wo-1 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_client_delegate_inos_pct: 50 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-61009-wo-1 sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2223 sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f sleep_before_teardown: 0 subset: 328/1024 suite: fs:workload suite_branch: wip-61009-wo-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_14:37:31 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-05T15:03:25.366 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa; will attempt to use it 2023-10-05T15:03:25.367 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks 2023-10-05T15:03:25.367 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-05T15:03:25.369 INFO:teuthology.task.internal:Checking packages... 2023-10-05T15:03:25.394 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f' 2023-10-05T15:03:25.395 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-05T15:03:25.395 INFO:teuthology.packaging:ref: None 2023-10-05T15:03:25.395 INFO:teuthology.packaging:tag: None 2023-10-05T15:03:25.395 INFO:teuthology.packaging:branch: wip-61009-wo-1 2023-10-05T15:03:25.395 INFO:teuthology.packaging:sha1: 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:03:25.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-61009-wo-1 2023-10-05T15:03:25.640 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6578.g689b3d5a 2023-10-05T15:03:25.640 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-05T15:03:25.648 INFO:teuthology.task.internal:no buildpackages task found 2023-10-05T15:03:25.648 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-05T15:03:25.659 INFO:teuthology.task.internal:Saving configuration 2023-10-05T15:03:25.680 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-05T15:03:25.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T15:03:25.710 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:58:01.806933', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T15:03:25.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:58:01.809456', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T15:03:25.753 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:58:01.808281', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T15:03:25.753 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-05T15:03:25.759 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-05T15:03:25.759 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-05T15:03:25.759 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-05T15:03:25.759 INFO:teuthology.run_tasks:Running task console_log... 2023-10-05T15:03:25.872 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f72e1743e50>, signals=[15]) 2023-10-05T15:03:25.873 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-05T15:03:25.879 INFO:teuthology.task.internal:Opening connections... 2023-10-05T15:03:25.879 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:03:25.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:03:25.949 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2023-10-05T15:03:25.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:03:26.017 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T15:03:26.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:03:26.084 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-05T15:03:26.092 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-10-05T15:03:26.115 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-10-05T15:03:26.115 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-05T15:03:26.175 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T15:03:26.175 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-10-05T15:03:26.175 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-05T15:03:26.175 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-05T15:03:26.175 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T15:03:26.176 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-05T15:03:26.177 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-05T15:03:26.199 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-05T15:03:26.219 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-05T15:03:26.219 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-05T15:03:26.279 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T15:03:26.279 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-10-05T15:03:26.279 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T15:03:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-05T15:03:26.281 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T15:03:26.281 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-05T15:03:26.281 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-05T15:03:26.306 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-10-05T15:03:26.327 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-10-05T15:03:26.327 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-05T15:03:26.386 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-10-05T15:03:26.389 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T15:03:26.390 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-05T15:03:26.391 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-05T15:03:26.415 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-05T15:03:26.427 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-05T15:03:26.435 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-05T15:03:26.435 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2023-10-05T15:03:26.438 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2023-10-05T15:03:26.440 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-10-05T15:03:26.458 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-05T15:03:26.467 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-05T15:03:26.467 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2023-10-05T15:03:26.498 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2023-10-05T15:03:26.500 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-10-05T15:03:26.529 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-05T15:03:26.612 INFO:teuthology.run_tasks:Running task kernel... 2023-10-05T15:03:26.626 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-05T15:03:26.627 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, timeout 300 2023-10-05T15:03:26.627 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T15:03:26.628 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T15:03:26.628 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T15:03:26.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:03:26.648 DEBUG:teuthology.task.kernel:sha1 for mon.b is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.648 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-05T15:03:26.649 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-05T15:03:26.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:03:26.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:03:26.651 DEBUG:teuthology.task.kernel:sha1 for mon.a is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.651 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-05T15:03:26.651 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-10-05T15:03:26.652 DEBUG:teuthology.task.kernel:sha1 for mon.c is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.652 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-05T15:03:26.652 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-10-05T15:03:26.707 INFO:teuthology.orchestra.run.smithi079.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-05T15:03:26.708 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.708 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-05T15:03:26.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.712 INFO:teuthology.orchestra.run.smithi017.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-05T15:03:26.713 INFO:teuthology.orchestra.run.smithi167.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-05T15:03:26.713 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.713 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-05T15:03:26.713 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.714 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.714 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-05T15:03:26.714 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:26.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum upgrade -y linux-firmware 2023-10-05T15:03:26.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum upgrade -y linux-firmware 2023-10-05T15:03:26.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum upgrade -y linux-firmware 2023-10-05T15:03:28.013 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:28.014 INFO:teuthology.orchestra.run.smithi167.stdout:Unable to read consumer identity 2023-10-05T15:03:28.029 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:28.029 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-05T15:03:28.086 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-05T15:03:28.086 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-10-05T15:03:29.461 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-05T15:03:29.466 INFO:teuthology.orchestra.run.smithi167.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-05T15:03:29.581 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-10-05T15:03:30.750 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-10-05T15:03:30.786 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-05T15:03:32.015 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 16 MB 00:02 2023-10-05T15:03:34.275 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 465 kB/s | 24 kB 00:00 2023-10-05T15:03:34.294 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 378 kB/s | 24 kB 00:00 2023-10-05T15:03:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-10-05T15:03:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2023-10-05T15:03:35.106 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-10-05T15:03:35.130 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-05T15:03:35.132 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2023-10-05T15:03:35.132 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-05T15:03:35.218 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-10-05T15:03:35.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:35.265 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-10-05T15:03:35.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:35.419 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-05T15:03:35.419 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-05T15:03:35.421 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi079.front.sepia.ceph.com to complete... 2023-10-05T15:03:35.459 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-05T15:03:35.459 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-05T15:03:35.462 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi167.front.sepia.ceph.com to complete... 2023-10-05T15:03:35.684 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 453 kB/s | 24 kB 00:00 2023-10-05T15:03:36.483 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-05T15:03:36.484 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2023-10-05T15:03:36.484 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-05T15:03:36.592 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-10-05T15:03:36.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-05T15:03:36.978 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-05T15:03:36.979 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-05T15:03:36.981 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2023-10-05T15:04:05.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05 15:04:05 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-05T15:04:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:FINISHED --2023-10-05 15:04:05-- 2023-10-05T15:04:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:Total wall clock time: 30s 2023-10-05T15:04:05.607 INFO:teuthology.orchestra.run.smithi079.stderr:Downloaded: 1 files, 363M in 30s (12.2 MB/s) 2023-10-05T15:04:05.663 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.b... 2023-10-05T15:04:05.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-05T15:04:07.327 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying... ######################################## 2023-10-05T15:04:07.391 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing... ######################################## 2023-10-05T15:04:07.476 INFO:teuthology.orchestra.run.smithi079.stdout:Updating / installing... 2023-10-05T15:04:08.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05 15:04:08 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-05T15:04:08.519 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2023-10-05 15:04:08-- 2023-10-05T15:04:08.519 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 32s 2023-10-05T15:04:08.519 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 363M in 31s (11.6 MB/s) 2023-10-05T15:04:08.520 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.a... 2023-10-05T15:04:08.521 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-05T15:04:10.255 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying... ######################################## 2023-10-05T15:04:10.671 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing... ######################################## 2023-10-05T15:04:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:Updating / installing... 2023-10-05T15:04:15.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05 15:04:15 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-05T15:04:15.663 INFO:teuthology.orchestra.run.smithi167.stderr:FINISHED --2023-10-05 15:04:15-- 2023-10-05T15:04:15.663 INFO:teuthology.orchestra.run.smithi167.stderr:Total wall clock time: 40s 2023-10-05T15:04:15.663 INFO:teuthology.orchestra.run.smithi167.stderr:Downloaded: 1 files, 363M in 40s (9.13 MB/s) 2023-10-05T15:04:15.665 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on mon.c... 2023-10-05T15:04:15.665 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-05T15:04:17.275 INFO:teuthology.orchestra.run.smithi167.stdout:Verifying... ######################################## 2023-10-05T15:04:17.339 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing... ######################################## 2023-10-05T15:04:17.420 INFO:teuthology.orchestra.run.smithi167.stdout:Updating / installing... 2023-10-05T15:04:45.432 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-05T15:04:51.455 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-05T15:04:55.630 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-05T15:05:10.181 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-05T15:05:10.181 DEBUG:teuthology.orchestra.run.smithi079:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-05T15:05:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-05T15:05:10.273 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-05T15:05:10.274 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-05T15:05:10.275 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-05T15:05:10.276 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-05T15:05:10.277 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-05T15:05:10.278 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-05T15:05:10.279 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-05T15:05:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-05T15:05:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-05T15:05:10.282 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-05T15:05:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-05T15:05:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-05T15:05:10.285 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-05T15:05:10.286 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-05T15:05:10.286 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-05T15:05:10.287 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-05T15:05:10.288 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-05T15:05:10.289 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-05T15:05:10.290 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-05T15:05:10.291 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-05T15:05:10.292 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-05T15:05:10.293 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-05T15:05:10.294 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-05T15:05:10.295 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-05T15:05:10.295 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-05T15:05:10.295 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-05T15:05:10.296 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-05T15:05:10.296 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-05T15:05:10.297 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-05T15:05:10.298 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-05T15:05:10.299 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-05T15:05:10.300 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-05T15:05:10.301 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-05T15:05:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-05T15:05:10.303 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-05T15:05:10.304 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-05T15:05:10.305 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-05T15:05:10.306 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-05T15:05:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-05T15:05:10.308 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-05T15:05:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-05T15:05:10.310 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-05T15:05:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-05T15:05:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-05T15:05:10.313 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-05T15:05:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-05T15:05:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-05T15:05:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-05T15:05:10.317 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-05T15:05:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-05T15:05:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-05T15:05:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-05T15:05:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-05T15:05:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-05T15:05:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-05T15:05:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-05T15:05:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-05T15:05:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-05T15:05:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-05T15:05:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-05T15:05:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-05T15:05:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-05T15:05:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-05T15:05:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-05T15:05:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-05T15:05:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-05T15:05:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-05T15:05:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-05T15:05:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-05T15:05:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-05T15:05:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-05T15:05:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-05T15:05:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-05T15:05:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-05T15:05:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-05T15:05:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-05T15:05:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-05T15:05:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-05T15:05:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-05T15:05:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-05T15:05:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-05T15:05:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-05T15:05:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-05T15:05:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-05T15:05:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-05T15:05:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-05T15:05:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-05T15:05:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-05T15:05:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-05T15:05:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-05T15:05:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-05T15:05:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-05T15:05:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-05T15:05:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-05T15:05:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-05T15:05:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-05T15:05:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-05T15:05:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-05T15:05:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-05T15:05:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-05T15:05:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-05T15:05:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-05T15:05:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-05T15:05:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-05T15:05:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-05T15:05:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-05T15:05:10.368 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-05T15:05:10.369 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-05T15:05:10.370 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-05T15:05:10.371 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-05T15:05:10.372 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-05T15:05:10.373 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-05T15:05:10.374 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-05T15:05:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-05T15:05:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-05T15:05:10.377 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-05T15:05:10.378 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-05T15:05:10.379 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-05T15:05:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-05T15:05:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-05T15:05:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-05T15:05:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-05T15:05:10.384 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-05T15:05:10.385 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-05T15:05:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-05T15:05:10.387 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-05T15:05:10.388 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-05T15:05:10.389 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-05T15:05:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-05T15:05:10.391 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-05T15:05:10.392 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-05T15:05:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-05T15:05:10.394 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-05T15:05:10.395 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-05T15:05:10.396 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-05T15:05:10.397 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-05T15:05:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-05T15:05:10.399 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-05T15:05:10.400 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-05T15:05:10.401 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-05T15:05:10.402 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-05T15:05:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-05T15:05:10.404 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-05T15:05:10.405 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-05T15:05:10.406 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-05T15:05:10.407 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-05T15:05:10.408 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-05T15:05:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-05T15:05:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-05T15:05:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-05T15:05:10.412 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-05T15:05:10.413 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-05T15:05:10.414 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-05T15:05:10.414 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-05T15:05:10.414 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-05T15:05:10.414 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-05T15:05:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-05T15:05:10.416 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-05T15:05:10.417 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-05T15:05:10.418 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-05T15:05:10.419 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-05T15:05:10.420 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-05T15:05:10.421 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-05T15:05:10.421 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-05T15:05:10.421 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-05T15:05:10.421 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-05T15:05:10.421 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-05T15:05:10.422 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-05T15:05:10.423 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-05T15:05:10.424 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-05T15:05:10.425 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-05T15:05:10.426 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-05T15:05:10.427 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-05T15:05:10.428 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-05T15:05:10.429 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-05T15:05:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-05T15:05:10.431 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-05T15:05:10.432 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-05T15:05:10.433 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-05T15:05:10.434 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-05T15:05:10.435 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-05T15:05:10.436 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-05T15:05:10.437 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-05T15:05:10.438 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-05T15:05:10.439 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-05T15:05:10.440 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-05T15:05:10.441 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-05T15:05:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-05T15:05:10.443 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-05T15:05:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-05T15:05:10.445 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-05T15:05:10.446 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-05T15:05:10.447 INFO:teuthology.orchestra.run.smithi079.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-05T15:05:10.447 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.447 DEBUG:teuthology.orchestra.run.smithi079:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-05T15:05:10.473 INFO:teuthology.orchestra.run.smithi079.stdout:postinstall scriptlet (using /bin/sh): 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-05T15:05:10.474 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.475 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2023-10-05T15:05:10.475 INFO:teuthology.orchestra.run.smithi079.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-05T15:05:10.475 INFO:teuthology.orchestra.run.smithi079.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-05T15:05:10.475 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.475 INFO:teuthology.orchestra.run.smithi079.stdout:fi 2023-10-05T15:05:10.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2023-10-05T15:05:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2023-10-05T15:05:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2023-10-05T15:05:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.02 2023-10-05T15:05:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 123.el8 2023-10-05T15:05:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2023-10-05T15:05:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Group : System Environment/Base 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 9265450 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-05T15:05:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Relocations : (not relocatable) 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : Red Hat, Inc. 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : Red Hat, Inc. 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T15:05:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2023-10-05T15:05:10.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:05:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T15:05:10.557 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T15:05:10.558 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:10.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T15:05:14.930 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2023-10-05T15:05:16.662 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-05T15:05:16.662 DEBUG:teuthology.orchestra.run.smithi017:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-05T15:05:16.728 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.728 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.728 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.728 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-05T15:05:16.729 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-05T15:05:16.730 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-05T15:05:16.731 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-05T15:05:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-05T15:05:16.733 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-05T15:05:16.734 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-05T15:05:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-05T15:05:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-05T15:05:16.737 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-05T15:05:16.738 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-05T15:05:16.739 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-05T15:05:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-05T15:05:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-05T15:05:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-05T15:05:16.743 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-05T15:05:16.744 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-05T15:05:16.745 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-05T15:05:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-05T15:05:16.747 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-05T15:05:16.748 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-05T15:05:16.749 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-05T15:05:16.750 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-05T15:05:16.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-05T15:05:16.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-05T15:05:16.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-05T15:05:16.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-05T15:05:16.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-05T15:05:16.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-05T15:05:16.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-05T15:05:16.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-05T15:05:16.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-05T15:05:16.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-05T15:05:16.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-05T15:05:16.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-05T15:05:16.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-05T15:05:16.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-05T15:05:16.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-05T15:05:16.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-05T15:05:16.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-05T15:05:16.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-05T15:05:16.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-05T15:05:16.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-05T15:05:16.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-05T15:05:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-05T15:05:16.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-05T15:05:16.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-05T15:05:16.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-05T15:05:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-05T15:05:16.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-05T15:05:16.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-05T15:05:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-05T15:05:16.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-05T15:05:16.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-05T15:05:16.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-05T15:05:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-05T15:05:16.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-05T15:05:16.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-05T15:05:16.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-05T15:05:16.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-05T15:05:16.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-05T15:05:16.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-05T15:05:16.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-05T15:05:16.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-05T15:05:16.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-05T15:05:16.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-05T15:05:16.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-05T15:05:16.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-05T15:05:16.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-05T15:05:16.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-05T15:05:16.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-05T15:05:16.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-05T15:05:16.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-05T15:05:16.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-05T15:05:16.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-05T15:05:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-05T15:05:16.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-05T15:05:16.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-05T15:05:16.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-05T15:05:16.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-05T15:05:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-05T15:05:16.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-05T15:05:16.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-05T15:05:16.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-05T15:05:16.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-05T15:05:16.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-05T15:05:16.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-05T15:05:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-05T15:05:16.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-05T15:05:16.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-05T15:05:16.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-05T15:05:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-05T15:05:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-05T15:05:16.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-05T15:05:16.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-05T15:05:16.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-05T15:05:16.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-05T15:05:16.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-05T15:05:16.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-05T15:05:16.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-05T15:05:16.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-05T15:05:16.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-05T15:05:16.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-05T15:05:16.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-05T15:05:16.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-05T15:05:16.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-05T15:05:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-05T15:05:16.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-05T15:05:16.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-05T15:05:16.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-05T15:05:16.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-05T15:05:16.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-05T15:05:16.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-05T15:05:16.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-05T15:05:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-05T15:05:16.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-05T15:05:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-05T15:05:16.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-05T15:05:16.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-05T15:05:16.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-05T15:05:16.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-05T15:05:16.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-05T15:05:16.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-05T15:05:16.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-05T15:05:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-05T15:05:16.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-05T15:05:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-05T15:05:16.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-05T15:05:16.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-05T15:05:16.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-05T15:05:16.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-05T15:05:16.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-05T15:05:16.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-05T15:05:16.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-05T15:05:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-05T15:05:16.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-05T15:05:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-05T15:05:16.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-05T15:05:16.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-05T15:05:16.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-05T15:05:16.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-05T15:05:16.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-05T15:05:16.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-05T15:05:16.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-05T15:05:16.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-05T15:05:16.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-05T15:05:16.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-05T15:05:16.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-05T15:05:16.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-05T15:05:16.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-05T15:05:16.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-05T15:05:16.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-05T15:05:16.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-05T15:05:16.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-05T15:05:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-05T15:05:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-05T15:05:16.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-05T15:05:16.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-05T15:05:16.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-05T15:05:16.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-05T15:05:16.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-05T15:05:16.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-05T15:05:16.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-05T15:05:16.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-05T15:05:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-05T15:05:16.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-05T15:05:16.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-05T15:05:16.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-05T15:05:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-05T15:05:16.895 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-05T15:05:16.896 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-05T15:05:16.897 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-05T15:05:16.898 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.898 DEBUG:teuthology.orchestra.run.smithi017:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-05T15:05:16.926 INFO:teuthology.orchestra.run.smithi017.stdout:postinstall scriptlet (using /bin/sh): 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-05T15:05:16.927 INFO:teuthology.orchestra.run.smithi017.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-05T15:05:16.928 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.928 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-10-05T15:05:16.928 INFO:teuthology.orchestra.run.smithi017.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-05T15:05:16.928 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-05T15:05:16.928 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:16.928 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-10-05T15:05:16.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2023-10-05T15:05:17.008 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2023-10-05T15:05:17.009 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2023-10-05T15:05:17.009 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.02 2023-10-05T15:05:17.009 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 123.el8 2023-10-05T15:05:17.009 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2023-10-05T15:05:17.009 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Group : System Environment/Base 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 9265450 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Relocations : (not relocatable) 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : Red Hat, Inc. 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : Red Hat, Inc. 2023-10-05T15:05:17.010 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:05:17.011 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T15:05:17.012 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T15:05:17.012 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:17.012 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T15:05:17.173 INFO:teuthology.orchestra.run.smithi079.stderr:done 2023-10-05T15:05:17.175 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-10-05T15:05:17.191 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.ISjpZXtAKB 2023-10-05T15:05:17.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ISjpZXtAKB 2023-10-05T15:05:17.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.ISjpZXtAKB 2023-10-05T15:05:17.432 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.ISjpZXtAKB is 6KB 2023-10-05T15:05:17.480 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.ISjpZXtAKB 2023-10-05T15:05:17.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T15:05:17.571 INFO:teuthology.orchestra.run.smithi079.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-05T15:05:17.571 INFO:teuthology.orchestra.run.smithi079.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-05T15:05:17.571 INFO:teuthology.orchestra.run.smithi079.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-05T15:05:17.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:17.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2023-10-05T15:05:19.760 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2023-10-05T15:05:22.131 INFO:teuthology.orchestra.run.smithi017.stderr:done 2023-10-05T15:05:22.133 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-10-05T15:05:22.156 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.bHHwADE1CW 2023-10-05T15:05:22.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bHHwADE1CW 2023-10-05T15:05:22.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.bHHwADE1CW 2023-10-05T15:05:22.396 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.bHHwADE1CW is 6KB 2023-10-05T15:05:22.444 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.bHHwADE1CW 2023-10-05T15:05:22.447 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-05T15:05:22.447 DEBUG:teuthology.orchestra.run.smithi167:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-05T15:05:22.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T15:05:22.513 INFO:teuthology.orchestra.run.smithi167.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.513 INFO:teuthology.orchestra.run.smithi167.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-05T15:05:22.514 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-05T15:05:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-05T15:05:22.516 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-05T15:05:22.517 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-05T15:05:22.518 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-05T15:05:22.519 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-05T15:05:22.520 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-05T15:05:22.520 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-05T15:05:22.521 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-05T15:05:22.522 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-05T15:05:22.523 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-05T15:05:22.524 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-05T15:05:22.525 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-05T15:05:22.526 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-05T15:05:22.527 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-05T15:05:22.528 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-05T15:05:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-05T15:05:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-05T15:05:22.531 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-05T15:05:22.532 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-05T15:05:22.533 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-05T15:05:22.534 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-05T15:05:22.535 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-05T15:05:22.536 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-05T15:05:22.537 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-05T15:05:22.538 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-05T15:05:22.538 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-05T15:05:22.538 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-05T15:05:22.538 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-05T15:05:22.538 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-05T15:05:22.538 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-05T15:05:22.539 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-05T15:05:22.540 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-05T15:05:22.541 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-05T15:05:22.542 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-05T15:05:22.543 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-05T15:05:22.544 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-05T15:05:22.545 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-05T15:05:22.546 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-05T15:05:22.547 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-05T15:05:22.548 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-05T15:05:22.549 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-05T15:05:22.550 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-05T15:05:22.551 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-05T15:05:22.552 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-05T15:05:22.553 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-05T15:05:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-05T15:05:22.555 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-05T15:05:22.556 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-05T15:05:22.557 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-05T15:05:22.558 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-05T15:05:22.559 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-05T15:05:22.560 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-05T15:05:22.561 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-05T15:05:22.562 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-05T15:05:22.563 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-05T15:05:22.564 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-05T15:05:22.565 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-05T15:05:22.566 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-05T15:05:22.567 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-05T15:05:22.568 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-05T15:05:22.569 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-05T15:05:22.570 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-05T15:05:22.571 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-05T15:05:22.572 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-05T15:05:22.573 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-05T15:05:22.574 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-05T15:05:22.575 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-05T15:05:22.576 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-05T15:05:22.577 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-05T15:05:22.578 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-05T15:05:22.579 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-05T15:05:22.580 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-05T15:05:22.581 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-05T15:05:22.582 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-05T15:05:22.583 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-05T15:05:22.584 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-05T15:05:22.585 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-05T15:05:22.586 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-05T15:05:22.587 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-05T15:05:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-05T15:05:22.589 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-05T15:05:22.590 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-05T15:05:22.591 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-05T15:05:22.592 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-05T15:05:22.593 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-05T15:05:22.594 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-05T15:05:22.595 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-05T15:05:22.596 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-05T15:05:22.597 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-05T15:05:22.598 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-05T15:05:22.599 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-05T15:05:22.600 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-05T15:05:22.601 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-05T15:05:22.602 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-05T15:05:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-05T15:05:22.604 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-05T15:05:22.605 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-05T15:05:22.606 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-05T15:05:22.607 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-05T15:05:22.608 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-05T15:05:22.609 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-05T15:05:22.610 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-05T15:05:22.611 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-05T15:05:22.612 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-05T15:05:22.613 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-05T15:05:22.614 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-05T15:05:22.615 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-05T15:05:22.616 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-05T15:05:22.617 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-05T15:05:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-05T15:05:22.619 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-05T15:05:22.620 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-05T15:05:22.621 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-05T15:05:22.621 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-05T15:05:22.621 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-05T15:05:22.621 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-05T15:05:22.621 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-05T15:05:22.621 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-05T15:05:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-05T15:05:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-05T15:05:22.624 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-05T15:05:22.625 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-05T15:05:22.626 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-05T15:05:22.627 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-05T15:05:22.628 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-05T15:05:22.629 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-05T15:05:22.630 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-05T15:05:22.631 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-05T15:05:22.631 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-05T15:05:22.631 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-05T15:05:22.631 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-05T15:05:22.631 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-05T15:05:22.631 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-05T15:05:22.632 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-05T15:05:22.633 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-05T15:05:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-05T15:05:22.635 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-05T15:05:22.636 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-05T15:05:22.637 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-05T15:05:22.638 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-05T15:05:22.639 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-05T15:05:22.640 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-05T15:05:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-05T15:05:22.642 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-05T15:05:22.643 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-05T15:05:22.644 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-05T15:05:22.645 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-05T15:05:22.646 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-05T15:05:22.647 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-05T15:05:22.648 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-05T15:05:22.649 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-05T15:05:22.650 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-05T15:05:22.651 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-05T15:05:22.652 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-05T15:05:22.653 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-05T15:05:22.654 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-05T15:05:22.655 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-05T15:05:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-05T15:05:22.657 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-05T15:05:22.658 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-05T15:05:22.659 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-05T15:05:22.660 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-05T15:05:22.661 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-05T15:05:22.662 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-05T15:05:22.663 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-05T15:05:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-05T15:05:22.665 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-05T15:05:22.666 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-05T15:05:22.667 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-05T15:05:22.668 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-05T15:05:22.669 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-05T15:05:22.670 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-05T15:05:22.671 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-05T15:05:22.672 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-05T15:05:22.673 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-05T15:05:22.674 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-05T15:05:22.675 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-05T15:05:22.676 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-05T15:05:22.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-05T15:05:22.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-05T15:05:22.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-05T15:05:22.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-05T15:05:22.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-05T15:05:22.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-05T15:05:22.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-05T15:05:22.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-05T15:05:22.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-05T15:05:22.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-05T15:05:22.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-05T15:05:22.682 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.683 DEBUG:teuthology.orchestra.run.smithi167:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-05T15:05:22.685 INFO:teuthology.orchestra.run.smithi017.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-05T15:05:22.685 INFO:teuthology.orchestra.run.smithi017.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-05T15:05:22.685 INFO:teuthology.orchestra.run.smithi017.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-05T15:05:22.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.711 INFO:teuthology.orchestra.run.smithi167.stdout:postinstall scriptlet (using /bin/sh): 2023-10-05T15:05:22.711 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-05T15:05:22.711 INFO:teuthology.orchestra.run.smithi167.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:22.711 INFO:teuthology.orchestra.run.smithi167.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:22.711 INFO:teuthology.orchestra.run.smithi167.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-05T15:05:22.712 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-05T15:05:22.713 INFO:teuthology.orchestra.run.smithi167.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.713 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2023-10-05T15:05:22.714 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.02 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 123.el8 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Group : System Environment/Base 2023-10-05T15:05:22.792 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 9265450 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Relocations : (not relocatable) 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : Red Hat, Inc. 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : Red Hat, Inc. 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2023-10-05T15:05:22.793 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:05:22.794 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T15:05:22.794 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T15:05:22.794 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T15:05:22.794 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2023-10-05T15:05:22.794 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:05:22.794 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T15:05:22.795 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T15:05:22.795 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:22.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T15:05:22.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2023-10-05T15:05:24.978 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-10-05T15:05:27.159 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-10-05T15:05:27.161 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-10-05T15:05:27.177 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.bDpSHqWrsB 2023-10-05T15:05:27.177 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bDpSHqWrsB 2023-10-05T15:05:27.251 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.bDpSHqWrsB 2023-10-05T15:05:27.402 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.bDpSHqWrsB is 6KB 2023-10-05T15:05:27.450 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.bDpSHqWrsB 2023-10-05T15:05:27.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T15:05:27.534 INFO:teuthology.orchestra.run.smithi167.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-10-05T15:05:27.534 INFO:teuthology.orchestra.run.smithi167.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-10-05T15:05:27.534 INFO:teuthology.orchestra.run.smithi167.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-10-05T15:05:27.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-10-05T15:05:27.689 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2023-10-05T15:05:47.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-05T15:05:47.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-05T15:05:47.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:05:52.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-05T15:05:52.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-05T15:05:52.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:05:57.694 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-10-05T15:05:57.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:05:57.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:06:32.191 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-05T15:06:41.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:06:41.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:06:47.746 DEBUG:teuthology.orchestra.remote:timed out 2023-10-05T15:06:52.835 DEBUG:teuthology.orchestra.remote:timed out 2023-10-05T15:06:56.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-05T15:06:56.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:06:59.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-05T15:07:00.116 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-05T15:07:00.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-05T15:07:00.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-05T15:07:00.474 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-05T15:07:00.515 INFO:teuthology.orchestra.run.smithi079.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-05T15:07:00.515 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:07:00.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T15:07:00.515 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-05T15:07:01.516 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-05T15:07:01.517 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T15:07:01.650 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2023-10-05T15:07:01.676 DEBUG:teuthology.parallel:result is None 2023-10-05T15:07:01.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-05T15:07:01.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:07:02.269 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-05T15:07:02.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-05T15:07:02.721 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-05T15:07:02.721 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-10-05T15:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-05T15:07:02.763 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:07:02.763 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T15:07:02.763 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-05T15:07:03.765 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-05T15:07:03.765 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T15:07:03.886 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2023-10-05T15:07:04.026 DEBUG:teuthology.parallel:result is None 2023-10-05T15:07:11.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:07:11.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:07:14.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-05T15:07:29.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:07:29.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:07:30.015 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-05T15:07:30.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:07:30.449 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-05T15:07:30.449 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-10-05T15:07:30.491 INFO:teuthology.orchestra.run.smithi167.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-05T15:07:30.492 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-05T15:07:30.492 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T15:07:30.492 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-05T15:07:31.493 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-10-05T15:07:31.493 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T15:07:31.624 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2023-10-05T15:07:31.653 DEBUG:teuthology.parallel:result is None 2023-10-05T15:07:31.653 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-05T15:07:31.663 INFO:teuthology.task.internal:Creating test directory... 2023-10-05T15:07:31.663 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T15:07:31.668 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T15:07:31.673 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T15:07:31.718 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-05T15:07:31.725 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-05T15:07:31.744 INFO:teuthology.task.internal:Creating archive directory... 2023-10-05T15:07:31.745 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T15:07:31.749 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T15:07:31.753 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T15:07:31.828 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-05T15:07:31.834 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-05T15:07:31.835 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T15:07:31.839 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T15:07:31.844 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T15:07:31.925 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T15:07:31.929 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T15:07:31.930 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T15:07:31.955 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T15:07:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T15:07:31.958 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T15:07:31.961 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-05T15:07:31.968 INFO:teuthology.task.internal:Configuring sudo... 2023-10-05T15:07:31.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T15:07:31.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T15:07:31.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T15:07:32.045 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-05T15:07:32.055 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-05T15:07:32.055 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T15:07:32.059 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T15:07:32.063 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T15:07:32.105 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T15:07:32.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T15:07:32.304 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T15:07:32.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T15:07:32.572 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:07:32.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T15:07:32.652 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T15:07:32.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T15:07:32.803 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T15:07:32.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T15:07:32.958 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:07:32.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T15:07:33.026 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T15:07:33.104 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T15:07:33.177 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T15:07:33.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T15:07:33.318 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:07:33.318 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T15:07:33.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2023-10-05T15:07:33.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2023-10-05T15:07:33.395 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-10-05T15:07:33.514 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T15:07:33.515 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T15:07:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T15:07:33.980 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-05T15:07:33.987 INFO:teuthology.task.internal:Starting timer... 2023-10-05T15:07:33.988 INFO:teuthology.run_tasks:Running task pcp... 2023-10-05T15:07:34.060 INFO:teuthology.run_tasks:Running task selinux... 2023-10-05T15:07:34.070 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-05T15:07:34.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2023-10-05T15:07:34.187 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2023-10-05T15:07:34.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2023-10-05T15:07:34.306 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2023-10-05T15:07:34.309 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2023-10-05T15:07:34.430 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2023-10-05T15:07:34.434 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-05T15:07:34.434 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2023-10-05T15:07:34.491 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2023-10-05T15:07:34.492 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2023-10-05T15:07:34.567 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2023-10-05T15:07:34.567 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2023-10-05T15:07:34.615 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2023-10-05T15:07:34.615 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2023-10-05T15:07:34.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T15:07:34.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:07:34.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T15:07:34.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:07:34.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T15:07:34.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T15:07:34.829 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-05T15:07:34.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2023-10-05T15:07:34.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2023-10-05T15:07:34.979 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2023-10-05T15:07:35.048 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-05T15:07:35.058 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-05T15:07:35.063 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-05T15:07:35.173 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-05T15:07:35.188 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-05T15:07:35.189 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-05T15:21:50.091 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2023-10-05T15:21:50.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-05T15:21:50.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:21:50.185 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-05T15:21:50.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-05T15:21:50.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-05T15:21:50.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:21:50.384 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-05T15:21:50.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-05T15:21:50.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:21:50.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T15:21:50.594 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-05T15:21:50.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T15:21:50.713 INFO:teuthology.run_tasks:Running task clock... 2023-10-05T15:21:50.723 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-05T15:21:50.724 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T15:21:50.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:21:50.729 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T15:21:50.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:21:50.734 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T15:21:50.734 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T15:21:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T15:21:50.805 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T15:21:50.825 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T15:21:50.837 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T15:21:50.840 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T15:21:50.860 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T15:21:50.930 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2023-10-05T15:21:50.945 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2023-10-05T15:21:50.949 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2023-10-05T15:21:50.959 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2023-10-05T15:21:50.974 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2023-10-05T15:21:50.979 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2023-10-05T15:21:50.995 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T15:21:51.008 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T15:21:51.013 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T15:21:51.030 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T15:21:51.042 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T15:21:51.047 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T15:21:51.127 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-10-05T15:21:51.132 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2023-10-05T15:21:51.134 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:21:51.134 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-10-05T15:21:51.134 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.135 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.135 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.135 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.139 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:21:51.139 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-10-05T15:21:51.139 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.139 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.139 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.140 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.147 INFO:teuthology.orchestra.run.smithi167.stderr:bash: ntpq: command not found 2023-10-05T15:21:51.154 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T15:21:51.154 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-10-05T15:21:51.154 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.154 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.154 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.155 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T15:21:51.156 INFO:teuthology.run_tasks:Running task pexec... 2023-10-05T15:21:51.172 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-05T15:21:51.172 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:21:51.173 DEBUG:teuthology.orchestra.run.smithi017:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-05T15:21:51.173 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi079.front.sepia.ceph.com 2023-10-05T15:21:51.174 DEBUG:teuthology.orchestra.run.smithi079:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-05T15:21:51.174 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T15:21:51.174 DEBUG:teuthology.orchestra.run.smithi167:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-05T15:21:51.653 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-05T15:21:51.658 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-10-05T15:21:51.691 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-05T15:21:53.301 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:02:29 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:21:53.366 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:29 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:21:53.372 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:15 ago on Thu 05 Oct 2023 03:19:37 PM UTC. 2023-10-05T15:21:55.085 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout:Resetting modules: 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout: container-tools 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2023-10-05T15:21:55.087 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:21:55.262 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout:Resetting modules: 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout: container-tools 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2023-10-05T15:21:55.264 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:21:55.444 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-05T15:21:55.445 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout:Resetting modules: 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout: container-tools 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-10-05T15:21:55.446 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:21:56.312 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:02:32 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:21:56.498 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:32 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:21:56.725 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:19 ago on Thu 05 Oct 2023 03:19:37 PM UTC. 2023-10-05T15:22:06.685 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-05T15:22:06.689 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-10-05T15:22:07.273 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-05T15:22:07.292 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:07.321 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:07.915 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:09.062 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:45 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:22:09.377 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:02:45 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:22:09.686 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:32 ago on Thu 05 Oct 2023 03:19:37 PM UTC. 2023-10-05T15:22:10.853 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================================ 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================================ 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout:Installing group/module packages: 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-05T15:22:10.952 INFO:teuthology.orchestra.run.smithi167.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout:Installing module profiles: 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: container-tools/common 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout:Enabling module streams: 2023-10-05T15:22:10.953 INFO:teuthology.orchestra.run.smithi167.stdout: container-tools rhel8 2023-10-05T15:22:10.954 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:22:10.954 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-10-05T15:22:10.954 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================================ 2023-10-05T15:22:10.954 INFO:teuthology.orchestra.run.smithi167.stdout:Install 10 Packages 2023-10-05T15:22:10.954 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:22:10.954 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 18 M 2023-10-05T15:22:10.955 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 65 M 2023-10-05T15:22:10.955 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-10-05T15:22:11.116 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-05T15:22:11.156 INFO:teuthology.orchestra.run.smithi167.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 203 kB/s | 41 kB 00:00 2023-10-05T15:22:11.181 INFO:teuthology.orchestra.run.smithi167.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 110 kB/s | 25 kB 00:00 2023-10-05T15:22:11.206 INFO:teuthology.orchestra.run.smithi167.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 373 kB/s | 94 kB 00:00 2023-10-05T15:22:11.214 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================================================ 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================================================ 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout:Installing group/module packages: 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-05T15:22:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:Installing module profiles: 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: container-tools/common 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling module streams: 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: container-tools rhel8 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2023-10-05T15:22:11.216 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================================================ 2023-10-05T15:22:11.217 INFO:teuthology.orchestra.run.smithi079.stdout:Install 10 Packages 2023-10-05T15:22:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:22:11.217 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 18 M 2023-10-05T15:22:11.217 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 65 M 2023-10-05T15:22:11.217 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2023-10-05T15:22:11.340 INFO:teuthology.orchestra.run.smithi167.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 269 kB/s | 49 kB 00:00 2023-10-05T15:22:11.347 INFO:teuthology.orchestra.run.smithi079.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 729 kB/s | 94 kB 00:00 2023-10-05T15:22:11.374 INFO:teuthology.orchestra.run.smithi167.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.7 MB/s | 524 kB 00:00 2023-10-05T15:22:11.405 INFO:teuthology.orchestra.run.smithi079.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 133 kB/s | 25 kB 00:00 2023-10-05T15:22:11.439 INFO:teuthology.orchestra.run.smithi079.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 185 kB/s | 41 kB 00:00 2023-10-05T15:22:11.474 INFO:teuthology.orchestra.run.smithi167.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.1 MB/s | 149 kB 00:00 2023-10-05T15:22:11.481 INFO:teuthology.orchestra.run.smithi079.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 369 kB/s | 49 kB 00:00 2023-10-05T15:22:11.583 INFO:teuthology.orchestra.run.smithi167.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 21 MB/s | 8.0 MB 00:00 2023-10-05T15:22:11.589 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-05T15:22:11.608 INFO:teuthology.orchestra.run.smithi167.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 911 kB/s | 213 kB 00:00 2023-10-05T15:22:11.648 INFO:teuthology.orchestra.run.smithi079.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.1 MB/s | 524 kB 00:00 2023-10-05T15:22:11.694 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================================ 2023-10-05T15:22:11.694 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================================ 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout:Installing group/module packages: 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-10-05T15:22:11.695 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout:Installing module profiles: 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: container-tools/common 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling module streams: 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: container-tools rhel8 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================================ 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout:Install 10 Packages 2023-10-05T15:22:11.696 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:22:11.697 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 18 M 2023-10-05T15:22:11.697 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 65 M 2023-10-05T15:22:11.697 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-10-05T15:22:11.748 INFO:teuthology.orchestra.run.smithi079.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 560 kB/s | 149 kB 00:00 2023-10-05T15:22:11.775 INFO:teuthology.orchestra.run.smithi167.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-10-05T15:22:11.790 INFO:teuthology.orchestra.run.smithi079.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.5 MB/s | 213 kB 00:00 2023-10-05T15:22:11.823 INFO:teuthology.orchestra.run.smithi017.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 198 kB/s | 25 kB 00:00 2023-10-05T15:22:11.875 INFO:teuthology.orchestra.run.smithi167.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 7.5 MB/s | 2.2 MB 00:00 2023-10-05T15:22:11.876 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:22:11.876 INFO:teuthology.orchestra.run.smithi167.stdout:Total 20 MB/s | 18 MB 00:00 2023-10-05T15:22:11.898 INFO:teuthology.orchestra.run.smithi017.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 468 kB/s | 94 kB 00:00 2023-10-05T15:22:11.915 INFO:teuthology.orchestra.run.smithi079.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 17 MB/s | 8.0 MB 00:00 2023-10-05T15:22:11.924 INFO:teuthology.orchestra.run.smithi017.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 181 kB/s | 41 kB 00:00 2023-10-05T15:22:11.982 INFO:teuthology.orchestra.run.smithi017.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-10-05T15:22:12.016 INFO:teuthology.orchestra.run.smithi017.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.4 MB/s | 524 kB 00:00 2023-10-05T15:22:12.024 INFO:teuthology.orchestra.run.smithi079.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 9.4 MB/s | 2.2 MB 00:00 2023-10-05T15:22:12.133 INFO:teuthology.orchestra.run.smithi017.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 995 kB/s | 149 kB 00:00 2023-10-05T15:22:12.157 INFO:teuthology.orchestra.run.smithi079.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 17 MB/s | 7.0 MB 00:00 2023-10-05T15:22:12.158 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:22:12.158 INFO:teuthology.orchestra.run.smithi079.stdout:Total 19 MB/s | 18 MB 00:00 2023-10-05T15:22:12.166 INFO:teuthology.orchestra.run.smithi017.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.4 MB/s | 213 kB 00:00 2023-10-05T15:22:12.211 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-10-05T15:22:12.235 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-10-05T15:22:12.235 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-10-05T15:22:12.333 INFO:teuthology.orchestra.run.smithi017.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 19 MB/s | 8.0 MB 00:00 2023-10-05T15:22:12.417 INFO:teuthology.orchestra.run.smithi017.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 8.8 MB/s | 2.2 MB 00:00 2023-10-05T15:22:12.487 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2023-10-05T15:22:12.509 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2023-10-05T15:22:12.509 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2023-10-05T15:22:12.575 INFO:teuthology.orchestra.run.smithi017.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 16 MB/s | 7.0 MB 00:00 2023-10-05T15:22:12.576 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:22:12.576 INFO:teuthology.orchestra.run.smithi017.stdout:Total 21 MB/s | 18 MB 00:00 2023-10-05T15:22:12.756 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-10-05T15:22:12.761 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-10-05T15:22:12.918 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-10-05T15:22:12.942 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-10-05T15:22:12.942 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-10-05T15:22:13.053 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2023-10-05T15:22:13.058 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2023-10-05T15:22:13.335 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-10-05T15:22:13.432 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-10-05T15:22:13.437 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-10-05T15:22:13.553 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-05T15:22:13.608 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2023-10-05T15:22:13.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:22:13.832 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-05T15:22:13.966 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-05T15:22:14.010 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:22:14.046 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-10-05T15:22:14.207 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-05T15:22:14.229 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-05T15:22:14.234 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-05T15:22:14.414 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:22:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-05T15:22:14.584 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-05T15:22:14.660 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-05T15:22:14.857 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-05T15:22:14.914 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-05T15:22:15.288 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-05T15:22:15.411 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-05T15:22:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-05T15:22:16.178 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-05T15:22:16.342 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-05T15:22:16.602 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-05T15:22:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-05T15:22:16.811 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-05T15:22:16.903 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-05T15:22:17.027 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:22:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-05T15:22:17.183 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-05T15:22:17.315 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:22:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:22:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-05T15:22:17.411 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-05T15:22:17.412 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-05T15:22:17.458 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-05T15:22:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-05T15:22:17.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-05T15:22:17.694 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-05T15:22:17.694 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-05T15:22:17.694 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-05T15:22:17.835 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-05T15:22:18.229 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-05T15:22:18.821 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-05T15:22:18.821 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:55 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:22:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-05T15:22:19.216 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:02:55 ago on Thu 05 Oct 2023 03:19:23 PM UTC. 2023-10-05T15:22:19.666 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-05T15:22:19.666 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:42 ago on Thu 05 Oct 2023 03:19:37 PM UTC. 2023-10-05T15:22:29.078 INFO:teuthology.orchestra.run.smithi167.stdout:Installed products updated. 2023-10-05T15:22:29.301 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:22:29.301 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-10-05T15:22:29.301 INFO:teuthology.orchestra.run.smithi167.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.301 INFO:teuthology.orchestra.run.smithi167.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:22:29.301 INFO:teuthology.orchestra.run.smithi167.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-05T15:22:29.302 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:22:29.303 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-10-05T15:22:29.529 DEBUG:teuthology.parallel:result is None 2023-10-05T15:22:29.536 INFO:teuthology.orchestra.run.smithi079.stdout:Installed products updated. 2023-10-05T15:22:29.758 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:29.759 INFO:teuthology.orchestra.run.smithi079.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:22:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-05T15:22:29.760 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:22:29.760 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-05T15:22:30.008 DEBUG:teuthology.parallel:result is None 2023-10-05T15:22:30.426 INFO:teuthology.orchestra.run.smithi017.stdout:Installed products updated. 2023-10-05T15:22:30.645 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-05T15:22:30.646 INFO:teuthology.orchestra.run.smithi017.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-05T15:22:30.647 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:22:30.647 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-05T15:22:30.868 DEBUG:teuthology.parallel:result is None 2023-10-05T15:22:30.869 INFO:teuthology.run_tasks:Running task install... 2023-10-05T15:22:30.878 DEBUG:teuthology.task.install:project ceph 2023-10-05T15:22:30.878 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f'}} 2023-10-05T15:22:30.878 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f'} 2023-10-05T15:22:30.878 INFO:teuthology.task.install:Using flavor: default 2023-10-05T15:22:30.886 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-05T15:22:30.886 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-05T15:22:30.886 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'tag': None, 'wait_for_package': False} 2023-10-05T15:22:30.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:22:30.889 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'tag': None, 'wait_for_package': False} 2023-10-05T15:22:30.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:22:30.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'tag': None, 'wait_for_package': False} 2023-10-05T15:22:30.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:22:31.034 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/ 2023-10-05T15:22:31.034 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6578.g689b3d5a 2023-10-05T15:22:31.039 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/ 2023-10-05T15:22:31.039 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6578.g689b3d5a 2023-10-05T15:22:31.105 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/ 2023-10-05T15:22:31.105 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6578.g689b3d5a 2023-10-05T15:22:31.204 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T15:22:31.204 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:22:31.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T15:22:31.210 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T15:22:31.211 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:22:31.211 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T15:22:31.273 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-05T15:22:31.274 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T15:22:31.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T15:22:31.277 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:22:31.277 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T15:22:31.283 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-05T15:22:31.284 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T15:22:31.347 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-05T15:22:31.347 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T15:22:31.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T15:22:31.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T15:22:31.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T15:22:31.480 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T15:22:31.496 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T15:22:31.549 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2023-10-05T15:22:31.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2023-10-05T15:22:31.556 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T15:22:31.563 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2023-10-05T15:22:31.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2023-10-05T15:22:31.625 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2023-10-05T15:22:31.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2023-10-05T15:22:32.031 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:32.056 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:32.124 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:33.113 INFO:teuthology.orchestra.run.smithi079.stdout:44 files removed 2023-10-05T15:22:33.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-05T15:22:33.181 INFO:teuthology.orchestra.run.smithi017.stdout:44 files removed 2023-10-05T15:22:33.185 INFO:teuthology.orchestra.run.smithi167.stdout:44 files removed 2023-10-05T15:22:33.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-05T15:22:33.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-05T15:22:33.647 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:33.724 INFO:teuthology.orchestra.run.smithi167.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:33.735 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-10-05T15:22:35.470 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 299 kB/s | 81 kB 00:00 2023-10-05T15:22:35.518 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 218 kB/s | 81 kB 00:00 2023-10-05T15:22:35.532 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 205 kB/s | 81 kB 00:00 2023-10-05T15:22:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-10-05T15:22:35.819 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-05T15:22:35.900 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-05T15:22:36.129 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-10-05T15:22:36.132 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-05T15:22:36.242 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-10-05T15:22:36.273 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-10-05T15:22:36.296 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-05T15:22:36.418 INFO:teuthology.orchestra.run.smithi167.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-05T15:22:37.093 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-05T15:22:37.288 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-05T15:22:38.446 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 16 MB 00:02 2023-10-05T15:22:41.652 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 351 kB/s | 24 kB 00:00 2023-10-05T15:22:41.749 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 376 kB/s | 24 kB 00:00 2023-10-05T15:22:42.963 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 457 kB/s | 24 kB 00:00 2023-10-05T15:22:43.146 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 MB/s | 47 MB 00:01 2023-10-05T15:22:43.168 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 36 MB/s | 47 MB 00:01 2023-10-05T15:22:44.308 INFO:teuthology.orchestra.run.smithi167.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-10-05T15:22:52.658 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 MB/s | 53 MB 00:01 2023-10-05T15:22:53.016 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 MB/s | 53 MB 00:01 2023-10-05T15:22:54.070 INFO:teuthology.orchestra.run.smithi167.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 MB/s | 53 MB 00:01 2023-10-05T15:23:04.697 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:23:04.698 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:23:04.713 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-05T15:23:04.714 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-05T15:23:04.715 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-05T15:23:04.716 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-05T15:23:04.718 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-05T15:23:04.722 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-05T15:23:04.723 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-05T15:23:04.860 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-05T15:23:04.873 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2023-10-05T15:23:04.873 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2023-10-05T15:23:04.873 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2023-10-05T15:23:04.873 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2023-10-05T15:23:04.873 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.4 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 5.4 M 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 918 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 167 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 1.6 M 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 132 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 1.8 M 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 7.4 M 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 47 k 2023-10-05T15:23:04.874 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 14 M 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 49 M 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 261 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 184 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 261 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 18 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 31 k 2023-10-05T15:23:04.875 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 840 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 139 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 197 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 371 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 364 k 2023-10-05T15:23:04.876 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 106 k 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 94 k 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.6 M 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 180 k 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-05T15:23:04.877 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 23 M 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 23 k 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 2.3 M 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 242 k 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 4.6 M 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 18 M 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 15 k 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 24 k 2023-10-05T15:23:04.878 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 184 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-05T15:23:04.879 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 518 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.9 M 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-05T15:23:04.880 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 45 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 125 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-05T15:23:04.881 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T15:23:04.882 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-05T15:23:04.883 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T15:23:04.884 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling module streams: 2023-10-05T15:23:04.885 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql 10 2023-10-05T15:23:04.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:23:04.886 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2023-10-05T15:23:04.886 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2023-10-05T15:23:04.886 INFO:teuthology.orchestra.run.smithi079.stdout:Install 128 Packages 2023-10-05T15:23:04.886 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 3 Packages 2023-10-05T15:23:04.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:23:04.887 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 209 M 2023-10-05T15:23:04.887 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2023-10-05T15:23:05.438 INFO:teuthology.orchestra.run.smithi079.stdout:(1/131): ceph-18.0.0-6578.g689b3d5a.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-10-05T15:23:05.755 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:23:05.756 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:23:05.771 INFO:teuthology.orchestra.run.smithi079.stdout:(2/131): ceph-fuse-18.0.0-6578.g689b3d5a.el8.x8 2.7 MB/s | 918 kB 00:00 2023-10-05T15:23:05.772 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-05T15:23:05.773 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-05T15:23:05.774 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-05T15:23:05.775 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-05T15:23:05.778 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-05T15:23:05.781 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-05T15:23:05.782 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-05T15:23:05.871 INFO:teuthology.orchestra.run.smithi079.stdout:(3/131): ceph-base-18.0.0-6578.g689b3d5a.el8.x8 8.6 MB/s | 5.4 MB 00:00 2023-10-05T15:23:05.896 INFO:teuthology.orchestra.run.smithi079.stdout:(4/131): ceph-immutable-object-cache-18.0.0-657 1.3 MB/s | 167 kB 00:00 2023-10-05T15:23:05.933 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-10-05T15:23:05.946 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================================================== 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================================================== 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.4 k 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 5.4 M 2023-10-05T15:23:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 918 k 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 167 k 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 1.6 M 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 132 k 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 1.8 M 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 7.4 M 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 47 k 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 14 M 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 49 M 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 261 k 2023-10-05T15:23:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 184 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 261 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 18 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 31 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 840 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 139 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-05T15:23:05.949 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 197 k 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 371 k 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 364 k 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 106 k 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 94 k 2023-10-05T15:23:05.950 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.6 M 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 180 k 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 23 M 2023-10-05T15:23:05.951 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 23 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 2.3 M 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 242 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 4.6 M 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 18 M 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 15 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 24 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-05T15:23:05.952 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 184 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 518 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.9 M 2023-10-05T15:23:05.953 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-05T15:23:05.954 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 45 k 2023-10-05T15:23:05.955 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 125 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-05T15:23:05.956 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-05T15:23:05.957 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T15:23:05.958 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T15:23:05.959 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling module streams: 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql 10 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-10-05T15:23:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================================================== 2023-10-05T15:23:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:Install 128 Packages 2023-10-05T15:23:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 3 Packages 2023-10-05T15:23:05.961 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:23:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 209 M 2023-10-05T15:23:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-10-05T15:23:06.072 INFO:teuthology.orchestra.run.smithi079.stdout:(5/131): ceph-mds-18.0.0-6578.g689b3d5a.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-05T15:23:06.229 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:23:06.230 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-05T15:23:06.245 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-05T15:23:06.246 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-05T15:23:06.248 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-05T15:23:06.249 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-05T15:23:06.251 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-05T15:23:06.254 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-05T15:23:06.256 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-05T15:23:06.313 INFO:teuthology.orchestra.run.smithi079.stdout:(6/131): ceph-mgr-18.0.0-6578.g689b3d5a.el8.x86 3.9 MB/s | 1.6 MB 00:00 2023-10-05T15:23:06.351 INFO:teuthology.orchestra.run.smithi017.stdout:(1/131): ceph-18.0.0-6578.g689b3d5a.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-10-05T15:23:06.394 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2023-10-05T15:23:06.406 INFO:teuthology.orchestra.run.smithi167.stdout:=========================================================================================================================== 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout:=========================================================================================================================== 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.4 k 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 5.4 M 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 918 k 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 167 k 2023-10-05T15:23:06.407 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 1.6 M 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 132 k 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 1.8 M 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 7.4 M 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 47 k 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 14 M 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 49 M 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 261 k 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 184 k 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 261 k 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 18 k 2023-10-05T15:23:06.408 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 31 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 840 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 139 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-05T15:23:06.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 197 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 371 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 364 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 106 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 94 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.6 M 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 180 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:23:06.410 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 3.7 M 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 23 M 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 23 k 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 2.3 M 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 242 k 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 4.6 M 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 18 M 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6578.g689b3d5a.el8 ceph-noarch 15 k 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 24 k 2023-10-05T15:23:06.411 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 184 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-05T15:23:06.412 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 518 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 6.9 M 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-05T15:23:06.413 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 45 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:18.0.0-6578.g689b3d5a.el8 ceph 125 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-05T15:23:06.414 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-05T15:23:06.415 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-05T15:23:06.416 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-05T15:23:06.417 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-05T15:23:06.418 INFO:teuthology.orchestra.run.smithi167.stdout:Enabling module streams: 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql 10 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout:=========================================================================================================================== 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout:Install 128 Packages 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 3 Packages 2023-10-05T15:23:06.419 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:23:06.420 INFO:teuthology.orchestra.run.smithi079.stdout:(7/131): ceph-mon-18.0.0-6578.g689b3d5a.el8.x86 14 MB/s | 4.6 MB 00:00 2023-10-05T15:23:06.420 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 209 M 2023-10-05T15:23:06.420 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2023-10-05T15:23:06.955 INFO:teuthology.orchestra.run.smithi167.stdout:(1/131): ceph-18.0.0-6578.g689b3d5a.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-10-05T15:23:07.085 INFO:teuthology.orchestra.run.smithi017.stdout:(2/131): ceph-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.2 MB/s | 918 kB 00:00 2023-10-05T15:23:07.243 INFO:teuthology.orchestra.run.smithi017.stdout:(3/131): ceph-immutable-object-cache-18.0.0-657 1.0 MB/s | 167 kB 00:00 2023-10-05T15:23:07.564 INFO:teuthology.orchestra.run.smithi167.stdout:(2/131): ceph-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.5 MB/s | 918 kB 00:00 2023-10-05T15:23:07.656 INFO:teuthology.orchestra.run.smithi167.stdout:(3/131): ceph-immutable-object-cache-18.0.0-657 1.8 MB/s | 167 kB 00:00 2023-10-05T15:23:07.772 INFO:teuthology.orchestra.run.smithi079.stdout:(8/131): ceph-radosgw-18.0.0-6578.g689b3d5a.el8 10 MB/s | 14 MB 00:01 2023-10-05T15:23:07.847 INFO:teuthology.orchestra.run.smithi079.stdout:(9/131): ceph-selinux-18.0.0-6578.g689b3d5a.el8 326 kB/s | 24 kB 00:00 2023-10-05T15:23:08.133 INFO:teuthology.orchestra.run.smithi017.stdout:(4/131): ceph-mds-18.0.0-6578.g689b3d5a.el8.x86 2.6 MB/s | 2.3 MB 00:00 2023-10-05T15:23:08.223 INFO:teuthology.orchestra.run.smithi167.stdout:(4/131): ceph-mds-18.0.0-6578.g689b3d5a.el8.x86 4.1 MB/s | 2.3 MB 00:00 2023-10-05T15:23:08.306 INFO:teuthology.orchestra.run.smithi167.stdout:(5/131): ceph-base-18.0.0-6578.g689b3d5a.el8.x8 3.2 MB/s | 5.4 MB 00:01 2023-10-05T15:23:08.310 INFO:teuthology.orchestra.run.smithi017.stdout:(5/131): ceph-base-18.0.0-6578.g689b3d5a.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-10-05T15:23:08.673 INFO:teuthology.orchestra.run.smithi167.stdout:(6/131): ceph-mgr-18.0.0-6578.g689b3d5a.el8.x86 3.6 MB/s | 1.6 MB 00:00 2023-10-05T15:23:08.694 INFO:teuthology.orchestra.run.smithi017.stdout:(6/131): ceph-mgr-18.0.0-6578.g689b3d5a.el8.x86 2.9 MB/s | 1.6 MB 00:00 2023-10-05T15:23:09.157 INFO:teuthology.orchestra.run.smithi167.stdout:(7/131): ceph-mon-18.0.0-6578.g689b3d5a.el8.x86 5.4 MB/s | 4.6 MB 00:00 2023-10-05T15:23:10.714 INFO:teuthology.orchestra.run.smithi079.stdout:(10/131): ceph-common-18.0.0-6578.g689b3d5a.el8 4.1 MB/s | 23 MB 00:05 2023-10-05T15:23:10.914 INFO:teuthology.orchestra.run.smithi079.stdout:(11/131): cephfs-mirror-18.0.0-6578.g689b3d5a.e 1.3 MB/s | 261 kB 00:00 2023-10-05T15:23:11.015 INFO:teuthology.orchestra.run.smithi079.stdout:(12/131): libcephfs-devel-18.0.0-6578.g689b3d5a 310 kB/s | 31 kB 00:00 2023-10-05T15:23:11.194 INFO:teuthology.orchestra.run.smithi017.stdout:(7/131): ceph-mon-18.0.0-6578.g689b3d5a.el8.x86 1.6 MB/s | 4.6 MB 00:02 2023-10-05T15:23:11.331 INFO:teuthology.orchestra.run.smithi079.stdout:(13/131): libcephfs2-18.0.0-6578.g689b3d5a.el8. 2.6 MB/s | 840 kB 00:00 2023-10-05T15:23:11.448 INFO:teuthology.orchestra.run.smithi079.stdout:(14/131): libcephsqlite-18.0.0-6578.g689b3d5a.e 1.5 MB/s | 184 kB 00:00 2023-10-05T15:23:11.532 INFO:teuthology.orchestra.run.smithi079.stdout:(15/131): librados-devel-18.0.0-6578.g689b3d5a. 1.6 MB/s | 139 kB 00:00 2023-10-05T15:23:11.615 INFO:teuthology.orchestra.run.smithi167.stdout:(8/131): ceph-radosgw-18.0.0-6578.g689b3d5a.el8 5.7 MB/s | 14 MB 00:02 2023-10-05T15:23:11.699 INFO:teuthology.orchestra.run.smithi079.stdout:(16/131): libradosstriper1-18.0.0-6578.g689b3d5 3.0 MB/s | 518 kB 00:00 2023-10-05T15:23:11.707 INFO:teuthology.orchestra.run.smithi167.stdout:(9/131): ceph-selinux-18.0.0-6578.g689b3d5a.el8 265 kB/s | 24 kB 00:00 2023-10-05T15:23:12.633 INFO:teuthology.orchestra.run.smithi167.stdout:(10/131): ceph-osd-18.0.0-6578.g689b3d5a.el8.x8 4.5 MB/s | 18 MB 00:03 2023-10-05T15:23:12.800 INFO:teuthology.orchestra.run.smithi167.stdout:(11/131): cephfs-mirror-18.0.0-6578.g689b3d5a.e 1.5 MB/s | 261 kB 00:00 2023-10-05T15:23:12.866 INFO:teuthology.orchestra.run.smithi167.stdout:(12/131): libcephfs-devel-18.0.0-6578.g689b3d5a 468 kB/s | 31 kB 00:00 2023-10-05T15:23:12.940 INFO:teuthology.orchestra.run.smithi079.stdout:(17/131): ceph-osd-18.0.0-6578.g689b3d5a.el8.x8 2.7 MB/s | 18 MB 00:06 2023-10-05T15:23:13.040 INFO:teuthology.orchestra.run.smithi079.stdout:(18/131): python3-ceph-argparse-18.0.0-6578.g68 449 kB/s | 45 kB 00:00 2023-10-05T15:23:13.083 INFO:teuthology.orchestra.run.smithi167.stdout:(13/131): libcephfs2-18.0.0-6578.g689b3d5a.el8. 3.8 MB/s | 840 kB 00:00 2023-10-05T15:23:13.151 INFO:teuthology.orchestra.run.smithi079.stdout:(19/131): python3-ceph-common-18.0.0-6578.g689b 1.1 MB/s | 125 kB 00:00 2023-10-05T15:23:13.167 INFO:teuthology.orchestra.run.smithi167.stdout:(14/131): libcephsqlite-18.0.0-6578.g689b3d5a.e 2.2 MB/s | 184 kB 00:00 2023-10-05T15:23:13.242 INFO:teuthology.orchestra.run.smithi167.stdout:(15/131): librados-devel-18.0.0-6578.g689b3d5a. 1.8 MB/s | 139 kB 00:00 2023-10-05T15:23:13.250 INFO:teuthology.orchestra.run.smithi017.stdout:(8/131): ceph-osd-18.0.0-6578.g689b3d5a.el8.x86 3.9 MB/s | 18 MB 00:04 2023-10-05T15:23:13.300 INFO:teuthology.orchestra.run.smithi079.stdout:(20/131): python3-cephfs-18.0.0-6578.g689b3d5a. 1.3 MB/s | 197 kB 00:00 2023-10-05T15:23:13.336 INFO:teuthology.orchestra.run.smithi017.stdout:(9/131): ceph-selinux-18.0.0-6578.g689b3d5a.el8 286 kB/s | 24 kB 00:00 2023-10-05T15:23:13.397 INFO:teuthology.orchestra.run.smithi167.stdout:(16/131): libradosstriper1-18.0.0-6578.g689b3d5 3.3 MB/s | 518 kB 00:00 2023-10-05T15:23:13.842 INFO:teuthology.orchestra.run.smithi079.stdout:(21/131): librgw2-18.0.0-6578.g689b3d5a.el8.x86 3.2 MB/s | 6.9 MB 00:02 2023-10-05T15:23:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:(22/131): python3-rados-18.0.0-6578.g689b3d5a.e 645 kB/s | 371 kB 00:00 2023-10-05T15:23:14.034 INFO:teuthology.orchestra.run.smithi079.stdout:(23/131): python3-rbd-18.0.0-6578.g689b3d5a.el8 1.9 MB/s | 364 kB 00:00 2023-10-05T15:23:14.067 INFO:teuthology.orchestra.run.smithi079.stdout:(24/131): python3-rgw-18.0.0-6578.g689b3d5a.el8 555 kB/s | 106 kB 00:00 2023-10-05T15:23:14.135 INFO:teuthology.orchestra.run.smithi079.stdout:(25/131): rbd-fuse-18.0.0-6578.g689b3d5a.el8.x8 935 kB/s | 94 kB 00:00 2023-10-05T15:23:14.251 INFO:teuthology.orchestra.run.smithi079.stdout:(26/131): rbd-nbd-18.0.0-6578.g689b3d5a.el8.x86 1.5 MB/s | 180 kB 00:00 2023-10-05T15:23:14.360 INFO:teuthology.orchestra.run.smithi079.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6578.g 213 kB/s | 23 kB 00:00 2023-10-05T15:23:14.477 INFO:teuthology.orchestra.run.smithi079.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6578.g689b3d5 1.1 MB/s | 132 kB 00:00 2023-10-05T15:23:14.740 INFO:teuthology.orchestra.run.smithi167.stdout:(17/131): librgw2-18.0.0-6578.g689b3d5a.el8.x86 5.1 MB/s | 6.9 MB 00:01 2023-10-05T15:23:14.835 INFO:teuthology.orchestra.run.smithi167.stdout:(18/131): python3-ceph-argparse-18.0.0-6578.g68 475 kB/s | 45 kB 00:00 2023-10-05T15:23:14.935 INFO:teuthology.orchestra.run.smithi167.stdout:(19/131): python3-ceph-common-18.0.0-6578.g689b 1.2 MB/s | 125 kB 00:00 2023-10-05T15:23:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6578.g689b3 3.3 MB/s | 1.8 MB 00:00 2023-10-05T15:23:15.210 INFO:teuthology.orchestra.run.smithi167.stdout:(20/131): python3-cephfs-18.0.0-6578.g689b3d5a. 716 kB/s | 197 kB 00:00 2023-10-05T15:23:15.394 INFO:teuthology.orchestra.run.smithi167.stdout:(21/131): python3-rados-18.0.0-6578.g689b3d5a.e 2.0 MB/s | 371 kB 00:00 2023-10-05T15:23:15.561 INFO:teuthology.orchestra.run.smithi167.stdout:(22/131): python3-rbd-18.0.0-6578.g689b3d5a.el8 2.1 MB/s | 364 kB 00:00 2023-10-05T15:23:15.636 INFO:teuthology.orchestra.run.smithi167.stdout:(23/131): python3-rgw-18.0.0-6578.g689b3d5a.el8 1.4 MB/s | 106 kB 00:00 2023-10-05T15:23:15.712 INFO:teuthology.orchestra.run.smithi167.stdout:(24/131): rbd-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.2 MB/s | 94 kB 00:00 2023-10-05T15:23:15.938 INFO:teuthology.orchestra.run.smithi079.stdout:(30/131): ceph-test-18.0.0-6578.g689b3d5a.el8.x 6.1 MB/s | 49 MB 00:08 2023-10-05T15:23:15.994 INFO:teuthology.orchestra.run.smithi079.stdout:(31/131): rbd-mirror-18.0.0-6578.g689b3d5a.el8. 1.9 MB/s | 3.6 MB 00:01 2023-10-05T15:23:16.111 INFO:teuthology.orchestra.run.smithi079.stdout:(32/131): ceph-mgr-modules-core-18.0.0-6578.g68 1.4 MB/s | 242 kB 00:00 2023-10-05T15:23:16.136 INFO:teuthology.orchestra.run.smithi079.stdout:(33/131): ceph-mgr-rook-18.0.0-6578.g689b3d5a.e 334 kB/s | 47 kB 00:00 2023-10-05T15:23:16.195 INFO:teuthology.orchestra.run.smithi079.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6578.g6 174 kB/s | 15 kB 00:00 2023-10-05T15:23:16.295 INFO:teuthology.orchestra.run.smithi079.stdout:(35/131): cephadm-18.0.0-6578.g689b3d5a.el8.noa 1.8 MB/s | 184 kB 00:00 2023-10-05T15:23:16.329 INFO:teuthology.orchestra.run.smithi079.stdout:(36/131): ceph-volume-18.0.0-6578.g689b3d5a.el8 1.3 MB/s | 261 kB 00:00 2023-10-05T15:23:16.370 INFO:teuthology.orchestra.run.smithi167.stdout:(25/131): rbd-mirror-18.0.0-6578.g689b3d5a.el8. 5.4 MB/s | 3.6 MB 00:00 2023-10-05T15:23:16.371 INFO:teuthology.orchestra.run.smithi079.stdout:(37/131): cephfs-top-18.0.0-6578.g689b3d5a.el8. 242 kB/s | 18 kB 00:00 2023-10-05T15:23:16.462 INFO:teuthology.orchestra.run.smithi167.stdout:(26/131): rbd-nbd-18.0.0-6578.g689b3d5a.el8.x86 1.9 MB/s | 180 kB 00:00 2023-10-05T15:23:16.538 INFO:teuthology.orchestra.run.smithi167.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6578.g 308 kB/s | 23 kB 00:00 2023-10-05T15:23:16.621 INFO:teuthology.orchestra.run.smithi167.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6578.g689b3d5 1.6 MB/s | 132 kB 00:00 2023-10-05T15:23:16.696 INFO:teuthology.orchestra.run.smithi079.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 181 kB/s | 59 kB 00:00 2023-10-05T15:23:16.788 INFO:teuthology.orchestra.run.smithi079.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 668 kB/s | 306 kB 00:00 2023-10-05T15:23:16.813 INFO:teuthology.orchestra.run.smithi079.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2023-10-05T15:23:16.894 INFO:teuthology.orchestra.run.smithi017.stdout:(10/131): ceph-radosgw-18.0.0-6578.g689b3d5a.el 2.4 MB/s | 14 MB 00:05 2023-10-05T15:23:16.914 INFO:teuthology.orchestra.run.smithi079.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 437 kB/s | 44 kB 00:00 2023-10-05T15:23:16.946 INFO:teuthology.orchestra.run.smithi167.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6578.g689b3 5.4 MB/s | 1.8 MB 00:00 2023-10-05T15:23:16.947 INFO:teuthology.orchestra.run.smithi079.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2023-10-05T15:23:17.039 INFO:teuthology.orchestra.run.smithi079.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-10-05T15:23:17.045 INFO:teuthology.orchestra.run.smithi017.stdout:(11/131): cephfs-mirror-18.0.0-6578.g689b3d5a.e 1.7 MB/s | 261 kB 00:00 2023-10-05T15:23:17.073 INFO:teuthology.orchestra.run.smithi079.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-10-05T15:23:17.120 INFO:teuthology.orchestra.run.smithi017.stdout:(12/131): libcephfs-devel-18.0.0-6578.g689b3d5a 416 kB/s | 31 kB 00:00 2023-10-05T15:23:17.173 INFO:teuthology.orchestra.run.smithi079.stdout:(45/131): ceph-mgr-diskprediction-local-18.0.0- 3.4 MB/s | 7.4 MB 00:02 2023-10-05T15:23:17.198 INFO:teuthology.orchestra.run.smithi079.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 103 kB/s | 16 kB 00:00 2023-10-05T15:23:17.232 INFO:teuthology.orchestra.run.smithi079.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-05T15:23:17.282 INFO:teuthology.orchestra.run.smithi079.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 969 kB/s | 81 kB 00:00 2023-10-05T15:23:17.316 INFO:teuthology.orchestra.run.smithi079.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 140 kB/s | 11 kB 00:00 2023-10-05T15:23:17.391 INFO:teuthology.orchestra.run.smithi079.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-10-05T15:23:17.437 INFO:teuthology.orchestra.run.smithi017.stdout:(13/131): libcephfs2-18.0.0-6578.g689b3d5a.el8. 2.6 MB/s | 840 kB 00:00 2023-10-05T15:23:17.475 INFO:teuthology.orchestra.run.smithi079.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 587 kB/s | 49 kB 00:00 2023-10-05T15:23:17.529 INFO:teuthology.orchestra.run.smithi017.stdout:(14/131): libcephsqlite-18.0.0-6578.g689b3d5a.e 2.0 MB/s | 184 kB 00:00 2023-10-05T15:23:17.542 INFO:teuthology.orchestra.run.smithi079.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-10-05T15:23:17.567 INFO:teuthology.orchestra.run.smithi079.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 640 kB/s | 59 kB 00:00 2023-10-05T15:23:17.612 INFO:teuthology.orchestra.run.smithi017.stdout:(15/131): librados-devel-18.0.0-6578.g689b3d5a. 1.6 MB/s | 139 kB 00:00 2023-10-05T15:23:17.626 INFO:teuthology.orchestra.run.smithi079.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 724 kB/s | 60 kB 00:00 2023-10-05T15:23:17.667 INFO:teuthology.orchestra.run.smithi079.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-10-05T15:23:17.710 INFO:teuthology.orchestra.run.smithi079.stdout:(56/131): python3-cherrypy-18.4.0-1.el8.noarch. 717 kB/s | 384 kB 00:00 2023-10-05T15:23:17.735 INFO:teuthology.orchestra.run.smithi079.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-05T15:23:17.760 INFO:teuthology.orchestra.run.smithi079.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 365 kB/s | 34 kB 00:00 2023-10-05T15:23:17.794 INFO:teuthology.orchestra.run.smithi079.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-05T15:23:17.813 INFO:teuthology.orchestra.run.smithi017.stdout:(16/131): libradosstriper1-18.0.0-6578.g689b3d5 2.5 MB/s | 518 kB 00:00 2023-10-05T15:23:17.819 INFO:teuthology.orchestra.run.smithi079.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 768 kB/s | 64 kB 00:00 2023-10-05T15:23:17.844 INFO:teuthology.orchestra.run.smithi079.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2023-10-05T15:23:17.878 INFO:teuthology.orchestra.run.smithi079.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 285 kB/s | 24 kB 00:00 2023-10-05T15:23:17.903 INFO:teuthology.orchestra.run.smithi079.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 349 kB/s | 29 kB 00:00 2023-10-05T15:23:17.928 INFO:teuthology.orchestra.run.smithi079.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 328 kB/s | 27 kB 00:00 2023-10-05T15:23:17.970 INFO:teuthology.orchestra.run.smithi079.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-10-05T15:23:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-10-05T15:23:18.054 INFO:teuthology.orchestra.run.smithi079.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2023-10-05T15:23:18.079 INFO:teuthology.orchestra.run.smithi079.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 785 kB/s | 85 kB 00:00 2023-10-05T15:23:18.113 INFO:teuthology.orchestra.run.smithi079.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-10-05T15:23:18.138 INFO:teuthology.orchestra.run.smithi079.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-10-05T15:23:18.188 INFO:teuthology.orchestra.run.smithi167.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 6.0 MB/s | 7.4 MB 00:01 2023-10-05T15:23:18.272 INFO:teuthology.orchestra.run.smithi167.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6578.g68 2.9 MB/s | 242 kB 00:00 2023-10-05T15:23:18.305 INFO:teuthology.orchestra.run.smithi079.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2023-10-05T15:23:18.330 INFO:teuthology.orchestra.run.smithi079.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 575 kB/s | 110 kB 00:00 2023-10-05T15:23:18.387 INFO:teuthology.orchestra.run.smithi167.stdout:(32/131): ceph-mgr-rook-18.0.0-6578.g689b3d5a.e 415 kB/s | 47 kB 00:00 2023-10-05T15:23:18.447 INFO:teuthology.orchestra.run.smithi079.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 383 kB/s | 54 kB 00:00 2023-10-05T15:23:18.464 INFO:teuthology.orchestra.run.smithi167.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6578.g6 188 kB/s | 15 kB 00:00 2023-10-05T15:23:18.514 INFO:teuthology.orchestra.run.smithi079.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-05T15:23:18.548 INFO:teuthology.orchestra.run.smithi079.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2023-10-05T15:23:18.548 INFO:teuthology.orchestra.run.smithi167.stdout:(34/131): ceph-volume-18.0.0-6578.g689b3d5a.el8 3.1 MB/s | 261 kB 00:00 2023-10-05T15:23:18.573 INFO:teuthology.orchestra.run.smithi079.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 665 kB/s | 39 kB 00:00 2023-10-05T15:23:18.640 INFO:teuthology.orchestra.run.smithi167.stdout:(35/131): cephadm-18.0.0-6578.g689b3d5a.el8.noa 2.0 MB/s | 184 kB 00:00 2023-10-05T15:23:18.716 INFO:teuthology.orchestra.run.smithi167.stdout:(36/131): cephfs-top-18.0.0-6578.g689b3d5a.el8. 241 kB/s | 18 kB 00:00 2023-10-05T15:23:18.768 INFO:teuthology.orchestra.run.smithi079.stdout:(77/131): python3-scipy-1.0.0-21.module+el8.5.0 21 MB/s | 14 MB 00:00 2023-10-05T15:23:18.809 INFO:teuthology.orchestra.run.smithi079.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.2 MB/s | 538 kB 00:00 2023-10-05T15:23:18.843 INFO:teuthology.orchestra.run.smithi079.stdout:(79/131): bison-3.0.4-10.el8.x86_64.rpm 2.3 MB/s | 688 kB 00:00 2023-10-05T15:23:18.926 INFO:teuthology.orchestra.run.smithi079.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 991 kB/s | 157 kB 00:00 2023-10-05T15:23:18.985 INFO:teuthology.orchestra.run.smithi079.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-10-05T15:23:19.010 INFO:teuthology.orchestra.run.smithi079.stdout:(82/131): oniguruma-6.8.2-2.el8.x86_64.rpm 933 kB/s | 187 kB 00:00 2023-10-05T15:23:19.110 INFO:teuthology.orchestra.run.smithi079.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 212 kB/s | 27 kB 00:00 2023-10-05T15:23:19.161 INFO:teuthology.orchestra.run.smithi079.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2023-10-05T15:23:19.186 INFO:teuthology.orchestra.run.smithi079.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 585 kB/s | 44 kB 00:00 2023-10-05T15:23:19.303 INFO:teuthology.orchestra.run.smithi079.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-10-05T15:23:19.310 INFO:teuthology.orchestra.run.smithi167.stdout:(37/131): ceph-common-18.0.0-6578.g689b3d5a.el8 1.8 MB/s | 23 MB 00:12 2023-10-05T15:23:19.333 INFO:teuthology.orchestra.run.smithi167.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 496 kB/s | 306 kB 00:00 2023-10-05T15:23:19.345 INFO:teuthology.orchestra.run.smithi079.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2023-10-05T15:23:19.388 INFO:teuthology.orchestra.run.smithi017.stdout:(17/131): ceph-common-18.0.0-6578.g689b3d5a.el8 1.7 MB/s | 23 MB 00:13 2023-10-05T15:23:19.437 INFO:teuthology.orchestra.run.smithi079.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-05T15:23:19.462 INFO:teuthology.orchestra.run.smithi079.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 548 kB/s | 64 kB 00:00 2023-10-05T15:23:19.463 INFO:teuthology.orchestra.run.smithi017.stdout:(18/131): python3-ceph-argparse-18.0.0-6578.g68 600 kB/s | 45 kB 00:00 2023-10-05T15:23:19.487 INFO:teuthology.orchestra.run.smithi079.stdout:(90/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.2 MB/s | 225 kB 00:00 2023-10-05T15:23:19.604 INFO:teuthology.orchestra.run.smithi079.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 757 kB/s | 126 kB 00:00 2023-10-05T15:23:19.622 INFO:teuthology.orchestra.run.smithi017.stdout:(19/131): librgw2-18.0.0-6578.g689b3d5a.el8.x86 3.8 MB/s | 6.9 MB 00:01 2023-10-05T15:23:19.646 INFO:teuthology.orchestra.run.smithi079.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 109 kB/s | 20 kB 00:00 2023-10-05T15:23:19.646 INFO:teuthology.orchestra.run.smithi017.stdout:(20/131): python3-ceph-common-18.0.0-6578.g689b 685 kB/s | 125 kB 00:00 2023-10-05T15:23:19.672 INFO:teuthology.orchestra.run.smithi017.stdout:(21/131): python3-cephfs-18.0.0-6578.g689b3d5a. 3.8 MB/s | 197 kB 00:00 2023-10-05T15:23:19.730 INFO:teuthology.orchestra.run.smithi079.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 428 kB/s | 103 kB 00:00 2023-10-05T15:23:19.756 INFO:teuthology.orchestra.run.smithi017.stdout:(22/131): python3-rbd-18.0.0-6578.g689b3d5a.el8 4.3 MB/s | 364 kB 00:00 2023-10-05T15:23:19.781 INFO:teuthology.orchestra.run.smithi017.stdout:(23/131): python3-rados-18.0.0-6578.g689b3d5a.e 2.7 MB/s | 371 kB 00:00 2023-10-05T15:23:19.815 INFO:teuthology.orchestra.run.smithi017.stdout:(24/131): python3-rgw-18.0.0-6578.g689b3d5a.el8 1.8 MB/s | 106 kB 00:00 2023-10-05T15:23:19.817 INFO:teuthology.orchestra.run.smithi167.stdout:(39/131): ceph-test-18.0.0-6578.g689b3d5a.el8.x 6.0 MB/s | 49 MB 00:08 2023-10-05T15:23:19.838 INFO:teuthology.orchestra.run.smithi079.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 3.0 MB/s | 709 kB 00:00 2023-10-05T15:23:19.842 INFO:teuthology.orchestra.run.smithi167.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 147 kB/s | 75 kB 00:00 2023-10-05T15:23:19.848 INFO:teuthology.orchestra.run.smithi017.stdout:(25/131): rbd-fuse-18.0.0-6578.g689b3d5a.el8.x8 1.4 MB/s | 94 kB 00:00 2023-10-05T15:23:19.863 INFO:teuthology.orchestra.run.smithi079.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-10-05T15:23:19.951 INFO:teuthology.orchestra.run.smithi017.stdout:(26/131): rbd-nbd-18.0.0-6578.g689b3d5a.el8.x86 1.7 MB/s | 180 kB 00:00 2023-10-05T15:23:19.959 INFO:teuthology.orchestra.run.smithi167.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 373 kB/s | 44 kB 00:00 2023-10-05T15:23:19.972 INFO:teuthology.orchestra.run.smithi079.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-10-05T15:23:19.998 INFO:teuthology.orchestra.run.smithi079.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-10-05T15:23:20.015 INFO:teuthology.orchestra.run.smithi017.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6578.g 358 kB/s | 23 kB 00:00 2023-10-05T15:23:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6578.g689b3d5 1.7 MB/s | 132 kB 00:00 2023-10-05T15:23:20.125 INFO:teuthology.orchestra.run.smithi079.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-05T15:23:20.157 INFO:teuthology.orchestra.run.smithi079.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-10-05T15:23:20.187 INFO:teuthology.orchestra.run.smithi167.stdout:(42/131): liboath-2.6.2-3.el8.x86_64.rpm 67 kB/s | 59 kB 00:00 2023-10-05T15:23:20.218 INFO:teuthology.orchestra.run.smithi167.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 716 kB/s | 185 kB 00:00 2023-10-05T15:23:20.240 INFO:teuthology.orchestra.run.smithi079.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-05T15:23:20.299 INFO:teuthology.orchestra.run.smithi079.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-05T15:23:20.336 INFO:teuthology.orchestra.run.smithi167.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 223 kB/s | 33 kB 00:00 2023-10-05T15:23:20.360 INFO:teuthology.orchestra.run.smithi167.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 115 kB/s | 16 kB 00:00 2023-10-05T15:23:20.382 INFO:teuthology.orchestra.run.smithi079.stdout:(102/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-10-05T15:23:20.383 INFO:teuthology.orchestra.run.smithi017.stdout:(29/131): rbd-mirror-18.0.0-6578.g689b3d5a.el8. 6.3 MB/s | 3.6 MB 00:00 2023-10-05T15:23:20.407 INFO:teuthology.orchestra.run.smithi079.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 280 kB/s | 47 kB 00:00 2023-10-05T15:23:20.433 INFO:teuthology.orchestra.run.smithi079.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-10-05T15:23:20.433 INFO:teuthology.orchestra.run.smithi017.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6578.g689b3 5.2 MB/s | 1.8 MB 00:00 2023-10-05T15:23:20.477 INFO:teuthology.orchestra.run.smithi167.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-05T15:23:20.502 INFO:teuthology.orchestra.run.smithi167.stdout:(47/131): python3-asyncssh-2.7.0-2.el8.noarch.r 695 kB/s | 476 kB 00:00 2023-10-05T15:23:20.508 INFO:teuthology.orchestra.run.smithi079.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 339 kB/s | 43 kB 00:00 2023-10-05T15:23:20.517 INFO:teuthology.orchestra.run.smithi017.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6578.g68 2.9 MB/s | 242 kB 00:00 2023-10-05T15:23:20.575 INFO:teuthology.orchestra.run.smithi079.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2023-10-05T15:23:20.584 INFO:teuthology.orchestra.run.smithi017.stdout:(32/131): ceph-mgr-rook-18.0.0-6578.g689b3d5a.e 712 kB/s | 47 kB 00:00 2023-10-05T15:23:20.609 INFO:teuthology.orchestra.run.smithi079.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 274 kB/s | 48 kB 00:00 2023-10-05T15:23:20.611 INFO:teuthology.orchestra.run.smithi167.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2023-10-05T15:23:20.628 INFO:teuthology.orchestra.run.smithi167.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 541 kB/s | 81 kB 00:00 2023-10-05T15:23:20.650 INFO:teuthology.orchestra.run.smithi017.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6578.g6 219 kB/s | 15 kB 00:00 2023-10-05T15:23:20.659 INFO:teuthology.orchestra.run.smithi079.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 577 kB/s | 87 kB 00:00 2023-10-05T15:23:20.709 INFO:teuthology.orchestra.run.smithi079.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 319 kB/s | 43 kB 00:00 2023-10-05T15:23:20.728 INFO:teuthology.orchestra.run.smithi167.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-10-05T15:23:20.751 INFO:teuthology.orchestra.run.smithi079.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 767 kB/s | 109 kB 00:00 2023-10-05T15:23:20.753 INFO:teuthology.orchestra.run.smithi167.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 123 kB/s | 18 kB 00:00 2023-10-05T15:23:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:(34/131): ceph-volume-18.0.0-6578.g689b3d5a.el8 2.4 MB/s | 261 kB 00:00 2023-10-05T15:23:20.837 INFO:teuthology.orchestra.run.smithi167.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-10-05T15:23:20.852 INFO:teuthology.orchestra.run.smithi079.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.9 MB/s | 560 kB 00:00 2023-10-05T15:23:20.877 INFO:teuthology.orchestra.run.smithi079.stdout:(112/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.0 MB/s | 229 kB 00:00 2023-10-05T15:23:20.879 INFO:teuthology.orchestra.run.smithi167.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 470 kB/s | 59 kB 00:00 2023-10-05T15:23:20.944 INFO:teuthology.orchestra.run.smithi079.stdout:(113/131): libaio-devel-0.3.112-1.el8.x86_64.rp 97 kB/s | 19 kB 00:00 2023-10-05T15:23:20.946 INFO:teuthology.orchestra.run.smithi167.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2023-10-05T15:23:20.971 INFO:teuthology.orchestra.run.smithi167.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 450 kB/s | 60 kB 00:00 2023-10-05T15:23:20.977 INFO:teuthology.orchestra.run.smithi079.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.2 MB/s | 155 kB 00:00 2023-10-05T15:23:21.011 INFO:teuthology.orchestra.run.smithi079.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 4.1 MB/s | 559 kB 00:00 2023-10-05T15:23:21.030 INFO:teuthology.orchestra.run.smithi167.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-05T15:23:21.064 INFO:teuthology.orchestra.run.smithi167.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-05T15:23:21.069 INFO:teuthology.orchestra.run.smithi079.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 143 kB/s | 18 kB 00:00 2023-10-05T15:23:21.089 INFO:teuthology.orchestra.run.smithi167.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 287 kB/s | 34 kB 00:00 2023-10-05T15:23:21.111 INFO:teuthology.orchestra.run.smithi079.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-10-05T15:23:21.146 INFO:teuthology.orchestra.run.smithi079.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.8 MB/s | 238 kB 00:00 2023-10-05T15:23:21.235 INFO:teuthology.orchestra.run.smithi017.stdout:(35/131): ceph-test-18.0.0-6578.g689b3d5a.el8.x 6.2 MB/s | 49 MB 00:07 2023-10-05T15:23:21.245 INFO:teuthology.orchestra.run.smithi079.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 13 MB/s | 2.3 MB 00:00 2023-10-05T15:23:21.248 INFO:teuthology.orchestra.run.smithi167.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 904 kB/s | 196 kB 00:00 2023-10-05T15:23:21.260 INFO:teuthology.orchestra.run.smithi017.stdout:(36/131): cephadm-18.0.0-6578.g689b3d5a.el8.noa 368 kB/s | 184 kB 00:00 2023-10-05T15:23:21.270 INFO:teuthology.orchestra.run.smithi079.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 455 kB/s | 72 kB 00:00 2023-10-05T15:23:21.273 INFO:teuthology.orchestra.run.smithi167.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 102 kB/s | 19 kB 00:00 2023-10-05T15:23:21.285 INFO:teuthology.orchestra.run.smithi017.stdout:(37/131): cephfs-top-18.0.0-6578.g689b3d5a.el8. 365 kB/s | 18 kB 00:00 2023-10-05T15:23:21.290 INFO:teuthology.orchestra.run.smithi167.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 284 kB/s | 64 kB 00:00 2023-10-05T15:23:21.321 INFO:teuthology.orchestra.run.smithi079.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 472 kB/s | 83 kB 00:00 2023-10-05T15:23:21.382 INFO:teuthology.orchestra.run.smithi167.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 178 kB/s | 24 kB 00:00 2023-10-05T15:23:21.388 INFO:teuthology.orchestra.run.smithi079.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 421 kB/s | 60 kB 00:00 2023-10-05T15:23:21.407 INFO:teuthology.orchestra.run.smithi167.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 219 kB/s | 29 kB 00:00 2023-10-05T15:23:21.413 INFO:teuthology.orchestra.run.smithi079.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 690 kB/s | 98 kB 00:00 2023-10-05T15:23:21.424 INFO:teuthology.orchestra.run.smithi167.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-10-05T15:23:21.469 INFO:teuthology.orchestra.run.smithi017.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 321 kB/s | 59 kB 00:00 2023-10-05T15:23:21.505 INFO:teuthology.orchestra.run.smithi079.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 313 kB/s | 58 kB 00:00 2023-10-05T15:23:21.539 INFO:teuthology.orchestra.run.smithi079.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 256 kB/s | 39 kB 00:00 2023-10-05T15:23:21.541 INFO:teuthology.orchestra.run.smithi167.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2023-10-05T15:23:21.567 INFO:teuthology.orchestra.run.smithi167.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 431 kB/s | 61 kB 00:00 2023-10-05T15:23:21.589 INFO:teuthology.orchestra.run.smithi079.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.6 MB/s | 644 kB 00:00 2023-10-05T15:23:21.610 INFO:teuthology.orchestra.run.smithi017.stdout:(39/131): ceph-mgr-diskprediction-local-18.0.0- 6.0 MB/s | 7.4 MB 00:01 2023-10-05T15:23:21.617 INFO:teuthology.orchestra.run.smithi167.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-10-05T15:23:21.630 INFO:teuthology.orchestra.run.smithi079.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-10-05T15:23:21.636 INFO:teuthology.orchestra.run.smithi017.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 815 kB/s | 306 kB 00:00 2023-10-05T15:23:21.661 INFO:teuthology.orchestra.run.smithi017.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2023-10-05T15:23:21.667 INFO:teuthology.orchestra.run.smithi167.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 680 kB/s | 85 kB 00:00 2023-10-05T15:23:21.673 INFO:teuthology.orchestra.run.smithi079.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.0 MB/s | 138 kB 00:00 2023-10-05T15:23:21.695 INFO:teuthology.orchestra.run.smithi017.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 750 kB/s | 44 kB 00:00 2023-10-05T15:23:21.701 INFO:teuthology.orchestra.run.smithi167.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-10-05T15:23:21.718 INFO:teuthology.orchestra.run.smithi167.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 152 kB/s | 23 kB 00:00 2023-10-05T15:23:21.754 INFO:teuthology.orchestra.run.smithi017.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 564 kB/s | 33 kB 00:00 2023-10-05T15:23:21.779 INFO:teuthology.orchestra.run.smithi017.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2023-10-05T15:23:21.781 INFO:teuthology.orchestra.run.smithi079.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 7.2 MB/s | 798 kB 00:00 2023-10-05T15:23:21.813 INFO:teuthology.orchestra.run.smithi017.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 280 kB/s | 16 kB 00:00 2023-10-05T15:23:21.855 INFO:teuthology.orchestra.run.smithi017.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-05T15:23:21.868 INFO:teuthology.orchestra.run.smithi167.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 736 kB/s | 110 kB 00:00 2023-10-05T15:23:21.905 INFO:teuthology.orchestra.run.smithi017.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-10-05T15:23:21.955 INFO:teuthology.orchestra.run.smithi017.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 814 kB/s | 81 kB 00:00 2023-10-05T15:23:21.960 INFO:teuthology.orchestra.run.smithi167.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2023-10-05T15:23:21.980 INFO:teuthology.orchestra.run.smithi017.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-05T15:23:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:(50/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2023-10-05T15:23:22.010 INFO:teuthology.orchestra.run.smithi167.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 382 kB/s | 54 kB 00:00 2023-10-05T15:23:22.015 INFO:teuthology.orchestra.run.smithi079.stdout:(130/131): librbd1-18.0.0-6578.g689b3d5a.el8.x8 9.7 MB/s | 3.7 MB 00:00 2023-10-05T15:23:22.031 INFO:teuthology.orchestra.run.smithi017.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-10-05T15:23:22.064 INFO:teuthology.orchestra.run.smithi017.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 833 kB/s | 49 kB 00:00 2023-10-05T15:23:22.090 INFO:teuthology.orchestra.run.smithi017.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-05T15:23:22.123 INFO:teuthology.orchestra.run.smithi017.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-10-05T15:23:22.136 INFO:teuthology.orchestra.run.smithi167.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2023-10-05T15:23:22.157 INFO:teuthology.orchestra.run.smithi017.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2023-10-05T15:23:22.178 INFO:teuthology.orchestra.run.smithi167.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2023-10-05T15:23:22.182 INFO:teuthology.orchestra.run.smithi017.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-10-05T15:23:22.207 INFO:teuthology.orchestra.run.smithi017.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-05T15:23:22.233 INFO:teuthology.orchestra.run.smithi017.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-10-05T15:23:22.250 INFO:teuthology.orchestra.run.smithi017.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-05T15:23:22.275 INFO:teuthology.orchestra.run.smithi017.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 956 kB/s | 64 kB 00:00 2023-10-05T15:23:22.300 INFO:teuthology.orchestra.run.smithi017.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-10-05T15:23:22.351 INFO:teuthology.orchestra.run.smithi017.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-05T15:23:22.353 INFO:teuthology.orchestra.run.smithi167.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 21 MB/s | 14 MB 00:00 2023-10-05T15:23:22.379 INFO:teuthology.orchestra.run.smithi017.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-10-05T15:23:22.380 INFO:teuthology.orchestra.run.smithi167.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 160 kB/s | 39 kB 00:00 2023-10-05T15:23:22.401 INFO:teuthology.orchestra.run.smithi017.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-05T15:23:22.412 INFO:teuthology.orchestra.run.smithi167.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2023-10-05T15:23:22.426 INFO:teuthology.orchestra.run.smithi017.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-10-05T15:23:22.460 INFO:teuthology.orchestra.run.smithi017.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-10-05T15:23:22.462 INFO:teuthology.orchestra.run.smithi167.stdout:(79/131): python3-jinja2-2.10.1-3.el8.noarch.rp 4.8 MB/s | 538 kB 00:00 2023-10-05T15:23:22.493 INFO:teuthology.orchestra.run.smithi017.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-10-05T15:23:22.519 INFO:teuthology.orchestra.run.smithi017.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 927 kB/s | 85 kB 00:00 2023-10-05T15:23:22.529 INFO:teuthology.orchestra.run.smithi167.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2023-10-05T15:23:22.544 INFO:teuthology.orchestra.run.smithi017.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-10-05T15:23:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-05T15:23:22.565 INFO:teuthology.orchestra.run.smithi079.stdout:(131/131): librados2-18.0.0-6578.g689b3d5a.el8. 3.8 MB/s | 3.7 MB 00:00 2023-10-05T15:23:22.568 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:23:22.568 INFO:teuthology.orchestra.run.smithi079.stdout:Total 12 MB/s | 209 MB 00:17 2023-10-05T15:23:22.569 INFO:teuthology.orchestra.run.smithi017.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-05T15:23:22.588 INFO:teuthology.orchestra.run.smithi167.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 5.6 MB/s | 713 kB 00:00 2023-10-05T15:23:22.670 INFO:teuthology.orchestra.run.smithi017.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 9.9 MB/s | 1.7 MB 00:00 2023-10-05T15:23:22.695 INFO:teuthology.orchestra.run.smithi017.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 945 kB/s | 110 kB 00:00 2023-10-05T15:23:22.722 INFO:teuthology.orchestra.run.smithi167.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-10-05T15:23:22.748 INFO:teuthology.orchestra.run.smithi167.stdout:(84/131): python3-jsonpatch-1.21-2.el8.noarch.r 138 kB/s | 27 kB 00:00 2023-10-05T15:23:22.790 INFO:teuthology.orchestra.run.smithi017.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.1 MB/s | 259 kB 00:00 2023-10-05T15:23:22.812 INFO:teuthology.orchestra.run.smithi017.stdout:(74/131): python3-pytz-2017.2-9.el8.noarch.rpm 382 kB/s | 54 kB 00:00 2023-10-05T15:23:22.839 INFO:teuthology.orchestra.run.smithi167.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-05T15:23:22.865 INFO:teuthology.orchestra.run.smithi167.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 309 kB/s | 44 kB 00:00 2023-10-05T15:23:22.904 INFO:teuthology.orchestra.run.smithi017.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-10-05T15:23:22.929 INFO:teuthology.orchestra.run.smithi017.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 332 kB/s | 39 kB 00:00 2023-10-05T15:23:22.999 INFO:teuthology.orchestra.run.smithi167.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-10-05T15:23:23.021 INFO:teuthology.orchestra.run.smithi017.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 5.8 MB/s | 688 kB 00:00 2023-10-05T15:23:23.040 INFO:teuthology.orchestra.run.smithi167.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.2 MB/s | 457 kB 00:00 2023-10-05T15:23:23.066 INFO:teuthology.orchestra.run.smithi167.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2023-10-05T15:23:23.099 INFO:teuthology.orchestra.run.smithi167.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 637 kB/s | 64 kB 00:00 2023-10-05T15:23:23.166 INFO:teuthology.orchestra.run.smithi167.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2023-10-05T15:23:23.191 INFO:teuthology.orchestra.run.smithi167.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 837 kB/s | 126 kB 00:00 2023-10-05T15:23:23.222 INFO:teuthology.orchestra.run.smithi017.stdout:(78/131): python3-scipy-1.0.0-21.module+el8.5.0 20 MB/s | 14 MB 00:00 2023-10-05T15:23:23.247 INFO:teuthology.orchestra.run.smithi017.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 697 kB/s | 157 kB 00:00 2023-10-05T15:23:23.275 INFO:teuthology.orchestra.run.smithi167.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2023-10-05T15:23:23.280 INFO:teuthology.orchestra.run.smithi017.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 1.5 MB/s | 538 kB 00:00 2023-10-05T15:23:23.309 INFO:teuthology.orchestra.run.smithi167.stdout:(94/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 494 kB/s | 103 kB 00:00 2023-10-05T15:23:23.422 INFO:teuthology.orchestra.run.smithi017.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 4.0 MB/s | 713 kB 00:00 2023-10-05T15:23:23.447 INFO:teuthology.orchestra.run.smithi017.stdout:(82/131): oniguruma-6.8.2-2.el8.x86_64.rpm 832 kB/s | 187 kB 00:00 2023-10-05T15:23:23.467 INFO:teuthology.orchestra.run.smithi167.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-10-05T15:23:23.493 INFO:teuthology.orchestra.run.smithi167.stdout:(96/131): libpq-13.5-1.el8.x86_64.rpm 911 kB/s | 198 kB 00:00 2023-10-05T15:23:23.618 INFO:teuthology.orchestra.run.smithi167.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-10-05T15:23:23.652 INFO:teuthology.orchestra.run.smithi167.stdout:(98/131): jq-1.6-3.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-10-05T15:23:23.677 INFO:teuthology.orchestra.run.smithi167.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-10-05T15:23:23.794 INFO:teuthology.orchestra.run.smithi167.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.6 MB/s | 808 kB 00:00 2023-10-05T15:23:23.869 INFO:teuthology.orchestra.run.smithi167.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 7.8 MB/s | 1.5 MB 00:00 2023-10-05T15:23:23.915 INFO:teuthology.orchestra.run.smithi017.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 7.6 MB/s | 4.8 MB 00:00 2023-10-05T15:23:23.953 INFO:teuthology.orchestra.run.smithi167.stdout:(102/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-10-05T15:23:23.965 INFO:teuthology.orchestra.run.smithi017.stdout:(84/131): python3-jsonpatch-1.21-2.el8.noarch.r 49 kB/s | 27 kB 00:00 2023-10-05T15:23:23.970 INFO:teuthology.orchestra.run.smithi167.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 267 kB/s | 47 kB 00:00 2023-10-05T15:23:23.999 INFO:teuthology.orchestra.run.smithi017.stdout:(85/131): flex-2.6.1-9.el8.x86_64.rpm 580 kB/s | 320 kB 00:00 2023-10-05T15:23:24.003 INFO:teuthology.orchestra.run.smithi167.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-10-05T15:23:24.024 INFO:teuthology.orchestra.run.smithi017.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 405 kB/s | 44 kB 00:00 2023-10-05T15:23:24.154 INFO:teuthology.orchestra.run.smithi167.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-10-05T15:23:24.179 INFO:teuthology.orchestra.run.smithi167.stdout:(106/131): python3-jwt-1.6.1-2.el8.noarch.rpm 189 kB/s | 43 kB 00:00 2023-10-05T15:23:24.199 INFO:teuthology.orchestra.run.smithi017.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-10-05T15:23:24.204 INFO:teuthology.orchestra.run.smithi167.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 240 kB/s | 48 kB 00:00 2023-10-05T15:23:24.233 INFO:teuthology.orchestra.run.smithi017.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 1.9 MB/s | 457 kB 00:00 2023-10-05T15:23:24.249 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2023-10-05T15:23:24.258 INFO:teuthology.orchestra.run.smithi017.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 964 kB/s | 225 kB 00:00 2023-10-05T15:23:24.263 INFO:teuthology.orchestra.run.smithi167.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 801 kB/s | 87 kB 00:00 2023-10-05T15:23:24.355 INFO:teuthology.orchestra.run.smithi167.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 243 kB/s | 43 kB 00:00 2023-10-05T15:23:24.358 INFO:teuthology.orchestra.run.smithi017.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 404 kB/s | 64 kB 00:00 2023-10-05T15:23:24.385 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2023-10-05T15:23:24.385 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2023-10-05T15:23:24.405 INFO:teuthology.orchestra.run.smithi167.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 543 kB/s | 109 kB 00:00 2023-10-05T15:23:24.425 INFO:teuthology.orchestra.run.smithi017.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 658 kB/s | 126 kB 00:00 2023-10-05T15:23:24.450 INFO:teuthology.orchestra.run.smithi017.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 104 kB/s | 20 kB 00:00 2023-10-05T15:23:24.506 INFO:teuthology.orchestra.run.smithi167.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 944 kB/s | 229 kB 00:00 2023-10-05T15:23:24.509 INFO:teuthology.orchestra.run.smithi017.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 687 kB/s | 103 kB 00:00 2023-10-05T15:23:24.531 INFO:teuthology.orchestra.run.smithi167.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 149 kB/s | 19 kB 00:00 2023-10-05T15:23:24.565 INFO:teuthology.orchestra.run.smithi167.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.6 MB/s | 560 kB 00:00 2023-10-05T15:23:24.598 INFO:teuthology.orchestra.run.smithi167.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2023-10-05T15:23:24.601 INFO:teuthology.orchestra.run.smithi017.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2023-10-05T15:23:24.626 INFO:teuthology.orchestra.run.smithi017.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-10-05T15:23:24.674 INFO:teuthology.orchestra.run.smithi167.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-05T15:23:24.699 INFO:teuthology.orchestra.run.smithi167.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 133 kB/s | 18 kB 00:00 2023-10-05T15:23:24.766 INFO:teuthology.orchestra.run.smithi167.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2023-10-05T15:23:24.768 INFO:teuthology.orchestra.run.smithi017.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-10-05T15:23:24.802 INFO:teuthology.orchestra.run.smithi017.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-10-05T15:23:24.841 INFO:teuthology.orchestra.run.smithi167.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.4 MB/s | 238 kB 00:00 2023-10-05T15:23:24.867 INFO:teuthology.orchestra.run.smithi167.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 719 kB/s | 72 kB 00:00 2023-10-05T15:23:24.935 INFO:teuthology.orchestra.run.smithi017.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-10-05T15:23:24.950 INFO:teuthology.orchestra.run.smithi167.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 9.3 MB/s | 2.3 MB 00:00 2023-10-05T15:23:24.969 INFO:teuthology.orchestra.run.smithi017.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-10-05T15:23:25.000 INFO:teuthology.orchestra.run.smithi167.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 521 kB/s | 83 kB 00:00 2023-10-05T15:23:25.034 INFO:teuthology.orchestra.run.smithi167.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 358 kB/s | 60 kB 00:00 2023-10-05T15:23:25.062 INFO:teuthology.orchestra.run.smithi017.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-10-05T15:23:25.084 INFO:teuthology.orchestra.run.smithi167.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 734 kB/s | 98 kB 00:00 2023-10-05T15:23:25.195 INFO:teuthology.orchestra.run.smithi017.stdout:(101/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-10-05T15:23:25.220 INFO:teuthology.orchestra.run.smithi017.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-10-05T15:23:25.227 INFO:teuthology.orchestra.run.smithi167.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 254 kB/s | 58 kB 00:00 2023-10-05T15:23:25.270 INFO:teuthology.orchestra.run.smithi017.stdout:(103/131): postgresql-10.21-2.module+el8.6.0+15 5.0 MB/s | 1.5 MB 00:00 2023-10-05T15:23:25.337 INFO:teuthology.orchestra.run.smithi017.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 365 kB/s | 43 kB 00:00 2023-10-05T15:23:25.371 INFO:teuthology.orchestra.run.smithi017.stdout:(105/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.1 MB/s | 200 kB 00:00 2023-10-05T15:23:25.446 INFO:teuthology.orchestra.run.smithi017.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 444 kB/s | 48 kB 00:00 2023-10-05T15:23:25.513 INFO:teuthology.orchestra.run.smithi017.stdout:(107/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 911 kB/s | 220 kB 00:00 2023-10-05T15:23:25.527 INFO:teuthology.orchestra.run.smithi167.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 78 kB/s | 39 kB 00:00 2023-10-05T15:23:25.564 INFO:teuthology.orchestra.run.smithi017.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 450 kB/s | 87 kB 00:00 2023-10-05T15:23:25.569 INFO:teuthology.orchestra.run.smithi167.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 502 kB/s | 171 kB 00:00 2023-10-05T15:23:25.602 INFO:teuthology.orchestra.run.smithi167.stdout:(127/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 1.2 MB/s | 644 kB 00:00 2023-10-05T15:23:25.622 INFO:teuthology.orchestra.run.smithi017.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 243 kB/s | 43 kB 00:00 2023-10-05T15:23:25.644 INFO:teuthology.orchestra.run.smithi167.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.2 MB/s | 138 kB 00:00 2023-10-05T15:23:25.664 INFO:teuthology.orchestra.run.smithi017.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 724 kB/s | 109 kB 00:00 2023-10-05T15:23:25.689 INFO:teuthology.orchestra.run.smithi017.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-10-05T15:23:25.781 INFO:teuthology.orchestra.run.smithi017.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-10-05T15:23:25.811 INFO:teuthology.orchestra.run.smithi167.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.7 MB/s | 798 kB 00:00 2023-10-05T15:23:25.823 INFO:teuthology.orchestra.run.smithi017.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2023-10-05T15:23:25.848 INFO:teuthology.orchestra.run.smithi017.stdout:(114/131): libaio-devel-0.3.112-1.el8.x86_64.rp 101 kB/s | 19 kB 00:00 2023-10-05T15:23:25.899 INFO:teuthology.orchestra.run.smithi017.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-10-05T15:23:25.942 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2023-10-05T15:23:25.947 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2023-10-05T15:23:25.982 INFO:teuthology.orchestra.run.smithi017.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 113 kB/s | 18 kB 00:00 2023-10-05T15:23:26.003 INFO:teuthology.orchestra.run.smithi167.stdout:(130/131): librbd1-18.0.0-6578.g689b3d5a.el8.x8 9.3 MB/s | 3.7 MB 00:00 2023-10-05T15:23:26.032 INFO:teuthology.orchestra.run.smithi017.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.2 MB/s | 605 kB 00:00 2023-10-05T15:23:26.066 INFO:teuthology.orchestra.run.smithi017.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.4 MB/s | 238 kB 00:00 2023-10-05T15:23:26.086 INFO:teuthology.orchestra.run.smithi167.stdout:(131/131): librados2-18.0.0-6578.g689b3d5a.el8. 7.2 MB/s | 3.7 MB 00:00 2023-10-05T15:23:26.090 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:23:26.090 INFO:teuthology.orchestra.run.smithi167.stdout:Total 11 MB/s | 209 MB 00:19 2023-10-05T15:23:26.108 INFO:teuthology.orchestra.run.smithi017.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 966 kB/s | 72 kB 00:00 2023-10-05T15:23:26.183 INFO:teuthology.orchestra.run.smithi017.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-10-05T15:23:26.208 INFO:teuthology.orchestra.run.smithi017.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 583 kB/s | 83 kB 00:00 2023-10-05T15:23:26.234 INFO:teuthology.orchestra.run.smithi017.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 477 kB/s | 60 kB 00:00 2023-10-05T15:23:26.292 INFO:teuthology.orchestra.run.smithi017.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 904 kB/s | 98 kB 00:00 2023-10-05T15:23:26.367 INFO:teuthology.orchestra.run.smithi017.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 289 kB/s | 39 kB 00:00 2023-10-05T15:23:26.393 INFO:teuthology.orchestra.run.smithi017.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 313 kB/s | 58 kB 00:00 2023-10-05T15:23:26.435 INFO:teuthology.orchestra.run.smithi017.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.4 MB/s | 644 kB 00:00 2023-10-05T15:23:26.493 INFO:teuthology.orchestra.run.smithi017.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-10-05T15:23:26.544 INFO:teuthology.orchestra.run.smithi017.stdout:(128/131): NetworkManager-initscripts-updown-1. 915 kB/s | 138 kB 00:00 2023-10-05T15:23:26.769 INFO:teuthology.orchestra.run.smithi017.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.5 MB/s | 798 kB 00:00 2023-10-05T15:23:26.836 INFO:teuthology.orchestra.run.smithi017.stdout:(130/131): librados2-18.0.0-6578.g689b3d5a.el8. 9.3 MB/s | 3.7 MB 00:00 2023-10-05T15:23:27.002 INFO:teuthology.orchestra.run.smithi017.stdout:(131/131): librbd1-18.0.0-6578.g689b3d5a.el8.x8 7.3 MB/s | 3.7 MB 00:00 2023-10-05T15:23:27.006 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:23:27.006 INFO:teuthology.orchestra.run.smithi017.stdout:Total 9.9 MB/s | 209 MB 00:21 2023-10-05T15:23:27.773 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2023-10-05T15:23:27.910 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2023-10-05T15:23:27.910 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2023-10-05T15:23:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-10-05T15:23:28.870 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-10-05T15:23:28.870 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-10-05T15:23:29.483 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2023-10-05T15:23:29.488 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2023-10-05T15:23:30.452 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-10-05T15:23:30.457 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-10-05T15:23:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2023-10-05T15:23:31.107 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-05T15:23:31.276 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-05T15:23:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-05T15:23:31.717 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:23:31.855 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:23:32.183 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:23:32.665 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:23:32.917 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:23:33.374 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:23:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:23:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:23:33.891 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:23:34.009 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:23:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:23:34.577 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2023-10-05T15:23:34.672 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-05T15:23:34.799 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-05T15:23:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-05T15:23:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-05T15:23:35.170 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-05T15:23:35.303 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-05T15:23:35.367 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:23:35.524 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-05T15:23:35.626 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:23:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:23:35.784 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-10-05T15:23:35.810 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:23:35.926 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:23:35.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-05T15:23:35.999 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:23:36.100 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:23:36.181 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-05T15:23:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:23:36.403 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:23:36.414 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-05T15:23:36.418 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:23:36.560 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:23:36.616 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:23:36.659 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:23:36.728 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-05T15:23:36.935 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:23:37.118 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:23:37.275 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:23:37.313 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:23:37.434 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:23:37.468 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-05T15:23:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:23:37.625 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:23:37.748 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:23:37.852 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:23:37.975 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:23:38.161 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:23:38.224 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-05T15:23:38.354 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:23:38.365 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:23:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-05T15:23:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:23:38.720 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:23:38.890 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-05T15:23:38.918 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:23:39.082 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:23:39.117 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-05T15:23:39.212 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:23:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:23:39.283 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:23:39.399 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:23:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-05T15:23:39.533 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:23:39.547 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-05T15:23:39.633 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:23:39.751 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-05T15:23:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-05T15:23:39.800 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:23:39.963 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:23:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-05T15:23:40.125 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:23:40.191 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-05T15:23:40.222 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-05T15:23:40.418 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-05T15:23:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-05T15:23:40.616 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:23:40.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-05T15:23:40.759 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 14/134 2023-10-05T15:23:40.829 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:23:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 26/134 2023-10-05T15:23:40.901 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:23:40.986 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 27/134 2023-10-05T15:23:41.000 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:23:41.028 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 15/134 2023-10-05T15:23:41.151 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:23:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-05T15:23:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:23:41.672 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:23:41.899 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:23:42.062 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 28/134 2023-10-05T15:23:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-05T15:23:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-05T15:23:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:23:42.690 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-05T15:23:42.744 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:23:42.976 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-05T15:23:43.049 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-05T15:23:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:23:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-05T15:23:43.284 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-05T15:23:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:23:43.523 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-05T15:23:43.717 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-05T15:23:44.002 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-05T15:23:44.261 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-05T15:23:44.313 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-05T15:23:44.490 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 26/134 2023-10-05T15:23:44.584 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-05T15:23:44.653 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 27/134 2023-10-05T15:23:44.859 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-05T15:23:45.108 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-05T15:23:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:23:45.303 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-05T15:23:45.560 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-05T15:23:45.614 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-05T15:23:45.725 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 28/134 2023-10-05T15:23:45.809 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-05T15:23:45.835 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-05T15:23:45.992 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 26/134 2023-10-05T15:23:46.052 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-05T15:23:46.061 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-05T15:23:46.127 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 27/134 2023-10-05T15:23:46.305 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 36/134 2023-10-05T15:23:46.364 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-05T15:23:46.535 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 37/134 2023-10-05T15:23:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-05T15:23:46.701 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-05T15:23:46.891 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:23:46.891 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-05T15:23:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-05T15:23:47.234 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 28/134 2023-10-05T15:23:47.252 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-05T15:23:47.499 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-05T15:23:47.623 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-05T15:23:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-05T15:23:47.912 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-05T15:23:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-05T15:23:48.183 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-05T15:23:48.367 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:23:48.471 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-05T15:23:48.670 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-05T15:23:48.950 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-05T15:23:48.970 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:23:49.198 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-05T15:23:49.349 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-05T15:23:49.558 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-05T15:23:49.560 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-05T15:23:49.790 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-05T15:23:49.795 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-05T15:23:49.967 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-05T15:23:49.990 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 36/134 2023-10-05T15:23:50.220 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 37/134 2023-10-05T15:23:50.233 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-05T15:23:50.390 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-05T15:23:50.429 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-05T15:23:50.545 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-05T15:23:50.560 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-05T15:23:50.618 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-05T15:23:50.777 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-05T15:23:50.885 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-05T15:23:50.946 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-05T15:23:51.000 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-05T15:23:51.131 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-05T15:23:51.213 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-05T15:23:51.294 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-05T15:23:51.315 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-05T15:23:51.455 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-05T15:23:51.531 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 36/134 2023-10-05T15:23:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-05T15:23:51.738 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 37/134 2023-10-05T15:23:51.821 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-05T15:23:51.893 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-05T15:23:51.918 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-05T15:23:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-05T15:23:52.084 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-05T15:23:52.197 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-05T15:23:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-05T15:23:52.403 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-05T15:23:52.404 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-05T15:23:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:23:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:23:52.566 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-05T15:23:52.658 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-05T15:23:52.809 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-05T15:23:52.809 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-05T15:23:52.933 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-05T15:23:53.001 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-05T15:23:53.046 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-05T15:23:53.162 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:23:53.255 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-05T15:23:53.279 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:23:53.467 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-05T15:23:53.486 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-05T15:23:53.525 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-05T15:23:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-05T15:23:53.668 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-05T15:23:53.813 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-05T15:23:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-05T15:23:53.940 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-05T15:23:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-05T15:23:54.049 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-05T15:23:54.113 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-05T15:23:54.294 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-05T15:23:54.316 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-05T15:23:54.319 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-05T15:23:54.528 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-05T15:23:54.652 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-05T15:23:54.678 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-05T15:23:54.692 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-05T15:23:54.858 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-05T15:23:54.942 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-05T15:23:55.002 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-05T15:23:55.085 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-05T15:23:55.189 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-05T15:23:55.235 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-05T15:23:55.311 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-05T15:23:55.423 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-05T15:23:55.440 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-05T15:23:55.509 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-05T15:23:55.632 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-05T15:23:55.672 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-05T15:23:55.698 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-05T15:23:55.818 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-05T15:23:55.877 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-05T15:23:55.884 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-05T15:23:55.998 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:23:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-05T15:23:56.103 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:23:56.107 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-05T15:23:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-05T15:23:56.359 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-05T15:23:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-05T15:23:56.576 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-05T15:23:56.578 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-05T15:23:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-05T15:23:56.739 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:23:56.840 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:23:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-05T15:23:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-05T15:23:57.065 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-05T15:23:57.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-05T15:23:57.225 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-05T15:23:57.296 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-05T15:23:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-05T15:23:57.382 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-05T15:23:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-05T15:23:57.542 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-05T15:23:57.605 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-05T15:23:57.762 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-05T15:23:57.879 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-05T15:23:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:23:58.099 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-05T15:23:58.105 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-05T15:23:58.252 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-05T15:23:58.377 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-05T15:23:58.427 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-05T15:23:58.624 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-05T15:23:58.635 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-05T15:23:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:23:58.862 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-05T15:23:58.871 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-05T15:23:58.877 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-05T15:23:59.085 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-05T15:23:59.129 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-05T15:23:59.206 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-05T15:23:59.286 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-05T15:23:59.317 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-05T15:23:59.454 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-05T15:23:59.458 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-05T15:23:59.519 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-05T15:23:59.674 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-05T15:23:59.701 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-05T15:23:59.862 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-05T15:23:59.885 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-05T15:24:00.000 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-05T15:24:00.061 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-05T15:24:00.163 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-05T15:24:00.241 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-05T15:24:00.338 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-05T15:24:00.379 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-05T15:24:00.426 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-05T15:24:00.523 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-05T15:24:00.530 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-05T15:24:00.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-05T15:24:00.777 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-05T15:24:00.943 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-05T15:24:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-05T15:24:01.183 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-05T15:24:01.269 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-05T15:24:01.345 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-05T15:24:01.427 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:24:01.522 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:24:01.523 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-05T15:24:01.719 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 93/134 2023-10-05T15:24:01.747 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-05T15:24:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-05T15:24:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-05T15:24:02.320 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-05T15:24:02.573 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-05T15:24:02.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-05T15:24:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-05T15:24:02.894 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-05T15:24:02.978 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-05T15:24:03.212 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-05T15:24:03.278 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-05T15:24:03.583 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-05T15:24:03.786 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-05T15:24:04.580 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-05T15:24:04.673 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-05T15:24:04.854 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:24:04.896 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-05T15:24:04.934 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:24:05.097 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 93/134 2023-10-05T15:24:05.189 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-05T15:24:05.538 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-05T15:24:05.826 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-05T15:24:06.061 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-05T15:24:06.681 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:06.970 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-05T15:24:07.148 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:24:07.228 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 92/134 2023-10-05T15:24:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 93/134 2023-10-05T15:24:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:07.892 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:24:08.024 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:24:08.200 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:24:10.221 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:10.438 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:11.137 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:12.729 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:24:12.775 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:12.913 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:24:12.998 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:13.029 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:24:13.732 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 94/134 2023-10-05T15:24:14.049 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:24:14.193 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 95/134 2023-10-05T15:24:14.389 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:24:28.530 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:24:28.530 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2023-10-05T15:24:28.530 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /run 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-10-05T15:24:28.531 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:24:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:24:30.666 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:24:30.836 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:24:31.105 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:24:31.296 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:24:31.823 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:24:32.054 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:24:32.096 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:24:33.485 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:24:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2023-10-05T15:24:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2023-10-05T15:24:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /dev 2023-10-05T15:24:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /run 2023-10-05T15:24:33.485 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2023-10-05T15:24:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2023-10-05T15:24:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2023-10-05T15:24:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2023-10-05T15:24:33.486 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /dev 2023-10-05T15:24:33.486 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:24:33.884 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:24:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:24:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:24:35.219 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 102/134 2023-10-05T15:24:35.411 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 103/134 2023-10-05T15:24:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:24:35.645 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:24:35.800 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:24:35.807 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 96/134 2023-10-05T15:24:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2023-10-05T15:24:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2023-10-05T15:24:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-10-05T15:24:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /run 2023-10-05T15:24:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2023-10-05T15:24:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2023-10-05T15:24:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2023-10-05T15:24:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2023-10-05T15:24:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-10-05T15:24:35.808 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:24:35.906 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:24:36.072 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:24:36.118 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:24:36.236 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:24:36.242 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:24:36.771 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:24:36.992 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:24:37.034 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:24:37.226 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:24:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:24:37.575 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:24:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 107/134 2023-10-05T15:24:38.114 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 97/134 2023-10-05T15:24:38.219 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:24:38.279 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:24:38.285 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:24:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:24:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:24:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 98/134 2023-10-05T15:24:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:24:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 99/134 2023-10-05T15:24:39.511 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:24:39.554 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 100/134 2023-10-05T15:24:39.749 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:24:39.939 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:24:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 110/134 2023-10-05T15:24:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 102/134 2023-10-05T15:24:40.205 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:24:40.267 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:24:40.298 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 103/134 2023-10-05T15:24:40.419 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:24:40.490 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:24:40.508 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:24:40.643 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:24:40.780 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:24:41.033 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:24:41.079 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:24:41.252 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:24:42.141 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:24:42.341 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:24:42.470 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:24:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:24:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 101/134 2023-10-05T15:24:42.839 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 107/134 2023-10-05T15:24:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 102/134 2023-10-05T15:24:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 103/134 2023-10-05T15:24:43.074 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:24:43.141 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:24:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:24:43.341 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:24:43.370 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:24:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 104/134 2023-10-05T15:24:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:24:44.828 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 110/134 2023-10-05T15:24:44.911 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 105/134 2023-10-05T15:24:45.066 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:24:45.093 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:24:45.129 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:24:45.228 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 106/134 2023-10-05T15:24:45.283 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:24:45.355 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:24:45.532 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:24:45.594 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 107/134 2023-10-05T15:24:45.821 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:24:45.888 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 108/134 2023-10-05T15:24:45.957 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:24:46.101 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:24:46.107 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:24:46.131 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 109/134 2023-10-05T15:24:46.351 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:24:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 115/134 2023-10-05T15:24:46.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:24:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:24:47.674 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 110/134 2023-10-05T15:24:47.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:24:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 111/134 2023-10-05T15:24:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:24:48.142 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6578.g689b3 112/134 2023-10-05T15:24:48.301 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:24:48.363 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-05T15:24:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-05T15:24:48.750 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 113/134 2023-10-05T15:24:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 119/134 2023-10-05T15:24:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:24:49.138 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:24:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 121/134 2023-10-05T15:24:49.476 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:24:51.209 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:24:51.537 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 115/134 2023-10-05T15:24:51.698 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:24:51.948 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:24:52.883 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:24:53.209 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-05T15:24:53.283 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:24:53.322 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:24:53.492 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 124/134 2023-10-05T15:24:53.534 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-05T15:24:53.720 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 119/134 2023-10-05T15:24:53.741 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 125/134 2023-10-05T15:24:53.902 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:24:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 126/134 2023-10-05T15:24:54.103 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 121/134 2023-10-05T15:24:54.249 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:24:54.351 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-05T15:24:54.367 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 114/134 2023-10-05T15:24:54.548 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:24:54.571 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:24:54.650 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 115/134 2023-10-05T15:24:54.801 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-05T15:24:54.808 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:24:55.007 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:24:55.074 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-05T15:24:55.119 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:24:55.323 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:24:55.352 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:24:55.352 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:24:55.588 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:24:55.588 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:24:55.848 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:24:56.057 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:24:56.331 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:24:56.331 INFO:teuthology.orchestra.run.smithi079.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-05T15:24:56.332 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:24:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-05T15:24:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 1/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 3/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 4/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 5/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:24:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 10/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 11/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 12/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 13/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 14/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 15/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 16/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 17/134 2023-10-05T15:24:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 18/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 19/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 20/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 21/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 22/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 23/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 24/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 25/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 26/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 27/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 28/134 2023-10-05T15:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 29/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 30/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 31/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 32/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 33/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 34/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 35/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 36/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 37/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 38/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-05T15:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-05T15:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-05T15:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-05T15:24:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-05T15:24:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-05T15:24:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-05T15:24:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-05T15:24:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 129/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 131/134 2023-10-05T15:24:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:24:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-05T15:24:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 119/134 2023-10-05T15:24:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:24:57.523 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 121/134 2023-10-05T15:24:57.631 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:24:57.710 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:24:57.889 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:24:57.929 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:24:58.232 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 124/134 2023-10-05T15:24:58.414 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 125/134 2023-10-05T15:24:58.771 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 126/134 2023-10-05T15:24:59.082 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-05T15:24:59.247 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:24:59.270 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:24:59.482 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-05T15:24:59.696 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:24:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:24:59.717 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:02:07 ago on Thu 05 Oct 2023 03:22:52 PM UTC. 2023-10-05T15:24:59.802 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:25:00.039 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:25:00.068 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:25:00.068 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:25:00.287 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:25:00.287 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:25:00.571 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:25:00.780 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:25:01.096 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:25:01.097 INFO:teuthology.orchestra.run.smithi167.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-05T15:25:01.097 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:25:01.227 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:25:01.542 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:25:01.580 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-05T15:25:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 1/134 2023-10-05T15:25:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2/134 2023-10-05T15:25:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 3/134 2023-10-05T15:25:01.728 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 4/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 5/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 10/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 11/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 12/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 13/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 14/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 15/134 2023-10-05T15:25:01.729 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 16/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 17/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 18/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 19/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 20/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 21/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 22/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 23/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 24/134 2023-10-05T15:25:01.730 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 25/134 2023-10-05T15:25:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 26/134 2023-10-05T15:25:01.739 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 27/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 28/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 29/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 30/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 31/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 32/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 33/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 34/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 35/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 36/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 37/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 38/134 2023-10-05T15:25:01.740 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-05T15:25:01.741 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-05T15:25:01.742 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-05T15:25:01.743 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-05T15:25:01.744 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-05T15:25:01.745 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-05T15:25:01.746 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:25:01.747 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 129/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 131/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:25:01.748 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-05T15:25:01.768 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 124/134 2023-10-05T15:25:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 125/134 2023-10-05T15:25:02.354 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 126/134 2023-10-05T15:25:02.660 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-05T15:25:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:25:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:25:03.104 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-05T15:25:03.290 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:25:03.430 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-05T15:25:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:25:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-05T15:25:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:25:03.890 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:25:03.890 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:25:04.135 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-05T15:25:04.350 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:25:04.510 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:25:04.510 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:11 ago on Thu 05 Oct 2023 03:22:53 PM UTC. 2023-10-05T15:25:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:25:04.641 INFO:teuthology.orchestra.run.smithi017.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-05T15:25:04.641 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:25:05.298 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 1/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 3/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 4/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6578.g689b3 5/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 6/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 7/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 8/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 9/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 10/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 11/134 2023-10-05T15:25:05.299 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 12/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 13/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_ 14/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 15/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 16/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_6 17/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86 18/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 19/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el 20/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8. 21/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_6 22/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 23/134 2023-10-05T15:25:05.300 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 24/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 25/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 26/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 27/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 28/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a. 29/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noa 30/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.n 31/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6578.g689 32/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el 33/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 34/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.e 35/134 2023-10-05T15:25:05.301 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 36/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 37/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 38/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-05T15:25:05.302 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-05T15:25:05.303 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-05T15:25:05.304 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-05T15:25:05.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-05T15:25:05.306 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-05T15:25:05.307 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-05T15:25:05.308 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-05T15:25:05.309 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-05T15:25:05.310 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-05T15:25:05.311 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 129/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 131/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-05T15:25:05.312 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-05T15:25:08.058 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-05T15:25:08.058 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:16 ago on Thu 05 Oct 2023 03:22:52 PM UTC. 2023-10-05T15:25:08.375 INFO:teuthology.orchestra.run.smithi079.stdout:Installed products updated. 2023-10-05T15:25:08.597 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.1-7.el8.noarch 2023-10-05T15:25:08.598 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.0.4-10.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.599 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.600 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.1-9.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: jq-1.6-3.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.601 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libpq-13.5-1.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-05T15:25:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-05T15:25:08.603 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T15:25:08.605 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T15:25:08.606 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T15:25:08.607 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.608 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T15:25:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T15:25:08.610 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T15:25:08.611 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-05T15:25:08.611 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-05T15:25:08.611 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T15:25:08.611 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-05T15:25:08.611 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-05T15:25:08.611 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-05T15:25:08.880 DEBUG:teuthology.parallel:result is None 2023-10-05T15:25:11.677 INFO:teuthology.orchestra.run.smithi167.stdout:Installed products updated. 2023-10-05T15:25:11.900 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:25:11.900 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2023-10-05T15:25:11.900 INFO:teuthology.orchestra.run.smithi167.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-05T15:25:11.900 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.900 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.900 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.1-7.el8.noarch 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.0.4-10.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.901 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.902 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.1-9.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: jq-1.6-3.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.903 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libpq-13.5-1.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.904 INFO:teuthology.orchestra.run.smithi167.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-05T15:25:11.905 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.906 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T15:25:11.907 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T15:25:11.908 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.909 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T15:25:11.910 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-05T15:25:11.911 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-05T15:25:11.912 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T15:25:11.912 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-05T15:25:11.912 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:25:11.912 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2023-10-05T15:25:12.195 DEBUG:teuthology.parallel:result is None 2023-10-05T15:25:15.513 INFO:teuthology.orchestra.run.smithi017.stdout:Installed products updated. 2023-10-05T15:25:15.756 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:25:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.1-7.el8.noarch 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.0.4-10.el8.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.757 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:18.0.0-6578.g689b3d5a.el8.noarch 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.1-9.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-05T15:25:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-3.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libpq-13.5-1.el8.x86_64 2023-10-05T15:25:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-05T15:25:15.761 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-05T15:25:15.762 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-05T15:25:15.763 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-05T15:25:15.764 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-2.6-1.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-05T15:25:15.765 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-05T15:25:15.766 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.0.0-6578.g689b3d5a.el8.x86_64 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-05T15:25:15.767 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-05T15:25:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-05T15:25:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-05T15:25:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-05T15:25:15.768 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:25:15.768 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-10-05T15:25:16.043 DEBUG:teuthology.parallel:result is None 2023-10-05T15:25:16.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:25:16.191 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T15:25:16.245 INFO:teuthology.orchestra.run.smithi017.stdout:18.0.0-6578.g689b3d5a.el8 2023-10-05T15:25:16.245 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6578.g689b3d5a.el8 2023-10-05T15:25:16.246 INFO:teuthology.task.install:The correct ceph version 18.0.0-6578.g689b3d5a is installed. 2023-10-05T15:25:16.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:25:16.458 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T15:25:16.518 INFO:teuthology.orchestra.run.smithi079.stdout:18.0.0-6578.g689b3d5a.el8 2023-10-05T15:25:16.518 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6578.g689b3d5a.el8 2023-10-05T15:25:16.518 INFO:teuthology.task.install:The correct ceph version 18.0.0-6578.g689b3d5a is installed. 2023-10-05T15:25:16.519 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:25:16.658 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T15:25:16.719 INFO:teuthology.orchestra.run.smithi167.stdout:18.0.0-6578.g689b3d5a.el8 2023-10-05T15:25:16.719 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6578.g689b3d5a.el8 2023-10-05T15:25:16.719 INFO:teuthology.task.install:The correct ceph version 18.0.0-6578.g689b3d5a is installed. 2023-10-05T15:25:16.719 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-05T15:25:16.720 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:25:16.720 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T15:25:16.813 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:25:16.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T15:25:16.908 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:25:16.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T15:25:17.005 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-05T15:25:17.005 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:25:17.005 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T15:25:17.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T15:25:17.184 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:25:17.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T15:25:17.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T15:25:17.363 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:25:17.363 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T15:25:17.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T15:25:17.694 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-05T15:25:17.695 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:25:17.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T15:25:17.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T15:25:17.874 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:25:17.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T15:25:17.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T15:25:18.050 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:25:18.050 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T15:25:18.120 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T15:25:18.230 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-05T15:25:18.230 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:25:18.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T15:25:18.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T15:25:18.407 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:25:18.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T15:25:18.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T15:25:18.592 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:25:18.592 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T15:25:18.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T15:25:18.790 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-05T15:25:18.874 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_client_delegate_inos_pct': 50, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-10-05T15:25:18.874 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:25:18.875 INFO:tasks.cephadm:Cluster fsid is 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:25:18.875 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-05T15:25:18.875 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.79', 'mon.c': '172.21.15.167'} 2023-10-05T15:25:18.875 INFO:tasks.cephadm:First mon is mon.a on smithi017 2023-10-05T15:25:18.875 INFO:tasks.cephadm:First mgr is x 2023-10-05T15:25:18.876 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-05T15:25:18.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2023-10-05T15:25:18.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2023-10-05T15:25:19.017 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2023-10-05T15:25:19.089 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-05T15:25:19.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:25:19.305 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73000/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6578-g689b3d5a', 'node_name': '172.21.4.64+confusa02', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6578.g689b3d5a'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-05 14:15:16.970244', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-61009-wo-1', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}] 2023-10-05T15:25:19.441 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-61009-wo-1, sha1 689b3d5ae1ed3e8efe9a65281cd9bd422749e95f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=689b3d5ae1ed3e8efe9a65281cd9bd422749e95f 2023-10-05T15:25:19.441 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm 2023-10-05T15:25:19.441 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:20.077 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-rw-r--. 1 ubuntu ubuntu 753815 Oct 5 15:25 /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:20.077 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:20.486 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-rw-r--. 1 ubuntu ubuntu 753815 Oct 5 15:25 /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:20.487 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-61009-wo-1/689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:21.068 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-rw-r--. 1 ubuntu ubuntu 753815 Oct 5 15:25 /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:21.069 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:21.120 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:21.170 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-05T15:25:21.236 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f on all hosts... 2023-10-05T15:25:21.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f pull 2023-10-05T15:25:21.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f pull 2023-10-05T15:25:21.245 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f pull 2023-10-05T15:25:23.499 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:25:24.167 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:25:24.942 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:25:51.955 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-05T15:25:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:25:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe", 2023-10-05T15:25:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2023-10-05T15:25:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3300db03fa5ba77da04282ea1191ae44872b62ffe3a77045637a1f1020109887" 2023-10-05T15:25:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-05T15:25:51.956 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-05T15:25:53.434 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T15:25:53.434 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:25:53.435 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe", 2023-10-05T15:25:53.435 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2023-10-05T15:25:53.435 INFO:teuthology.orchestra.run.smithi167.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3300db03fa5ba77da04282ea1191ae44872b62ffe3a77045637a1f1020109887" 2023-10-05T15:25:53.435 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T15:25:53.435 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T15:25:54.209 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:25:54.209 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:25:54.209 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe", 2023-10-05T15:25:54.209 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2023-10-05T15:25:54.210 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3300db03fa5ba77da04282ea1191ae44872b62ffe3a77045637a1f1020109887" 2023-10-05T15:25:54.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:25:54.210 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:25:54.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2023-10-05T15:25:54.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2023-10-05T15:25:54.387 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2023-10-05T15:25:54.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2023-10-05T15:25:54.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2023-10-05T15:25:54.604 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2023-10-05T15:25:54.672 INFO:tasks.cephadm:Writing seed config... 2023-10-05T15:25:54.673 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-05T15:25:54.673 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-05T15:25:54.673 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-05T15:25:54.673 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-05T15:25:54.673 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-05T15:25:54.674 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mds] mds_client_delegate_inos_pct = 50 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-05T15:25:54.675 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-05T15:25:54.676 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-05T15:25:54.677 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-05T15:25:54.677 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-05T15:25:54.677 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-05T15:25:54.677 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-05T15:25:54.678 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:25:54.678 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-05T15:25:54.720 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6446904c-6393-11ee-8db5-212e2dc638e7 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_client_delegate_inos_pct = 50 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-05T15:25:54.720 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-05T15:25:54.765 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-05T15:25:54.809 INFO:tasks.cephadm:Bootstrapping... 2023-10-05T15:25:54.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f -v bootstrap --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:25:54.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:25:54.878 INFO:journalctl@ceph.mgr.x.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:25:55.043 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-10-05T15:25:55.043 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f', '-v', 'bootstrap', '--fsid', '6446904c-6393-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2023-10-05T15:25:55.216 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.1.1 2023-10-05T15:25:55.216 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-05T15:25:55.217 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2023-10-05T15:25:55.388 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.1.1 2023-10-05T15:25:55.388 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2023-10-05T15:25:55.388 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2023-10-05T15:25:55.402 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-05T15:25:55.403 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-05T15:25:55.415 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-05T15:25:55.415 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-10-05T15:25:55.429 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2023-10-05T15:25:55.442 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2023-10-05T15:25:55.442 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2023-10-05T15:25:55.442 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2023-10-05T15:25:55.612 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.1.1 2023-10-05T15:25:55.613 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-05T15:25:55.613 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2023-10-05T15:25:55.613 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2023-10-05T15:25:55.626 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-05T15:25:55.626 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-05T15:25:55.639 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-05T15:25:55.639 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-10-05T15:25:55.652 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2023-10-05T15:25:55.665 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2023-10-05T15:25:55.665 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2023-10-05T15:25:55.665 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2023-10-05T15:25:55.665 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:25:55.666 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 140007733230056 on /run/cephadm/6446904c-6393-11ee-8db5-212e2dc638e7.lock 2023-10-05T15:25:55.666 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 140007733230056 acquired on /run/cephadm/6446904c-6393-11ee-8db5-212e2dc638e7.lock 2023-10-05T15:25:55.666 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2023-10-05T15:25:55.667 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2023-10-05T15:25:55.667 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2023-10-05T15:25:55.676 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-05T15:25:55.676 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2023-10-05T15:25:55.682 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-05T15:25:55.683 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-05T15:25:55.683 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1699sec hoplimit 64 pref medium 2023-10-05T15:25:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-05T15:25:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-05T15:25:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-05T15:25:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-05T15:25:55.690 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-10-05T15:25:55.690 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-05T15:25:55.690 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2023-10-05T15:25:55.690 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2023-10-05T15:25:55.691 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-05T15:25:55.691 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-05T15:25:55.693 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:25:56.167 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f... 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:bbaffcd584794b4c36d1bbf695604ab523bf72bb8494f3e7d90e19daa4269491 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:83c9d078d78518d010b5ec5b3c61afb26aaf32a4efd4c90d62d349bb2daadcfe 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-05T15:25:56.168 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Storing signatures 2023-10-05T15:25:57.142 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:25:57.143 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:25:57.143 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2023-10-05T15:25:57.920 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2023-10-05T15:25:57.921 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2023-10-05T15:25:58.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQCG1R5l/+LrERAAgmVoG4CwF5Z8B4Z/BkRTQA== 2023-10-05T15:25:59.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQCH1R5l9C/6BBAAf95WKtoxr6oYKn70wNrcsg== 2023-10-05T15:26:00.247 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQCH1R5lIXwxNBAAl0itP+dkAzRBRl+eRfQSQw== 2023-10-05T15:26:00.249 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2023-10-05T15:26:01.026 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:26:01.027 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2023-10-05T15:26:01.802 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2023-10-05T15:26:02.355 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-05T15:26:02.565 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-05T15:26:02.814 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6446904c-6393-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-6446904c-6393-11ee-8db5-212e2dc638e7.target. 2023-10-05T15:26:02.815 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6446904c-6393-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-6446904c-6393-11ee-8db5-212e2dc638e7.target. 2023-10-05T15:26:03.194 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a 2023-10-05T15:26:03.194 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-05T15:26:03.400 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6446904c-6393-11ee-8db5-212e2dc638e7.target.wants/ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-6446904c-6393-11ee-8db5-212e2dc638e7@.service. 2023-10-05T15:26:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:03 smithi017 systemd[1]: Starting Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:26:04.172 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:03 smithi017 podman[128568]: 2023-10-05T15:26:04.229 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:26:04.229 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-10-05T15:26:04.245 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:26:04.246 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-10-05T15:26:04.246 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-10-05T15:26:04.246 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2023-10-05T15:26:04.246 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2023-10-05T15:26:04.247 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2023-10-05T15:26:04.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:04 smithi017 bash[128568]: 5a930ab961c7b26034abb06c586540e03b6cd2a41826ac61bbf96209af24425b 2023-10-05T15:26:04.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:04 smithi017 systemd[1]: Started Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:26:04.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:04 smithi017 ceph-mon[128608]: mkfs 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:04.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:04 smithi017 ceph-mon[128608]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-05T15:26:05.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.706834s) 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:05.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.825+0000 7f3e2d0f2700 1 Processor -- start 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.825+0000 7f3e2d0f2700 1 -- start start 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.826+0000 7f3e2d0f2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e281069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.826+0000 7f3e2d0f2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28106f80 con 0x7f3e28106590 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.827+0000 7f3e26d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e281069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.827+0000 7f3e26d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e281069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50130/0 (socket says 172.21.15.17:50130) 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.827+0000 7f3e26d9d700 1 -- 172.21.15.17:0/2412875775 learned_addr learned my addr 172.21.15.17:0/2412875775 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:05.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.827+0000 7f3e26d9d700 1 -- 172.21.15.17:0/2412875775 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28107790 con 0x7f3e28106590 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.827+0000 7f3e26d9d700 1 --2- 172.21.15.17:0/2412875775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e281069b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e180098a0 tx=0x7f3e18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb10e326372129b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e25d9b700 1 -- 172.21.15.17:0/2412875775 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18004160 con 0x7f3e28106590 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e25d9b700 1 -- 172.21.15.17:0/2412875775 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e180042c0 con 0x7f3e28106590 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e25d9b700 1 -- 172.21.15.17:0/2412875775 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e180045a0 con 0x7f3e28106590 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2412875775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 msgr2=0x7f3e281069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e2d0f2700 1 --2- 172.21.15.17:0/2412875775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e281069b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3e180098a0 tx=0x7f3e18009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2412875775 shutdown_connections 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e2d0f2700 1 --2- 172.21.15.17:0/2412875775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e281069b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2412875775 >> 172.21.15.17:0/2412875775 conn(0x7f3e28101b30 msgr2=0x7f3e28103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.828+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2412875775 shutdown_connections 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.829+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2412875775 wait complete. 2023-10-05T15:26:05.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e2d0f2700 1 Processor -- start 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e2d0f2700 1 -- start start 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e2d0f2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e2819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e2d0f2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2819c120 con 0x7f3e28106590 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e26d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e2819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e26d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e2819bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50138/0 (socket says 172.21.15.17:50138) 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.830+0000 7f3e26d9d700 1 -- 172.21.15.17:0/2354132230 learned_addr learned my addr 172.21.15.17:0/2354132230 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.831+0000 7f3e26d9d700 1 -- 172.21.15.17:0/2354132230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18009550 con 0x7f3e28106590 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.831+0000 7f3e26d9d700 1 --2- 172.21.15.17:0/2354132230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e2819bbe0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e18004000 tx=0x7f3e18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.831+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18011630 con 0x7f3e28106590 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.831+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18011790 con 0x7f3e28106590 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.831+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2354132230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2819c320 con 0x7f3e28106590 2023-10-05T15:26:05.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.831+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e18011a30 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.832+0000 7f3e2d0f2700 1 -- 172.21.15.17:0/2354132230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2819c740 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.832+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e18022070 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.832+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3e1801c790 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.833+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e080052f0 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.836+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3e1801bcf0 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.912+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f3e08005870 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.912+0000 7f3e0ffff700 1 -- 172.21.15.17:0/2354132230 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f3e1801b450 con 0x7f3e28106590 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 msgr2=0x7f3e2819bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 --2- 172.21.15.17:0/2354132230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e2819bbe0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3e18004000 tx=0x7f3e18004750 comp rx=0 tx=0).stop 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 shutdown_connections 2023-10-05T15:26:05.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 --2- 172.21.15.17:0/2354132230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e28106590 0x7f3e2819bbe0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:05.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 >> 172.21.15.17:0/2354132230 conn(0x7f3e28101b30 msgr2=0x7f3e2818df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:05.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 shutdown_connections 2023-10-05T15:26:05.239 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:04.913+0000 7f3e0dffb700 1 -- 172.21.15.17:0/2354132230 wait complete. 2023-10-05T15:26:05.239 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2023-10-05T15:26:05.239 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2023-10-05T15:26:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:05 smithi017 ceph-mon[128608]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-05T15:26:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:05 smithi017 ceph-mon[128608]: monmap e1: 1 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} 2023-10-05T15:26:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:05 smithi017 ceph-mon[128608]: fsmap 2023-10-05T15:26:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:05 smithi017 ceph-mon[128608]: osdmap e1: 0 total, 0 up, 0 in 2023-10-05T15:26:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:05 smithi017 ceph-mon[128608]: mgrmap e1: no daemons active 2023-10-05T15:26:05.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:05 smithi017 ceph-mon[128608]: from='client.? 172.21.15.17:0/2354132230' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-05T15:26:06.316 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:06.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.750+0000 7f5f5e33d700 1 Processor -- start 2023-10-05T15:26:06.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.750+0000 7f5f5e33d700 1 -- start start 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.751+0000 7f5f5e33d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.751+0000 7f5f5e33d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5807a8b0 con 0x7f5f5807be80 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.751+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50154/0 (socket says 172.21.15.17:50154) 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f57fff700 1 -- 172.21.15.17:0/661637116 learned_addr learned my addr 172.21.15.17:0/661637116 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f57fff700 1 -- 172.21.15.17:0/661637116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5807a9f0 con 0x7f5f5807be80 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f57fff700 1 --2- 172.21.15.17:0/661637116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5807a2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5f480098a0 tx=0x7f5f48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94086f831bb4a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f56ffd700 1 -- 172.21.15.17:0/661637116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f48004160 con 0x7f5f5807be80 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f56ffd700 1 -- 172.21.15.17:0/661637116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480042c0 con 0x7f5f5807be80 2023-10-05T15:26:06.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.752+0000 7f5f56ffd700 1 -- 172.21.15.17:0/661637116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f480045a0 con 0x7f5f5807be80 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 -- 172.21.15.17:0/661637116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 msgr2=0x7f5f5807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 --2- 172.21.15.17:0/661637116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5807a2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5f480098a0 tx=0x7f5f48009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 -- 172.21.15.17:0/661637116 shutdown_connections 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 --2- 172.21.15.17:0/661637116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5807a2e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 -- 172.21.15.17:0/661637116 >> 172.21.15.17:0/661637116 conn(0x7f5f58101b30 msgr2=0x7f5f58103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 -- 172.21.15.17:0/661637116 shutdown_connections 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.753+0000 7f5f5e33d700 1 -- 172.21.15.17:0/661637116 wait complete. 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.754+0000 7f5f5e33d700 1 Processor -- start 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.754+0000 7f5f5e33d700 1 -- start start 2023-10-05T15:26:06.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f5e33d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f5e33d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5819c120 con 0x7f5f5807be80 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f57fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5819bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50168/0 (socket says 172.21.15.17:50168) 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f57fff700 1 -- 172.21.15.17:0/2981788316 learned_addr learned my addr 172.21.15.17:0/2981788316 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f57fff700 1 -- 172.21.15.17:0/2981788316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009550 con 0x7f5f5807be80 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.755+0000 7f5f57fff700 1 --2- 172.21.15.17:0/2981788316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5819bbe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5f48004000 tx=0x7f5f48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f48011630 con 0x7f5f5807be80 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48011790 con 0x7f5f5807be80 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5819c320 con 0x7f5f5807be80 2023-10-05T15:26:06.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f48011a30 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5819c740 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5f48022070 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.756+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5f4801c450 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.757+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58195ac0 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.760+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5f4801b450 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.834+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5f580624e0 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.838+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f5f580624e0 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.839+0000 7f5f557fa700 1 -- 172.21.15.17:0/2981788316 <== mon.0 v2:172.21.15.17:3300/0 8 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5f4801b5f0 con 0x7f5f5807be80 2023-10-05T15:26:06.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 msgr2=0x7f5f5819bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 --2- 172.21.15.17:0/2981788316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5819bbe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5f48004000 tx=0x7f5f48004750 comp rx=0 tx=0).stop 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 shutdown_connections 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 --2- 172.21.15.17:0/2981788316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f5807be80 0x7f5f5819bbe0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 >> 172.21.15.17:0/2981788316 conn(0x7f5f58101b30 msgr2=0x7f5f58103440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 shutdown_connections 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:05.840+0000 7f5f5e33d700 1 -- 172.21.15.17:0/2981788316 wait complete. 2023-10-05T15:26:06.323 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2023-10-05T15:26:06.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:06 smithi017 ceph-mon[128608]: from='client.? 172.21.15.17:0/2981788316' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-05T15:26:06.594 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:06 smithi017 ceph-mon[128608]: from='client.? 172.21.15.17:0/2981788316' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-05T15:26:07.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:07 smithi017 ceph-mon[128608]: from='client.? 172.21.15.17:0/3680412576' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:26:08.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.857+0000 7f49f1a0f700 1 Processor -- start 2023-10-05T15:26:08.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.857+0000 7f49f1a0f700 1 -- start start 2023-10-05T15:26:08.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.857+0000 7f49f1a0f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec07a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:08.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.857+0000 7f49f1a0f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec07a870 con 0x7f49ec07be40 2023-10-05T15:26:08.702 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.858+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec07a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.858+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec07a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50184/0 (socket says 172.21.15.17:50184) 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.858+0000 7f49eaffd700 1 -- 172.21.15.17:0/1723265579 learned_addr learned my addr 172.21.15.17:0/1723265579 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.858+0000 7f49eaffd700 1 -- 172.21.15.17:0/1723265579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec07a9b0 con 0x7f49ec07be40 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.858+0000 7f49eaffd700 1 --2- 172.21.15.17:0/1723265579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec07a2a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098a0 tx=0x7f49dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb7afe2601c2d52 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49e9ffb700 1 -- 172.21.15.17:0/1723265579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49dc004160 con 0x7f49ec07be40 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49e9ffb700 1 -- 172.21.15.17:0/1723265579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f49dc0042c0 con 0x7f49ec07be40 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49e9ffb700 1 -- 172.21.15.17:0/1723265579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49dc011940 con 0x7f49ec07be40 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49f1a0f700 1 -- 172.21.15.17:0/1723265579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 msgr2=0x7f49ec07a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49f1a0f700 1 --2- 172.21.15.17:0/1723265579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec07a2a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0098a0 tx=0x7f49dc009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49f1a0f700 1 -- 172.21.15.17:0/1723265579 shutdown_connections 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49f1a0f700 1 --2- 172.21.15.17:0/1723265579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec07a2a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:08.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.859+0000 7f49f1a0f700 1 -- 172.21.15.17:0/1723265579 >> 172.21.15.17:0/1723265579 conn(0x7f49ec101b30 msgr2=0x7f49ec103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.860+0000 7f49f1a0f700 1 -- 172.21.15.17:0/1723265579 shutdown_connections 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.860+0000 7f49f1a0f700 1 -- 172.21.15.17:0/1723265579 wait complete. 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49f1a0f700 1 Processor -- start 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49f1a0f700 1 -- start start 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49f1a0f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49f1a0f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19c7d0 con 0x7f49ec07be40 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49eaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50188/0 (socket says 172.21.15.17:50188) 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.861+0000 7f49eaffd700 1 -- 172.21.15.17:0/3680412576 learned_addr learned my addr 172.21.15.17:0/3680412576 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49eaffd700 1 -- 172.21.15.17:0/3680412576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc009550 con 0x7f49ec07be40 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49eaffd700 1 --2- 172.21.15.17:0/3680412576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec19c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49dc011dc0 tx=0x7f49dc011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:08.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49dc0037d0 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f49dc01b440 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49dc01a560 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec19c9d0 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.862+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec19cdf0 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.863+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f49dc01aad0 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.863+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f49dc0193f0 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.863+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec0624e0 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.866+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f49dc029060 con 0x7f49ec07be40 2023-10-05T15:26:08.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.960+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f49ec10c8e0 con 0x7f49ec07be40 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.961+0000 7f49f0a0d700 1 -- 172.21.15.17:0/3680412576 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f49dc01f070 con 0x7f49ec07be40 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 msgr2=0x7f49ec19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 --2- 172.21.15.17:0/3680412576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec19c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f49dc011dc0 tx=0x7f49dc011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 shutdown_connections 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 --2- 172.21.15.17:0/3680412576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49ec07be40 0x7f49ec19c290 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 >> 172.21.15.17:0/3680412576 conn(0x7f49ec101b30 msgr2=0x7f49ec102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 shutdown_connections 2023-10-05T15:26:08.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:06.962+0000 7f49f1a0f700 1 -- 172.21.15.17:0/3680412576 wait complete. 2023-10-05T15:26:08.707 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2023-10-05T15:26:09.169 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:08 smithi017 systemd[1]: Stopping Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:26:09.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:09 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-a[128584]: 2023-10-05T15:26:09.166+0000 7ff1992cc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:26:09.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:09 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-a[128584]: 2023-10-05T15:26:09.166+0000 7ff1992cc700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-05T15:26:09.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:09 smithi017 bash[128947]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-a 2023-10-05T15:26:10.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:09 smithi017 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-05T15:26:10.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:09 smithi017 systemd[1]: Stopped Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:26:10.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:09 smithi017 systemd[1]: Starting Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:26:10.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 podman[129067]: 2023-10-05T15:26:10.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 bash[129067]: 76700c0a255de75e683c6a20f6a41e6fbb22185f7ee6d8857e765b0e67a7cbe6 2023-10-05T15:26:10.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: set uid:gid to 167:167 (ceph:ceph) 2023-10-05T15:26:10.681 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev), process ceph-mon, pid 7 2023-10-05T15:26:10.681 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: pidfile_write: ignore empty --pid-file 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: load: jerasure load: lrc 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: RocksDB version: 7.9.2 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Git sha 0 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Compile date 2023-10-05 12:06:36 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: DB SUMMARY 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: DB Session ID: T9FHZFFXYU99SJTI6VXS 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: CURRENT file: CURRENT 2023-10-05T15:26:10.682 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: IDENTITY file: IDENTITY 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98304 ; 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.error_if_exists: 0 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.create_if_missing: 0 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.paranoid_checks: 1 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-05T15:26:10.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.env: 0x557f40023da0 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.fs: PosixFileSystem 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.info_log: 0x557f40c755c0 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_file_opening_threads: 16 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.statistics: (nil) 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.use_fsync: 0 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_log_file_size: 0 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.keep_log_file_num: 1000 2023-10-05T15:26:10.684 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.recycle_log_file_num: 0 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.allow_fallocate: 1 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.allow_mmap_reads: 0 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.allow_mmap_writes: 0 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.use_direct_reads: 0 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.create_missing_column_families: 0 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.db_log_dir: 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.wal_dir: 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-05T15:26:10.685 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.advise_random_on_open: 1 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.db_write_buffer_size: 0 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.write_buffer_manager: 0x557f40c2d360 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.rate_limiter: (nil) 2023-10-05T15:26:10.686 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.wal_recovery_mode: 2 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.enable_thread_tracking: 0 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.enable_pipelined_write: 0 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.unordered_write: 0 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.row_cache: None 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.wal_filter: None 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-05T15:26:10.687 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.allow_ingest_behind: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.two_write_queues: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.manual_wal_flush: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.wal_compression: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.atomic_flush: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.log_readahead_size: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.best_efforts_recovery: 0 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-05T15:26:10.688 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.allow_data_in_errors: 0 2023-10-05T15:26:10.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.db_host_id: __hostname__ 2023-10-05T15:26:10.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_background_jobs: 2 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_background_compactions: -1 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_subcompactions: 1 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_total_wal_size: 0 2023-10-05T15:26:10.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_open_files: -1 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bytes_per_sync: 0 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_readahead_size: 0 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_background_flushes: -1 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Compression algorithms supported: 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-05T15:26:10.691 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kZSTD supported: 0 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kXpressCompression supported: 0 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kLZ4HCCompression supported: 1 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kZlibCompression supported: 1 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kSnappyCompression supported: 1 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kLZ4Compression supported: 1 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: kBZip2Compression supported: 0 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-05T15:26:10.692 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.merge_operator: 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_filter: None 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_filter_factory: None 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.sst_partitioner_factory: None 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557f40c756c0) 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2023-10-05T15:26:10.693 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x557f40ccb1f0 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2023-10-05T15:26:10.694 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2023-10-05T15:26:10.695 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.write_buffer_size: 33554432 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_write_buffer_number: 2 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression: NoCompression 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression: Disabled 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.prefix_extractor: nullptr 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-05T15:26:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.num_levels: 7 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:26:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.level: 32767 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.strategy: 0 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.enabled: false 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-05T15:26:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.target_file_size_base: 67108864 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-05T15:26:10.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.arena_block_size: 1048576 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.disable_auto_compactions: 0 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-05T15:26:10.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.table_properties_collectors: 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.inplace_update_support: 0 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.bloom_locality: 0 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.max_successive_merges: 0 2023-10-05T15:26:10.701 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.paranoid_file_checks: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.force_consistency_checks: 1 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.report_bg_io_stats: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.ttl: 2592000 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.enable_blob_files: false 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.min_blob_size: 0 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.blob_file_size: 268435456 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-05T15:26:10.702 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.blob_file_starting_level: 0 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0a50a81b-59a9-4395-b1a6-c0dc3e100f2e 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519570614999, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519570616944, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93614, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 312, "table_properties": {"data_size": 91614, "index_size": 282, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13529, "raw_average_key_size": 49, "raw_value_size": 84223, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 271, "num_filter_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696519570, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0a50a81b-59a9-4395-b1a6-c0dc3e100f2e", "db_session_id": "T9FHZFFXYU99SJTI6VXS", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519570617035, "job": 1, "event": "recovery_finished"} 2023-10-05T15:26:10.703 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557f40d68000 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: DB pointer 0x557f40d54000 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-05T15:26:10.704 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 93.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 65.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 93.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 65.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 65.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-05T15:26:10.705 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 65.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 13.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 13.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:26:10.706 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x557f40ccb1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???) e1 preinit fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).mds e1 new map 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).mds e1 print_map 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:26:10.707 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: monmap e1: 1 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: fsmap 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: osdmap e1: 0 total, 0 up, 0 in 2023-10-05T15:26:10.708 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 ceph-mon[129107]: mgrmap e1: no daemons active 2023-10-05T15:26:10.709 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-05T15:26:10.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:10 smithi017 systemd[1]: Started Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.221+0000 7f8d50cd7700 1 Processor -- start 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.221+0000 7f8d50cd7700 1 -- start start 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.222+0000 7f8d50cd7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c07a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.222+0000 7f8d50cd7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c07a8d0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.222+0000 7f8d4a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c07a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.222+0000 7f8d4a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c07a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50202/0 (socket says 172.21.15.17:50202) 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.222+0000 7f8d4a59c700 1 -- 172.21.15.17:0/1067043145 learned_addr learned my addr 172.21.15.17:0/1067043145 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:11.685 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.223+0000 7f8d4a59c700 1 -- 172.21.15.17:0/1067043145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c07aa10 con 0x7f8d4c07bea0 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.223+0000 7f8d4a59c700 1 --2- 172.21.15.17:0/1067043145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c07a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0098a0 tx=0x7f8d3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b50955021be7db server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.223+0000 7f8d4959a700 1 -- 172.21.15.17:0/1067043145 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d3c004160 con 0x7f8d4c07bea0 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.223+0000 7f8d4959a700 1 -- 172.21.15.17:0/1067043145 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8d3c0042c0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.223+0000 7f8d4959a700 1 -- 172.21.15.17:0/1067043145 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d3c011940 con 0x7f8d4c07bea0 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 -- 172.21.15.17:0/1067043145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 msgr2=0x7f8d4c07a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 --2- 172.21.15.17:0/1067043145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c07a300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0098a0 tx=0x7f8d3c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 -- 172.21.15.17:0/1067043145 shutdown_connections 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 --2- 172.21.15.17:0/1067043145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c07a300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:11.686 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 -- 172.21.15.17:0/1067043145 >> 172.21.15.17:0/1067043145 conn(0x7f8d4c101b00 msgr2=0x7f8d4c103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 -- 172.21.15.17:0/1067043145 shutdown_connections 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.224+0000 7f8d50cd7700 1 -- 172.21.15.17:0/1067043145 wait complete. 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.225+0000 7f8d50cd7700 1 Processor -- start 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.225+0000 7f8d50cd7700 1 -- start start 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.226+0000 7f8d50cd7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c19c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.226+0000 7f8d50cd7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c19c780 con 0x7f8d4c07bea0 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.226+0000 7f8d4a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c19c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.226+0000 7f8d4a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c19c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50204/0 (socket says 172.21.15.17:50204) 2023-10-05T15:26:11.687 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.226+0000 7f8d4a59c700 1 -- 172.21.15.17:0/3999722482 learned_addr learned my addr 172.21.15.17:0/3999722482 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.226+0000 7f8d4a59c700 1 -- 172.21.15.17:0/3999722482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c009550 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d4a59c700 1 --2- 172.21.15.17:0/3999722482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c19c240 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c000c00 tx=0x7f8d3c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d3c0036a0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8d3c01b440 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c19c980 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d3c0193f0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c19cda0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8d3c0198e0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.227+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8d3c01a3d0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.228+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c10c8d0 con 0x7f8d4c07bea0 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.231+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8d3c029060 con 0x7f8d4c07bea0 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.304+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f8d4c19fa80 con 0x7f8d4c07bea0 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.306+0000 7f8d3b7fe700 1 -- 172.21.15.17:0/3999722482 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8d3c01f070 con 0x7f8d4c07bea0 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 msgr2=0x7f8d4c19c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 --2- 172.21.15.17:0/3999722482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c19c240 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c000c00 tx=0x7f8d3c011e70 comp rx=0 tx=0).stop 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 shutdown_connections 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 --2- 172.21.15.17:0/3999722482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d4c07bea0 0x7f8d4c19c240 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 >> 172.21.15.17:0/3999722482 conn(0x7f8d4c101b00 msgr2=0x7f8d4c102790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:11.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 shutdown_connections 2023-10-05T15:26:11.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:11.307+0000 7f8d50cd7700 1 -- 172.21.15.17:0/3999722482 wait complete. 2023-10-05T15:26:11.690 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-05T15:26:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:26:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2023-10-05T15:26:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-05T15:26:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-05T15:26:12.088 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x 2023-10-05T15:26:12.088 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-05T15:26:12.296 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6446904c-6393-11ee-8db5-212e2dc638e7.target.wants/ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-6446904c-6393-11ee-8db5-212e2dc638e7@.service. 2023-10-05T15:26:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:12 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3999722482' entity='client.admin' 2023-10-05T15:26:12.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:12 smithi017 systemd[1]: Starting Ceph mgr.x for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:26:13.027 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:12 smithi017 podman[129336]: 2023-10-05T15:26:13.112 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:26:13.112 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-10-05T15:26:13.129 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:26:13.129 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-10-05T15:26:13.129 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-10-05T15:26:13.129 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2023-10-05T15:26:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:26:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-10-05T15:26:13.165 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:26:13.165 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-10-05T15:26:13.165 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-10-05T15:26:13.165 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-05T15:26:13.166 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2023-10-05T15:26:13.166 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2023-10-05T15:26:13.321 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 bash[129336]: bfd56eacfde9d7845d71ff93dc946f33768eb8ef94e46cbf31556da75f272f0d 2023-10-05T15:26:13.321 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 systemd[1]: Started Ceph mgr.x for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:26:13.321 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:13.190+0000 7f213f344200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:26:13.321 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:13.318+0000 7f213f344200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:26:13.572 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:13.438+0000 7f213f344200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:26:13.901 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:13.569+0000 7f213f344200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:26:13.901 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:13.810+0000 7f213f344200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:26:14.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:13 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2498994660' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:26:14.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:14.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:26:14.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:26:14.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:26:14.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:26:14.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:26:14.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:26:14.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:14.375 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:26:14.375 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:26:14.375 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:26:14.382 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:26:14.382 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:26:14.383 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:26:14.384 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:26:04.208701+0000", 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:26:14.385 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.785+0000 7f0196fa5700 1 Processor -- start 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.785+0000 7f0196fa5700 1 -- start start 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.786+0000 7f0196fa5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.786+0000 7f0196fa5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019007a870 con 0x7f019007be40 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.786+0000 7f0194d41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.786+0000 7f0194d41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50240/0 (socket says 172.21.15.17:50240) 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.786+0000 7f0194d41700 1 -- 172.21.15.17:0/570396113 learned_addr learned my addr 172.21.15.17:0/570396113 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.787+0000 7f0194d41700 1 -- 172.21.15.17:0/570396113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019007a9b0 con 0x7f019007be40 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.787+0000 7f0194d41700 1 --2- 172.21.15.17:0/570396113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019007a2a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f01840098a0 tx=0x7f0184009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c400b5010684fa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.787+0000 7f018f7fe700 1 -- 172.21.15.17:0/570396113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0184004160 con 0x7f019007be40 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.787+0000 7f018f7fe700 1 -- 172.21.15.17:0/570396113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f01840042c0 con 0x7f019007be40 2023-10-05T15:26:14.386 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.787+0000 7f018f7fe700 1 -- 172.21.15.17:0/570396113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0184011940 con 0x7f019007be40 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 -- 172.21.15.17:0/570396113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 msgr2=0x7f019007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 --2- 172.21.15.17:0/570396113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019007a2a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f01840098a0 tx=0x7f0184009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 -- 172.21.15.17:0/570396113 shutdown_connections 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 --2- 172.21.15.17:0/570396113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019007a2a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 -- 172.21.15.17:0/570396113 >> 172.21.15.17:0/570396113 conn(0x7f0190101b30 msgr2=0x7f0190103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 -- 172.21.15.17:0/570396113 shutdown_connections 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.788+0000 7f0196fa5700 1 -- 172.21.15.17:0/570396113 wait complete. 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.790+0000 7f0196fa5700 1 Processor -- start 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.790+0000 7f0196fa5700 1 -- start start 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.790+0000 7f0196fa5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.790+0000 7f0196fa5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019019c7d0 con 0x7f019007be40 2023-10-05T15:26:14.387 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.791+0000 7f0194d41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.791+0000 7f0194d41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019019c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50252/0 (socket says 172.21.15.17:50252) 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.791+0000 7f0194d41700 1 -- 172.21.15.17:0/2498994660 learned_addr learned my addr 172.21.15.17:0/2498994660 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.791+0000 7f0194d41700 1 -- 172.21.15.17:0/2498994660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184009550 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.791+0000 7f0194d41700 1 --2- 172.21.15.17:0/2498994660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019019c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0184011dc0 tx=0x7f0184011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01840037d0 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f018401b440 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019019c9d0 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f018401a560 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019019cdf0 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f018401ab20 con 0x7f019007be40 2023-10-05T15:26:14.388 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.792+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0184019730 con 0x7f019007be40 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.793+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01900624e0 con 0x7f019007be40 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.797+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0184029060 con 0x7f019007be40 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.875+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f019010cb50 con 0x7f019007be40 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.875+0000 7f018dffb700 1 -- 172.21.15.17:0/2498994660 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f018401f070 con 0x7f019007be40 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.876+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 msgr2=0x7f019019c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.876+0000 7f0196fa5700 1 --2- 172.21.15.17:0/2498994660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019019c290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0184011dc0 tx=0x7f0184011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.877+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 shutdown_connections 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.877+0000 7f0196fa5700 1 --2- 172.21.15.17:0/2498994660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be40 0x7f019019c290 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.877+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 >> 172.21.15.17:0/2498994660 conn(0x7f0190101b30 msgr2=0x7f0190102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.877+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 shutdown_connections 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:13.877+0000 7f0196fa5700 1 -- 172.21.15.17:0/2498994660 wait complete. 2023-10-05T15:26:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2023-10-05T15:26:14.618 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:14.315+0000 7f213f344200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:26:14.618 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:14.493+0000 7f213f344200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:26:14.618 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:14.615+0000 7f213f344200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:26:14.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:14.745+0000 7f213f344200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:26:15.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:15 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:15.313+0000 7f213f344200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:26:16.687 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:16.246+0000 7f213f344200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:26:16.687 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:16.357+0000 7f213f344200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:26:17.393 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:17 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/199803896' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:26:17.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:17.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:26:17.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:26:17.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:26:17.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:26:17.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:26:17.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:26:17.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:26:17.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:26:17.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:26:17.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:26:04.208701+0000", 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:26:17.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.956+0000 7f78ac4fe700 1 Processor -- start 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.956+0000 7f78ac4fe700 1 -- start start 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.957+0000 7f78ac4fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.957+0000 7f78ac4fe700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a407a890 con 0x7f78a407be60 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.957+0000 7f78aa29a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.957+0000 7f78aa29a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47062/0 (socket says 172.21.15.17:47062) 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.957+0000 7f78aa29a700 1 -- 172.21.15.17:0/4223240177 learned_addr learned my addr 172.21.15.17:0/4223240177 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.958+0000 7f78aa29a700 1 -- 172.21.15.17:0/4223240177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a407a9d0 con 0x7f78a407be60 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.958+0000 7f78aa29a700 1 --2- 172.21.15.17:0/4223240177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a407a2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78a00098a0 tx=0x7f78a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b070cad43867df74 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.958+0000 7f78a9298700 1 -- 172.21.15.17:0/4223240177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78a0004160 con 0x7f78a407be60 2023-10-05T15:26:17.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.958+0000 7f78a9298700 1 -- 172.21.15.17:0/4223240177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f78a00042c0 con 0x7f78a407be60 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.958+0000 7f78a9298700 1 -- 172.21.15.17:0/4223240177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78a0011940 con 0x7f78a407be60 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 -- 172.21.15.17:0/4223240177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 msgr2=0x7f78a407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 --2- 172.21.15.17:0/4223240177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a407a2c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f78a00098a0 tx=0x7f78a0009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 -- 172.21.15.17:0/4223240177 shutdown_connections 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 --2- 172.21.15.17:0/4223240177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a407a2c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 -- 172.21.15.17:0/4223240177 >> 172.21.15.17:0/4223240177 conn(0x7f78a4101b30 msgr2=0x7f78a4103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 -- 172.21.15.17:0/4223240177 shutdown_connections 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.959+0000 7f78ac4fe700 1 -- 172.21.15.17:0/4223240177 wait complete. 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.961+0000 7f78ac4fe700 1 Processor -- start 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.961+0000 7f78ac4fe700 1 -- start start 2023-10-05T15:26:17.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.961+0000 7f78ac4fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.961+0000 7f78ac4fe700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a419c7d0 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.961+0000 7f78aa29a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f78aa29a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a419c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47068/0 (socket says 172.21.15.17:47068) 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f78aa29a700 1 -- 172.21.15.17:0/199803896 learned_addr learned my addr 172.21.15.17:0/199803896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f78aa29a700 1 -- 172.21.15.17:0/199803896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0009550 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f78aa29a700 1 --2- 172.21.15.17:0/199803896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a419c290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f78a0011dc0 tx=0x7f78a0011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78a00037d0 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a419c9d0 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f78a001b440 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.962+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78a001a560 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.963+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a419cdf0 con 0x7f78a407be60 2023-10-05T15:26:17.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.963+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78a001ab20 con 0x7f78a407be60 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.963+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f78a0019730 con 0x7f78a407be60 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.964+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a410c920 con 0x7f78a407be60 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:16.966+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f78a0029060 con 0x7f78a407be60 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.045+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f78a419fa20 con 0x7f78a407be60 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.045+0000 7f789b7fe700 1 -- 172.21.15.17:0/199803896 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f78a001f070 con 0x7f78a407be60 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.046+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 msgr2=0x7f78a419c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.046+0000 7f78ac4fe700 1 --2- 172.21.15.17:0/199803896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a419c290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f78a0011dc0 tx=0x7f78a0011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.047+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 shutdown_connections 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.047+0000 7f78ac4fe700 1 --2- 172.21.15.17:0/199803896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78a407be60 0x7f78a419c290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.047+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 >> 172.21.15.17:0/199803896 conn(0x7f78a4101b30 msgr2=0x7f78a4102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:17.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.047+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 shutdown_connections 2023-10-05T15:26:17.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:17.047+0000 7f78ac4fe700 1 -- 172.21.15.17:0/199803896 wait complete. 2023-10-05T15:26:17.476 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2023-10-05T15:26:17.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:17.390+0000 7f213f344200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:26:17.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:17.519+0000 7f213f344200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:26:18.135 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:17.753+0000 7f213f344200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:26:18.440 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:18.132+0000 7f213f344200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:26:18.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:18.437+0000 7f213f344200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:26:18.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:18.643+0000 7f213f344200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:26:19.446 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:19.002+0000 7f213f344200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:26:20.444 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:20.002+0000 7f213f344200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:26:20.445 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:20.184+0000 7f213f344200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:26:20.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:20.441+0000 7f213f344200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:26:20.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:20.594+0000 7f213f344200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:26:21.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:20.882+0000 7f213f344200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:26:22.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:21.998+0000 7f213f344200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:26:22.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: Activating manager daemon x 2023-10-05T15:26:22.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: mgrmap e2: x(active, starting, since 0.00380842s) 2023-10-05T15:26:22.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:26:22.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:26:22.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:26:22.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:26:22.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:26:22.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:22 smithi017 ceph-mon[129107]: Manager daemon x is now available 2023-10-05T15:26:23.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:23 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:26:23.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:23 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' 2023-10-05T15:26:23.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:23 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:26:23.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:23 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' 2023-10-05T15:26:23.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:23 smithi017 ceph-mon[129107]: from='mgr.14100 172.21.15.17:0/2797945061' entity='mgr.x' 2023-10-05T15:26:23.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:23 smithi017 ceph-mon[129107]: mgrmap e3: x(active, since 1.00968s) 2023-10-05T15:26:25.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:25 smithi017 ceph-mon[129107]: mgrmap e4: x(active, since 2s) 2023-10-05T15:26:26.674 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:26.675 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:26:26.675 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:26:26.675 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2023-10-05T15:26:26.675 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-05T15:26:26.675 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-05T15:26:26.676 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-05T15:26:26.676 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.676 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-05T15:26:26.676 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-05T15:26:26.676 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-05T15:26:26.677 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.678 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-05T15:26:26.678 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:26.678 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-05T15:26:26.678 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-05T15:26:26.678 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-05T15:26:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-05T15:26:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-05T15:26:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-05T15:26:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-05T15:26:26.688 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-05T15:26:26.689 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:26:26.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2023-10-05T15:26:04.208701+0000", 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.931+0000 7f62d0d8d700 1 Processor -- start 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.932+0000 7f62d0d8d700 1 -- start start 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.932+0000 7f62d0d8d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.932+0000 7f62d0d8d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc07a890 con 0x7f62cc07be60 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.932+0000 7f62ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:26.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.932+0000 7f62ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33428/0 (socket says 172.21.15.17:33428) 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.932+0000 7f62ca59c700 1 -- 172.21.15.17:0/1674182157 learned_addr learned my addr 172.21.15.17:0/1674182157 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.933+0000 7f62ca59c700 1 -- 172.21.15.17:0/1674182157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc07a9d0 con 0x7f62cc07be60 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.933+0000 7f62ca59c700 1 --2- 172.21.15.17:0/1674182157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc07a2c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0098a0 tx=0x7f62bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9ff2a13d669257 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.933+0000 7f62c959a700 1 -- 172.21.15.17:0/1674182157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62bc004160 con 0x7f62cc07be60 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.933+0000 7f62c959a700 1 -- 172.21.15.17:0/1674182157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f62bc0042c0 con 0x7f62cc07be60 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.933+0000 7f62c959a700 1 -- 172.21.15.17:0/1674182157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62bc011940 con 0x7f62cc07be60 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1674182157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 msgr2=0x7f62cc07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 --2- 172.21.15.17:0/1674182157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc07a2c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0098a0 tx=0x7f62bc009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1674182157 shutdown_connections 2023-10-05T15:26:26.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 --2- 172.21.15.17:0/1674182157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc07a2c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1674182157 >> 172.21.15.17:0/1674182157 conn(0x7f62cc101b30 msgr2=0x7f62cc103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1674182157 shutdown_connections 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.934+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1674182157 wait complete. 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.935+0000 7f62d0d8d700 1 Processor -- start 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.935+0000 7f62d0d8d700 1 -- start start 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.935+0000 7f62d0d8d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.935+0000 7f62d0d8d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc19c7d0 con 0x7f62cc07be60 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33436/0 (socket says 172.21.15.17:33436) 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62ca59c700 1 -- 172.21.15.17:0/1101730292 learned_addr learned my addr 172.21.15.17:0/1101730292 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62ca59c700 1 -- 172.21.15.17:0/1101730292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009550 con 0x7f62cc07be60 2023-10-05T15:26:26.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62ca59c700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc19c290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62bc011dc0 tx=0x7f62bc011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62bc0037d0 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.936+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc19c9d0 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.937+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f62bc01b440 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.937+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62bc01a560 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.937+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc19cdf0 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.938+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f62bc01b5b0 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.938+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc0624e0 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.938+0000 7f62bb7fe700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f62b4038890 0x7f62b403ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.938+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f62bc04c710 con 0x7f62cc07be60 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.939+0000 7f62c9d9b700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f62b4038890 0x7f62b403ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:26.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.939+0000 7f62c9d9b700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f62b4038890 0x7f62b403ad50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62c0006fd0 tx=0x7f62c0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:25.944+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62bc023590 con 0x7f62cc07be60 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.235+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f62cc10c920 con 0x7f62cc07be60 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.236+0000 7f62bb7fe700 1 -- 172.21.15.17:0/1101730292 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f62bc01f090 con 0x7f62cc07be60 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f62b4038890 msgr2=0x7f62b403ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f62b4038890 0x7f62b403ad50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62c0006fd0 tx=0x7f62c0006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 msgr2=0x7f62cc19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc19c290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f62bc011dc0 tx=0x7f62bc011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 shutdown_connections 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f62b4038890 0x7f62b403ad50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 --2- 172.21.15.17:0/1101730292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62cc07be60 0x7f62cc19c290 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 >> 172.21.15.17:0/1101730292 conn(0x7f62cc101b30 msgr2=0x7f62cc102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:26.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 shutdown_connections 2023-10-05T15:26:26.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:26.238+0000 7f62d0d8d700 1 -- 172.21.15.17:0/1101730292 wait complete. 2023-10-05T15:26:26.696 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2023-10-05T15:26:26.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:26 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1101730292' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-05T15:26:27.945 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:27 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3266867466' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-05T15:26:27.964 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.253+0000 7f519306f700 1 Processor -- start 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.253+0000 7f519306f700 1 -- start start 2023-10-05T15:26:27.965 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.254+0000 7f519306f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c07a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.254+0000 7f519306f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c07a8d0 con 0x7f518c07bea0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.254+0000 7f5190e0b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c07a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.254+0000 7f5190e0b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c07a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33444/0 (socket says 172.21.15.17:33444) 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.254+0000 7f5190e0b700 1 -- 172.21.15.17:0/140622742 learned_addr learned my addr 172.21.15.17:0/140622742 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.254+0000 7f5190e0b700 1 -- 172.21.15.17:0/140622742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c07aa10 con 0x7f518c07bea0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.255+0000 7f5190e0b700 1 --2- 172.21.15.17:0/140622742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c07a300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51800098a0 tx=0x7f5180009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33481037b3221017 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.255+0000 7f518b7fe700 1 -- 172.21.15.17:0/140622742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5180004160 con 0x7f518c07bea0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.255+0000 7f518b7fe700 1 -- 172.21.15.17:0/140622742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f51800042c0 con 0x7f518c07bea0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.255+0000 7f518b7fe700 1 -- 172.21.15.17:0/140622742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5180011940 con 0x7f518c07bea0 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 -- 172.21.15.17:0/140622742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 msgr2=0x7f518c07a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:27.966 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 --2- 172.21.15.17:0/140622742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c07a300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f51800098a0 tx=0x7f5180009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 -- 172.21.15.17:0/140622742 shutdown_connections 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 --2- 172.21.15.17:0/140622742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c07a300 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 -- 172.21.15.17:0/140622742 >> 172.21.15.17:0/140622742 conn(0x7f518c101b30 msgr2=0x7f518c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 -- 172.21.15.17:0/140622742 shutdown_connections 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.256+0000 7f519306f700 1 -- 172.21.15.17:0/140622742 wait complete. 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.257+0000 7f519306f700 1 Processor -- start 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.257+0000 7f519306f700 1 -- start start 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.257+0000 7f519306f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.257+0000 7f519306f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c19c800 con 0x7f518c07bea0 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5190e0b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5190e0b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c19c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33452/0 (socket says 172.21.15.17:33452) 2023-10-05T15:26:27.967 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5190e0b700 1 -- 172.21.15.17:0/3266867466 learned_addr learned my addr 172.21.15.17:0/3266867466 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5190e0b700 1 -- 172.21.15.17:0/3266867466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180009550 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5190e0b700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c19c2c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5180006af0 tx=0x7f5180011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5180003bf0 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f518001b8b0 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51800198b0 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.258+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c19ca00 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.259+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c19ce20 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.260+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f518001ba20 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.260+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c0624e0 con 0x7f518c07bea0 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.260+0000 7f5189ffb700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f517c038840 0x7f517c03ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:27.968 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.260+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f518004caf0 con 0x7f518c07bea0 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.260+0000 7f518bfff700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f517c038840 0x7f517c03ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.261+0000 7f518bfff700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f517c038840 0x7f517c03ad00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5178006fd0 tx=0x7f5178006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.265+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5180018530 con 0x7f518c07bea0 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.474+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f518c10c8e0 con 0x7f518c07bea0 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.475+0000 7f5189ffb700 1 -- 172.21.15.17:0/3266867466 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f518001f250 con 0x7f518c07bea0 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f517c038840 msgr2=0x7f517c03ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f517c038840 0x7f517c03ad00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5178006fd0 tx=0x7f5178006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 msgr2=0x7f518c19c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c19c2c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5180006af0 tx=0x7f5180011a30 comp rx=0 tx=0).stop 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 shutdown_connections 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f517c038840 0x7f517c03ad00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:27.969 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 --2- 172.21.15.17:0/3266867466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f518c07bea0 0x7f518c19c2c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:27.970 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.477+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 >> 172.21.15.17:0/3266867466 conn(0x7f518c101b30 msgr2=0x7f518c102850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:27.970 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.478+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 shutdown_connections 2023-10-05T15:26:27.970 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:27.478+0000 7f519306f700 1 -- 172.21.15.17:0/3266867466 wait complete. 2023-10-05T15:26:27.970 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2023-10-05T15:26:29.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:28 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/269294992' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-05T15:26:29.129 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: ignoring --setuser ceph since I am not root 2023-10-05T15:26:29.129 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: ignoring --setgroup ceph since I am not root 2023-10-05T15:26:29.129 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:29.125+0000 7f13af0d5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:26:29.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.521+0000 7fdc0d4ba700 1 Processor -- start 2023-10-05T15:26:29.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.521+0000 7fdc0d4ba700 1 -- start start 2023-10-05T15:26:29.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.521+0000 7fdc0d4ba700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0807a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:29.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.521+0000 7fdc0d4ba700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0807a890 con 0x7fdc0807be60 2023-10-05T15:26:29.349 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.521+0000 7fdc06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0807a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:29.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.522+0000 7fdc06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0807a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33462/0 (socket says 172.21.15.17:33462) 2023-10-05T15:26:29.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.522+0000 7fdc06ffd700 1 -- 172.21.15.17:0/2782518902 learned_addr learned my addr 172.21.15.17:0/2782518902 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:29.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.522+0000 7fdc06ffd700 1 -- 172.21.15.17:0/2782518902 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0807a9d0 con 0x7fdc0807be60 2023-10-05T15:26:29.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.522+0000 7fdc06ffd700 1 --2- 172.21.15.17:0/2782518902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0807a2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80098a0 tx=0x7fdbf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c879b6a23bbd1cc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:29.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.522+0000 7fdc05ffb700 1 -- 172.21.15.17:0/2782518902 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdbf8004160 con 0x7fdc0807be60 2023-10-05T15:26:29.350 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc05ffb700 1 -- 172.21.15.17:0/2782518902 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fdbf80042c0 con 0x7fdc0807be60 2023-10-05T15:26:29.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc05ffb700 1 -- 172.21.15.17:0/2782518902 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdbf8011940 con 0x7fdc0807be60 2023-10-05T15:26:29.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/2782518902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 msgr2=0x7fdc0807a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:29.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 --2- 172.21.15.17:0/2782518902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0807a2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80098a0 tx=0x7fdbf8009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/2782518902 shutdown_connections 2023-10-05T15:26:29.351 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 --2- 172.21.15.17:0/2782518902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0807a2c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.352 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/2782518902 >> 172.21.15.17:0/2782518902 conn(0x7fdc08101b00 msgr2=0x7fdc08103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:29.352 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/2782518902 shutdown_connections 2023-10-05T15:26:29.352 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.523+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/2782518902 wait complete. 2023-10-05T15:26:29.352 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.525+0000 7fdc0d4ba700 1 Processor -- start 2023-10-05T15:26:29.353 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.525+0000 7fdc0d4ba700 1 -- start start 2023-10-05T15:26:29.353 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.525+0000 7fdc0d4ba700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:29.353 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.525+0000 7fdc0d4ba700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0819c770 con 0x7fdc0807be60 2023-10-05T15:26:29.353 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.526+0000 7fdc06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:29.353 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.526+0000 7fdc06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33466/0 (socket says 172.21.15.17:33466) 2023-10-05T15:26:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.526+0000 7fdc06ffd700 1 -- 172.21.15.17:0/269294992 learned_addr learned my addr 172.21.15.17:0/269294992 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.526+0000 7fdc06ffd700 1 -- 172.21.15.17:0/269294992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8009550 con 0x7fdc0807be60 2023-10-05T15:26:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.526+0000 7fdc06ffd700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0819c230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8011dc0 tx=0x7fdbf8011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.526+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdbf80037d0 con 0x7fdc0807be60 2023-10-05T15:26:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.527+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fdbf801b440 con 0x7fdc0807be60 2023-10-05T15:26:29.354 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.527+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0819c970 con 0x7fdc0807be60 2023-10-05T15:26:29.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.527+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdbf801a560 con 0x7fdc0807be60 2023-10-05T15:26:29.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.527+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0819cd90 con 0x7fdc0807be60 2023-10-05T15:26:29.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.528+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc080624e0 con 0x7fdc0807be60 2023-10-05T15:26:29.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.528+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7fdbf801b5b0 con 0x7fdc0807be60 2023-10-05T15:26:29.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.528+0000 7fdbeffff700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7fdbf00388e0 0x7fdbf003ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:29.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.528+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdbf804c6c0 con 0x7fdc0807be60 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.529+0000 7fdc067fc700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7fdbf00388e0 0x7fdbf003ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.529+0000 7fdc067fc700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7fdbf00388e0 0x7fdbf003ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc006fd0 tx=0x7fdbfc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.533+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdbf8023590 con 0x7fdc0807be60 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.799+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fdc0810c910 con 0x7fdc0807be60 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.851+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fdbf801f070 con 0x7fdc0807be60 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.853+0000 7fdbeffff700 1 -- 172.21.15.17:0/269294992 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fdbf801b920 con 0x7fdc0807be60 2023-10-05T15:26:29.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7fdbf00388e0 msgr2=0x7fdbf003ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:29.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7fdbf00388e0 0x7fdbf003ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc006fd0 tx=0x7fdbfc006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:29.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 msgr2=0x7fdc0819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:29.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0819c230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8011dc0 tx=0x7fdbf8011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 shutdown_connections 2023-10-05T15:26:29.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7fdbf00388e0 0x7fdbf003ada0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 --2- 172.21.15.17:0/269294992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc0807be60 0x7fdc0819c230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:29.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 >> 172.21.15.17:0/269294992 conn(0x7fdc08101b00 msgr2=0x7fdc08102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:29.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 shutdown_connections 2023-10-05T15:26:29.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:28.855+0000 7fdc0d4ba700 1 -- 172.21.15.17:0/269294992 wait complete. 2023-10-05T15:26:29.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:29.234+0000 7f13af0d5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:26:29.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:29.359+0000 7f13af0d5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:26:29.859 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:29.489+0000 7f13af0d5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:26:29.859 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:29.730+0000 7f13af0d5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:26:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/269294992' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-05T15:26:30.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:29 smithi017 ceph-mon[129107]: mgrmap e5: x(active, since 6s) 2023-10-05T15:26:30.526 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:30 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:30.217+0000 7f13af0d5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:26:30.526 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:30 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:30.401+0000 7f13af0d5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:26:30.526 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:30 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:30.523+0000 7f13af0d5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:26:30.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:26:30.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-05T15:26:30.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-05T15:26:30.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-05T15:26:30.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-05T15:26:30.631 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.918+0000 7feba27e7700 1 Processor -- start 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.918+0000 7feba27e7700 1 -- start start 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.918+0000 7feba27e7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c07a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.918+0000 7feba27e7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c07a890 con 0x7feb9c07be60 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.919+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c07a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.919+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c07a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33500/0 (socket says 172.21.15.17:33500) 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.919+0000 7feb9bfff700 1 -- 172.21.15.17:0/949594831 learned_addr learned my addr 172.21.15.17:0/949594831 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.919+0000 7feb9bfff700 1 -- 172.21.15.17:0/949594831 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c07a9d0 con 0x7feb9c07be60 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.919+0000 7feb9bfff700 1 --2- 172.21.15.17:0/949594831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c07a2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098a0 tx=0x7feb8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29268d269f9bef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feb9affd700 1 -- 172.21.15.17:0/949594831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c004160 con 0x7feb9c07be60 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feb9affd700 1 -- 172.21.15.17:0/949594831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7feb8c0042c0 con 0x7feb9c07be60 2023-10-05T15:26:30.632 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feb9affd700 1 -- 172.21.15.17:0/949594831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c011940 con 0x7feb9c07be60 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 -- 172.21.15.17:0/949594831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 msgr2=0x7feb9c07a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 --2- 172.21.15.17:0/949594831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c07a2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0098a0 tx=0x7feb8c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 -- 172.21.15.17:0/949594831 shutdown_connections 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 --2- 172.21.15.17:0/949594831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c07a2c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 -- 172.21.15.17:0/949594831 >> 172.21.15.17:0/949594831 conn(0x7feb9c101b30 msgr2=0x7feb9c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 -- 172.21.15.17:0/949594831 shutdown_connections 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.920+0000 7feba27e7700 1 -- 172.21.15.17:0/949594831 wait complete. 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.921+0000 7feba27e7700 1 Processor -- start 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.922+0000 7feba27e7700 1 -- start start 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.922+0000 7feba27e7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.922+0000 7feba27e7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c19c7d0 con 0x7feb9c07be60 2023-10-05T15:26:30.633 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.922+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.922+0000 7feb9bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33504/0 (socket says 172.21.15.17:33504) 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.922+0000 7feb9bfff700 1 -- 172.21.15.17:0/1237256136 learned_addr learned my addr 172.21.15.17:0/1237256136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feb9bfff700 1 -- 172.21.15.17:0/1237256136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009550 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feb9bfff700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c19c290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb8c011dc0 tx=0x7feb8c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c0037d0 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c19c9d0 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7feb8c01b440 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb8c01a560 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.923+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c19cdf0 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.924+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c10c920 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.925+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7feb8c003930 con 0x7feb9c07be60 2023-10-05T15:26:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.925+0000 7feb997fa700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 0x7feb8403ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.925+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feb8c04c760 con 0x7feb9c07be60 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.925+0000 7feb9b7fe700 1 -- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 msgr2=0x7feb8403ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.925+0000 7feb9b7fe700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 0x7feb8403ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:29.930+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feb8c01b5b0 con 0x7feb9c07be60 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.126+0000 7feb9b7fe700 1 -- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 msgr2=0x7feb8403ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.126+0000 7feb9b7fe700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 0x7feb8403ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.200+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7feb9c19f830 con 0x7feb9c07be60 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.200+0000 7feb997fa700 1 -- 172.21.15.17:0/1237256136 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7feb8c01f020 con 0x7feb9c07be60 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.202+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 msgr2=0x7feb8403ada0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.202+0000 7feba27e7700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 0x7feb8403ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.202+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 msgr2=0x7feb9c19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:30.635 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.202+0000 7feba27e7700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c19c290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feb8c011dc0 tx=0x7feb8c011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.203+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 shutdown_connections 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.203+0000 7feba27e7700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7feb840388e0 0x7feb8403ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.203+0000 7feba27e7700 1 --2- 172.21.15.17:0/1237256136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb9c07be60 0x7feb9c19c290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.203+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 >> 172.21.15.17:0/1237256136 conn(0x7feb9c101b30 msgr2=0x7feb9c102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.203+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 shutdown_connections 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:30.203+0000 7feba27e7700 1 -- 172.21.15.17:0/1237256136 wait complete. 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2023-10-05T15:26:30.636 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2023-10-05T15:26:30.860 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:30 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:30.656+0000 7f13af0d5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:26:31.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:30 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1237256136' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-05T15:26:31.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:31 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:31.236+0000 7f13af0d5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:26:32.449 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:32 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:32.112+0000 7f13af0d5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:26:32.449 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:32 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:32.221+0000 7f13af0d5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:26:33.575 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:33.215+0000 7f13af0d5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:26:33.575 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:33.340+0000 7f13af0d5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:26:33.575 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:33.571+0000 7f13af0d5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:26:34.232 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:33.947+0000 7f13af0d5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:26:34.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:34 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:34.229+0000 7f13af0d5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:26:34.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:34 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:34.430+0000 7f13af0d5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:26:35.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:34 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:34.785+0000 7f13af0d5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:26:36.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:35 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:35.757+0000 7f13af0d5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:26:36.197 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:35 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:35.938+0000 7f13af0d5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:26:36.635 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:36 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:36.195+0000 7f13af0d5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:26:36.635 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:36 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:36.346+0000 7f13af0d5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:26:36.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:36 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:36.632+0000 7f13af0d5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:26:38.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:37.739+0000 7f13af0d5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: Active manager daemon x restarted 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: Activating manager daemon x 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: osdmap e2: 0 total, 0 up, 0 in 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: mgrmap e6: x(active, starting, since 0.00403525s) 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:26:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:26:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:26:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: Manager daemon x is now available 2023-10-05T15:26:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:37 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:39.176 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: Found migration_current of "None". Setting to last migration. 2023-10-05T15:26:39.176 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:39.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:26:39.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:26:39.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:39.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:39.177 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:38 smithi017 ceph-mon[129107]: mgrmap e7: x(active, since 1.00727s) 2023-10-05T15:26:39.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:26:39.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-05T15:26:39.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-05T15:26:39.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.172+0000 7f28abdfa700 1 Processor -- start 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.173+0000 7f28abdfa700 1 -- start start 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.173+0000 7f28abdfa700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a41093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.173+0000 7f28abdfa700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4079e90 con 0x7f28a4106ff0 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.173+0000 7f28a9b96700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a41093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.174+0000 7f28a9b96700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a41093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33512/0 (socket says 172.21.15.17:33512) 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.174+0000 7f28a9b96700 1 -- 172.21.15.17:0/1916784382 learned_addr learned my addr 172.21.15.17:0/1916784382 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.174+0000 7f28a9b96700 1 -- 172.21.15.17:0/1916784382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4109920 con 0x7f28a4106ff0 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.174+0000 7f28a9b96700 1 --2- 172.21.15.17:0/1916784382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a41093e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28a00098a0 tx=0x7f28a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3745e78e3fb396b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.174+0000 7f28a8b94700 1 -- 172.21.15.17:0/1916784382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28a0004160 con 0x7f28a4106ff0 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28a8b94700 1 -- 172.21.15.17:0/1916784382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f28a00042c0 con 0x7f28a4106ff0 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28a8b94700 1 -- 172.21.15.17:0/1916784382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28a0011940 con 0x7f28a4106ff0 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 -- 172.21.15.17:0/1916784382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 msgr2=0x7f28a41093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 --2- 172.21.15.17:0/1916784382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a41093e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28a00098a0 tx=0x7f28a0009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 -- 172.21.15.17:0/1916784382 shutdown_connections 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 --2- 172.21.15.17:0/1916784382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a41093e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 -- 172.21.15.17:0/1916784382 >> 172.21.15.17:0/1916784382 conn(0x7f28a4100a20 msgr2=0x7f28a4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 -- 172.21.15.17:0/1916784382 shutdown_connections 2023-10-05T15:26:39.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.175+0000 7f28abdfa700 1 -- 172.21.15.17:0/1916784382 wait complete. 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.176+0000 7f28abdfa700 1 Processor -- start 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.177+0000 7f28abdfa700 1 -- start start 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.177+0000 7f28abdfa700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.177+0000 7f28abdfa700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a419a5d0 con 0x7f28a4106ff0 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.177+0000 7f28a9b96700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.177+0000 7f28a9b96700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a419a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33522/0 (socket says 172.21.15.17:33522) 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.177+0000 7f28a9b96700 1 -- 172.21.15.17:0/2684956712 learned_addr learned my addr 172.21.15.17:0/2684956712 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f28a9b96700 1 -- 172.21.15.17:0/2684956712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0009550 con 0x7f28a4106ff0 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f28a9b96700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a419a090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f28a0011dc0 tx=0x7f28a0011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:39.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28a00037d0 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f28a001b440 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a419a7d0 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28a001a560 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.178+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a419abf0 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.179+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f28a001b5b0 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.180+0000 7f289affd700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.180+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 --> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f289003b4b0 con 0x7f28900388e0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.180+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f28a004c740 con 0x7f28a4106ff0 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.180+0000 7f28a9395700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:39.234 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.180+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.381+0000 7f28a9395700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.381+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.782+0000 7f28a9395700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:31.782+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:32.583+0000 7f28a9395700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:32.583+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:34.185+0000 7f28a9395700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:34.185+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-05T15:26:39.235 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:37.388+0000 7f28a9395700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3129756101 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:37.388+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:37.744+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) v1 ==== 45346+0+0 (secure 0 0 0) 0x7f28a001b920 con 0x7f28a4106ff0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:37.744+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 msgr2=0x7f289003ada0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:37.744+0000 7f289affd700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.746+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f28a0021da0 con 0x7f28a4106ff0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.746+0000 7f289affd700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f289003bff0 0x7f289003e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.746+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f289003b4b0 con 0x7f289003bff0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.747+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f289003bff0 0x7f289003e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.748+0000 7f28a9395700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f289003bff0 0x7f289003e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2894003a10 tx=0x7f2894009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.749+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f289003b4b0 con 0x7f289003bff0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.755+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f28a419b3d0 con 0x7f289003bff0 2023-10-05T15:26:39.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.755+0000 7f289affd700 1 -- 172.21.15.17:0/2684956712 <== mgr.14118 v2:172.21.15.17:6800/2369336529 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f28a419b3d0 con 0x7f289003bff0 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f289003bff0 msgr2=0x7f289003e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f289003bff0 0x7f289003e3e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2894003a10 tx=0x7f2894009290 comp rx=0 tx=0).stop 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 msgr2=0x7f28a419a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a419a090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f28a0011dc0 tx=0x7f28a0011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 shutdown_connections 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28a4106ff0 0x7f28a419a090 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f289003bff0 0x7f289003e3e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 --2- 172.21.15.17:0/2684956712 >> [v2:172.21.15.17:6800/3129756101,v1:172.21.15.17:6801/3129756101] conn(0x7f28900388e0 0x7f289003ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:39.237 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 >> 172.21.15.17:0/2684956712 conn(0x7f28a4100a20 msgr2=0x7f28a4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:39.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 shutdown_connections 2023-10-05T15:26:39.238 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:38.756+0000 7f28abdfa700 1 -- 172.21.15.17:0/2684956712 wait complete. 2023-10-05T15:26:39.238 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2023-10-05T15:26:39.238 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2023-10-05T15:26:40.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:39 smithi017 ceph-mon[129107]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-05T15:26:40.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:39 smithi017 ceph-mon[129107]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.803+0000 7f839a868700 1 Processor -- start 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.804+0000 7f839a868700 1 -- start start 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.804+0000 7f839a868700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f8394108ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.804+0000 7f839a868700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394109170 con 0x7f8394108780 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.804+0000 7f8393fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f8394108ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.805+0000 7f8393fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f8394108ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46126/0 (socket says 172.21.15.17:46126) 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.805+0000 7f8393fff700 1 -- 172.21.15.17:0/1303256522 learned_addr learned my addr 172.21.15.17:0/1303256522 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:40.418 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.805+0000 7f8393fff700 1 -- 172.21.15.17:0/1303256522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394109980 con 0x7f8394108780 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.805+0000 7f8393fff700 1 --2- 172.21.15.17:0/1303256522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f8394108ba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83840098a0 tx=0x7f8384009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef718dea52b2521 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.805+0000 7f8392ffd700 1 -- 172.21.15.17:0/1303256522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8384004160 con 0x7f8394108780 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.805+0000 7f8392ffd700 1 -- 172.21.15.17:0/1303256522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f83840042c0 con 0x7f8394108780 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f8392ffd700 1 -- 172.21.15.17:0/1303256522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8384011940 con 0x7f8394108780 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 -- 172.21.15.17:0/1303256522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 msgr2=0x7f8394108ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 --2- 172.21.15.17:0/1303256522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f8394108ba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83840098a0 tx=0x7f8384009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 -- 172.21.15.17:0/1303256522 shutdown_connections 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 --2- 172.21.15.17:0/1303256522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f8394108ba0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 -- 172.21.15.17:0/1303256522 >> 172.21.15.17:0/1303256522 conn(0x7f839407bb50 msgr2=0x7f83941064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 -- 172.21.15.17:0/1303256522 shutdown_connections 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.806+0000 7f839a868700 1 -- 172.21.15.17:0/1303256522 wait complete. 2023-10-05T15:26:40.419 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.807+0000 7f839a868700 1 Processor -- start 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f839a868700 1 -- start start 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f839a868700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f839419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f839a868700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839419c830 con 0x7f8394108780 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f8393fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f839419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f8393fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f839419c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46140/0 (socket says 172.21.15.17:46140) 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f8393fff700 1 -- 172.21.15.17:0/3500642954 learned_addr learned my addr 172.21.15.17:0/3500642954 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.808+0000 7f8393fff700 1 -- 172.21.15.17:0/3500642954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384009550 con 0x7f8394108780 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.809+0000 7f8393fff700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f839419c2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8384006af0 tx=0x7f8384011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.809+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8384003bf0 con 0x7f8394108780 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.809+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f838401b8b0 con 0x7f8394108780 2023-10-05T15:26:40.420 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.809+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83840197e0 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.809+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839419ca30 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.809+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839419ce50 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.810+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f838401ba20 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.810+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83940624e0 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.811+0000 7f83917fa700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f837c0388e0 0x7f837c03ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.811+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f838404cbb0 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.811+0000 7f83937fe700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f837c0388e0 0x7f837c03ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.811+0000 7f83937fe700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f837c0388e0 0x7f837c03ada0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8388006fd0 tx=0x7f8388006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:39.816+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8384018940 con 0x7f8394108780 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.042+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f83941064c0 con 0x7f837c0388e0 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.049+0000 7f83917fa700 1 -- 172.21.15.17:0/3500642954 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f83941064c0 con 0x7f837c0388e0 2023-10-05T15:26:40.421 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.051+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f837c0388e0 msgr2=0x7f837c03ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.051+0000 7f839a868700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f837c0388e0 0x7f837c03ada0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8388006fd0 tx=0x7f8388006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.051+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 msgr2=0x7f839419c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.051+0000 7f839a868700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f839419c2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8384006af0 tx=0x7f8384011a30 comp rx=0 tx=0).stop 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.052+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 shutdown_connections 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.052+0000 7f839a868700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f837c0388e0 0x7f837c03ada0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.052+0000 7f839a868700 1 --2- 172.21.15.17:0/3500642954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8394108780 0x7f839419c2f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.052+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 >> 172.21.15.17:0/3500642954 conn(0x7f839407bb50 msgr2=0x7f8394105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.052+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 shutdown_connections 2023-10-05T15:26:40.422 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.052+0000 7f839a868700 1 -- 172.21.15.17:0/3500642954 wait complete. 2023-10-05T15:26:41.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: [05/Oct/2023:15:26:39] ENGINE Bus STARTING 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: [05/Oct/2023:15:26:39] ENGINE Serving on https://172.21.15.17:7150 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: [05/Oct/2023:15:26:39] ENGINE Serving on http://172.21.15.17:8765 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: [05/Oct/2023:15:26:39] ENGINE Bus STARTED 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: mgrmap e8: x(active, since 2s) 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:41.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:40 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:41.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-05T15:26:41.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.985+0000 7f8f03c28700 1 Processor -- start 2023-10-05T15:26:41.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.985+0000 7f8f03c28700 1 -- start start 2023-10-05T15:26:41.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.986+0000 7f8f03c28700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc07a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:41.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.986+0000 7f8f03c28700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc07a870 con 0x7f8efc07be40 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.986+0000 7f8f019c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc07a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.986+0000 7f8f019c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc07a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46148/0 (socket says 172.21.15.17:46148) 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.986+0000 7f8f019c4700 1 -- 172.21.15.17:0/41730446 learned_addr learned my addr 172.21.15.17:0/41730446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.986+0000 7f8f019c4700 1 -- 172.21.15.17:0/41730446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc07a9b0 con 0x7f8efc07be40 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.987+0000 7f8f019c4700 1 --2- 172.21.15.17:0/41730446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc07a2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80098a0 tx=0x7f8ef8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6838b764263ee20e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.987+0000 7f8f009c2700 1 -- 172.21.15.17:0/41730446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ef8004160 con 0x7f8efc07be40 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.987+0000 7f8f009c2700 1 -- 172.21.15.17:0/41730446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8ef80042c0 con 0x7f8efc07be40 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.987+0000 7f8f009c2700 1 -- 172.21.15.17:0/41730446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ef8011940 con 0x7f8efc07be40 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 -- 172.21.15.17:0/41730446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 msgr2=0x7f8efc07a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:41.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 --2- 172.21.15.17:0/41730446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc07a2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ef80098a0 tx=0x7f8ef8009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 -- 172.21.15.17:0/41730446 shutdown_connections 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 --2- 172.21.15.17:0/41730446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc07a2a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 -- 172.21.15.17:0/41730446 >> 172.21.15.17:0/41730446 conn(0x7f8efc101b30 msgr2=0x7f8efc103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 -- 172.21.15.17:0/41730446 shutdown_connections 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.988+0000 7f8f03c28700 1 -- 172.21.15.17:0/41730446 wait complete. 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.989+0000 7f8f03c28700 1 Processor -- start 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.989+0000 7f8f03c28700 1 -- start start 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.989+0000 7f8f03c28700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.989+0000 7f8f03c28700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc19c7d0 con 0x7f8efc07be40 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8f019c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8f019c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46164/0 (socket says 172.21.15.17:46164) 2023-10-05T15:26:41.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8f019c4700 1 -- 172.21.15.17:0/3401532055 learned_addr learned my addr 172.21.15.17:0/3401532055 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8f019c4700 1 -- 172.21.15.17:0/3401532055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8009550 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8f019c4700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc19c290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8011dc0 tx=0x7f8ef8011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ef80037d0 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8ef801b440 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ef801a560 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.990+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc19c9d0 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.991+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc19cdf0 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.991+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc10c8e0 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.992+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f8ef801b5b0 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.992+0000 7f8ef2ffd700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f8ee8038930 0x7f8ee803adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.992+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8ef804c810 con 0x7f8efc07be40 2023-10-05T15:26:41.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.992+0000 7f8f011c3700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f8ee8038930 0x7f8ee803adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.993+0000 7f8f011c3700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f8ee8038930 0x7f8ee803adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8eec006fd0 tx=0x7f8eec006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:40.997+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ef8023590 con 0x7f8efc07be40 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.209+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f8efc19f830 con 0x7f8ee8038930 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.210+0000 7f8ef2ffd700 1 -- 172.21.15.17:0/3401532055 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f8efc19f830 con 0x7f8ee8038930 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f8ee8038930 msgr2=0x7f8ee803adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f8ee8038930 0x7f8ee803adf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8eec006fd0 tx=0x7f8eec006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 msgr2=0x7f8efc19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc19c290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8011dc0 tx=0x7f8ef8011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 shutdown_connections 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f8ee8038930 0x7f8ee803adf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 --2- 172.21.15.17:0/3401532055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8efc07be40 0x7f8efc19c290 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:41.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 >> 172.21.15.17:0/3401532055 conn(0x7f8efc101b30 msgr2=0x7f8efc102820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:41.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 shutdown_connections 2023-10-05T15:26:41.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:41.213+0000 7f8f03c28700 1 -- 172.21.15.17:0/3401532055 wait complete. 2023-10-05T15:26:41.602 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2023-10-05T15:26:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:41 smithi017 ceph-mon[129107]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:42.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: Generating public/private rsa key pair. 2023-10-05T15:26:42.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: Your identification has been saved in /tmp/tmprbn0rsl5/key. 2023-10-05T15:26:42.698 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: Your public key has been saved in /tmp/tmprbn0rsl5/key.pub. 2023-10-05T15:26:42.698 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: The key fingerprint is: 2023-10-05T15:26:42.698 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: SHA256:4cSRc5pRBSXZTEvFRx+e7SrMAFq2tAn5g/T48TbOs84 ceph-6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:42.698 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: The key's randomart image is: 2023-10-05T15:26:42.698 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: +---[RSA 3072]----+ 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | .o+O=o.o.| 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | o+.ooo.o *| 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | + O* . +o| 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | . &o* . | 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | + S . .| 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | . + + . | 2023-10-05T15:26:42.699 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | . + + . | 2023-10-05T15:26:42.700 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | =.. . | 2023-10-05T15:26:42.700 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: | .Eo | 2023-10-05T15:26:42.700 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: +----[SHA256]-----+ 2023-10-05T15:26:42.871 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc11444f700 1 Processor -- start 2023-10-05T15:26:42.871 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc11444f700 1 -- start start 2023-10-05T15:26:42.871 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc11444f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c1069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc11444f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c106f80 con 0x7fc10c106590 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc1121eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c1069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc1121eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c1069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46166/0 (socket says 172.21.15.17:46166) 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc1121eb700 1 -- 172.21.15.17:0/4128840995 learned_addr learned my addr 172.21.15.17:0/4128840995 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.120+0000 7fc1121eb700 1 -- 172.21.15.17:0/4128840995 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c107790 con 0x7fc10c106590 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.121+0000 7fc1121eb700 1 --2- 172.21.15.17:0/4128840995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c1069b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1080098a0 tx=0x7fc108009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20359e7dbf9aad1d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.121+0000 7fc1111e9700 1 -- 172.21.15.17:0/4128840995 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc108004160 con 0x7fc10c106590 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.121+0000 7fc1111e9700 1 -- 172.21.15.17:0/4128840995 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc1080042c0 con 0x7fc10c106590 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.121+0000 7fc1111e9700 1 -- 172.21.15.17:0/4128840995 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc108011940 con 0x7fc10c106590 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.121+0000 7fc11444f700 1 -- 172.21.15.17:0/4128840995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 msgr2=0x7fc10c1069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.872 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.121+0000 7fc11444f700 1 --2- 172.21.15.17:0/4128840995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c1069b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1080098a0 tx=0x7fc108009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.122+0000 7fc11444f700 1 -- 172.21.15.17:0/4128840995 shutdown_connections 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.122+0000 7fc11444f700 1 --2- 172.21.15.17:0/4128840995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c1069b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.122+0000 7fc11444f700 1 -- 172.21.15.17:0/4128840995 >> 172.21.15.17:0/4128840995 conn(0x7fc10c101b30 msgr2=0x7fc10c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.122+0000 7fc11444f700 1 -- 172.21.15.17:0/4128840995 shutdown_connections 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.122+0000 7fc11444f700 1 -- 172.21.15.17:0/4128840995 wait complete. 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.123+0000 7fc11444f700 1 Processor -- start 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.123+0000 7fc11444f700 1 -- start start 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.123+0000 7fc11444f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c19c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.123+0000 7fc11444f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c19c810 con 0x7fc10c106590 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.123+0000 7fc1121eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c19c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1121eb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c19c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46170/0 (socket says 172.21.15.17:46170) 2023-10-05T15:26:42.873 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1121eb700 1 -- 172.21.15.17:0/2784460135 learned_addr learned my addr 172.21.15.17:0/2784460135 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1121eb700 1 -- 172.21.15.17:0/2784460135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108009550 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1121eb700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c19c2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc108000c00 tx=0x7fc108011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1080036a0 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc10801b440 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1080193f0 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c19ca10 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.124+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c19ce30 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.125+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fc10801b5b0 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.126+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c0624e0 con 0x7fc10c106590 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.126+0000 7fc1037fe700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fc0f8038930 0x7fc0f803adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:42.874 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.126+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc10804c7a0 con 0x7fc10c106590 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.126+0000 7fc1119ea700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fc0f8038930 0x7fc0f803adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.127+0000 7fc1119ea700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fc0f8038930 0x7fc0f803adf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006fd0 tx=0x7fc0fc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.131+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc108022950 con 0x7fc10c106590 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.339+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc10c102f00 con 0x7fc0f8038930 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.414+0000 7fc1037fe700 1 -- 172.21.15.17:0/2784460135 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc10c102f00 con 0x7fc0f8038930 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fc0f8038930 msgr2=0x7fc0f803adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fc0f8038930 0x7fc0f803adf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006fd0 tx=0x7fc0fc006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 msgr2=0x7fc10c19c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c19c2d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc108000c00 tx=0x7fc108011e70 comp rx=0 tx=0).stop 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 shutdown_connections 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fc0f8038930 0x7fc0f803adf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.875 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 --2- 172.21.15.17:0/2784460135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc10c106590 0x7fc10c19c2d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:42.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 >> 172.21.15.17:0/2784460135 conn(0x7fc10c101b30 msgr2=0x7fc10c1027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:42.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 shutdown_connections 2023-10-05T15:26:42.876 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:42.417+0000 7fc11444f700 1 -- 172.21.15.17:0/2784460135 wait complete. 2023-10-05T15:26:43.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-mon[129107]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:43.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:43.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:42 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:43 smithi017 ceph-mon[129107]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:43 smithi017 ceph-mon[129107]: Generating ssh key... 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.409+0000 7f3fb88e7700 1 Processor -- start 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.409+0000 7f3fb88e7700 1 -- start start 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.411+0000 7f3fb88e7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb407a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.411+0000 7f3fb88e7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb407a8b0 con 0x7f3fb407be80 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.411+0000 7f3fb259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb407a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:44.151 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.411+0000 7f3fb259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb407a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46178/0 (socket says 172.21.15.17:46178) 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.411+0000 7f3fb259c700 1 -- 172.21.15.17:0/2425308175 learned_addr learned my addr 172.21.15.17:0/2425308175 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.412+0000 7f3fb259c700 1 -- 172.21.15.17:0/2425308175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb407a9f0 con 0x7f3fb407be80 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.412+0000 7f3fb259c700 1 --2- 172.21.15.17:0/2425308175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb407a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40098a0 tx=0x7f3fa4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6fdd4a8094dff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.412+0000 7f3fb159a700 1 -- 172.21.15.17:0/2425308175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fa4004160 con 0x7f3fb407be80 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.412+0000 7f3fb159a700 1 -- 172.21.15.17:0/2425308175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3fa40042c0 con 0x7f3fb407be80 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.412+0000 7f3fb159a700 1 -- 172.21.15.17:0/2425308175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fa4011940 con 0x7f3fb407be80 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 -- 172.21.15.17:0/2425308175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 msgr2=0x7f3fb407a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 --2- 172.21.15.17:0/2425308175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb407a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40098a0 tx=0x7f3fa4009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 -- 172.21.15.17:0/2425308175 shutdown_connections 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 --2- 172.21.15.17:0/2425308175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb407a2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:44.152 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 -- 172.21.15.17:0/2425308175 >> 172.21.15.17:0/2425308175 conn(0x7f3fb4101b30 msgr2=0x7f3fb4103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 -- 172.21.15.17:0/2425308175 shutdown_connections 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.413+0000 7f3fb88e7700 1 -- 172.21.15.17:0/2425308175 wait complete. 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.414+0000 7f3fb88e7700 1 Processor -- start 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.414+0000 7f3fb88e7700 1 -- start start 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.414+0000 7f3fb88e7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.414+0000 7f3fb88e7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb419c800 con 0x7f3fb407be80 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fb259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fb259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb419c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46184/0 (socket says 172.21.15.17:46184) 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fb259c700 1 -- 172.21.15.17:0/3885138373 learned_addr learned my addr 172.21.15.17:0/3885138373 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fb259c700 1 -- 172.21.15.17:0/3885138373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4009550 con 0x7f3fb407be80 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fb259c700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb419c2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4000c00 tx=0x7f3fa4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:44.153 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fa40036a0 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3fa401b440 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.415+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3fa40193f0 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.416+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb419ca00 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.416+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb419ce20 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.417+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb40624e0 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.417+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f3fa401b5b0 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.417+0000 7f3fa37fe700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f3f9c038930 0x7f3f9c03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.417+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3fa404c7a0 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.417+0000 7f3fb1d9b700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f3f9c038930 0x7f3f9c03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.418+0000 7f3fb1d9b700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f3f9c038930 0x7f3f9c03adf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8006fd0 tx=0x7f3fa8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.422+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fa4022950 con 0x7f3fb407be80 2023-10-05T15:26:44.154 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.633+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fb4102f90 con 0x7f3f9c038930 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.634+0000 7f3fa37fe700 1 -- 172.21.15.17:0/3885138373 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f3fb4102f90 con 0x7f3f9c038930 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f3f9c038930 msgr2=0x7f3f9c03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f3f9c038930 0x7f3f9c03adf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8006fd0 tx=0x7f3fa8006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 msgr2=0x7f3fb419c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb419c2c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4000c00 tx=0x7f3fa4011e70 comp rx=0 tx=0).stop 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 shutdown_connections 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f3f9c038930 0x7f3f9c03adf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 --2- 172.21.15.17:0/3885138373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb407be80 0x7f3fb419c2c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 >> 172.21.15.17:0/3885138373 conn(0x7f3fb4101b30 msgr2=0x7f3fb4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 shutdown_connections 2023-10-05T15:26:44.155 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:43.637+0000 7f3fb88e7700 1 -- 172.21.15.17:0/3885138373 wait complete. 2023-10-05T15:26:44.156 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:26:44.156 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2023-10-05T15:26:44.156 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2023-10-05T15:26:45.055 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:44 smithi017 ceph-mon[129107]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:45.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:45 smithi017 ceph-mon[129107]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:47.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:46 smithi017 ceph-mon[129107]: Deploying cephadm binary to smithi017 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.722+0000 7f4b0c0c4700 1 Processor -- start 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.722+0000 7f4b0c0c4700 1 -- start start 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.722+0000 7f4b0c0c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.722+0000 7f4b0c0c4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04079e50 con 0x7f4b04107020 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.723+0000 7f4b09e60700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:48.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.723+0000 7f4b09e60700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55670/0 (socket says 172.21.15.17:55670) 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.723+0000 7f4b09e60700 1 -- 172.21.15.17:0/1175907062 learned_addr learned my addr 172.21.15.17:0/1175907062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.723+0000 7f4b09e60700 1 -- 172.21.15.17:0/1175907062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04109950 con 0x7f4b04107020 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.723+0000 7f4b09e60700 1 --2- 172.21.15.17:0/1175907062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04109410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b000098a0 tx=0x7f4b00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77376925d10ab56 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b08e5e700 1 -- 172.21.15.17:0/1175907062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b00004160 con 0x7f4b04107020 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b08e5e700 1 -- 172.21.15.17:0/1175907062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4b000042c0 con 0x7f4b04107020 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b08e5e700 1 -- 172.21.15.17:0/1175907062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b00011940 con 0x7f4b04107020 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/1175907062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 msgr2=0x7f4b04109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b0c0c4700 1 --2- 172.21.15.17:0/1175907062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04109410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b000098a0 tx=0x7f4b00009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/1175907062 shutdown_connections 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b0c0c4700 1 --2- 172.21.15.17:0/1175907062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04109410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/1175907062 >> 172.21.15.17:0/1175907062 conn(0x7f4b041009f0 msgr2=0x7f4b04102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:48.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.724+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/1175907062 shutdown_connections 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.725+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/1175907062 wait complete. 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b0c0c4700 1 Processor -- start 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b0c0c4700 1 -- start start 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b0c0c4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04106980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b0c0c4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04106ec0 con 0x7f4b04107020 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b09e60700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b09e60700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55680/0 (socket says 172.21.15.17:55680) 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.726+0000 7f4b09e60700 1 -- 172.21.15.17:0/4171947139 learned_addr learned my addr 172.21.15.17:0/4171947139 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4b09e60700 1 -- 172.21.15.17:0/4171947139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b00009550 con 0x7f4b04107020 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4b09e60700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04106980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b00011dc0 tx=0x7f4b00011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b000037d0 con 0x7f4b04107020 2023-10-05T15:26:48.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4b0001b440 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b04104fd0 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b0001a560 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.727+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b041053f0 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.728+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04062550 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.728+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f4b0001b5b0 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.729+0000 7f4afaffd700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4af0038930 0x7f4af003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.729+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4b0004c810 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.729+0000 7f4b0965f700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4af0038930 0x7f4af003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.730+0000 7f4b0965f700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4af0038930 0x7f4af003adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4af4006fd0 tx=0x7f4af4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.734+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4b04062550 con 0x7f4b04107020 2023-10-05T15:26:48.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:44.949+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b0410a9a0 con 0x7f4af0038930 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.269+0000 7f4afaffd700 1 -- 172.21.15.17:0/4171947139 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f4b0410a9a0 con 0x7f4af0038930 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.271+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4af0038930 msgr2=0x7f4af003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.271+0000 7f4b0c0c4700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4af0038930 0x7f4af003adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4af4006fd0 tx=0x7f4af4006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.271+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 msgr2=0x7f4b04106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.271+0000 7f4b0c0c4700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04106980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b00011dc0 tx=0x7f4b00011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.272+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 shutdown_connections 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.272+0000 7f4b0c0c4700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4af0038930 0x7f4af003adf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.272+0000 7f4b0c0c4700 1 --2- 172.21.15.17:0/4171947139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b04107020 0x7f4b04106980 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.272+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 >> 172.21.15.17:0/4171947139 conn(0x7f4b041009f0 msgr2=0x7f4b04101680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.272+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 shutdown_connections 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:48.272+0000 7f4b0c0c4700 1 -- 172.21.15.17:0/4171947139 wait complete. 2023-10-05T15:26:48.751 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2023-10-05T15:26:49.570 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:49 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:49.570 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:49 smithi017 ceph-mon[129107]: Added host smithi017 2023-10-05T15:26:49.570 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:49 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:26:50.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.299+0000 7fb3be23b700 1 Processor -- start 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.300+0000 7fb3be23b700 1 -- start start 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.300+0000 7fb3be23b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b81069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.300+0000 7fb3be23b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8106f70 con 0x7fb3b8106580 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.300+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b81069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.301+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b81069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55690/0 (socket says 172.21.15.17:55690) 2023-10-05T15:26:50.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.301+0000 7fb3b77fe700 1 -- 172.21.15.17:0/2423220075 learned_addr learned my addr 172.21.15.17:0/2423220075 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.301+0000 7fb3b77fe700 1 -- 172.21.15.17:0/2423220075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8107780 con 0x7fb3b8106580 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.301+0000 7fb3b77fe700 1 --2- 172.21.15.17:0/2423220075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b81069a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80098a0 tx=0x7fb3a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430e8b2d536d8d63 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.301+0000 7fb3b67fc700 1 -- 172.21.15.17:0/2423220075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8004160 con 0x7fb3b8106580 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.301+0000 7fb3b67fc700 1 -- 172.21.15.17:0/2423220075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb3a80042c0 con 0x7fb3b8106580 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3b67fc700 1 -- 172.21.15.17:0/2423220075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3a8011940 con 0x7fb3b8106580 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 -- 172.21.15.17:0/2423220075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 msgr2=0x7fb3b81069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 --2- 172.21.15.17:0/2423220075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b81069a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80098a0 tx=0x7fb3a8009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 -- 172.21.15.17:0/2423220075 shutdown_connections 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 --2- 172.21.15.17:0/2423220075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b81069a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 -- 172.21.15.17:0/2423220075 >> 172.21.15.17:0/2423220075 conn(0x7fb3b8101b00 msgr2=0x7fb3b8103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 -- 172.21.15.17:0/2423220075 shutdown_connections 2023-10-05T15:26:50.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.302+0000 7fb3be23b700 1 -- 172.21.15.17:0/2423220075 wait complete. 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.303+0000 7fb3be23b700 1 Processor -- start 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.303+0000 7fb3be23b700 1 -- start start 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.304+0000 7fb3be23b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b807bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.304+0000 7fb3be23b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b807c170 con 0x7fb3b8106580 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.304+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b807bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.304+0000 7fb3b77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b807bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55692/0 (socket says 172.21.15.17:55692) 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.304+0000 7fb3b77fe700 1 -- 172.21.15.17:0/4153072391 learned_addr learned my addr 172.21.15.17:0/4153072391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.304+0000 7fb3b77fe700 1 -- 172.21.15.17:0/4153072391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8009550 con 0x7fb3b8106580 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.305+0000 7fb3b77fe700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b807bc30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000c00 tx=0x7fb3a8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.305+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3a80036a0 con 0x7fb3b8106580 2023-10-05T15:26:50.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.305+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb3a801b440 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.305+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b807a280 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.305+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3a80193f0 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.305+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b807a6a0 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.306+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7fb3a801b5b0 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.306+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b80624e0 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.307+0000 7fb3b4ff9700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fb3a0038930 0x7fb3a003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.307+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb3a804c7a0 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.307+0000 7fb3b6ffd700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fb3a0038930 0x7fb3a003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.307+0000 7fb3b6ffd700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fb3a0038930 0x7fb3a003adf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006fd0 tx=0x7fb3ac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.312+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb3a8022950 con 0x7fb3b8106580 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.539+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb3b807af50 con 0x7fb3a0038930 2023-10-05T15:26:50.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.544+0000 7fb3b4ff9700 1 -- 172.21.15.17:0/4153072391 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb3b807af50 con 0x7fb3a0038930 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fb3a0038930 msgr2=0x7fb3a003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fb3a0038930 0x7fb3a003adf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006fd0 tx=0x7fb3ac006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 msgr2=0x7fb3b807bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b807bc30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000c00 tx=0x7fb3a8011e70 comp rx=0 tx=0).stop 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 shutdown_connections 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fb3a0038930 0x7fb3a003adf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 --2- 172.21.15.17:0/4153072391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3b8106580 0x7fb3b807bc30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 >> 172.21.15.17:0/4153072391 conn(0x7fb3b8101b00 msgr2=0x7fb3b8102760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 shutdown_connections 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:49.547+0000 7fb3be23b700 1 -- 172.21.15.17:0/4153072391 wait complete. 2023-10-05T15:26:50.138 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2023-10-05T15:26:50.935 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:50 smithi017 ceph-mon[129107]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:50.935 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:50 smithi017 ceph-mon[129107]: Saving service mon spec with placement count:5 2023-10-05T15:26:50.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:50 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:51.423 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.772+0000 7f4dcfaea700 1 Processor -- start 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.772+0000 7f4dcfaea700 1 -- start start 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.772+0000 7f4dcfaea700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc807a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.772+0000 7f4dcfaea700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc807a890 con 0x7f4dc807be60 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.772+0000 7f4dcd886700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc807a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.772+0000 7f4dcd886700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc807a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55700/0 (socket says 172.21.15.17:55700) 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.773+0000 7f4dcd886700 1 -- 172.21.15.17:0/1523720717 learned_addr learned my addr 172.21.15.17:0/1523720717 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.773+0000 7f4dcd886700 1 -- 172.21.15.17:0/1523720717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc807a9d0 con 0x7f4dc807be60 2023-10-05T15:26:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.773+0000 7f4dcd886700 1 --2- 172.21.15.17:0/1523720717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc807a2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098a0 tx=0x7f4dc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842d3b315a5f8249 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.773+0000 7f4dcc884700 1 -- 172.21.15.17:0/1523720717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4004160 con 0x7f4dc807be60 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.773+0000 7f4dcc884700 1 -- 172.21.15.17:0/1523720717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4dc40042c0 con 0x7f4dc807be60 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.773+0000 7f4dcc884700 1 -- 172.21.15.17:0/1523720717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4011940 con 0x7f4dc807be60 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1523720717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 msgr2=0x7f4dc807a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 --2- 172.21.15.17:0/1523720717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc807a2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098a0 tx=0x7f4dc4009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1523720717 shutdown_connections 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 --2- 172.21.15.17:0/1523720717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc807a2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1523720717 >> 172.21.15.17:0/1523720717 conn(0x7f4dc8101b00 msgr2=0x7f4dc8103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1523720717 shutdown_connections 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.774+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1523720717 wait complete. 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.776+0000 7f4dcfaea700 1 Processor -- start 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.776+0000 7f4dcfaea700 1 -- start start 2023-10-05T15:26:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.776+0000 7f4dcfaea700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.776+0000 7f4dcfaea700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc819c770 con 0x7f4dc807be60 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dcd886700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dcd886700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55702/0 (socket says 172.21.15.17:55702) 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dcd886700 1 -- 172.21.15.17:0/1558122937 learned_addr learned my addr 172.21.15.17:0/1558122937 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dcd886700 1 -- 172.21.15.17:0/1558122937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4009550 con 0x7f4dc807be60 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dcd886700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc819c230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4011dc0 tx=0x7f4dc4011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc40037d0 con 0x7f4dc807be60 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4dc401b440 con 0x7f4dc807be60 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc819c970 con 0x7f4dc807be60 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.777+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dc401a560 con 0x7f4dc807be60 2023-10-05T15:26:51.426 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.778+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc819cd90 con 0x7f4dc807be60 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.779+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc810c910 con 0x7f4dc807be60 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.779+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f4dc401b5b0 con 0x7f4dc807be60 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.779+0000 7f4dbeffd700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4db4038930 0x7f4db403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.780+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4dc404c750 con 0x7f4dc807be60 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.780+0000 7f4dcd085700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4db4038930 0x7f4db403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.780+0000 7f4dcd085700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4db4038930 0x7f4db403adf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006fd0 tx=0x7f4db8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.785+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4dc4023590 con 0x7f4dc807be60 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:50.990+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dc404c160 con 0x7f4dc807be60 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.016+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc819f7d0 con 0x7f4db4038930 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.021+0000 7f4dbeffd700 1 -- 172.21.15.17:0/1558122937 <== mgr.14118 v2:172.21.15.17:6800/2369336529 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4dc819f7d0 con 0x7f4db4038930 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4db4038930 msgr2=0x7f4db403adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:51.427 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4db4038930 0x7f4db403adf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006fd0 tx=0x7f4db8006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 msgr2=0x7f4dc819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc819c230 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4011dc0 tx=0x7f4dc4011ea0 comp rx=0 tx=0).stop 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 shutdown_connections 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f4db4038930 0x7f4db403adf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 --2- 172.21.15.17:0/1558122937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dc807be60 0x7f4dc819c230 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.023+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 >> 172.21.15.17:0/1558122937 conn(0x7f4dc8101b00 msgr2=0x7f4dc8102770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.024+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 shutdown_connections 2023-10-05T15:26:51.428 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.024+0000 7f4dcfaea700 1 -- 172.21.15.17:0/1558122937 wait complete. 2023-10-05T15:26:52.250 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:51 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:52.251 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:51 smithi017 ceph-mon[129107]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:26:52.251 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:51 smithi017 ceph-mon[129107]: Saving service mgr spec with placement count:2 2023-10-05T15:26:52.251 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:51 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:52.251 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:51 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:52.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.968+0000 7f599cae3700 1 Processor -- start 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.969+0000 7f599cae3700 1 -- start start 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.969+0000 7f599cae3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f5998105200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.969+0000 7f599cae3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998079e90 con 0x7f5998104de0 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.970+0000 7f599659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f5998105200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.970+0000 7f599659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f5998105200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55712/0 (socket says 172.21.15.17:55712) 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.970+0000 7f599659c700 1 -- 172.21.15.17:0/1818335423 learned_addr learned my addr 172.21.15.17:0/1818335423 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.970+0000 7f599659c700 1 -- 172.21.15.17:0/1818335423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5998105740 con 0x7f5998104de0 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.971+0000 7f599659c700 1 --2- 172.21.15.17:0/1818335423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f5998105200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59880098a0 tx=0x7f5988009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987a589c2eb81ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.971+0000 7f599559a700 1 -- 172.21.15.17:0/1818335423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5988004160 con 0x7f5998104de0 2023-10-05T15:26:52.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.971+0000 7f599559a700 1 -- 172.21.15.17:0/1818335423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59880042c0 con 0x7f5998104de0 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.971+0000 7f599559a700 1 -- 172.21.15.17:0/1818335423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59880118e0 con 0x7f5998104de0 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 -- 172.21.15.17:0/1818335423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 msgr2=0x7f5998105200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 --2- 172.21.15.17:0/1818335423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f5998105200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59880098a0 tx=0x7f5988009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 -- 172.21.15.17:0/1818335423 shutdown_connections 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 --2- 172.21.15.17:0/1818335423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f5998105200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 -- 172.21.15.17:0/1818335423 >> 172.21.15.17:0/1818335423 conn(0x7f5998100a20 msgr2=0x7f5998102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 -- 172.21.15.17:0/1818335423 shutdown_connections 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.972+0000 7f599cae3700 1 -- 172.21.15.17:0/1818335423 wait complete. 2023-10-05T15:26:52.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.973+0000 7f599cae3700 1 Processor -- start 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.973+0000 7f599cae3700 1 -- start start 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.973+0000 7f599cae3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f599819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.973+0000 7f599cae3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599819c880 con 0x7f5998104de0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.974+0000 7f599659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f599819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.974+0000 7f599659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f599819c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55714/0 (socket says 172.21.15.17:55714) 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.974+0000 7f599659c700 1 -- 172.21.15.17:0/1761961373 learned_addr learned my addr 172.21.15.17:0/1761961373 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.974+0000 7f599659c700 1 -- 172.21.15.17:0/1761961373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988009550 con 0x7f5998104de0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.974+0000 7f599659c700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f599819c340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59880118f0 tx=0x7f59880119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.975+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59880036a0 con 0x7f5998104de0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.975+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f598801b440 con 0x7f5998104de0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.975+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599819ca80 con 0x7f5998104de0 2023-10-05T15:26:52.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.975+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59880193f0 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.975+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599819cea0 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.976+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f598801b5b0 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.976+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998195bf0 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.977+0000 7f59877fe700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f5980038930 0x7f598003adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.977+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f598804c7a0 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.977+0000 7f5995d9b700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f5980038930 0x7f598003adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.978+0000 7f5995d9b700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f5980038930 0x7f598003adf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f598c006fd0 tx=0x7f598c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:51.983+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5988023980 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.221+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f59980624e0 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.224+0000 7f59877fe700 1 -- 172.21.15.17:0/1761961373 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f598801f070 con 0x7f5998104de0 2023-10-05T15:26:52.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.226+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f5980038930 msgr2=0x7f598003adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.226+0000 7f599cae3700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f5980038930 0x7f598003adf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f598c006fd0 tx=0x7f598c006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.226+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 msgr2=0x7f599819c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f599819c340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f59880118f0 tx=0x7f59880119d0 comp rx=0 tx=0).stop 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 shutdown_connections 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f5980038930 0x7f598003adf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 --2- 172.21.15.17:0/1761961373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5998104de0 0x7f599819c340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 >> 172.21.15.17:0/1761961373 conn(0x7f5998100a20 msgr2=0x7f59981909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 shutdown_connections 2023-10-05T15:26:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:52.227+0000 7f599cae3700 1 -- 172.21.15.17:0/1761961373 wait complete. 2023-10-05T15:26:53.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:53 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1761961373' entity='client.admin' 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.259+0000 7f21712bd700 1 Processor -- start 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.260+0000 7f21712bd700 1 -- start start 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.260+0000 7f21712bd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c07a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.260+0000 7f21712bd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c07a870 con 0x7f216c07be40 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.260+0000 7f216affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c07a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.260+0000 7f216affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c07a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55718/0 (socket says 172.21.15.17:55718) 2023-10-05T15:26:54.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.260+0000 7f216affd700 1 -- 172.21.15.17:0/1235729532 learned_addr learned my addr 172.21.15.17:0/1235729532 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.261+0000 7f216affd700 1 -- 172.21.15.17:0/1235729532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c07a9b0 con 0x7f216c07be40 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.261+0000 7f216affd700 1 --2- 172.21.15.17:0/1235729532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c07a2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098a0 tx=0x7f215c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb55822f886b866 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.261+0000 7f2169ffb700 1 -- 172.21.15.17:0/1235729532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215c004160 con 0x7f216c07be40 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.261+0000 7f2169ffb700 1 -- 172.21.15.17:0/1235729532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f215c0042c0 con 0x7f216c07be40 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.261+0000 7f2169ffb700 1 -- 172.21.15.17:0/1235729532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215c0118e0 con 0x7f216c07be40 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 -- 172.21.15.17:0/1235729532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 msgr2=0x7f216c07a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 --2- 172.21.15.17:0/1235729532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c07a2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098a0 tx=0x7f215c009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 -- 172.21.15.17:0/1235729532 shutdown_connections 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 --2- 172.21.15.17:0/1235729532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c07a2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 -- 172.21.15.17:0/1235729532 >> 172.21.15.17:0/1235729532 conn(0x7f216c101b00 msgr2=0x7f216c103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:54.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 -- 172.21.15.17:0/1235729532 shutdown_connections 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.262+0000 7f21712bd700 1 -- 172.21.15.17:0/1235729532 wait complete. 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.263+0000 7f21712bd700 1 Processor -- start 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.263+0000 7f21712bd700 1 -- start start 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.263+0000 7f21712bd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c19c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.263+0000 7f21712bd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c19c810 con 0x7f216c07be40 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.264+0000 7f216affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c19c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.264+0000 7f216affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c19c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55720/0 (socket says 172.21.15.17:55720) 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.264+0000 7f216affd700 1 -- 172.21.15.17:0/1622787547 learned_addr learned my addr 172.21.15.17:0/1622787547 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.264+0000 7f216affd700 1 -- 172.21.15.17:0/1622787547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c009550 con 0x7f216c07be40 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.264+0000 7f216affd700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c19c2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f215c0118f0 tx=0x7f215c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:54.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.265+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215c0036a0 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.265+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f215c01b440 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.265+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c19ca10 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.265+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f215c0193f0 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.265+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c19ce30 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.266+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c10c920 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.266+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f215c01b5b0 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.267+0000 7f2153fff700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f2154038930 0x7f215403adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.267+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f215c04c7a0 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.267+0000 7f216a7fc700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f2154038930 0x7f215403adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.268+0000 7f216a7fc700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f2154038930 0x7f215403adf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2160006fd0 tx=0x7f2160006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.271+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f215c023980 con 0x7f216c07be40 2023-10-05T15:26:54.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.485+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f216c19f870 con 0x7f216c07be40 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.487+0000 7f2153fff700 1 -- 172.21.15.17:0/1622787547 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f215c01f070 con 0x7f216c07be40 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f2154038930 msgr2=0x7f215403adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f2154038930 0x7f215403adf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2160006fd0 tx=0x7f2160006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 msgr2=0x7f216c19c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c19c2d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f215c0118f0 tx=0x7f215c0119d0 comp rx=0 tx=0).stop 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 shutdown_connections 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f2154038930 0x7f215403adf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 --2- 172.21.15.17:0/1622787547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f216c07be40 0x7f216c19c2d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.490+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 >> 172.21.15.17:0/1622787547 conn(0x7f216c101b00 msgr2=0x7f216c1027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.491+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 shutdown_connections 2023-10-05T15:26:54.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:53.491+0000 7f21712bd700 1 -- 172.21.15.17:0/1622787547 wait complete. 2023-10-05T15:26:54.097 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2023-10-05T15:26:54.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:54 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1622787547' entity='client.admin' 2023-10-05T15:26:54.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:54 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:55.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:55 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2198372421' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-05T15:26:55.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:55 smithi017 ceph-mon[129107]: from='mgr.14118 172.21.15.17:0/89735705' entity='mgr.x' 2023-10-05T15:26:55.820 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: ignoring --setuser ceph since I am not root 2023-10-05T15:26:55.820 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: ignoring --setgroup ceph since I am not root 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.674+0000 7f4595937700 1 Processor -- start 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.674+0000 7f4595937700 1 -- start start 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.674+0000 7f4595937700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459007a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.674+0000 7f4595937700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459007a870 con 0x7f459007be40 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.675+0000 7f458effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459007a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.675+0000 7f458effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459007a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50256/0 (socket says 172.21.15.17:50256) 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.675+0000 7f458effd700 1 -- 172.21.15.17:0/3130085690 learned_addr learned my addr 172.21.15.17:0/3130085690 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:55.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.675+0000 7f458effd700 1 -- 172.21.15.17:0/3130085690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459007a9b0 con 0x7f459007be40 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.675+0000 7f458effd700 1 --2- 172.21.15.17:0/3130085690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459007a2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45800098a0 tx=0x7f4580009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba25b1db1912c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f458dffb700 1 -- 172.21.15.17:0/3130085690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4580004160 con 0x7f459007be40 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f458dffb700 1 -- 172.21.15.17:0/3130085690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45800042c0 con 0x7f459007be40 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f458dffb700 1 -- 172.21.15.17:0/3130085690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45800118e0 con 0x7f459007be40 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 -- 172.21.15.17:0/3130085690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 msgr2=0x7f459007a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 --2- 172.21.15.17:0/3130085690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459007a2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45800098a0 tx=0x7f4580009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 -- 172.21.15.17:0/3130085690 shutdown_connections 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 --2- 172.21.15.17:0/3130085690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459007a2a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 -- 172.21.15.17:0/3130085690 >> 172.21.15.17:0/3130085690 conn(0x7f4590101b00 msgr2=0x7f4590103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 -- 172.21.15.17:0/3130085690 shutdown_connections 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.676+0000 7f4595937700 1 -- 172.21.15.17:0/3130085690 wait complete. 2023-10-05T15:26:55.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.677+0000 7f4595937700 1 Processor -- start 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.678+0000 7f4595937700 1 -- start start 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.678+0000 7f4595937700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.678+0000 7f4595937700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459019c810 con 0x7f459007be40 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.678+0000 7f458effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.678+0000 7f458effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50270/0 (socket says 172.21.15.17:50270) 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.678+0000 7f458effd700 1 -- 172.21.15.17:0/2198372421 learned_addr learned my addr 172.21.15.17:0/2198372421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f458effd700 1 -- 172.21.15.17:0/2198372421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580009550 con 0x7f459007be40 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f458effd700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459019c2d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45800118f0 tx=0x7f45800119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45800036a0 con 0x7f459007be40 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f458001b440 con 0x7f459007be40 2023-10-05T15:26:55.981 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459019ca10 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45800193f0 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.679+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459019ce30 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.680+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f458001b5b0 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.681+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459010c920 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.681+0000 7f4594935700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f45780388e0 0x7f457803ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.681+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f458004c7f0 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.681+0000 7f458e7fc700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f45780388e0 0x7f457803ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.682+0000 7f458e7fc700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f45780388e0 0x7f457803ada0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4584006fd0 tx=0x7f4584006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.687+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4580023590 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:54.972+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f459010cb30 con 0x7f459007be40 2023-10-05T15:26:55.982 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.490+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f458001f020 con 0x7f459007be40 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.492+0000 7f4594935700 1 -- 172.21.15.17:0/2198372421 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f45800196b0 con 0x7f459007be40 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f45780388e0 msgr2=0x7f457803ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f45780388e0 0x7f457803ada0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4584006fd0 tx=0x7f4584006e40 comp rx=0 tx=0).stop 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 msgr2=0x7f459019c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459019c2d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45800118f0 tx=0x7f45800119d0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 shutdown_connections 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7f45780388e0 0x7f457803ada0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 --2- 172.21.15.17:0/2198372421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f459007be40 0x7f459019c2d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:55.983 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.494+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 >> 172.21.15.17:0/2198372421 conn(0x7f4590101b00 msgr2=0x7f45901027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:55.984 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.495+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 shutdown_connections 2023-10-05T15:26:55.984 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:55.495+0000 7f4595937700 1 -- 172.21.15.17:0/2198372421 wait complete. 2023-10-05T15:26:56.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:55.816+0000 7f32c27bf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:26:56.197 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:55.925+0000 7f32c27bf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:26:56.197 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:56.065+0000 7f32c27bf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:26:56.453 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:56.197+0000 7f32c27bf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:26:56.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:56 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2198372421' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-05T15:26:56.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:56 smithi017 ceph-mon[129107]: mgrmap e9: x(active, since 17s) 2023-10-05T15:26:56.844 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:56.451+0000 7f32c27bf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:26:57.094 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:56.965+0000 7f32c27bf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:26:57.417 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:57.147+0000 7f32c27bf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:26:57.417 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:57.274+0000 7f32c27bf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:26:57.418 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:57.405+0000 7f32c27bf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:26:57.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.573+0000 7fcac9b4e700 1 Processor -- start 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.573+0000 7fcac9b4e700 1 -- start start 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.574+0000 7fcac9b4e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac41069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.574+0000 7fcac9b4e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4106f80 con 0x7fcac4106590 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.574+0000 7fcac37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac41069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.574+0000 7fcac37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac41069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50306/0 (socket says 172.21.15.17:50306) 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.574+0000 7fcac37fe700 1 -- 172.21.15.17:0/2140616090 learned_addr learned my addr 172.21.15.17:0/2140616090 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.575+0000 7fcac37fe700 1 -- 172.21.15.17:0/2140616090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4107790 con 0x7fcac4106590 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.575+0000 7fcac37fe700 1 --2- 172.21.15.17:0/2140616090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac41069b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcab40098a0 tx=0x7fcab4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a50af3344fb1091 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.575+0000 7fcac27fc700 1 -- 172.21.15.17:0/2140616090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcab4004160 con 0x7fcac4106590 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.575+0000 7fcac27fc700 1 -- 172.21.15.17:0/2140616090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcab40042c0 con 0x7fcac4106590 2023-10-05T15:26:57.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.575+0000 7fcac27fc700 1 -- 172.21.15.17:0/2140616090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcab40118e0 con 0x7fcac4106590 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.576+0000 7fcac9b4e700 1 -- 172.21.15.17:0/2140616090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 msgr2=0x7fcac41069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.576+0000 7fcac9b4e700 1 --2- 172.21.15.17:0/2140616090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac41069b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcab40098a0 tx=0x7fcab4009bb0 comp rx=0 tx=0).stop 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.576+0000 7fcac9b4e700 1 -- 172.21.15.17:0/2140616090 shutdown_connections 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.576+0000 7fcac9b4e700 1 --2- 172.21.15.17:0/2140616090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac41069b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.576+0000 7fcac9b4e700 1 -- 172.21.15.17:0/2140616090 >> 172.21.15.17:0/2140616090 conn(0x7fcac4101b30 msgr2=0x7fcac4103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.577+0000 7fcac9b4e700 1 -- 172.21.15.17:0/2140616090 shutdown_connections 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.577+0000 7fcac9b4e700 1 -- 172.21.15.17:0/2140616090 wait complete. 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.578+0000 7fcac9b4e700 1 Processor -- start 2023-10-05T15:26:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.578+0000 7fcac9b4e700 1 -- start start 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.579+0000 7fcac9b4e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.579+0000 7fcac9b4e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac419a6d0 con 0x7fcac4106590 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.579+0000 7fcac37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.579+0000 7fcac37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50310/0 (socket says 172.21.15.17:50310) 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.579+0000 7fcac37fe700 1 -- 172.21.15.17:0/195603533 learned_addr learned my addr 172.21.15.17:0/195603533 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac37fe700 1 -- 172.21.15.17:0/195603533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4009550 con 0x7fcac4106590 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac37fe700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac419a190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcab4006af0 tx=0x7fcab4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcab40037d0 con 0x7fcac4106590 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac419a8d0 con 0x7fcac4106590 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcab401b440 con 0x7fcac4106590 2023-10-05T15:26:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcab4019560 con 0x7fcac4106590 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.580+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac419acf0 con 0x7fcac4106590 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.582+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac40624e0 con 0x7fcac4106590 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.582+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fcab4019820 con 0x7fcac4106590 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.582+0000 7fcac0ff9700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 0x7fcaac03ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.582+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcab404c910 con 0x7fcac4106590 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.583+0000 7fcac2ffd700 1 -- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 msgr2=0x7fcaac03ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.583+0000 7fcac2ffd700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 0x7fcaac03ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.592+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcab4018530 con 0x7fcac4106590 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.784+0000 7fcac2ffd700 1 -- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 msgr2=0x7fcaac03ada0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.784+0000 7fcac2ffd700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 0x7fcaac03ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:26:57.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.874+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcac419d940 con 0x7fcac4106590 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.875+0000 7fcac0ff9700 1 -- 172.21.15.17:0/195603533 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fcab4018350 con 0x7fcac4106590 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 msgr2=0x7fcaac03ada0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 0x7fcaac03ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 msgr2=0x7fcac419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac419a190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcab4006af0 tx=0x7fcab4011e80 comp rx=0 tx=0).stop 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 shutdown_connections 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fcaac0388e0 0x7fcaac03ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 --2- 172.21.15.17:0/195603533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcac4106590 0x7fcac419a190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 >> 172.21.15.17:0/195603533 conn(0x7fcac4101b30 msgr2=0x7fcac41028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.877+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 shutdown_connections 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:56.878+0000 7fcac9b4e700 1 -- 172.21.15.17:0/195603533 wait complete. 2023-10-05T15:26:57.598 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2023-10-05T15:26:57.599 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2023-10-05T15:26:57.678 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:26:57 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/195603533' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-05T15:26:58.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:57.986+0000 7f32c27bf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:26:59.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:58.866+0000 7f32c27bf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:26:59.197 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:58.976+0000 7f32c27bf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:27:00.318 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:26:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:26:59.961+0000 7f32c27bf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:27:00.318 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:00.085+0000 7f32c27bf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:27:00.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:00.316+0000 7f32c27bf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:27:00.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:00.694+0000 7f32c27bf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:27:01.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:00.977+0000 7f32c27bf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:27:01.447 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:01.177+0000 7f32c27bf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:27:01.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:01.533+0000 7f32c27bf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:27:02.931 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:02.493+0000 7f32c27bf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:27:02.931 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:02.673+0000 7f32c27bf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:27:03.196 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:02.929+0000 7f32c27bf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:27:03.197 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:03 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:03.080+0000 7f32c27bf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:27:03.696 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:03 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:03.365+0000 7f32c27bf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:27:04.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:04.475+0000 7f32c27bf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: Active manager daemon x restarted 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: Activating manager daemon x 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: osdmap e3: 0 total, 0 up, 0 in 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: mgrmap e10: x(active, starting, since 0.00419357s) 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-05T15:27:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-05T15:27:04.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-05T15:27:04.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: Manager daemon x is now available 2023-10-05T15:27:04.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:04.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-05T15:27:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-05T15:27:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:05 smithi017 ceph-mon[129107]: mgrmap e11: x(active, since 1.00725s) 2023-10-05T15:27:05.995 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.196+0000 7fd148b4d700 1 Processor -- start 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.196+0000 7fd148b4d700 1 -- start start 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.196+0000 7fd148b4d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.196+0000 7fd148b4d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14407a890 con 0x7fd14407be60 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.197+0000 7fd14259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.197+0000 7fd14259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50322/0 (socket says 172.21.15.17:50322) 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.197+0000 7fd14259c700 1 -- 172.21.15.17:0/1137438165 learned_addr learned my addr 172.21.15.17:0/1137438165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.197+0000 7fd14259c700 1 -- 172.21.15.17:0/1137438165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14407a9d0 con 0x7fd14407be60 2023-10-05T15:27:05.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.197+0000 7fd14259c700 1 --2- 172.21.15.17:0/1137438165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14407a2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1340098a0 tx=0x7fd134009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c272fd89105432 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd14159a700 1 -- 172.21.15.17:0/1137438165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd134004160 con 0x7fd14407be60 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd14159a700 1 -- 172.21.15.17:0/1137438165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1340042c0 con 0x7fd14407be60 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd14159a700 1 -- 172.21.15.17:0/1137438165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1340118e0 con 0x7fd14407be60 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 -- 172.21.15.17:0/1137438165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 msgr2=0x7fd14407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1137438165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14407a2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1340098a0 tx=0x7fd134009bb0 comp rx=0 tx=0).stop 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 -- 172.21.15.17:0/1137438165 shutdown_connections 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1137438165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14407a2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 -- 172.21.15.17:0/1137438165 >> 172.21.15.17:0/1137438165 conn(0x7fd144101b30 msgr2=0x7fd144103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 -- 172.21.15.17:0/1137438165 shutdown_connections 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.198+0000 7fd148b4d700 1 -- 172.21.15.17:0/1137438165 wait complete. 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.199+0000 7fd148b4d700 1 Processor -- start 2023-10-05T15:27:05.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.200+0000 7fd148b4d700 1 -- start start 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.200+0000 7fd148b4d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.200+0000 7fd148b4d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14419c870 con 0x7fd14407be60 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.200+0000 7fd14259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.200+0000 7fd14259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14419c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50338/0 (socket says 172.21.15.17:50338) 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.200+0000 7fd14259c700 1 -- 172.21.15.17:0/1354078043 learned_addr learned my addr 172.21.15.17:0/1354078043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.201+0000 7fd14259c700 1 -- 172.21.15.17:0/1354078043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009550 con 0x7fd14407be60 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.201+0000 7fd14259c700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14419c330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1340118f0 tx=0x7fd1340119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.201+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1340036a0 con 0x7fd14407be60 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.201+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd13401b440 con 0x7fd14407be60 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.201+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14419ca70 con 0x7fd14407be60 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.201+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1340193f0 con 0x7fd14407be60 2023-10-05T15:27:05.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.202+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14419ce90 con 0x7fd14407be60 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.202+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fd134003800 con 0x7fd14407be60 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.203+0000 7fd1337fe700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.203+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 --> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1440624e0 con 0x7fd12c038980 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.203+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd134051580 con 0x7fd14407be60 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.203+0000 7fd141d9b700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.203+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.404+0000 7fd141d9b700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.404+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.805+0000 7fd141d9b700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:58.805+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:59.606+0000 7fd141d9b700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:27:05.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:26:59.606+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:01.207+0000 7fd141d9b700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:01.207+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:04.410+0000 7fd141d9b700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2369336529 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:04.410+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:04.480+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) v1 ==== 45359+0+0 (secure 0 0 0) 0x7fd134019660 con 0x7fd14407be60 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:04.480+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 msgr2=0x7fd12c03ae40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:04.480+0000 7fd1337fe700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.482+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7fd134041850 con 0x7fd14407be60 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.482+0000 7fd1337fe700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd12c03bfd0 0x7fd12c03e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.482+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1440624e0 con 0x7fd12c03bfd0 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.483+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd12c03bfd0 0x7fd12c03e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:06.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.485+0000 7fd141d9b700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd12c03bfd0 0x7fd12c03e3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd138003a10 tx=0x7fd138009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.486+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fd1440624e0 con 0x7fd12c03bfd0 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.493+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd14419d670 con 0x7fd12c03bfd0 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.493+0000 7fd1337fe700 1 -- 172.21.15.17:0/1354078043 <== mgr.14150 v2:172.21.15.17:6800/1244004544 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fd14419d670 con 0x7fd12c03bfd0 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.493+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd12c03bfd0 msgr2=0x7fd12c03e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.493+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd12c03bfd0 0x7fd12c03e3c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd138003a10 tx=0x7fd138009270 comp rx=0 tx=0).stop 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 msgr2=0x7fd14419c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14419c330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1340118f0 tx=0x7fd1340119d0 comp rx=0 tx=0).stop 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 shutdown_connections 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd12c03bfd0 0x7fd12c03e3c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd14407be60 0x7fd14419c330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 --2- 172.21.15.17:0/1354078043 >> [v2:172.21.15.17:6800/2369336529,v1:172.21.15.17:6801/2369336529] conn(0x7fd12c038980 0x7fd12c03ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:06.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 >> 172.21.15.17:0/1354078043 conn(0x7fd144101b30 msgr2=0x7fd144102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:06.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 shutdown_connections 2023-10-05T15:27:06.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:05.494+0000 7fd148b4d700 1 -- 172.21.15.17:0/1354078043 wait complete. 2023-10-05T15:27:06.002 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2023-10-05T15:27:06.002 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2023-10-05T15:27:06.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:06 smithi017 ceph-mon[129107]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-05T15:27:06.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:06 smithi017 ceph-mon[129107]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-05T15:27:07.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-05T15:27:07.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.980+0000 7fcbc0b23700 1 Processor -- start 2023-10-05T15:27:07.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.980+0000 7fcbc0b23700 1 -- start start 2023-10-05T15:27:07.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.981+0000 7fcbc0b23700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc107210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:07.690 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.981+0000 7fcbc0b23700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc079e90 con 0x7fcbbc104de0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.981+0000 7fcbba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.981+0000 7fcbba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57922/0 (socket says 172.21.15.17:57922) 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.981+0000 7fcbba59c700 1 -- 172.21.15.17:0/1532430793 learned_addr learned my addr 172.21.15.17:0/1532430793 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.982+0000 7fcbba59c700 1 -- 172.21.15.17:0/1532430793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc107750 con 0x7fcbbc104de0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.982+0000 7fcbba59c700 1 --2- 172.21.15.17:0/1532430793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc107210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0098a0 tx=0x7fcbac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf98fa90aa8c943 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.982+0000 7fcbb959a700 1 -- 172.21.15.17:0/1532430793 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbac004160 con 0x7fcbbc104de0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.982+0000 7fcbb959a700 1 -- 172.21.15.17:0/1532430793 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbac0042c0 con 0x7fcbbc104de0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.982+0000 7fcbb959a700 1 -- 172.21.15.17:0/1532430793 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0118e0 con 0x7fcbbc104de0 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1532430793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 msgr2=0x7fcbbc107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:07.691 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 --2- 172.21.15.17:0/1532430793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc107210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0098a0 tx=0x7fcbac009bb0 comp rx=0 tx=0).stop 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1532430793 shutdown_connections 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 --2- 172.21.15.17:0/1532430793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc107210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1532430793 >> 172.21.15.17:0/1532430793 conn(0x7fcbbc100a20 msgr2=0x7fcbbc102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1532430793 shutdown_connections 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.983+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1532430793 wait complete. 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.984+0000 7fcbc0b23700 1 Processor -- start 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.984+0000 7fcbc0b23700 1 -- start start 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbc0b23700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc1a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbc0b23700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc1a0c60 con 0x7fcbbc104de0 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc1a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc1a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57926/0 (socket says 172.21.15.17:57926) 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbba59c700 1 -- 172.21.15.17:0/1235113686 learned_addr learned my addr 172.21.15.17:0/1235113686 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbba59c700 1 -- 172.21.15.17:0/1235113686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009550 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.985+0000 7fcbba59c700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc1a0720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0118f0 tx=0x7fcbac0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.986+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0036a0 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.986+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc1a0e60 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.986+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbac01b440 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.986+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0193f0 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.986+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc1a1280 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.987+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fcbac003800 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.987+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc19a0c0 con 0x7fcbbc104de0 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.988+0000 7fcbab7fe700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcba4038980 0x7fcba403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:07.693 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.988+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcbac04c8e0 con 0x7fcbbc104de0 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.988+0000 7fcbb9d9b700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcba4038980 0x7fcba403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.989+0000 7fcbb9d9b700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcba4038980 0x7fcba403ae40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0006fd0 tx=0x7fcbb0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:06.994+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcbac023a00 con 0x7fcbbc104de0 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.213+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbbc02d080 con 0x7fcba4038980 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.277+0000 7fcbab7fe700 1 -- 172.21.15.17:0/1235113686 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fcbbc02d080 con 0x7fcba4038980 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.279+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcba4038980 msgr2=0x7fcba403ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.279+0000 7fcbc0b23700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcba4038980 0x7fcba403ae40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0006fd0 tx=0x7fcbb0006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.279+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 msgr2=0x7fcbbc1a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.279+0000 7fcbc0b23700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc1a0720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0118f0 tx=0x7fcbac0119d0 comp rx=0 tx=0).stop 2023-10-05T15:27:07.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.280+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 shutdown_connections 2023-10-05T15:27:07.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.280+0000 7fcbc0b23700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcba4038980 0x7fcba403ae40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:07.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.280+0000 7fcbc0b23700 1 --2- 172.21.15.17:0/1235113686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc104de0 0x7fcbbc1a0720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:07.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.280+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 >> 172.21.15.17:0/1235113686 conn(0x7fcbbc100a20 msgr2=0x7fcbbc102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:07.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.280+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 shutdown_connections 2023-10-05T15:27:07.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:07.280+0000 7fcbc0b23700 1 -- 172.21.15.17:0/1235113686 wait complete. 2023-10-05T15:27:07.695 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: [05/Oct/2023:15:27:05] ENGINE Bus STARTING 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: [05/Oct/2023:15:27:05] ENGINE Serving on https://172.21.15.17:7150 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: [05/Oct/2023:15:27:06] ENGINE Serving on http://172.21.15.17:8765 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: [05/Oct/2023:15:27:06] ENGINE Bus STARTED 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: mgrmap e12: x(active, since 2s) 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:08.941 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:08 smithi017 ceph-mon[129107]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:08.941 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$.zSHPG7t/utCIo3fhNTLOus45.oUQ0b5PcaBRQaDHmmwZu8SbXxqy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696519628, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.270+0000 7f77009db700 1 Processor -- start 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.270+0000 7f77009db700 1 -- start start 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.271+0000 7f77009db700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc1067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.271+0000 7f77009db700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc106db0 con 0x7f76fc1063c0 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.271+0000 7f76fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc1067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.271+0000 7f76fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc1067e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57938/0 (socket says 172.21.15.17:57938) 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.271+0000 7f76fb7fe700 1 -- 172.21.15.17:0/2315707949 learned_addr learned my addr 172.21.15.17:0/2315707949 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.271+0000 7f76fb7fe700 1 -- 172.21.15.17:0/2315707949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc1075c0 con 0x7f76fc1063c0 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.272+0000 7f76fb7fe700 1 --2- 172.21.15.17:0/2315707949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc1067e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098a0 tx=0x7f76ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87dbf425d3861a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.272+0000 7f76fa7fc700 1 -- 172.21.15.17:0/2315707949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ec004160 con 0x7f76fc1063c0 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.272+0000 7f76fa7fc700 1 -- 172.21.15.17:0/2315707949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec0042c0 con 0x7f76fc1063c0 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.272+0000 7f76fa7fc700 1 -- 172.21.15.17:0/2315707949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ec0118e0 con 0x7f76fc1063c0 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 -- 172.21.15.17:0/2315707949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 msgr2=0x7f76fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 --2- 172.21.15.17:0/2315707949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc1067e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098a0 tx=0x7f76ec009bb0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 -- 172.21.15.17:0/2315707949 shutdown_connections 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 --2- 172.21.15.17:0/2315707949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc1067e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 -- 172.21.15.17:0/2315707949 >> 172.21.15.17:0/2315707949 conn(0x7f76fc101960 msgr2=0x7f76fc103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 -- 172.21.15.17:0/2315707949 shutdown_connections 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.273+0000 7f77009db700 1 -- 172.21.15.17:0/2315707949 wait complete. 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.274+0000 7f77009db700 1 Processor -- start 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.274+0000 7f77009db700 1 -- start start 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.274+0000 7f77009db700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.274+0000 7f77009db700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc19c740 con 0x7f76fc1063c0 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.275+0000 7f76fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.275+0000 7f76fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc19c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57952/0 (socket says 172.21.15.17:57952) 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.275+0000 7f76fb7fe700 1 -- 172.21.15.17:0/1238230445 learned_addr learned my addr 172.21.15.17:0/1238230445 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.275+0000 7f76fb7fe700 1 -- 172.21.15.17:0/1238230445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec009550 con 0x7f76fc1063c0 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.275+0000 7f76fb7fe700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc19c200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76ec006af0 tx=0x7f76ec011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:09.174 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.275+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ec0037d0 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.276+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc19c940 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.276+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec01b440 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.276+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76ec019560 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.276+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc19cd60 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.277+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f76ec003930 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.277+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc0624e0 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.277+0000 7f76f8ff9700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e40388e0 0x7f76e403ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.277+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f76ec04c880 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.277+0000 7f76faffd700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e40388e0 0x7f76e403ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.278+0000 7f76faffd700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e40388e0 0x7f76e403ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76f0006fd0 tx=0x7f76f0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.282+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f76ec018350 con 0x7f76fc1063c0 2023-10-05T15:27:09.175 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.528+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f76fc062300 con 0x7f76e40388e0 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.776+0000 7f76f8ff9700 1 -- 172.21.15.17:0/1238230445 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f76fc062300 con 0x7f76e40388e0 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.778+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e40388e0 msgr2=0x7f76e403ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.778+0000 7f77009db700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e40388e0 0x7f76e403ada0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f76f0006fd0 tx=0x7f76f0006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.778+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 msgr2=0x7f76fc19c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.778+0000 7f77009db700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc19c200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76ec006af0 tx=0x7f76ec011e80 comp rx=0 tx=0).stop 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.779+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 shutdown_connections 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.779+0000 7f77009db700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e40388e0 0x7f76e403ada0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.779+0000 7f77009db700 1 --2- 172.21.15.17:0/1238230445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76fc1063c0 0x7f76fc19c200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.779+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 >> 172.21.15.17:0/1238230445 conn(0x7f76fc101960 msgr2=0x7f76fc102760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.779+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 shutdown_connections 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:08.779+0000 7f77009db700 1 -- 172.21.15.17:0/1238230445 wait complete. 2023-10-05T15:27:09.176 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2023-10-05T15:27:09.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:09 smithi017 ceph-mon[129107]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:09.826 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:09 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:10.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2023-10-05T15:27:10.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.764+0000 7fcffc6a1700 1 Processor -- start 2023-10-05T15:27:10.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.764+0000 7fcffc6a1700 1 -- start start 2023-10-05T15:27:10.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.764+0000 7fcffc6a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff41069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:10.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.764+0000 7fcffc6a1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff4106f70 con 0x7fcff4106580 2023-10-05T15:27:10.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.765+0000 7fcffa43d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff41069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:10.790 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.765+0000 7fcffa43d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff41069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57958/0 (socket says 172.21.15.17:57958) 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.765+0000 7fcffa43d700 1 -- 172.21.15.17:0/526978324 learned_addr learned my addr 172.21.15.17:0/526978324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.765+0000 7fcffa43d700 1 -- 172.21.15.17:0/526978324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff4107780 con 0x7fcff4106580 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.765+0000 7fcffa43d700 1 --2- 172.21.15.17:0/526978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff41069a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcff00098a0 tx=0x7fcff0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93fd806f803765b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcff943b700 1 -- 172.21.15.17:0/526978324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcff0004160 con 0x7fcff4106580 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcff943b700 1 -- 172.21.15.17:0/526978324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcff00042c0 con 0x7fcff4106580 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcff943b700 1 -- 172.21.15.17:0/526978324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcff00118e0 con 0x7fcff4106580 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 -- 172.21.15.17:0/526978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 msgr2=0x7fcff41069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 --2- 172.21.15.17:0/526978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff41069a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcff00098a0 tx=0x7fcff0009bb0 comp rx=0 tx=0).stop 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 -- 172.21.15.17:0/526978324 shutdown_connections 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 --2- 172.21.15.17:0/526978324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff41069a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:10.791 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 -- 172.21.15.17:0/526978324 >> 172.21.15.17:0/526978324 conn(0x7fcff4101b00 msgr2=0x7fcff4103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 -- 172.21.15.17:0/526978324 shutdown_connections 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.766+0000 7fcffc6a1700 1 -- 172.21.15.17:0/526978324 wait complete. 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.767+0000 7fcffc6a1700 1 Processor -- start 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffc6a1700 1 -- start start 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffc6a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff407bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffc6a1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff407c170 con 0x7fcff4106580 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffa43d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff407bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffa43d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff407bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57960/0 (socket says 172.21.15.17:57960) 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffa43d700 1 -- 172.21.15.17:0/1692304223 learned_addr learned my addr 172.21.15.17:0/1692304223 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.768+0000 7fcffa43d700 1 -- 172.21.15.17:0/1692304223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009550 con 0x7fcff4106580 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.769+0000 7fcffa43d700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff407bc30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcff0000c00 tx=0x7fcff00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:10.792 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.769+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcff00036a0 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.769+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcff001b440 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.769+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff407a280 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.769+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcff001a3d0 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.769+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff407a6a0 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.770+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7fcff001b5b0 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.770+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff40624e0 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.771+0000 7fcfeb7fe700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcfe0038980 0x7fcfe003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.771+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcff004c880 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.771+0000 7fcff9c3c700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcfe0038980 0x7fcfe003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.772+0000 7fcff9c3c700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcfe0038980 0x7fcfe003ae40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006fd0 tx=0x7fcfe4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:09.776+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcff0023be0 con 0x7fcff4106580 2023-10-05T15:27:10.793 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.002+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fcff410a9b0 con 0x7fcff4106580 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.003+0000 7fcfeb7fe700 1 -- 172.21.15.17:0/1692304223 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fcff001f070 con 0x7fcff4106580 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.005+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcfe0038980 msgr2=0x7fcfe003ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.005+0000 7fcffc6a1700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcfe0038980 0x7fcfe003ae40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006fd0 tx=0x7fcfe4006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.005+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 msgr2=0x7fcff407bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.005+0000 7fcffc6a1700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff407bc30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcff0000c00 tx=0x7fcff00119a0 comp rx=0 tx=0).stop 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.006+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 shutdown_connections 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.006+0000 7fcffc6a1700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcfe0038980 0x7fcfe003ae40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.006+0000 7fcffc6a1700 1 --2- 172.21.15.17:0/1692304223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcff4106580 0x7fcff407bc30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.006+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 >> 172.21.15.17:0/1692304223 conn(0x7fcff4101b00 msgr2=0x7fcff4102840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.006+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 shutdown_connections 2023-10-05T15:27:10.794 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:10.006+0000 7fcffc6a1700 1 -- 172.21.15.17:0/1692304223 wait complete. 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2023-10-05T15:27:10.796 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2023-10-05T15:27:10.797 INFO:teuthology.orchestra.run.smithi017.stdout: Password: 2h5m6bvhgt 2023-10-05T15:27:10.797 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config directory 2023-10-05T15:27:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling autotune for osd_memory_target 2023-10-05T15:27:10.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:10 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1692304223' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-05T15:27:11.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:11 smithi017 ceph-mon[129107]: mgrmap e13: x(active, since 6s) 2023-10-05T15:27:12.075 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.327+0000 7f4569650700 1 Processor -- start 2023-10-05T15:27:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.327+0000 7f4569650700 1 -- start start 2023-10-05T15:27:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.327+0000 7f4569650700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f45641069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.327+0000 7f4569650700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4564106f70 con 0x7f4564106580 2023-10-05T15:27:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.328+0000 7f4562ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f45641069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.328+0000 7f4562ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f45641069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57976/0 (socket says 172.21.15.17:57976) 2023-10-05T15:27:12.081 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.328+0000 7f4562ffd700 1 -- 172.21.15.17:0/2109320621 learned_addr learned my addr 172.21.15.17:0/2109320621 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.328+0000 7f4562ffd700 1 -- 172.21.15.17:0/2109320621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564107780 con 0x7f4564106580 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.328+0000 7f4562ffd700 1 --2- 172.21.15.17:0/2109320621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f45641069a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45540098a0 tx=0x7f4554009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f6e0454c232f82 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4561ffb700 1 -- 172.21.15.17:0/2109320621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4554004160 con 0x7f4564106580 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4561ffb700 1 -- 172.21.15.17:0/2109320621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45540042c0 con 0x7f4564106580 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4561ffb700 1 -- 172.21.15.17:0/2109320621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45540118e0 con 0x7f4564106580 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 -- 172.21.15.17:0/2109320621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 msgr2=0x7f45641069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 --2- 172.21.15.17:0/2109320621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f45641069a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45540098a0 tx=0x7f4554009bb0 comp rx=0 tx=0).stop 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 -- 172.21.15.17:0/2109320621 shutdown_connections 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 --2- 172.21.15.17:0/2109320621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f45641069a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:12.082 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 -- 172.21.15.17:0/2109320621 >> 172.21.15.17:0/2109320621 conn(0x7f4564101b00 msgr2=0x7f4564103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 -- 172.21.15.17:0/2109320621 shutdown_connections 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.329+0000 7f4569650700 1 -- 172.21.15.17:0/2109320621 wait complete. 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.330+0000 7f4569650700 1 Processor -- start 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.331+0000 7f4569650700 1 -- start start 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.331+0000 7f4569650700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f456419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.331+0000 7f4569650700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456419a650 con 0x7f4564106580 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.331+0000 7f4562ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f456419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.331+0000 7f4562ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f456419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57988/0 (socket says 172.21.15.17:57988) 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.331+0000 7f4562ffd700 1 -- 172.21.15.17:0/1857268541 learned_addr learned my addr 172.21.15.17:0/1857268541 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f4562ffd700 1 -- 172.21.15.17:0/1857268541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009550 con 0x7f4564106580 2023-10-05T15:27:12.083 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f4562ffd700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f456419a110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4554000c00 tx=0x7f45540119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45540036a0 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f455401b440 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f455401a3d0 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456419a850 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.332+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456419ac70 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.333+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45640624e0 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.334+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f455401b5b0 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.334+0000 7f454bfff700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f454c0389d0 0x7f454c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.334+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f455404c9d0 con 0x7f4564106580 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.334+0000 7f45627fc700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f454c0389d0 0x7f454c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:12.084 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.335+0000 7f45627fc700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f454c0389d0 0x7f454c03ae90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4558006fd0 tx=0x7f4558006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.339+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f45540239a0 con 0x7f4564106580 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.549+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f456410a9b0 con 0x7f4564106580 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.549+0000 7f454bfff700 1 -- 172.21.15.17:0/1857268541 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f455401f070 con 0x7f4564106580 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.551+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f454c0389d0 msgr2=0x7f454c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.551+0000 7f4569650700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f454c0389d0 0x7f454c03ae90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4558006fd0 tx=0x7f4558006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.551+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 msgr2=0x7f456419a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.551+0000 7f4569650700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f456419a110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4554000c00 tx=0x7f45540119a0 comp rx=0 tx=0).stop 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.552+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 shutdown_connections 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.552+0000 7f4569650700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f454c0389d0 0x7f454c03ae90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.552+0000 7f4569650700 1 --2- 172.21.15.17:0/1857268541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4564106580 0x7f456419a110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.552+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 >> 172.21.15.17:0/1857268541 conn(0x7f4564101b00 msgr2=0x7f4564102840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:12.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.552+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 shutdown_connections 2023-10-05T15:27:12.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:11.552+0000 7f4569650700 1 -- 172.21.15.17:0/1857268541 wait complete. 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.633+0000 7f0c0c798700 1 Processor -- start 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.634+0000 7f0c0c798700 1 -- start start 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.634+0000 7f0c0c798700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0407a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.634+0000 7f0c0c798700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0407a890 con 0x7f0c0407be60 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.634+0000 7f0c0a534700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0407a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.634+0000 7f0c0a534700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0407a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57994/0 (socket says 172.21.15.17:57994) 2023-10-05T15:27:13.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.634+0000 7f0c0a534700 1 -- 172.21.15.17:0/2309706958 learned_addr learned my addr 172.21.15.17:0/2309706958 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.635+0000 7f0c0a534700 1 -- 172.21.15.17:0/2309706958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0407a9d0 con 0x7f0c0407be60 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.635+0000 7f0c0a534700 1 --2- 172.21.15.17:0/2309706958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0407a2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c000098a0 tx=0x7f0c00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0a1cb69b9fbb6e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.635+0000 7f0c09532700 1 -- 172.21.15.17:0/2309706958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c00004160 con 0x7f0c0407be60 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.635+0000 7f0c09532700 1 -- 172.21.15.17:0/2309706958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c000042c0 con 0x7f0c0407be60 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.635+0000 7f0c09532700 1 -- 172.21.15.17:0/2309706958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c000118e0 con 0x7f0c0407be60 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 -- 172.21.15.17:0/2309706958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 msgr2=0x7f0c0407a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:13.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 --2- 172.21.15.17:0/2309706958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0407a2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c000098a0 tx=0x7f0c00009bb0 comp rx=0 tx=0).stop 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 -- 172.21.15.17:0/2309706958 shutdown_connections 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 --2- 172.21.15.17:0/2309706958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0407a2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 -- 172.21.15.17:0/2309706958 >> 172.21.15.17:0/2309706958 conn(0x7f0c04101b00 msgr2=0x7f0c04103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 -- 172.21.15.17:0/2309706958 shutdown_connections 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.636+0000 7f0c0c798700 1 -- 172.21.15.17:0/2309706958 wait complete. 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.637+0000 7f0c0c798700 1 Processor -- start 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.637+0000 7f0c0c798700 1 -- start start 2023-10-05T15:27:13.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.637+0000 7f0c0c798700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0419c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:13.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.637+0000 7f0c0c798700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0419c810 con 0x7f0c0407be60 2023-10-05T15:27:13.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.638+0000 7f0c0a534700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0419c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:13.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.638+0000 7f0c0a534700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0419c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58008/0 (socket says 172.21.15.17:58008) 2023-10-05T15:27:13.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.638+0000 7f0c0a534700 1 -- 172.21.15.17:0/2476647355 learned_addr learned my addr 172.21.15.17:0/2476647355 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:13.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.638+0000 7f0c0a534700 1 -- 172.21.15.17:0/2476647355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00009550 con 0x7f0c0407be60 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.638+0000 7f0c0a534700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0419c2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c000118f0 tx=0x7f0c000119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.638+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c000036a0 con 0x7f0c0407be60 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.639+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c0001b440 con 0x7f0c0407be60 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.639+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c000193f0 con 0x7f0c0407be60 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.639+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0419ca10 con 0x7f0c0407be60 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.639+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0419ce30 con 0x7f0c0407be60 2023-10-05T15:27:13.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.640+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f0c0001b5b0 con 0x7f0c0407be60 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.640+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0410c960 con 0x7f0c0407be60 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.640+0000 7f0bfb7fe700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0bf0038a20 0x7f0bf003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.640+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c0004c970 con 0x7f0c0407be60 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.640+0000 7f0c09d33700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0bf0038a20 0x7f0bf003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.641+0000 7f0c09d33700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0bf0038a20 0x7f0bf003aee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4006fd0 tx=0x7f0bf4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.645+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c00023a00 con 0x7f0c0407be60 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.971+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f0c0410cba0 con 0x7f0c0407be60 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.974+0000 7f0bfb7fe700 1 -- 172.21.15.17:0/2476647355 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f0c0001f070 con 0x7f0c0407be60 2023-10-05T15:27:13.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.976+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0bf0038a20 msgr2=0x7f0bf003aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.976+0000 7f0c0c798700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0bf0038a20 0x7f0bf003aee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4006fd0 tx=0x7f0bf4006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.976+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 msgr2=0x7f0c0419c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.976+0000 7f0c0c798700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0419c2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c000118f0 tx=0x7f0c000119d0 comp rx=0 tx=0).stop 2023-10-05T15:27:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.977+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 shutdown_connections 2023-10-05T15:27:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.977+0000 7f0c0c798700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0bf0038a20 0x7f0bf003aee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:13.475 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.977+0000 7f0c0c798700 1 --2- 172.21.15.17:0/2476647355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c0407be60 0x7f0c0419c2d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.977+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 >> 172.21.15.17:0/2476647355 conn(0x7f0c04101b00 msgr2=0x7f0c041027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.977+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 shutdown_connections 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-10-05T15:27:12.977+0000 7f0c0c798700 1 -- 172.21.15.17:0/2476647355 wait complete. 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.476 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:13.477 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2023-10-05T15:27:13.527 INFO:tasks.cephadm:Fetching config... 2023-10-05T15:27:13.527 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:27:13.527 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-05T15:27:13.569 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-05T15:27:13.570 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:27:13.570 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-05T15:27:13.655 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-05T15:27:13.655 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:27:13.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-05T15:27:13.766 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-05T15:27:13.767 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:27:13.767 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-05T15:27:13.852 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-05T15:27:13.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-05T15:27:13.996 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:27:14.017 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:13 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2476647355' entity='client.admin' 2023-10-05T15:27:14.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-05T15:27:14.130 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:27:14.160 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-05T15:27:14.264 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsEmlfmwrtSn9RsBo9YdP4s1El53c8cP1jRau5gn+6GSD465vNq+hXdcLGuOkA20QULMfOwYm42rhPMnsAhT7Cp0Ruj42bNSGZjImR6NXcvW1PnCU8XllSHrqvYdadJJKBlLmyvkeP7JuAge/wmK/rCCT2tj92PaMr2grqIICWKZtZ0slx7BJJQzExkOHRZsQd7usju/TfxGZNP0hXhO/TdMvd4ahG/WGjjB9dh3glzDl2k9+F3EDLDrhGyw14lVF29YT1aJpLkGPM0haYe29YfoYrCZRFOXH8uvybpO9GzN9zvmArkZJ2en8RAMZq6FVP03kJE6OrHGbwjZZKZJXvH1eiu8PhLrRg6cQ9dVrbf1POFX2Evs1KSZy6FSW03jEypTO2bT2pVpkBdbMZolFgg3E+TlQNtNfoV8UISZkC6frHC02DZ4W2J7gPTwnKJteFKqB7ygAzIfd96rtez53a0bJV5OkQC2ZAVobCqONrqLREckMyHeGqgXBtJ0MVus0= ceph-6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:27:14.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-05T15:27:15.058 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:17.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 -- 172.21.15.17:0/2624192617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 msgr2=0x7f97ac073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 --2- 172.21.15.17:0/2624192617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac073340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009910 tx=0x7f97a8009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 -- 172.21.15.17:0/2624192617 shutdown_connections 2023-10-05T15:27:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 --2- 172.21.15.17:0/2624192617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac073340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 -- 172.21.15.17:0/2624192617 >> 172.21.15.17:0/2624192617 conn(0x7f97ac0fbf80 msgr2=0x7f97ac0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 -- 172.21.15.17:0/2624192617 shutdown_connections 2023-10-05T15:27:17.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.147+0000 7f97b45b7700 1 -- 172.21.15.17:0/2624192617 wait complete. 2023-10-05T15:27:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.149+0000 7f97b45b7700 1 Processor -- start 2023-10-05T15:27:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.149+0000 7f97b45b7700 1 -- start start 2023-10-05T15:27:17.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.149+0000 7f97b45b7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac19c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.149+0000 7f97b45b7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac19c540 con 0x7f97ac074ee0 2023-10-05T15:27:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.150+0000 7f97b2353700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac19c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.150+0000 7f97b2353700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac19c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38490/0 (socket says 172.21.15.17:38490) 2023-10-05T15:27:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.150+0000 7f97b2353700 1 -- 172.21.15.17:0/2773771313 learned_addr learned my addr 172.21.15.17:0/2773771313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:17.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.150+0000 7f97b2353700 1 -- 172.21.15.17:0/2773771313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80095f0 con 0x7f97ac074ee0 2023-10-05T15:27:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.150+0000 7f97b2353700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac19c000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97a8006010 tx=0x7f97a8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.151+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97a800ba90 con 0x7f97ac074ee0 2023-10-05T15:27:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.151+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97a800bbf0 con 0x7f97ac074ee0 2023-10-05T15:27:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.151+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac19c740 con 0x7f97ac074ee0 2023-10-05T15:27:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.151+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97a8017440 con 0x7f97ac074ee0 2023-10-05T15:27:17.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.151+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac19cbe0 con 0x7f97ac074ee0 2023-10-05T15:27:17.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.152+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f97a80175a0 con 0x7f97ac074ee0 2023-10-05T15:27:17.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.152+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac1959d0 con 0x7f97ac074ee0 2023-10-05T15:27:17.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.152+0000 7f97a37fe700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9798038960 0x7f979803ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.153+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f97a804cb20 con 0x7f97ac074ee0 2023-10-05T15:27:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.153+0000 7f97b1b52700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9798038960 0x7f979803ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:17.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.153+0000 7f97b1b52700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9798038960 0x7f979803ae20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f979c006fd0 tx=0x7f979c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:17.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.158+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f97a8015940 con 0x7f97ac074ee0 2023-10-05T15:27:17.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.393+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f97ac0624e0 con 0x7f97ac074ee0 2023-10-05T15:27:17.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.396+0000 7f97a37fe700 1 -- 172.21.15.17:0/2773771313 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f97a8027070 con 0x7f97ac074ee0 2023-10-05T15:27:17.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9798038960 msgr2=0x7f979803ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9798038960 0x7f979803ae20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f979c006fd0 tx=0x7f979c006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 msgr2=0x7f97ac19c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac19c000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97a8006010 tx=0x7f97a8005810 comp rx=0 tx=0).stop 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 shutdown_connections 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9798038960 0x7f979803ae20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 --2- 172.21.15.17:0/2773771313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97ac074ee0 0x7f97ac19c000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.398+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 >> 172.21.15.17:0/2773771313 conn(0x7f97ac0fbf80 msgr2=0x7f97ac0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.399+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 shutdown_connections 2023-10-05T15:27:17.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:17.399+0000 7f97b45b7700 1 -- 172.21.15.17:0/2773771313 wait complete. 2023-10-05T15:27:17.875 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-05T15:27:17.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-05T15:27:18.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:18 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2773771313' entity='client.admin' 2023-10-05T15:27:18.744 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:19.566 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:19.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:19.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:19.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:19.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:19.567 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:20.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.206+0000 7f82ea911700 1 -- 172.21.15.17:0/2093624343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 msgr2=0x7f82e4073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.206+0000 7f82ea911700 1 --2- 172.21.15.17:0/2093624343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4073340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009910 tx=0x7f82d4009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.206+0000 7f82ea911700 1 -- 172.21.15.17:0/2093624343 shutdown_connections 2023-10-05T15:27:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.206+0000 7f82ea911700 1 --2- 172.21.15.17:0/2093624343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4073340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.206+0000 7f82ea911700 1 -- 172.21.15.17:0/2093624343 >> 172.21.15.17:0/2093624343 conn(0x7f82e40fbf80 msgr2=0x7f82e40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.207+0000 7f82ea911700 1 -- 172.21.15.17:0/2093624343 shutdown_connections 2023-10-05T15:27:20.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.207+0000 7f82ea911700 1 -- 172.21.15.17:0/2093624343 wait complete. 2023-10-05T15:27:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.207+0000 7f82ea911700 1 Processor -- start 2023-10-05T15:27:20.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.208+0000 7f82ea911700 1 -- start start 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.208+0000 7f82ea911700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.208+0000 7f82ea911700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41981b0 con 0x7f82e4074ee0 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.208+0000 7f82e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.208+0000 7f82e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38510/0 (socket says 172.21.15.17:38510) 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.208+0000 7f82e3fff700 1 -- 172.21.15.17:0/1533835537 learned_addr learned my addr 172.21.15.17:0/1533835537 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82e3fff700 1 -- 172.21.15.17:0/1533835537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40095f0 con 0x7f82e4074ee0 2023-10-05T15:27:20.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82e3fff700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4197c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005950 tx=0x7f82d4005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:20.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82d400ba90 con 0x7f82e4074ee0 2023-10-05T15:27:20.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d400bbf0 con 0x7f82e4074ee0 2023-10-05T15:27:20.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e41983b0 con 0x7f82e4074ee0 2023-10-05T15:27:20.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82d4017440 con 0x7f82e4074ee0 2023-10-05T15:27:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.209+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e4198850 con 0x7f82e4074ee0 2023-10-05T15:27:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.210+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f82d400f460 con 0x7f82e4074ee0 2023-10-05T15:27:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.210+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e41915d0 con 0x7f82e4074ee0 2023-10-05T15:27:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.211+0000 7f82e17fa700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82cc0388c0 0x7f82cc03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.211+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f82d404cae0 con 0x7f82e4074ee0 2023-10-05T15:27:20.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.211+0000 7f82e37fe700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82cc0388c0 0x7f82cc03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:20.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.212+0000 7f82e37fe700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82cc0388c0 0x7f82cc03ad80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006fd0 tx=0x7f82d8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:20.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.216+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f82d4015350 con 0x7f82e4074ee0 2023-10-05T15:27:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.429+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f82e402d170 con 0x7f82cc0388c0 2023-10-05T15:27:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.433+0000 7f82e17fa700 1 -- 172.21.15.17:0/1533835537 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f82e402d170 con 0x7f82cc0388c0 2023-10-05T15:27:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82cc0388c0 msgr2=0x7f82cc03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82cc0388c0 0x7f82cc03ad80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006fd0 tx=0x7f82d8006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 msgr2=0x7f82e4197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4197c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005950 tx=0x7f82d4005810 comp rx=0 tx=0).stop 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 shutdown_connections 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82cc0388c0 0x7f82cc03ad80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 --2- 172.21.15.17:0/1533835537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e4074ee0 0x7f82e4197c70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 >> 172.21.15.17:0/1533835537 conn(0x7f82e40fbf80 msgr2=0x7f82e40fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 shutdown_connections 2023-10-05T15:27:20.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:20.435+0000 7f82ea911700 1 -- 172.21.15.17:0/1533835537 wait complete. 2023-10-05T15:27:20.922 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi079 2023-10-05T15:27:20.923 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:27:20.923 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.conf 2023-10-05T15:27:20.970 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:27:20.970 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:21.055 INFO:tasks.cephadm:Adding host smithi079 to orchestrator... 2023-10-05T15:27:21.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi079 2023-10-05T15:27:21.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:21 smithi017 ceph-mon[129107]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:21 smithi017 ceph-mon[129107]: Updating smithi017:/etc/ceph/ceph.conf 2023-10-05T15:27:21.819 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:22.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:22 smithi017 ceph-mon[129107]: Updating smithi017:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:27:22.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:22 smithi017 ceph-mon[129107]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:23.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 -- 172.21.15.17:0/2809595544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 msgr2=0x7f34d4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:23.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 --2- 172.21.15.17:0/2809595544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d4106d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009910 tx=0x7f34c4009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 -- 172.21.15.17:0/2809595544 shutdown_connections 2023-10-05T15:27:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 --2- 172.21.15.17:0/2809595544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d4106d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 -- 172.21.15.17:0/2809595544 >> 172.21.15.17:0/2809595544 conn(0x7f34d40fc4a0 msgr2=0x7f34d40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 -- 172.21.15.17:0/2809595544 shutdown_connections 2023-10-05T15:27:23.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.461+0000 7f34d9dbf700 1 -- 172.21.15.17:0/2809595544 wait complete. 2023-10-05T15:27:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.462+0000 7f34d9dbf700 1 Processor -- start 2023-10-05T15:27:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.462+0000 7f34d9dbf700 1 -- start start 2023-10-05T15:27:23.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.463+0000 7f34d9dbf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d40731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.463+0000 7f34d9dbf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4075130 con 0x7f34d4106970 2023-10-05T15:27:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.463+0000 7f34d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d40731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.463+0000 7f34d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d40731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38528/0 (socket says 172.21.15.17:38528) 2023-10-05T15:27:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.463+0000 7f34d37fe700 1 -- 172.21.15.17:0/466019154 learned_addr learned my addr 172.21.15.17:0/466019154 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.463+0000 7f34d37fe700 1 -- 172.21.15.17:0/466019154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c40095f0 con 0x7f34d4106970 2023-10-05T15:27:23.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.464+0000 7f34d37fe700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d40731b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34c4006010 tx=0x7f34c4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.464+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34c401d070 con 0x7f34d4106970 2023-10-05T15:27:23.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.464+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34c400bdf0 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.464+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34c4022d80 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.464+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d40736f0 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.464+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d4073b70 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.465+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f34c4022570 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.465+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4104c20 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.465+0000 7f34d0ff9700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f34c0038910 0x7f34c003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.465+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f34c404cb20 con 0x7f34d4106970 2023-10-05T15:27:23.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.466+0000 7f34d2ffd700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f34c0038910 0x7f34c003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:23.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.466+0000 7f34d2ffd700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f34c0038910 0x7f34c003add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006fd0 tx=0x7f34bc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:23.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.471+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f34c402bb60 con 0x7f34d4106970 2023-10-05T15:27:23.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:23.686+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}) v1 -- 0x7f34d4073e70 con 0x7f34c0038910 2023-10-05T15:27:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:23 smithi017 ceph-mon[129107]: Updating smithi017:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:27:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:25.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:25 smithi017 ceph-mon[129107]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:25 smithi017 ceph-mon[129107]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:25 smithi017 ceph-mon[129107]: Deploying cephadm binary to smithi079 2023-10-05T15:27:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.945+0000 7f34d0ff9700 1 -- 172.21.15.17:0/466019154 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f34d4073e70 con 0x7f34c0038910 2023-10-05T15:27:26.947 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi079' with addr '172.21.15.79' 2023-10-05T15:27:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f34c0038910 msgr2=0x7f34c003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f34c0038910 0x7f34c003add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34bc006fd0 tx=0x7f34bc006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 msgr2=0x7f34d40731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d40731b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34c4006010 tx=0x7f34c4004ff0 comp rx=0 tx=0).stop 2023-10-05T15:27:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 shutdown_connections 2023-10-05T15:27:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f34c0038910 0x7f34c003add0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 --2- 172.21.15.17:0/466019154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34d4106970 0x7f34d40731b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 >> 172.21.15.17:0/466019154 conn(0x7f34d40fc4a0 msgr2=0x7f34d4108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 shutdown_connections 2023-10-05T15:27:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:26.948+0000 7f34d9dbf700 1 -- 172.21.15.17:0/466019154 wait complete. 2023-10-05T15:27:27.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-05T15:27:27.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:27 smithi017 ceph-mon[129107]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:27.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:27.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:27.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:28.153 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:28.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:28 smithi017 ceph-mon[129107]: Added host smithi079 2023-10-05T15:27:28.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:28 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.634+0000 7fb758eef700 1 -- 172.21.15.17:0/278627600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 msgr2=0x7fb7540736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.634+0000 7fb758eef700 1 --2- 172.21.15.17:0/278627600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb7540736c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb744009910 tx=0x7fb744009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.635+0000 7fb758eef700 1 -- 172.21.15.17:0/278627600 shutdown_connections 2023-10-05T15:27:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.635+0000 7fb758eef700 1 --2- 172.21.15.17:0/278627600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb7540736c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:29.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.635+0000 7fb758eef700 1 -- 172.21.15.17:0/278627600 >> 172.21.15.17:0/278627600 conn(0x7fb7540fc4a0 msgr2=0x7fb7540fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.635+0000 7fb758eef700 1 -- 172.21.15.17:0/278627600 shutdown_connections 2023-10-05T15:27:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.635+0000 7fb758eef700 1 -- 172.21.15.17:0/278627600 wait complete. 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.636+0000 7fb758eef700 1 Processor -- start 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.636+0000 7fb758eef700 1 -- start start 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.636+0000 7fb758eef700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb754198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.636+0000 7fb758eef700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754198560 con 0x7fb7540732e0 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.636+0000 7fb75259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb754198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb75259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb754198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43952/0 (socket says 172.21.15.17:43952) 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb75259c700 1 -- 172.21.15.17:0/1390623772 learned_addr learned my addr 172.21.15.17:0/1390623772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb75259c700 1 -- 172.21.15.17:0/1390623772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440095f0 con 0x7fb7540732e0 2023-10-05T15:27:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb75259c700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb754198020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb744004e90 tx=0x7fb744004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb74401d070 con 0x7fb7540732e0 2023-10-05T15:27:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb754198760 con 0x7fb7540732e0 2023-10-05T15:27:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7440044b0 con 0x7fb7540732e0 2023-10-05T15:27:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.637+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7440038f0 con 0x7fb7540732e0 2023-10-05T15:27:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.638+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754198b20 con 0x7fb7540732e0 2023-10-05T15:27:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.638+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fb744003b70 con 0x7fb7540732e0 2023-10-05T15:27:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.639+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7540624e0 con 0x7fb7540732e0 2023-10-05T15:27:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.639+0000 7fb7437fe700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb73c0388c0 0x7fb73c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.639+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb74404ca30 con 0x7fb7540732e0 2023-10-05T15:27:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.639+0000 7fb751d9b700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb73c0388c0 0x7fb73c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.640+0000 7fb751d9b700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb73c0388c0 0x7fb73c03ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb748006fd0 tx=0x7fb748006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:29.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.644+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb74402a950 con 0x7fb7540732e0 2023-10-05T15:27:29.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.863+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb75410ce70 con 0x7fb73c0388c0 2023-10-05T15:27:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.864+0000 7fb7437fe700 1 -- 172.21.15.17:0/1390623772 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7fb75410ce70 con 0x7fb73c0388c0 2023-10-05T15:27:29.866 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:29.866 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}] 2023-10-05T15:27:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb73c0388c0 msgr2=0x7fb73c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb73c0388c0 0x7fb73c03ad80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb748006fd0 tx=0x7fb748006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 msgr2=0x7fb754198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb754198020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb744004e90 tx=0x7fb744004f70 comp rx=0 tx=0).stop 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 shutdown_connections 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb73c0388c0 0x7fb73c03ad80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 --2- 172.21.15.17:0/1390623772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7540732e0 0x7fb754198020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.866+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 >> 172.21.15.17:0/1390623772 conn(0x7fb7540fc4a0 msgr2=0x7fb754107550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.867+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 shutdown_connections 2023-10-05T15:27:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:29.867+0000 7fb758eef700 1 -- 172.21.15.17:0/1390623772 wait complete. 2023-10-05T15:27:29.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:29 smithi017 ceph-mon[129107]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:30.332 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2023-10-05T15:27:30.332 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:27:30.332 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2023-10-05T15:27:30.380 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:27:30.380 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:30.466 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2023-10-05T15:27:30.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi167 2023-10-05T15:27:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:30 smithi017 ceph-mon[129107]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:27:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:30 smithi017 ceph-mon[129107]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:31.202 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:32.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 -- 172.21.15.17:0/534815872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 msgr2=0x7f0ad8106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:32.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 --2- 172.21.15.17:0/534815872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8106d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009910 tx=0x7f0ac8009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 -- 172.21.15.17:0/534815872 shutdown_connections 2023-10-05T15:27:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 --2- 172.21.15.17:0/534815872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8106d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 -- 172.21.15.17:0/534815872 >> 172.21.15.17:0/534815872 conn(0x7f0ad80fc4a0 msgr2=0x7f0ad80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 -- 172.21.15.17:0/534815872 shutdown_connections 2023-10-05T15:27:32.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.692+0000 7f0adca19700 1 -- 172.21.15.17:0/534815872 wait complete. 2023-10-05T15:27:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.693+0000 7f0adca19700 1 Processor -- start 2023-10-05T15:27:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.693+0000 7f0adca19700 1 -- start start 2023-10-05T15:27:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.693+0000 7f0adca19700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8190200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.693+0000 7f0adca19700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad81941f0 con 0x7f0ad8106970 2023-10-05T15:27:32.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ad659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8190200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ad659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8190200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43958/0 (socket says 172.21.15.17:43958) 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ad659c700 1 -- 172.21.15.17:0/3745094919 learned_addr learned my addr 172.21.15.17:0/3745094919 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ad659c700 1 -- 172.21.15.17:0/3745094919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80095f0 con 0x7f0ad8106970 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ad659c700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8190200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8004f40 tx=0x7f0ac8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac801d070 con 0x7f0ad8106970 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ac80044b0 con 0x7f0ad8106970 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ac8003810 con 0x7f0ad8106970 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.694+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad8190740 con 0x7f0ad8106970 2023-10-05T15:27:32.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.695+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad8190bc0 con 0x7f0ad8106970 2023-10-05T15:27:32.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.696+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f0ac800b960 con 0x7f0ad8106970 2023-10-05T15:27:32.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.696+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8194390 con 0x7f0ad8106970 2023-10-05T15:27:32.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.696+0000 7f0ac77fe700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ac0038900 0x7f0ac003adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:32.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.696+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0ac804c850 con 0x7f0ad8106970 2023-10-05T15:27:32.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.696+0000 7f0ad5d9b700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ac0038900 0x7f0ac003adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:32.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.697+0000 7f0ad5d9b700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ac0038900 0x7f0ac003adc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0acc006fd0 tx=0x7f0acc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.702+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ac80042e0 con 0x7f0ad8106970 2023-10-05T15:27:32.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:32.921+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad8190e50 con 0x7f0ac0038900 2023-10-05T15:27:33.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:33.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:33.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:33.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:33.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:33.950 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:33.950 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:33.950 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:34.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:34 smithi017 ceph-mon[129107]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:34.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:34 smithi017 ceph-mon[129107]: Updating smithi079:/etc/ceph/ceph.conf 2023-10-05T15:27:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:35 smithi017 ceph-mon[129107]: Deploying cephadm binary to smithi167 2023-10-05T15:27:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:35 smithi017 ceph-mon[129107]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:27:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:35 smithi017 ceph-mon[129107]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:35 smithi017 ceph-mon[129107]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:36.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.238+0000 7f0ac77fe700 1 -- 172.21.15.17:0/3745094919 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0ad8190e50 con 0x7f0ac0038900 2023-10-05T15:27:36.241 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi167' with addr '172.21.15.167' 2023-10-05T15:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ac0038900 msgr2=0x7f0ac003adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ac0038900 0x7f0ac003adc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0acc006fd0 tx=0x7f0acc006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 msgr2=0x7f0ad8190200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:36.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8190200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8004f40 tx=0x7f0ac8005020 comp rx=0 tx=0).stop 2023-10-05T15:27:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 shutdown_connections 2023-10-05T15:27:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ac0038900 0x7f0ac003adc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 --2- 172.21.15.17:0/3745094919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ad8106970 0x7f0ad8190200 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 >> 172.21.15.17:0/3745094919 conn(0x7f0ad80fc4a0 msgr2=0x7f0ad8108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 shutdown_connections 2023-10-05T15:27:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:36.241+0000 7f0adca19700 1 -- 172.21.15.17:0/3745094919 wait complete. 2023-10-05T15:27:36.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-05T15:27:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: Added host smithi167 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:37.693 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.952+0000 7f55152c7700 1 -- 172.21.15.17:0/1731039301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 msgr2=0x7f5510073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.952+0000 7f55152c7700 1 --2- 172.21.15.17:0/1731039301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510073660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5500009910 tx=0x7f5500009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.952+0000 7f55152c7700 1 -- 172.21.15.17:0/1731039301 shutdown_connections 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.952+0000 7f55152c7700 1 --2- 172.21.15.17:0/1731039301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510073660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.952+0000 7f55152c7700 1 -- 172.21.15.17:0/1731039301 >> 172.21.15.17:0/1731039301 conn(0x7f55100fc4a0 msgr2=0x7f55100fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.952+0000 7f55152c7700 1 -- 172.21.15.17:0/1731039301 shutdown_connections 2023-10-05T15:27:38.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.953+0000 7f55152c7700 1 -- 172.21.15.17:0/1731039301 wait complete. 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f55152c7700 1 Processor -- start 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f55152c7700 1 -- start start 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f55152c7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f55152c7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101984d0 con 0x7f5510073280 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f550effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f550effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36904/0 (socket says 172.21.15.17:36904) 2023-10-05T15:27:38.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.954+0000 7f550effd700 1 -- 172.21.15.17:0/3071524973 learned_addr learned my addr 172.21.15.17:0/3071524973 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:38.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.955+0000 7f550effd700 1 -- 172.21.15.17:0/3071524973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000095f0 con 0x7f5510073280 2023-10-05T15:27:38.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.955+0000 7f550effd700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510197f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5500006010 tx=0x7f5500004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.955+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f550001d070 con 0x7f5510073280 2023-10-05T15:27:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.955+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f550000bdf0 con 0x7f5510073280 2023-10-05T15:27:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.955+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5500022d80 con 0x7f5510073280 2023-10-05T15:27:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.955+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55101986d0 con 0x7f5510073280 2023-10-05T15:27:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.956+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5510198af0 con 0x7f5510073280 2023-10-05T15:27:38.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.956+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f5500022570 con 0x7f5510073280 2023-10-05T15:27:38.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.957+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55100624e0 con 0x7f5510073280 2023-10-05T15:27:38.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.957+0000 7f54f7fff700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54f8038860 0x7f54f803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:38.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.957+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f550004ca90 con 0x7f5510073280 2023-10-05T15:27:38.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.957+0000 7f550e7fc700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54f8038860 0x7f54f803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:38.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.958+0000 7f550e7fc700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54f8038860 0x7f54f803ad20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5504006fd0 tx=0x7f5504006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:38.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:38.963+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f550002a540 con 0x7f5510073280 2023-10-05T15:27:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.183+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f551010cef0 con 0x7f54f8038860 2023-10-05T15:27:39.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.184+0000 7f54f7fff700 1 -- 172.21.15.17:0/3071524973 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7f551010cef0 con 0x7f54f8038860 2023-10-05T15:27:39.186 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:27:39.186 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54f8038860 msgr2=0x7f54f803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54f8038860 0x7f54f803ad20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5504006fd0 tx=0x7f5504006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 msgr2=0x7f5510197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510197f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5500006010 tx=0x7f5500004f40 comp rx=0 tx=0).stop 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 shutdown_connections 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54f8038860 0x7f54f803ad20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 --2- 172.21.15.17:0/3071524973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5510073280 0x7f5510197f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 >> 172.21.15.17:0/3071524973 conn(0x7f55100fc4a0 msgr2=0x7f5510107570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:39.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 shutdown_connections 2023-10-05T15:27:39.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:39.187+0000 7f55152c7700 1 -- 172.21.15.17:0/3071524973 wait complete. 2023-10-05T15:27:39.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:39.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:39 smithi017 ceph-mon[129107]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:39.701 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-05T15:27:39.701 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-05T15:27:40.435 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:27:40.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:40 smithi017 ceph-mon[129107]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:27:40.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:41.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 -- 172.21.15.17:0/4111639414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 msgr2=0x7ff464106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 --2- 172.21.15.17:0/4111639414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464106d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff454009910 tx=0x7ff454009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 -- 172.21.15.17:0/4111639414 shutdown_connections 2023-10-05T15:27:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 --2- 172.21.15.17:0/4111639414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464106d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:41.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 -- 172.21.15.17:0/4111639414 >> 172.21.15.17:0/4111639414 conn(0x7ff4640fc4a0 msgr2=0x7ff4640fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:41.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 -- 172.21.15.17:0/4111639414 shutdown_connections 2023-10-05T15:27:41.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.859+0000 7ff46a376700 1 -- 172.21.15.17:0/4111639414 wait complete. 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.860+0000 7ff46a376700 1 Processor -- start 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.860+0000 7ff46a376700 1 -- start start 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff46a376700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff46a376700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641962a0 con 0x7ff464106970 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff463fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff463fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36920/0 (socket says 172.21.15.17:36920) 2023-10-05T15:27:41.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff463fff700 1 -- 172.21.15.17:0/3980595176 learned_addr learned my addr 172.21.15.17:0/3980595176 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff463fff700 1 -- 172.21.15.17:0/3980595176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540095f0 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.861+0000 7ff463fff700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464195d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff454006010 tx=0x7ff454004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.862+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff45401d070 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.862+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff464196500 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.862+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff45400bdf0 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.862+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff454022cd0 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.862+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff464196980 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.863+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff454022470 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.863+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4640624e0 con 0x7ff464106970 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.864+0000 7ff4617fa700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff44c038910 0x7ff44c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:41.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.864+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff45404c9e0 con 0x7ff464106970 2023-10-05T15:27:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.864+0000 7ff4637fe700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff44c038910 0x7ff44c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:41.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.864+0000 7ff4637fe700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff44c038910 0x7ff44c03add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff458006fd0 tx=0x7ff458006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:41.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:41.869+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff45402a360 con 0x7ff464106970 2023-10-05T15:27:41.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:41 smithi017 ceph-mon[129107]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:42.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.081+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff4640008d0 con 0x7ff464106970 2023-10-05T15:27:42.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.645+0000 7ff4617fa700 1 -- 172.21.15.17:0/3980595176 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff454027030 con 0x7ff464106970 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.648+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff44c038910 msgr2=0x7ff44c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.648+0000 7ff46a376700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff44c038910 0x7ff44c03add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff458006fd0 tx=0x7ff458006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.648+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 msgr2=0x7ff464195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.648+0000 7ff46a376700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464195d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff454006010 tx=0x7ff454004ff0 comp rx=0 tx=0).stop 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.649+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 shutdown_connections 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.649+0000 7ff46a376700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff44c038910 0x7ff44c03add0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.649+0000 7ff46a376700 1 --2- 172.21.15.17:0/3980595176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff464106970 0x7ff464195d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.649+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 >> 172.21.15.17:0/3980595176 conn(0x7ff4640fc4a0 msgr2=0x7ff464108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.649+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 shutdown_connections 2023-10-05T15:27:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:27:42.649+0000 7ff46a376700 1 -- 172.21.15.17:0/3980595176 wait complete. 2023-10-05T15:27:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2023-10-05T15:27:42.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:42 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3980595176' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-05T15:27:43.116 INFO:tasks.cephadm:Adding mon.a on smithi017 2023-10-05T15:27:43.116 INFO:tasks.cephadm:Adding mon.b on smithi079 2023-10-05T15:27:43.116 INFO:tasks.cephadm:Adding mon.c on smithi167 2023-10-05T15:27:43.116 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c' 2023-10-05T15:27:43.860 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-05T15:27:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3980595176' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-05T15:27:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:27:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:43.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:43.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:43.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:43.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:43.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:44.205 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-05T15:27:44.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:44 smithi017 ceph-mon[129107]: Updating smithi167:/etc/ceph/ceph.conf 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 -- 172.21.15.167:0/2838845225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 msgr2=0x7f41e4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 --2- 172.21.15.167:0/2838845225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4106d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009910 tx=0x7f41d4009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 -- 172.21.15.167:0/2838845225 shutdown_connections 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 --2- 172.21.15.167:0/2838845225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4106d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 -- 172.21.15.167:0/2838845225 >> 172.21.15.167:0/2838845225 conn(0x7f41e40fc4a0 msgr2=0x7f41e40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 -- 172.21.15.167:0/2838845225 shutdown_connections 2023-10-05T15:27:45.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.764+0000 7f41e9c18700 1 -- 172.21.15.167:0/2838845225 wait complete. 2023-10-05T15:27:45.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.765+0000 7f41e9c18700 1 Processor -- start 2023-10-05T15:27:45.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.766+0000 7f41e9c18700 1 -- start start 2023-10-05T15:27:45.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.766+0000 7f41e9c18700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:45.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.766+0000 7f41e9c18700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e41984d0 con 0x7f41e4106970 2023-10-05T15:27:45.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.767+0000 7f41e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:45.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.767+0000 7f41e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.167:48964/0 (socket says 172.21.15.167:48964) 2023-10-05T15:27:45.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.767+0000 7f41e37fe700 1 -- 172.21.15.167:0/2929864917 learned_addr learned my addr 172.21.15.167:0/2929864917 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:27:45.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.767+0000 7f41e37fe700 1 -- 172.21.15.167:0/2929864917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40095f0 con 0x7f41e4106970 2023-10-05T15:27:45.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.768+0000 7f41e37fe700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4197f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41d4006010 tx=0x7f41d4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:45.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.768+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41d401d070 con 0x7f41e4106970 2023-10-05T15:27:45.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.768+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e4198730 con 0x7f41e4106970 2023-10-05T15:27:45.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.768+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41d400bdf0 con 0x7f41e4106970 2023-10-05T15:27:45.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.768+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41d4022d80 con 0x7f41e4106970 2023-10-05T15:27:45.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.768+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e4198bb0 con 0x7f41e4106970 2023-10-05T15:27:45.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.769+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e40624e0 con 0x7f41e4106970 2023-10-05T15:27:45.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.769+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f41d400b960 con 0x7f41e4106970 2023-10-05T15:27:45.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.770+0000 7f41e0ff9700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41cc0388c0 0x7f41cc03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:45.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.770+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f41d404cac0 con 0x7f41e4106970 2023-10-05T15:27:45.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.770+0000 7f41e2ffd700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41cc0388c0 0x7f41cc03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:45.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.771+0000 7f41e2ffd700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41cc0388c0 0x7f41cc03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41d8006fd0 tx=0x7f41d8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:45.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.776+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f41d402bba0 con 0x7f41e4106970 2023-10-05T15:27:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:45 smithi017 ceph-mon[129107]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:27:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:45 smithi017 ceph-mon[129107]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:45 smithi017 ceph-mon[129107]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:45.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.983+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f41e410ad50 con 0x7f41cc0388c0 2023-10-05T15:27:45.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.991+0000 7f41e0ff9700 1 -- 172.21.15.167:0/2929864917 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f41e410ad50 con 0x7f41cc0388c0 2023-10-05T15:27:45.994 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mon update... 2023-10-05T15:27:45.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41cc0388c0 msgr2=0x7f41cc03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:45.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41cc0388c0 0x7f41cc03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f41d8006fd0 tx=0x7f41d8006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:45.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 msgr2=0x7f41e4197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4197f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41d4006010 tx=0x7f41d4004ff0 comp rx=0 tx=0).stop 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 shutdown_connections 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41cc0388c0 0x7f41cc03ad80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 --2- 172.21.15.167:0/2929864917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41e4106970 0x7f41e4197f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 >> 172.21.15.167:0/2929864917 conn(0x7f41e40fc4a0 msgr2=0x7f41e4108e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 shutdown_connections 2023-10-05T15:27:45.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:45.994+0000 7f41e9c18700 1 -- 172.21.15.167:0/2929864917 wait complete. 2023-10-05T15:27:46.495 DEBUG:teuthology.orchestra.run.smithi079:mon.b> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-05T15:27:46.500 DEBUG:teuthology.orchestra.run.smithi167:mon.c> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-05T15:27:46.504 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-05T15:27:46.504 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-05T15:27:46.577 INFO:journalctl@ceph.mon.b.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:27:46.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c;count:3 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:46.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:46.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:27:46.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:46.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: Deploying daemon mon.c on smithi167 2023-10-05T15:27:46.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:46 smithi017 ceph-mon[129107]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:47.777 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:27:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:49 smithi017 ceph-mon[129107]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:49.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.994+0000 7fba7141b700 1 -- 172.21.15.167:0/3221365979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 msgr2=0x7fba6c0684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:49.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.994+0000 7fba7141b700 1 --2- 172.21.15.167:0/3221365979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c0684c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009910 tx=0x7fba5c009c20 comp rx=0 tx=0).stop 2023-10-05T15:27:49.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.995+0000 7fba7141b700 1 -- 172.21.15.167:0/3221365979 shutdown_connections 2023-10-05T15:27:49.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.995+0000 7fba7141b700 1 --2- 172.21.15.167:0/3221365979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c0684c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:49.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.995+0000 7fba7141b700 1 -- 172.21.15.167:0/3221365979 >> 172.21.15.167:0/3221365979 conn(0x7fba6c075180 msgr2=0x7fba6c075590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:49.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.995+0000 7fba7141b700 1 -- 172.21.15.167:0/3221365979 shutdown_connections 2023-10-05T15:27:49.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.995+0000 7fba7141b700 1 -- 172.21.15.167:0/3221365979 wait complete. 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.996+0000 7fba7141b700 1 Processor -- start 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.996+0000 7fba7141b700 1 -- start start 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.996+0000 7fba7141b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.996+0000 7fba7141b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c198340 con 0x7fba6c0680e0 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.997+0000 7fba6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.997+0000 7fba6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.167:58448/0 (socket says 172.21.15.167:58448) 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.997+0000 7fba6bfff700 1 -- 172.21.15.167:0/437222690 learned_addr learned my addr 172.21.15.167:0/437222690 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:27:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.997+0000 7fba6bfff700 1 -- 172.21.15.167:0/437222690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0095f0 con 0x7fba6c0680e0 2023-10-05T15:27:50.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.997+0000 7fba6bfff700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c197e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba5c006010 tx=0x7fba5c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:50.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.998+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba5c01d070 con 0x7fba6c0680e0 2023-10-05T15:27:50.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.998+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c198540 con 0x7fba6c0680e0 2023-10-05T15:27:50.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.998+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c198960 con 0x7fba6c0680e0 2023-10-05T15:27:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.998+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba5c00bdf0 con 0x7fba6c0680e0 2023-10-05T15:27:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.998+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba5c022d10 con 0x7fba6c0680e0 2023-10-05T15:27:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.999+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c0624e0 con 0x7fba6c0680e0 2023-10-05T15:27:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:49.999+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fba5c00b960 con 0x7fba6c0680e0 2023-10-05T15:27:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.000+0000 7fba697fa700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba54038910 0x7fba5403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.000+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fba5c04ca50 con 0x7fba6c0680e0 2023-10-05T15:27:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.000+0000 7fba6b7fe700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba54038910 0x7fba5403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.001+0000 7fba6b7fe700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba54038910 0x7fba5403add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba60006fd0 tx=0x7fba60006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:50.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.005+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fba5c022500 con 0x7fba6c0680e0 2023-10-05T15:27:50.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.322+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fba6c10cb50 con 0x7fba6c0680e0 2023-10-05T15:27:50.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.323+0000 7fba697fa700 1 -- 172.21.15.167:0/437222690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fba5c027070 con 0x7fba6c0680e0 2023-10-05T15:27:50.325 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:27:50.325 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","modified":"2023-10-05T15:26:00.673148Z","created":"2023-10-05T15:26:00.673148Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-05T15:27:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba54038910 msgr2=0x7fba5403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba54038910 0x7fba5403add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba60006fd0 tx=0x7fba60006e40 comp rx=0 tx=0).stop 2023-10-05T15:27:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 msgr2=0x7fba6c197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c197e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba5c006010 tx=0x7fba5c004ff0 comp rx=0 tx=0).stop 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 shutdown_connections 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba54038910 0x7fba5403add0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 --2- 172.21.15.167:0/437222690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba6c0680e0 0x7fba6c197e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 >> 172.21.15.167:0/437222690 conn(0x7fba6c075180 msgr2=0x7fba6c107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 shutdown_connections 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:50.325+0000 7fba7141b700 1 -- 172.21.15.167:0/437222690 wait complete. 2023-10-05T15:27:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2023-10-05T15:27:50.446 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:50 smithi167 systemd[1]: Starting Ceph mon.c for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:27:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/437222690' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:27:51.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 podman[133326]: 2023-10-05T15:27:51.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 bash[133326]: 5737034d7f94d54253ff52c33999c7389b3c7cec088983095a101e50c76cd446 2023-10-05T15:27:51.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: set uid:gid to 167:167 (ceph:ceph) 2023-10-05T15:27:51.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev), process ceph-mon, pid 7 2023-10-05T15:27:51.360 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pidfile_write: ignore empty --pid-file 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: load: jerasure load: lrc 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: RocksDB version: 7.9.2 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Git sha 0 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Compile date 2023-10-05 12:06:36 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: DB SUMMARY 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: DB Session ID: THUWU0E5EHNLY0MJ80FC 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: CURRENT file: CURRENT 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: IDENTITY file: IDENTITY 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-05T15:27:51.361 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.error_if_exists: 0 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.create_if_missing: 0 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.paranoid_checks: 1 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.env: 0x5613a4d47da0 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.fs: PosixFileSystem 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.info_log: 0x5613a67cf5c0 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_file_opening_threads: 16 2023-10-05T15:27:51.362 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.statistics: (nil) 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.use_fsync: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_log_file_size: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.keep_log_file_num: 1000 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.recycle_log_file_num: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.allow_fallocate: 1 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.allow_mmap_reads: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.allow_mmap_writes: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.use_direct_reads: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-05T15:27:51.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.create_missing_column_families: 0 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.db_log_dir: 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.wal_dir: 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.advise_random_on_open: 1 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.db_write_buffer_size: 0 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.write_buffer_manager: 0x5613a6787360 2023-10-05T15:27:51.364 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.rate_limiter: (nil) 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.wal_recovery_mode: 2 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.enable_thread_tracking: 0 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.enable_pipelined_write: 0 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.unordered_write: 0 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-05T15:27:51.365 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.row_cache: None 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.wal_filter: None 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.allow_ingest_behind: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.two_write_queues: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.manual_wal_flush: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.wal_compression: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.atomic_flush: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-05T15:27:51.366 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-05T15:27:51.367 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.log_readahead_size: 0 2023-10-05T15:27:51.367 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-05T15:27:51.367 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.best_efforts_recovery: 0 2023-10-05T15:27:51.367 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-05T15:27:51.367 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-05T15:27:51.368 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.allow_data_in_errors: 0 2023-10-05T15:27:51.368 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.db_host_id: __hostname__ 2023-10-05T15:27:51.368 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-05T15:27:51.368 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_background_jobs: 2 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_background_compactions: -1 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_subcompactions: 1 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_total_wal_size: 0 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_open_files: -1 2023-10-05T15:27:51.369 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bytes_per_sync: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_readahead_size: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_background_flushes: -1 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Compression algorithms supported: 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kZSTD supported: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kXpressCompression supported: 0 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kLZ4HCCompression supported: 1 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kZlibCompression supported: 1 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kSnappyCompression supported: 1 2023-10-05T15:27:51.370 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kLZ4Compression supported: 1 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: kBZip2Compression supported: 0 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.merge_operator: 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_filter: None 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_filter_factory: None 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.sst_partitioner_factory: None 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-05T15:27:51.371 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5613a67cf6c0) 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks: 1 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_top_level_index_and_filter: 1 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_type: 0 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_index_type: 0 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_shortening: 1 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: checksum: 4 2023-10-05T15:27:51.372 INFO:journalctl@ceph.mon.c.smithi167.stdout: no_block_cache: 0 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache: 0x5613a68251f0 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_name: BinnedLRUCache 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_options: 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: capacity : 536870912 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_shard_bits : 4 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: strict_capacity_limit : 0 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: high_pri_pool_ratio: 0.000 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_compressed: (nil) 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: persistent_cache: (nil) 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size: 4096 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size_deviation: 10 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_restart_interval: 16 2023-10-05T15:27:51.373 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_block_restart_interval: 1 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: metadata_block_size: 4096 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: partition_filters: 0 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: use_delta_encoding: 1 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: filter_policy: bloomfilter 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: whole_key_filtering: 1 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: verify_compression: 0 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: read_amp_bytes_per_bit: 0 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: format_version: 5 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_index_compression: 1 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_align: 0 2023-10-05T15:27:51.374 INFO:journalctl@ceph.mon.c.smithi167.stdout: max_auto_readahead_size: 262144 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout: prepopulate_block_cache: 0 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout: initial_auto_readahead_size: 8192 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.write_buffer_size: 33554432 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_write_buffer_number: 2 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression: NoCompression 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression: Disabled 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.prefix_extractor: nullptr 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.num_levels: 7 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-05T15:27:51.375 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-05T15:27:51.376 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.level: 32767 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.strategy: 0 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.enabled: false 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.target_file_size_base: 67108864 2023-10-05T15:27:51.377 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-05T15:27:51.378 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.arena_block_size: 1048576 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.disable_auto_compactions: 0 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-05T15:27:51.379 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.table_properties_collectors: 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.inplace_update_support: 0 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.bloom_locality: 0 2023-10-05T15:27:51.380 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.max_successive_merges: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.paranoid_file_checks: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.force_consistency_checks: 1 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.report_bg_io_stats: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.ttl: 2592000 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.enable_blob_files: false 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.min_blob_size: 0 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.blob_file_size: 268435456 2023-10-05T15:27:51.381 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.blob_file_starting_level: 0 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 28b961b3-502e-407c-b5eb-b8104ba49375 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519671319160, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-05T15:27:51.382 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 systemd[1]: Started Ceph mon.c for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519671320386, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696519671, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "28b961b3-502e-407c-b5eb-b8104ba49375", "db_session_id": "THUWU0E5EHNLY0MJ80FC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519671320532, "job": 1, "event": "recovery_finished"} 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5613a68c2000 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: DB pointer 0x5613a68ae000 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** DB Stats ** 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:27:51.383 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:27:51.384 INFO:journalctl@ceph.mon.c.smithi167.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-05T15:27:51.385 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache BinnedLRUCache@0x5613a68251f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-05T15:27:51.386 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: starting mon.c rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(???) e0 preinit fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).mds e1 new map 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout: e1 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout: legacy client fscid: -1 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout: No filesystems configured 2023-10-05T15:27:51.387 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Added host smithi079 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.388 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:51.389 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:51.739 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-05T15:27:51.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi079:/etc/ceph/ceph.conf 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Deploying cephadm binary to smithi167 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:27:51.804 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Added host smithi167 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.805 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3980595176' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3980595176' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:51.806 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi167:/etc/ceph/ceph.conf 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c;count:3 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:51.807 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: Deploying daemon mon.c on smithi167 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/437222690' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expand map: {default=false} 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta from 'false' to 'false' 2023-10-05T15:27:51.808 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expanded map: {default=false} 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expand map: {default=info} 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta from 'info' to 'info' 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expanded map: {default=info} 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expand map: {default=daemon} 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expanded map: {default=daemon} 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expand map: {default=debug} 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta from 'debug' to 'debug' 2023-10-05T15:27:51.809 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:51 smithi167 ceph-mon[133366]: expand_channel_meta expanded map: {default=debug} 2023-10-05T15:27:52.465 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:27:56.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:27:56.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: mon.a calling monitor election 2023-10-05T15:27:56.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:56.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: mon.c calling monitor election 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0]} removed_ranks: {} 2023-10-05T15:27:56.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: fsmap 2023-10-05T15:27:56.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:27:56.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: mgrmap e13: x(active, since 51s) 2023-10-05T15:27:56.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: overall HEALTH_OK 2023-10-05T15:27:56.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:56.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:27:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: mon.a calling monitor election 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: mon.c calling monitor election 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:56.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0]} removed_ranks: {} 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: fsmap 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: mgrmap e13: x(active, since 51s) 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: overall HEALTH_OK 2023-10-05T15:27:56.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:56.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:56.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.969+0000 7f106deb1700 1 -- 172.21.15.167:0/1281841133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 msgr2=0x7f1050005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:56.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.969+0000 7f106deb1700 1 --2- 172.21.15.167:0/1281841133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1050005610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1058005fa0 tx=0x7f105800ffc0 comp rx=0 tx=0).stop 2023-10-05T15:27:56.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.969+0000 7f106deb1700 1 -- 172.21.15.167:0/1281841133 shutdown_connections 2023-10-05T15:27:56.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.969+0000 7f106deb1700 1 --2- 172.21.15.167:0/1281841133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1050005610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:56.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.969+0000 7f106deb1700 1 -- 172.21.15.167:0/1281841133 >> 172.21.15.167:0/1281841133 conn(0x7f10680fc540 msgr2=0x7f10680fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:56.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.970+0000 7f106deb1700 1 -- 172.21.15.167:0/1281841133 shutdown_connections 2023-10-05T15:27:56.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.970+0000 7f106deb1700 1 -- 172.21.15.167:0/1281841133 wait complete. 2023-10-05T15:27:56.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.971+0000 7f106deb1700 1 Processor -- start 2023-10-05T15:27:56.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.971+0000 7f106deb1700 1 -- start start 2023-10-05T15:27:56.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f106deb1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1068195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:56.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f106deb1700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10681963c0 0x7f106819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:56.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f106deb1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068196950 con 0x7f1068106a70 2023-10-05T15:27:56.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f106deb1700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068196ac0 con 0x7f10681963c0 2023-10-05T15:27:56.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f10677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1068195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:56.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f10677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1068195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.167:58514/0 (socket says 172.21.15.167:58514) 2023-10-05T15:27:56.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f10677fe700 1 -- 172.21.15.167:0/3275524232 learned_addr learned my addr 172.21.15.167:0/3275524232 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:27:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.972+0000 7f10677fe700 1 -- 172.21.15.167:0/3275524232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10681963c0 msgr2=0x7f106819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.973+0000 7f10677fe700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10681963c0 0x7f106819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.973+0000 7f10677fe700 1 -- 172.21.15.167:0/3275524232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105800f9c0 con 0x7f1068106a70 2023-10-05T15:27:56.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.973+0000 7f10677fe700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1068195e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1058004be0 tx=0x7f1058005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.974+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1058005290 con 0x7f1068106a70 2023-10-05T15:27:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.974+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1058021040 con 0x7f1068106a70 2023-10-05T15:27:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.974+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106819add0 con 0x7f1068106a70 2023-10-05T15:27:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.974+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f105801bdf0 con 0x7f1068106a70 2023-10-05T15:27:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.974+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106819b320 con 0x7f1068106a70 2023-10-05T15:27:56.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.975+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f1058011550 con 0x7f1068106a70 2023-10-05T15:27:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.975+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10680624e0 con 0x7f1068106a70 2023-10-05T15:27:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.975+0000 7f1064ff9700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1054038700 0x7f105403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:27:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.976+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f105804dca0 con 0x7f1068106a70 2023-10-05T15:27:56.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.976+0000 7f1066ffd700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1054038700 0x7f105403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:27:56.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.977+0000 7f1066ffd700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1054038700 0x7f105403abc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f105c0098e0 tx=0x7f105c006dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:27:56.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:56.981+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f105802de20 con 0x7f1068106a70 2023-10-05T15:27:57.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.260+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f106819b5a0 con 0x7f1068106a70 2023-10-05T15:27:57.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.261+0000 7f1064ff9700 1 -- 172.21.15.167:0/3275524232 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f105802de20 con 0x7f1068106a70 2023-10-05T15:27:57.263 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:27:57.263 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","modified":"2023-10-05T15:27:51.369891Z","created":"2023-10-05T15:26:00.673148Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-05T15:27:57.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1054038700 msgr2=0x7f105403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1054038700 0x7f105403abc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f105c0098e0 tx=0x7f105c006dd0 comp rx=0 tx=0).stop 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 msgr2=0x7f1068195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1068195e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1058004be0 tx=0x7f1058005be0 comp rx=0 tx=0).stop 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 shutdown_connections 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1054038700 0x7f105403abc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1068106a70 0x7f1068195e80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:57.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 --2- 172.21.15.167:0/3275524232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10681963c0 0x7f106819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:27:57.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.263+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 >> 172.21.15.167:0/3275524232 conn(0x7f10680fc540 msgr2=0x7f1068102570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:27:57.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.264+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 shutdown_connections 2023-10-05T15:27:57.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:27:57.264+0000 7f106deb1700 1 -- 172.21.15.167:0/3275524232 wait complete. 2023-10-05T15:27:57.267 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2023-10-05T15:27:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:27:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: Deploying daemon mon.b on smithi079 2023-10-05T15:27:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:57.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/3275524232' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:27:57.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: Deploying daemon mon.b on smithi079 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/3275524232' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:27:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:27:58.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:27:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:27:58.369+0000 7f327be70700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-05T15:27:58.748 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-05T15:27:58.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-05T15:27:59.481 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:27:59.800 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:27:59 smithi167 ceph-mon[133366]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:27:59.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:27:59 smithi017 ceph-mon[129107]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:00.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 systemd[1]: Starting Ceph mon.b for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:28:00.815 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 podman[132896]: 2023-10-05T15:28:00.815 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 bash[132896]: 25ce400afe6766551bb4e74cb00d4f4844ace52919f2aa01f2f6464fb4b25d3e 2023-10-05T15:28:00.815 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: set uid:gid to 167:167 (ceph:ceph) 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev), process ceph-mon, pid 7 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pidfile_write: ignore empty --pid-file 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: load: jerasure load: lrc 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: RocksDB version: 7.9.2 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Git sha 0 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Compile date 2023-10-05 12:06:36 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: DB SUMMARY 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: DB Session ID: L6TLY4N1RZVGC0PX3VPI 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: CURRENT file: CURRENT 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: IDENTITY file: IDENTITY 2023-10-05T15:28:00.816 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.error_if_exists: 0 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.create_if_missing: 0 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.paranoid_checks: 1 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.env: 0x56129520dda0 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.fs: PosixFileSystem 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.info_log: 0x561296c875c0 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_file_opening_threads: 16 2023-10-05T15:28:00.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.statistics: (nil) 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.use_fsync: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_log_file_size: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.keep_log_file_num: 1000 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.recycle_log_file_num: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.allow_fallocate: 1 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.allow_mmap_reads: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.allow_mmap_writes: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.use_direct_reads: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-05T15:28:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.create_missing_column_families: 0 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.db_log_dir: 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.wal_dir: 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.advise_random_on_open: 1 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.db_write_buffer_size: 0 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.write_buffer_manager: 0x561296c3f360 2023-10-05T15:28:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.rate_limiter: (nil) 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.wal_recovery_mode: 2 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.enable_thread_tracking: 0 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.enable_pipelined_write: 0 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.unordered_write: 0 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-05T15:28:00.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.row_cache: None 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.wal_filter: None 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.allow_ingest_behind: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.two_write_queues: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.manual_wal_flush: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.wal_compression: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.atomic_flush: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.log_readahead_size: 0 2023-10-05T15:28:00.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-05T15:28:00.822 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.best_efforts_recovery: 0 2023-10-05T15:28:00.822 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-05T15:28:00.822 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-05T15:28:00.823 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.allow_data_in_errors: 0 2023-10-05T15:28:00.823 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.db_host_id: __hostname__ 2023-10-05T15:28:00.823 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-05T15:28:00.823 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_background_jobs: 2 2023-10-05T15:28:00.823 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_background_compactions: -1 2023-10-05T15:28:00.823 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_subcompactions: 1 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_total_wal_size: 0 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_open_files: -1 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bytes_per_sync: 0 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-05T15:28:00.824 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_readahead_size: 0 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_background_flushes: -1 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Compression algorithms supported: 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kZSTD supported: 0 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kXpressCompression supported: 0 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kLZ4HCCompression supported: 1 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kZlibCompression supported: 1 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kSnappyCompression supported: 1 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kLZ4Compression supported: 1 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: kBZip2Compression supported: 0 2023-10-05T15:28:00.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.merge_operator: 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_filter: None 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_filter_factory: None 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.sst_partitioner_factory: None 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561296c876c0) 2023-10-05T15:28:00.826 INFO:journalctl@ceph.mon.b.smithi079.stdout: cache_index_and_filter_blocks: 1 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: pin_top_level_index_and_filter: 1 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: index_type: 0 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: data_block_index_type: 0 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: index_shortening: 1 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: checksum: 4 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: no_block_cache: 0 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_cache: 0x561296cdd1f0 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_cache_name: BinnedLRUCache 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_cache_options: 2023-10-05T15:28:00.827 INFO:journalctl@ceph.mon.b.smithi079.stdout: capacity : 536870912 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: num_shard_bits : 4 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: strict_capacity_limit : 0 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: high_pri_pool_ratio: 0.000 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_cache_compressed: (nil) 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: persistent_cache: (nil) 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_size: 4096 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_size_deviation: 10 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_restart_interval: 16 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: index_block_restart_interval: 1 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: metadata_block_size: 4096 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: partition_filters: 0 2023-10-05T15:28:00.828 INFO:journalctl@ceph.mon.b.smithi079.stdout: use_delta_encoding: 1 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: filter_policy: bloomfilter 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: whole_key_filtering: 1 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: verify_compression: 0 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: read_amp_bytes_per_bit: 0 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: format_version: 5 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: enable_index_compression: 1 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: block_align: 0 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: max_auto_readahead_size: 262144 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: prepopulate_block_cache: 0 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: initial_auto_readahead_size: 8192 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout: num_file_reads_for_auto_readahead: 2 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.write_buffer_size: 33554432 2023-10-05T15:28:00.829 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_write_buffer_number: 2 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression: NoCompression 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression: Disabled 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.prefix_extractor: nullptr 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.num_levels: 7 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-05T15:28:00.830 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.level: 32767 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.strategy: 0 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-05T15:28:00.831 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.enabled: false 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.target_file_size_base: 67108864 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-05T15:28:00.832 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.arena_block_size: 1048576 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.disable_auto_compactions: 0 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-05T15:28:00.833 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.table_properties_collectors: 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.inplace_update_support: 0 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-05T15:28:00.834 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.bloom_locality: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.max_successive_merges: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.paranoid_file_checks: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.force_consistency_checks: 1 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.report_bg_io_stats: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.ttl: 2592000 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-05T15:28:00.835 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.enable_blob_files: false 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.min_blob_size: 0 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.blob_file_size: 268435456 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.blob_file_starting_level: 0 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-05T15:28:00.836 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b84e37a3-1cb2-467f-b4f6-59d1123a7492 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519680776606, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519680777360, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696519680, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b84e37a3-1cb2-467f-b4f6-59d1123a7492", "db_session_id": "L6TLY4N1RZVGC0PX3VPI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696519680777609, "job": 1, "event": "recovery_finished"} 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561296d7a000 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: DB pointer 0x561296d66000 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout: ** DB Stats ** 2023-10-05T15:28:00.837 INFO:journalctl@ceph.mon.b.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: ** Compaction Stats [default] ** 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:28:00.838 INFO:journalctl@ceph.mon.b.smithi079.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: ** Compaction Stats [default] ** 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-05T15:28:00.839 INFO:journalctl@ceph.mon.b.smithi079.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: Cumulative compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: Interval compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: Block cache BinnedLRUCache@0x561296cdd1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: using public_addr v2:172.21.15.79:0/0 -> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] 2023-10-05T15:28:00.840 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: starting mon.b rank -1 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(???) e0 preinit fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).mds e1 new map 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout: e1 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout: legacy client fscid: -1 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout: 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout: No filesystems configured 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-05T15:28:00.841 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Added host smithi079 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:28:00.842 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi079:/etc/ceph/ceph.conf 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Deploying cephadm binary to smithi167 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:00.843 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Added host smithi167 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:00.844 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3980595176' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3980595176' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi167:/etc/ceph/ceph.conf 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:28:01.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c;count:3 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.107 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Deploying daemon mon.c on smithi167 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/437222690' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.a calling monitor election 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.c calling monitor election 2023-10-05T15:28:01.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0]} removed_ranks: {} 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: fsmap 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mgrmap e13: x(active, since 51s) 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: overall HEALTH_OK 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.109 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: Deploying daemon mon.b on smithi079 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/3275524232' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expand map: {default=false} 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta from 'false' to 'false' 2023-10-05T15:28:01.110 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expanded map: {default=false} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expand map: {default=info} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta from 'info' to 'info' 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expanded map: {default=info} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expand map: {default=daemon} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expanded map: {default=daemon} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expand map: {default=debug} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta from 'debug' to 'debug' 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 ceph-mon[132936]: expand_channel_meta expanded map: {default=debug} 2023-10-05T15:28:01.111 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:00 smithi079 systemd[1]: Started Ceph mon.b for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:28:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:28:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: mon.a calling monitor election 2023-10-05T15:28:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: mon.c calling monitor election 2023-10-05T15:28:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: mon.b calling monitor election 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0],c=[v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0]} removed_ranks: {} 2023-10-05T15:28:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: fsmap 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: mgrmap e13: x(active, since 61s) 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: overall HEALTH_OK 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:28:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: mon.a calling monitor election 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: mon.c calling monitor election 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: mon.b calling monitor election 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0],c=[v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0]} removed_ranks: {} 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: fsmap 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: mgrmap e13: x(active, since 61s) 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: overall HEALTH_OK 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: mon.a calling monitor election 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: mon.c calling monitor election 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: mon.b calling monitor election 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0],c=[v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0]} removed_ranks: {} 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: fsmap 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: osdmap e4: 0 total, 0 up, 0 in 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: mgrmap e13: x(active, since 61s) 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: overall HEALTH_OK 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:06.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.958+0000 7fc1482cc700 1 -- 172.21.15.167:0/490747179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12c0062a0 msgr2=0x7fc12c008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.958+0000 7fc1482cc700 1 --2- 172.21.15.167:0/490747179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12c0062a0 0x7fc12c008710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc140101b30 tx=0x7fc13c00fe90 comp rx=0 tx=0).stop 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.958+0000 7fc1482cc700 1 -- 172.21.15.167:0/490747179 shutdown_connections 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.959+0000 7fc1482cc700 1 --2- 172.21.15.167:0/490747179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc12c0062a0 0x7fc12c008710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.959+0000 7fc1482cc700 1 -- 172.21.15.167:0/490747179 >> 172.21.15.167:0/490747179 conn(0x7fc1400fc540 msgr2=0x7fc1400fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.959+0000 7fc1482cc700 1 -- 172.21.15.167:0/490747179 shutdown_connections 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.959+0000 7fc1482cc700 1 -- 172.21.15.167:0/490747179 wait complete. 2023-10-05T15:28:06.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 Processor -- start 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 -- start start 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 0x7fc1401988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc140198df0 0x7fc14019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc14019d3c0 0x7fc14019d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401a52d0 con 0x7fc14019d3c0 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401a5440 con 0x7fc140198df0 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.960+0000 7fc1482cc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1401a5600 con 0x7fc1401984d0 2023-10-05T15:28:06.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 0x7fc1401988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 0x7fc1401988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36892/0 (socket says 172.21.15.167:36892) 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 -- 172.21.15.167:0/3278288492 learned_addr learned my addr 172.21.15.167:0/3278288492 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146869700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc14019d3c0 0x7fc14019d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 -- 172.21.15.167:0/3278288492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc140198df0 msgr2=0x7fc14019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc145867700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc140198df0 0x7fc14019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc140198df0 0x7fc14019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 -- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc14019d3c0 msgr2=0x7fc14019d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc14019d3c0 0x7fc14019d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 -- 172.21.15.167:0/3278288492 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c00f8e0 con 0x7fc1401984d0 2023-10-05T15:28:06.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146869700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc14019d3c0 0x7fc14019d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc145867700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc140198df0 0x7fc14019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.961+0000 7fc146068700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 0x7fc1401988b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc13c015040 tx=0x7fc13c005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.962+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c005da0 con 0x7fc1401984d0 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.962+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc13c02b070 con 0x7fc1401984d0 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.962+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1401a5880 con 0x7fc1401984d0 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.962+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c031420 con 0x7fc1401984d0 2023-10-05T15:28:06.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.962+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1401a5d30 con 0x7fc1401984d0 2023-10-05T15:28:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.963+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fc13c003680 con 0x7fc1401984d0 2023-10-05T15:28:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.963+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1400624e0 con 0x7fc1401984d0 2023-10-05T15:28:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.963+0000 7fc1377fe700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc124038d90 0x7fc12403b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.963+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc13c02d070 con 0x7fc1401984d0 2023-10-05T15:28:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.964+0000 7fc145867700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc124038d90 0x7fc12403b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:06.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.964+0000 7fc145867700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc124038d90 0x7fc12403b250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc1300079b0 tx=0x7fc130008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:06.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:06.969+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc13c01d9e0 con 0x7fc1401984d0 2023-10-05T15:28:07.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:06 smithi017 ceph-mon[129107]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:07.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.257+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc140108760 con 0x7fc1401984d0 2023-10-05T15:28:07.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.258+0000 7fc1377fe700 1 -- 172.21.15.167:0/3278288492 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1272 (secure 0 0 0) 0x7fc13c03aba0 con 0x7fc1401984d0 2023-10-05T15:28:07.260 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T15:28:07.261 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":3,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","modified":"2023-10-05T15:28:00.822313Z","created":"2023-10-05T15:26:00.673148Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-05T15:28:07.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc124038d90 msgr2=0x7fc12403b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:07.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc124038d90 0x7fc12403b250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc1300079b0 tx=0x7fc130008040 comp rx=0 tx=0).stop 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 msgr2=0x7fc1401988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 0x7fc1401988b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc13c015040 tx=0x7fc13c005c90 comp rx=0 tx=0).stop 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 shutdown_connections 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc124038d90 0x7fc12403b250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc14019d3c0 0x7fc14019d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1401984d0 0x7fc1401988b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 --2- 172.21.15.167:0/3278288492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc140198df0 0x7fc14019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.261+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 >> 172.21.15.167:0/3278288492 conn(0x7fc1400fc540 msgr2=0x7fc1400730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.262+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 shutdown_connections 2023-10-05T15:28:07.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:07.262+0000 7fc1482cc700 1 -- 172.21.15.167:0/3278288492 wait complete. 2023-10-05T15:28:07.265 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 3 2023-10-05T15:28:07.292 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:07.293 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:06 smithi167 ceph-mon[133366]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:07.293 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:07.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:07.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:06 smithi079 ceph-mon[132936]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:07.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:28:07.766 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-05T15:28:07.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-05T15:28:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:07 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/3278288492' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:28:08.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:07 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/3278288492' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:28:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:07 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/3278288492' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-05T15:28:08.531 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:28:09.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:09.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:09.194 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: Updating smithi017:/etc/ceph/ceph.conf 2023-10-05T15:28:09.194 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: Updating smithi079:/etc/ceph/ceph.conf 2023-10-05T15:28:09.194 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: Updating smithi167:/etc/ceph/ceph.conf 2023-10-05T15:28:09.194 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:08 smithi017 ceph-mon[129107]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: Updating smithi017:/etc/ceph/ceph.conf 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: Updating smithi079:/etc/ceph/ceph.conf 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: Updating smithi167:/etc/ceph/ceph.conf 2023-10-05T15:28:09.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:08 smithi167 ceph-mon[133366]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:09.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: Updating smithi017:/etc/ceph/ceph.conf 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: Updating smithi079:/etc/ceph/ceph.conf 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: Updating smithi167:/etc/ceph/ceph.conf 2023-10-05T15:28:09.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:08 smithi079 ceph-mon[132936]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 -- 172.21.15.17:0/709185661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818106970 msgr2=0x7f6818106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 --2- 172.21.15.17:0/709185661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818106970 0x7f6818106d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6814009910 tx=0x7f6814009c20 comp rx=0 tx=0).stop 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 -- 172.21.15.17:0/709185661 shutdown_connections 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 --2- 172.21.15.17:0/709185661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818106970 0x7f6818106d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 -- 172.21.15.17:0/709185661 >> 172.21.15.17:0/709185661 conn(0x7f68180fc4a0 msgr2=0x7f68180fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 -- 172.21.15.17:0/709185661 shutdown_connections 2023-10-05T15:28:10.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.196+0000 7f6820335700 1 -- 172.21.15.17:0/709185661 wait complete. 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.197+0000 7f6820335700 1 Processor -- start 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.197+0000 7f6820335700 1 -- start start 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.197+0000 7f6820335700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6818106970 0x7f68181981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.197+0000 7f6820335700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 0x7f681819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.197+0000 7f6820335700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f681819d0d0 0x7f681819d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f6820335700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6818198e10 con 0x7f6818198720 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f6820335700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68181a4e40 con 0x7f6818106970 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f6820335700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68181a4f80 con 0x7f681819d0d0 2023-10-05T15:28:10.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 0x7f681819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 0x7f681819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37400/0 (socket says 172.21.15.17:37400) 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 -- 172.21.15.17:0/1349453001 learned_addr learned my addr 172.21.15.17:0/1349453001 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681e0d1700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6818106970 0x7f68181981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681e8d2700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f681819d0d0 0x7f681819d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 -- 172.21.15.17:0/1349453001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f681819d0d0 msgr2=0x7f681819d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f681819d0d0 0x7f681819d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 -- 172.21.15.17:0/1349453001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6818106970 msgr2=0x7f68181981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6818106970 0x7f68181981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 -- 172.21.15.17:0/1349453001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140095f0 con 0x7f6818198720 2023-10-05T15:28:10.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.198+0000 7f681d8d0700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 0x7f681819cb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f680800b780 tx=0x7f680800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.199+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808004230 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.199+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6808004390 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.199+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808011a50 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.199+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68181a5260 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.199+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68181a5710 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.200+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f68080036a0 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.200+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6818103c10 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.200+0000 7f680f7fe700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6804038d90 0x7f680403b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.200+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f680804aee0 con 0x7f6818198720 2023-10-05T15:28:10.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.201+0000 7f681e0d1700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6804038d90 0x7f680403b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:10.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.201+0000 7f681e0d1700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6804038d90 0x7f680403b250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6814009fd0 tx=0x7f68140058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:10.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.206+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6808004500 con 0x7f6818198720 2023-10-05T15:28:10.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.424+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f68180624e0 con 0x7f6818198720 2023-10-05T15:28:10.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.424+0000 7f680f7fe700 1 -- 172.21.15.17:0/1349453001 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f6808021760 con 0x7f6818198720 2023-10-05T15:28:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:28:10.428 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2023-10-05T15:28:10.428 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:28:10.428 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2023-10-05T15:28:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6804038d90 msgr2=0x7f680403b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6804038d90 0x7f680403b250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6814009fd0 tx=0x7f68140058e0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 msgr2=0x7f681819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 0x7f681819cb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f680800b780 tx=0x7f680800ba90 comp rx=0 tx=0).stop 2023-10-05T15:28:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 shutdown_connections 2023-10-05T15:28:10.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6804038d90 0x7f680403b250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f681819d0d0 0x7f681819d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6818106970 0x7f68181981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 --2- 172.21.15.17:0/1349453001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6818198720 0x7f681819cb90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:10.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 >> 172.21.15.17:0/1349453001 conn(0x7f68180fc4a0 msgr2=0x7f6818073470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:10.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 shutdown_connections 2023-10-05T15:28:10.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:10.427+0000 7f6820335700 1 -- 172.21.15.17:0/1349453001 wait complete. 2023-10-05T15:28:10.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.549 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: Updating smithi017:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.550 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:10.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:10.551 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: Updating smithi017:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:10.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: Updating smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: Updating smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: Updating smithi017:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:10.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:10.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:10.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:11.123 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-05T15:28:11.124 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:28:11.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2023-10-05T15:28:11.197 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:28:11.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:28:11.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:11 smithi017 ceph-mon[129107]: Reconfiguring mon.a (unknown last config time)... 2023-10-05T15:28:11.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:11 smithi017 ceph-mon[129107]: Reconfiguring daemon mon.a on smithi017 2023-10-05T15:28:11.300 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:11 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1349453001' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:11.301 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:11 smithi017 ceph-mon[129107]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:11.309 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:28:11.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2023-10-05T15:28:11.388 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:28:11.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:28:11.498 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:28:11.498 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2023-10-05T15:28:11.566 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:11 smithi167 ceph-mon[133366]: Reconfiguring mon.a (unknown last config time)... 2023-10-05T15:28:11.566 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:11 smithi167 ceph-mon[133366]: Reconfiguring daemon mon.a on smithi017 2023-10-05T15:28:11.566 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:11 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1349453001' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:11.566 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:11 smithi167 ceph-mon[133366]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:11.577 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:28:11.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-05T15:28:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:11 smithi079 ceph-mon[132936]: Reconfiguring mon.a (unknown last config time)... 2023-10-05T15:28:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:11 smithi079 ceph-mon[132936]: Reconfiguring daemon mon.a on smithi017 2023-10-05T15:28:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:11 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1349453001' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:11.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:11 smithi079 ceph-mon[132936]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:11.687 INFO:tasks.cephadm:Adding mgr.x on smithi017 2023-10-05T15:28:11.687 INFO:tasks.cephadm:Adding mgr.y on smithi079 2023-10-05T15:28:11.687 INFO:tasks.cephadm:Adding mgr.z on smithi167 2023-10-05T15:28:11.688 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi017=x;smithi079=y;smithi167=z' 2023-10-05T15:28:12.442 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: Reconfiguring mon.b (monmap changed)... 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:12 smithi079 ceph-mon[132936]: Reconfiguring daemon mon.b on smithi079 2023-10-05T15:28:12.767 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:12.767 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:12.767 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: Reconfiguring mon.b (monmap changed)... 2023-10-05T15:28:12.767 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:12.768 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:12.768 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:12.768 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:12 smithi167 ceph-mon[133366]: Reconfiguring daemon mon.b on smithi079 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: Reconfiguring mon.b (monmap changed)... 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:12 smithi017 ceph-mon[129107]: Reconfiguring daemon mon.b on smithi079 2023-10-05T15:28:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:13 smithi167 ceph-mon[133366]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:13.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:13.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:13 smithi079 ceph-mon[132936]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:13.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:13 smithi017 ceph-mon[129107]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-05T15:28:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-05T15:28:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 -- 172.21.15.167:0/1669715111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa044100af0 msgr2=0x7fa044100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 --2- 172.21.15.167:0/1669715111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa044100af0 0x7fa044100f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa034009910 tx=0x7fa034009c20 comp rx=0 tx=0).stop 2023-10-05T15:28:14.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 -- 172.21.15.167:0/1669715111 shutdown_connections 2023-10-05T15:28:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 --2- 172.21.15.167:0/1669715111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa044100af0 0x7fa044100f10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 -- 172.21.15.167:0/1669715111 >> 172.21.15.167:0/1669715111 conn(0x7fa0440fc0b0 msgr2=0x7fa0440fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 -- 172.21.15.167:0/1669715111 shutdown_connections 2023-10-05T15:28:14.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.044+0000 7fa048fb0700 1 -- 172.21.15.167:0/1669715111 wait complete. 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 Processor -- start 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 -- start start 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa044100af0 0x7fa044197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa044198470 0x7fa04419d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 0x7fa04419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441a0210 con 0x7fa0441988f0 2023-10-05T15:28:14.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441a0380 con 0x7fa044100af0 2023-10-05T15:28:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.045+0000 7fa048fb0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441a0540 con 0x7fa044198470 2023-10-05T15:28:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 0x7fa04419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa041d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa044198470 0x7fa04419d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 0x7fa04419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.167:37530/0 (socket says 172.21.15.167:37530) 2023-10-05T15:28:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 -- 172.21.15.167:0/479861294 learned_addr learned my addr 172.21.15.167:0/479861294 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:28:14.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa04259c700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa044100af0 0x7fa044197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 -- 172.21.15.167:0/479861294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa044198470 msgr2=0x7fa04419d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa044198470 0x7fa04419d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 -- 172.21.15.167:0/479861294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa044100af0 msgr2=0x7fa044197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa044100af0 0x7fa044197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa042d9d700 1 -- 172.21.15.167:0/479861294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0340095f0 con 0x7fa0441988f0 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.046+0000 7fa041d9b700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa044198470 0x7fa04419d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:28:14.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.047+0000 7fa042d9d700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 0x7fa04419fa70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00ba50 tx=0x7fa03c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:14.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.047+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00c930 con 0x7fa0441988f0 2023-10-05T15:28:14.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.047+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa03c014440 con 0x7fa0441988f0 2023-10-05T15:28:14.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.047+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0441a0820 con 0x7fa0441988f0 2023-10-05T15:28:14.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.047+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0075b0 con 0x7fa0441988f0 2023-10-05T15:28:14.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.047+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0441a0da0 con 0x7fa0441988f0 2023-10-05T15:28:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.048+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fa03c00ca90 con 0x7fa0441988f0 2023-10-05T15:28:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.048+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0441066f0 con 0x7fa0441988f0 2023-10-05T15:28:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.049+0000 7fa0337fe700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa02c038d90 0x7fa02c03b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.049+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa03c04acd0 con 0x7fa0441988f0 2023-10-05T15:28:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.049+0000 7fa04259c700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa02c038d90 0x7fa02c03b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:14.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.050+0000 7fa04259c700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa02c038d90 0x7fa02c03b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa034006010 tx=0x7fa0340058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:14.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.055+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa03c013d70 con 0x7fa0441988f0 2023-10-05T15:28:14.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.285+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi079=y;smithi167=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fa044073890 con 0x7fa02c038d90 2023-10-05T15:28:14.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.292+0000 7fa0337fe700 1 -- 172.21.15.167:0/479861294 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa044073890 con 0x7fa02c038d90 2023-10-05T15:28:14.294 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mgr update... 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa02c038d90 msgr2=0x7fa02c03b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa02c038d90 0x7fa02c03b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa034006010 tx=0x7fa0340058e0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 msgr2=0x7fa04419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 0x7fa04419fa70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00ba50 tx=0x7fa03c00bd60 comp rx=0 tx=0).stop 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 shutdown_connections 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa02c038d90 0x7fa02c03b250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0441988f0 0x7fa04419fa70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa044100af0 0x7fa044197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 --2- 172.21.15.167:0/479861294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa044198470 0x7fa04419d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 >> 172.21.15.167:0/479861294 conn(0x7fa0440fc0b0 msgr2=0x7fa044073180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 shutdown_connections 2023-10-05T15:28:14.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:28:14.295+0000 7fa048fb0700 1 -- 172.21.15.167:0/479861294 wait complete. 2023-10-05T15:28:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:14 smithi167 ceph-mon[133366]: Reconfiguring mon.c (monmap changed)... 2023-10-05T15:28:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:14 smithi167 ceph-mon[133366]: Reconfiguring daemon mon.c on smithi167 2023-10-05T15:28:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:14.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:14 smithi079 ceph-mon[132936]: Reconfiguring mon.c (monmap changed)... 2023-10-05T15:28:14.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:14 smithi079 ceph-mon[132936]: Reconfiguring daemon mon.c on smithi167 2023-10-05T15:28:14.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:14.921 DEBUG:teuthology.orchestra.run.smithi079:mgr.y> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-05T15:28:14.926 DEBUG:teuthology.orchestra.run.smithi167:mgr.z> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-05T15:28:14.931 INFO:tasks.cephadm:Deploying OSDs... 2023-10-05T15:28:14.931 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:28:14.931 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T15:28:14.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:14 smithi017 ceph-mon[129107]: Reconfiguring mon.c (monmap changed)... 2023-10-05T15:28:14.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:14 smithi017 ceph-mon[129107]: Reconfiguring daemon mon.c on smithi167 2023-10-05T15:28:14.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:14.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T15:28:14.977 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2023-10-05T15:28:15.000 INFO:journalctl@ceph.mgr.z.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:28:15.002 INFO:journalctl@ceph.mgr.y.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:28:15.061 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-05 15:27:17.341409835 +0000 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-05 15:21:06.711348541 +0000 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-05 15:21:06.711348541 +0000 2023-10-05T15:28:15.062 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-10-05 15:21:06.688348758 +0000 2023-10-05T15:28:15.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T15:28:15.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-05T15:28:15.169 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-05T15:28:15.169 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000191589 s, 2.7 MB/s 2023-10-05T15:28:15.172 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T15:28:15.223 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2023-10-05T15:28:15.267 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-05 15:27:17.426409027 +0000 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-05 15:21:07.525340861 +0000 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-05 15:21:07.525340861 +0000 2023-10-05T15:28:15.268 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-10-05 15:21:07.503341069 +0000 2023-10-05T15:28:15.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T15:28:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-05T15:28:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-05T15:28:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000205883 s, 2.5 MB/s 2023-10-05T15:28:15.378 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T15:28:15.423 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2023-10-05T15:28:15.508 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-05 15:27:17.512408209 +0000 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-05 15:21:08.343333144 +0000 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-05 15:21:08.343333144 +0000 2023-10-05T15:28:15.509 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-10-05 15:21:08.320333360 +0000 2023-10-05T15:28:15.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T15:28:15.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-05T15:28:15.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-05T15:28:15.615 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000188948 s, 2.7 MB/s 2023-10-05T15:28:15.617 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T15:28:15.663 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2023-10-05T15:28:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T15:28:15.747 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-10-05 15:27:17.592407448 +0000 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-10-05 15:21:09.181325237 +0000 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-10-05 15:21:09.181325237 +0000 2023-10-05T15:28:15.748 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-10-05 15:21:09.157325463 +0000 2023-10-05T15:28:15.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T15:28:15.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi079=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:15.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: Saving service mgr spec with placement smithi017=x;smithi079=y;smithi167=z;count:3 2023-10-05T15:28:15.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:15.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi079=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: Saving service mgr spec with placement smithi017=x;smithi079=y;smithi167=z;count:3 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:15.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:15.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:28:15.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:15.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-10-05T15:28:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-10-05T15:28:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.0001841 s, 2.8 MB/s 2023-10-05T15:28:15.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi079=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:15.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: Saving service mgr spec with placement smithi017=x;smithi079=y;smithi167=z;count:3 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:15.856 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T15:28:15.901 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-05T15:28:15.901 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T15:28:15.949 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T15:28:15.949 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2023-10-05T15:28:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-05 15:27:59.944841801 +0000 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-05 15:20:50.397758420 +0000 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-05 15:20:50.397758420 +0000 2023-10-05T15:28:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-10-05 15:20:50.368759054 +0000 2023-10-05T15:28:16.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T15:28:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-05T15:28:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-05T15:28:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000295455 s, 1.7 MB/s 2023-10-05T15:28:16.107 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T15:28:16.152 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2023-10-05T15:28:16.237 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T15:28:16.237 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:16.237 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-05T15:28:16.237 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:16.237 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:16.237 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-05 15:27:59.944841801 +0000 2023-10-05T15:28:16.238 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-05 15:20:51.213740593 +0000 2023-10-05T15:28:16.238 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-05 15:20:51.213740593 +0000 2023-10-05T15:28:16.238 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-10-05 15:20:51.184741227 +0000 2023-10-05T15:28:16.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T15:28:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-05T15:28:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-05T15:28:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000342954 s, 1.5 MB/s 2023-10-05T15:28:16.344 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T15:28:16.389 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-05 15:27:59.945841779 +0000 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-05 15:20:52.026722832 +0000 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-05 15:20:52.026722832 +0000 2023-10-05T15:28:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-10-05 15:20:52.001723378 +0000 2023-10-05T15:28:16.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T15:28:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-05T15:28:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-05T15:28:16.579 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000303677 s, 1.7 MB/s 2023-10-05T15:28:16.581 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T15:28:16.626 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2023-10-05T15:28:16.711 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T15:28:16.711 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:16.711 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-05T15:28:16.711 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:16.712 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:16.712 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-05 15:27:59.945841779 +0000 2023-10-05T15:28:16.712 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-05 15:20:52.845704940 +0000 2023-10-05T15:28:16.712 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-05 15:20:52.845704940 +0000 2023-10-05T15:28:16.712 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2023-10-05 15:20:52.819705507 +0000 2023-10-05T15:28:16.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T15:28:16.816 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-05T15:28:16.817 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-05T15:28:16.817 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.00049486 s, 1.0 MB/s 2023-10-05T15:28:16.819 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T15:28:16.853 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:16 smithi167 ceph-mon[133366]: Deploying daemon mgr.z on smithi167 2023-10-05T15:28:16.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:16 smithi079 ceph-mon[132936]: Deploying daemon mgr.z on smithi167 2023-10-05T15:28:16.863 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T15:28:16.864 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T15:28:16.907 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T15:28:16.907 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2023-10-05T15:28:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:16 smithi017 ceph-mon[129107]: Deploying daemon mgr.z on smithi167 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 15:27:50.283882594 +0000 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 15:20:49.325083305 +0000 2023-10-05T15:28:16.999 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 15:20:49.325083305 +0000 2023-10-05T15:28:17.000 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-10-05 15:20:49.298083809 +0000 2023-10-05T15:28:17.000 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T15:28:17.185 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T15:28:17.186 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T15:28:17.186 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000307673 s, 1.7 MB/s 2023-10-05T15:28:17.188 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T15:28:17.234 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2023-10-05T15:28:17.328 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T15:28:17.328 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:17.328 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-05T15:28:17.328 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:17.328 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:17.329 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 15:28:17.048382167 +0000 2023-10-05T15:28:17.329 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 15:20:50.155067811 +0000 2023-10-05T15:28:17.329 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 15:20:50.155067811 +0000 2023-10-05T15:28:17.329 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-10-05 15:20:50.127068333 +0000 2023-10-05T15:28:17.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T15:28:17.495 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T15:28:17.495 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T15:28:17.495 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000311 s, 1.6 MB/s 2023-10-05T15:28:17.498 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T15:28:17.546 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 15:28:17.359376352 +0000 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 15:20:50.994052148 +0000 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 15:20:50.994052148 +0000 2023-10-05T15:28:17.592 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-10-05 15:20:50.969052615 +0000 2023-10-05T15:28:17.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T15:28:17.702 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T15:28:17.703 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T15:28:17.703 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000338474 s, 1.5 MB/s 2023-10-05T15:28:17.705 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T15:28:17.752 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2023-10-05T15:28:17.800 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 15:28:17.360376333 +0000 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 15:20:51.808036952 +0000 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 15:20:51.808036952 +0000 2023-10-05T15:28:17.801 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2023-10-05 15:20:51.782037438 +0000 2023-10-05T15:28:17.801 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T15:28:17.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:17 smithi167 ceph-mon[133366]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:17.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:17 smithi167 systemd[1]: Starting Ceph mgr.z for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:28:17.871 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T15:28:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T15:28:17.872 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000291025 s, 1.8 MB/s 2023-10-05T15:28:17.875 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T15:28:17.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:17 smithi017 ceph-mon[129107]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:17.961 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2023-10-05T15:28:17.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-05T15:28:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:17 smithi079 ceph-mon[132936]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:18.164 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 podman[135448]: 2023-10-05T15:28:18.546 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 bash[135448]: 0cfbcc5064f6826f9743f40679264e2c92223e0a1be6097e24522ba29788aeee 2023-10-05T15:28:18.546 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 ceph-mgr[135529]: -- 172.21.15.167:0/99147098 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559bdbc691e0 con 0x559bdbc3f000 2023-10-05T15:28:18.546 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 systemd[1]: Started Ceph mgr.z for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:28:18.546 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:18.438+0000 7f780f01a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:28:18.703 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:28:18.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:18.543+0000 7f780f01a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:28:18.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:18.659+0000 7f780f01a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:28:18.834 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:18.779+0000 7f780f01a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:28:19.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:19.002+0000 7f780f01a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:28:19.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: Deploying daemon mgr.y on smithi079 2023-10-05T15:28:19.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:19 smithi079 ceph-mon[132936]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:19.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.634 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:19.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:28:19.635 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:19.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:19.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: Deploying daemon mgr.y on smithi079 2023-10-05T15:28:19.637 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:19 smithi017 ceph-mon[129107]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:19.637 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:19.468+0000 7f780f01a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:19.634+0000 7f780f01a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:19.638 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: Deploying daemon mgr.y on smithi079 2023-10-05T15:28:19.639 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-mon[133366]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:20.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:19.751+0000 7f780f01a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:28:20.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:19.874+0000 7f780f01a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:28:20.582 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:20 smithi079 systemd[1]: Starting Ceph mgr.y for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:28:20.701 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-05T15:28:20.701 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-05T15:28:20.701 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-10-05T15:28:20.701 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-10-05T15:28:20.702 INFO:teuthology.orchestra.run.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.037827 s, 277 MB/s 2023-10-05T15:28:20.702 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 2023-10-05T15:28:20.702 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-10-05T15:28:20.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:20 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:20.419+0000 7f780f01a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:28:21.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2023-10-05T15:28:21.328 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 podman[134376]: 2023-10-05T15:28:21.329 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 bash[134376]: 30e2da6135b627a1be19df055f7d572f43ae6ad56ac188705e94d0a96cb7e478 2023-10-05T15:28:21.329 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-mgr[134416]: -- 172.21.15.79:0/1885360516 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5598659331e0 con 0x559865909000 2023-10-05T15:28:21.558 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 systemd[1]: Started Ceph mgr.y for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:28:21.558 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:21.450+0000 7f8a1deb5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T15:28:21.583 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:21.300+0000 7f780f01a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:28:21.583 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:21.405+0000 7f780f01a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:28:21.604 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:21.555+0000 7f8a1deb5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T15:28:21.854 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:21.672+0000 7f8a1deb5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T15:28:21.854 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:21.793+0000 7f8a1deb5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T15:28:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-mon[132936]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.915 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:28:21.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:21 smithi017 ceph-mon[129107]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-mon[133366]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:22.354 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:22.039+0000 7f8a1deb5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T15:28:22.723 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:22 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:22.787 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:22 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:22.788 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:22.420+0000 7f780f01a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:28:22.788 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:22.544+0000 7f780f01a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:28:22.825 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:22 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:22.825 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:22.529+0000 7f8a1deb5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T15:28:22.825 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:22.700+0000 7f8a1deb5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T15:28:23.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:22.785+0000 7f780f01a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:28:23.104 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:22.822+0000 7f8a1deb5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T15:28:23.105 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:22.952+0000 7f8a1deb5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T15:28:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 -- 172.21.15.17:0/1198247426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 msgr2=0x7f1cb0073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 --2- 172.21.15.17:0/1198247426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0073d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009990 tx=0x7f1c9c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:28:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 -- 172.21.15.17:0/1198247426 shutdown_connections 2023-10-05T15:28:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 --2- 172.21.15.17:0/1198247426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cb0108e40 0x7f1cb010b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 --2- 172.21.15.17:0/1198247426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cb0074ee0 0x7f1cb0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 --2- 172.21.15.17:0/1198247426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0073d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:23.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 -- 172.21.15.17:0/1198247426 >> 172.21.15.17:0/1198247426 conn(0x7f1cb00fc4d0 msgr2=0x7f1cb00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:23.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 -- 172.21.15.17:0/1198247426 shutdown_connections 2023-10-05T15:28:23.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.347+0000 7f1cb7094700 1 -- 172.21.15.17:0/1198247426 wait complete. 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 Processor -- start 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 -- start start 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cb0074ee0 0x7f1cb01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cb0108e40 0x7f1cb01a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01a0900 con 0x7f1cb0073910 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01a0a40 con 0x7f1cb0108e40 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.348+0000 7f1cb7094700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01a0c00 con 0x7f1cb0074ee0 2023-10-05T15:28:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48446/0 (socket says 172.21.15.17:48446) 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 -- 172.21.15.17:0/2765875098 learned_addr learned my addr 172.21.15.17:0/2765875098 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1caffff700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cb0074ee0 0x7f1cb01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb5631700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cb0108e40 0x7f1cb01a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 -- 172.21.15.17:0/2765875098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cb0074ee0 msgr2=0x7f1cb01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cb0074ee0 0x7f1cb01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 -- 172.21.15.17:0/2765875098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cb0108e40 msgr2=0x7f1cb01a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cb0108e40 0x7f1cb01a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 -- 172.21.15.17:0/2765875098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0095f0 con 0x7f1cb0073910 2023-10-05T15:28:23.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.349+0000 7f1cb4e30700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0198db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400d950 tx=0x7f1ca400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.350+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4004220 con 0x7f1cb0073910 2023-10-05T15:28:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.350+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ca4007620 con 0x7f1cb0073910 2023-10-05T15:28:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.350+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40055b0 con 0x7f1cb0073910 2023-10-05T15:28:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.350+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb01a0ee0 con 0x7f1cb0073910 2023-10-05T15:28:23.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.350+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb01a12f0 con 0x7f1cb0073910 2023-10-05T15:28:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.351+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f1ca4004750 con 0x7f1cb0073910 2023-10-05T15:28:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.351+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb01074f0 con 0x7f1cb0073910 2023-10-05T15:28:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.351+0000 7f1cadffb700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1ca0038af0 0x7f1ca003afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.351+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ca404b250 con 0x7f1cb0073910 2023-10-05T15:28:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.352+0000 7f1caffff700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1ca0038af0 0x7f1ca003afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:23.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.352+0000 7f1caffff700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1ca0038af0 0x7f1ca003afb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00b5c0 tx=0x7f1c9c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:23.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.357+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ca40193b0 con 0x7f1cb0073910 2023-10-05T15:28:23.474 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:23.172+0000 7f780f01a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:28:23.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:23.577+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cb002d390 con 0x7f1ca0038af0 2023-10-05T15:28:23.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:23.472+0000 7f780f01a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:28:23.833 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:23.687+0000 7f780f01a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:28:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-mon[133366]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:28:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:28:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:23 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:23 smithi079 ceph-mon[132936]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:23 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:28:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:23 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:28:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:23 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:23.855 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:23.518+0000 7f8a1deb5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T15:28:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:23 smithi017 ceph-mon[129107]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:28:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:28:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:24.038+0000 7f780f01a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:28:24.855 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:24.418+0000 7f8a1deb5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T15:28:24.855 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:24.522+0000 7f8a1deb5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T15:28:24.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:24.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:24.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: Reconfiguring mgr.x (unknown last config time)... 2023-10-05T15:28:24.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:24.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:24.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.858 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: Reconfiguring daemon mgr.x on smithi017 2023-10-05T15:28:24.858 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:24.858 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: Reconfiguring mgr.x (unknown last config time)... 2023-10-05T15:28:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: Reconfiguring daemon mgr.x on smithi017 2023-10-05T15:28:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.977 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:24.977 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.977 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: Reconfiguring mgr.x (unknown last config time)... 2023-10-05T15:28:24.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-05T15:28:24.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-05T15:28:24.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:24.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: Reconfiguring daemon mgr.x on smithi017 2023-10-05T15:28:24.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:24.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:25.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:24.975+0000 7f780f01a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:28:25.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:25.148+0000 7f780f01a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:28:25.811 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:25.466+0000 7f8a1deb5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:28:25.811 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:25.587+0000 7f8a1deb5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T15:28:25.811 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:25.808+0000 7f8a1deb5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T15:28:25.817 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:25.395+0000 7f780f01a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:28:25.817 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:25.541+0000 7f780f01a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:28:26.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:25.815+0000 7f780f01a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:28:26.447 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:26.172+0000 7f8a1deb5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T15:28:26.854 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:26.445+0000 7f8a1deb5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T15:28:26.854 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:26.633+0000 7f8a1deb5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T15:28:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:26.945+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 14) v1 ==== 90791+0+0 (secure 0 0 0) 0x7f1ca400fd70 con 0x7f1cb0073910 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: Standby manager daemon z started 2023-10-05T15:28:27.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:28:27.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:28:27.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:28:27.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:26 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:28:27.333 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z[135505]: 2023-10-05T15:28:26.894+0000 7f780f01a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:28:27.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:27.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:27.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:27.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:27.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: Standby manager daemon z started 2023-10-05T15:28:27.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:28:27.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:28:27.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:28:27.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:26 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:28:27.354 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:26.973+0000 7f8a1deb5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: Standby manager daemon z started 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-05T15:28:27.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:28:27.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-05T15:28:27.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:26 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.167:0/2375381800' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:28:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:27 smithi017 ceph-mon[129107]: mgrmap e14: x(active, since 82s), standbys: z 2023-10-05T15:28:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:28:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:27 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2359031722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85786796-98b0-494a-b862-5fa0b52d790c"}]: dispatch 2023-10-05T15:28:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:27 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2359031722' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85786796-98b0-494a-b862-5fa0b52d790c"}]': finished 2023-10-05T15:28:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:27 smithi017 ceph-mon[129107]: osdmap e5: 1 total, 0 up, 1 in 2023-10-05T15:28:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:28.306 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:27.889+0000 7f8a1deb5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T15:28:28.306 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:28.060+0000 7f8a1deb5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T15:28:28.306 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:28.303+0000 7f8a1deb5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T15:28:28.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-mon[132936]: mgrmap e14: x(active, since 82s), standbys: z 2023-10-05T15:28:28.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:28:28.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2359031722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85786796-98b0-494a-b862-5fa0b52d790c"}]: dispatch 2023-10-05T15:28:28.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2359031722' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85786796-98b0-494a-b862-5fa0b52d790c"}]': finished 2023-10-05T15:28:28.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-mon[132936]: osdmap e5: 1 total, 0 up, 1 in 2023-10-05T15:28:28.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:27 smithi167 ceph-mon[133366]: mgrmap e14: x(active, since 82s), standbys: z 2023-10-05T15:28:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-05T15:28:28.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:27 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2359031722' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85786796-98b0-494a-b862-5fa0b52d790c"}]: dispatch 2023-10-05T15:28:28.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:27 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2359031722' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85786796-98b0-494a-b862-5fa0b52d790c"}]': finished 2023-10-05T15:28:28.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:27 smithi167 ceph-mon[133366]: osdmap e5: 1 total, 0 up, 1 in 2023-10-05T15:28:28.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:28.604 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:28.446+0000 7f8a1deb5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T15:28:29.104 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:28.717+0000 7f8a1deb5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T15:28:29.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:28 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1455110734' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:28:29.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:28 smithi079 ceph-mon[132936]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:29.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:28 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1455110734' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:28:29.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:28 smithi167 ceph-mon[133366]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:29.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:28 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1455110734' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:28:29.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:28 smithi017 ceph-mon[129107]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:29.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:29.962+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f1ca400e3b0 con 0x7f1cb0073910 2023-10-05T15:28:30.104 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:28:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y[134392]: 2023-10-05T15:28:29.773+0000 7f8a1deb5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T15:28:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:29 smithi079 ceph-mon[132936]: Standby manager daemon y started 2023-10-05T15:28:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:29 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:28:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:29 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:28:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:29 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:28:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:29 smithi079 ceph-mon[132936]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:28:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:29 smithi167 ceph-mon[133366]: Standby manager daemon y started 2023-10-05T15:28:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:29 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:28:30.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:29 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:28:30.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:29 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:28:30.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:29 smithi167 ceph-mon[133366]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:28:30.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:29 smithi017 ceph-mon[129107]: Standby manager daemon y started 2023-10-05T15:28:30.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:29 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-05T15:28:30.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:29 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-05T15:28:30.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:29 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-05T15:28:30.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:29 smithi017 ceph-mon[129107]: from='mgr.? 172.21.15.79:0/2526644539' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-05T15:28:31.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:30 smithi017 ceph-mon[129107]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-10-05T15:28:31.297 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:28:31.298 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:30 smithi017 ceph-mon[129107]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:31.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:30 smithi167 ceph-mon[133366]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-10-05T15:28:31.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:28:31.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:30 smithi167 ceph-mon[133366]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:31.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:30 smithi079 ceph-mon[132936]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-10-05T15:28:31.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-05T15:28:31.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:30 smithi079 ceph-mon[132936]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:33 smithi017 ceph-mon[129107]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:33.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:33 smithi167 ceph-mon[133366]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:33 smithi079 ceph-mon[132936]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:35.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:35 smithi017 ceph-mon[129107]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:35.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-05T15:28:35.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:35.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:35 smithi167 ceph-mon[133366]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:35.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-05T15:28:35.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:35.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:35 smithi079 ceph-mon[132936]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-05T15:28:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:36 smithi017 ceph-mon[129107]: Deploying daemon osd.0 on smithi017 2023-10-05T15:28:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:36 smithi167 ceph-mon[133366]: Deploying daemon osd.0 on smithi017 2023-10-05T15:28:37.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:36 smithi079 ceph-mon[132936]: Deploying daemon osd.0 on smithi017 2023-10-05T15:28:37.916 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:37 smithi017 ceph-mon[129107]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:38.085 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:37 smithi167 ceph-mon[133366]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:37 smithi079 ceph-mon[132936]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:38 smithi017 ceph-mon[129107]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:39.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:38 smithi167 ceph-mon[133366]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:39.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:38 smithi079 ceph-mon[132936]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:41.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:41 smithi017 ceph-mon[129107]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:41.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:41 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:41.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:41 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:41.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:41 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:41 smithi167 ceph-mon[133366]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:41 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:42.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:41 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:42.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:41 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:41 smithi079 ceph-mon[132936]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:41 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:42.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:41 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:42.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:41 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:43.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:43 smithi017 ceph-mon[129107]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:43.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:43.921 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:43.922 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:43.922 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:43.922 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:43 smithi167 ceph-mon[133366]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:44.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:44.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:43 smithi079 ceph-mon[132936]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:44.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:44.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:44.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:44.243 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2023-10-05T15:28:44.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.240+0000 7f1cadffb700 1 -- 172.21.15.17:0/2765875098 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1cb002d390 con 0x7f1ca0038af0 2023-10-05T15:28:44.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1ca0038af0 msgr2=0x7f1ca003afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:44.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1ca0038af0 0x7f1ca003afb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00b5c0 tx=0x7f1c9c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 msgr2=0x7f1cb0198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:44.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0198db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400d950 tx=0x7f1ca400dc60 comp rx=0 tx=0).stop 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 shutdown_connections 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1ca0038af0 0x7f1ca003afb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cb0108e40 0x7f1cb01a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cb0073910 0x7f1cb0198db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 --2- 172.21.15.17:0/2765875098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cb0074ee0 0x7f1cb01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.243+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 >> 172.21.15.17:0/2765875098 conn(0x7f1cb00fc4d0 msgr2=0x7f1cb00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.244+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 shutdown_connections 2023-10-05T15:28:44.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:28:44.244+0000 7f1cb7094700 1 -- 172.21.15.17:0/2765875098 wait complete. 2023-10-05T15:28:44.740 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-05T15:28:44.745 INFO:tasks.cephadm:Deploying osd.1 on smithi079 with /dev/vg_nvme/lv_4... 2023-10-05T15:28:44.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-05T15:28:44.827 INFO:journalctl@ceph.osd.0.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:28:45.208 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:28:44 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0[147863]: 2023-10-05T15:28:44.945+0000 7f6513d67640 -1 osd.0 0 log_to_monitors true 2023-10-05T15:28:45.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:45.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:45.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:45.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:45 smithi017 ceph-mon[129107]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:45.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:45 smithi017 ceph-mon[129107]: from='osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:28:45.461 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:45 smithi017 ceph-mon[129107]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:28:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:28:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:45.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:45.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:45.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:45 smithi167 ceph-mon[133366]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:45.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:45 smithi167 ceph-mon[133366]: from='osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:28:45.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:45 smithi167 ceph-mon[133366]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:28:45.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:45.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:45.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:28:45.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:45 smithi079 ceph-mon[132936]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:45.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:45 smithi079 ceph-mon[132936]: from='osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:28:45.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:45 smithi079 ceph-mon[132936]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-05T15:28:46.306 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:46 smithi079 ceph-mon[132936]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-05T15:28:46.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:46 smithi079 ceph-mon[132936]: osdmap e6: 1 total, 0 up, 1 in 2023-10-05T15:28:46.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:46 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:46.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:46 smithi079 ceph-mon[132936]: from='osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:28:46.307 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:46 smithi079 ceph-mon[132936]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:28:46.369 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0[147863]: 2023-10-05T15:28:46.225+0000 7f65093de700 -1 osd.0 0 waiting for initial osdmap 2023-10-05T15:28:46.369 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0[147863]: 2023-10-05T15:28:46.229+0000 7f65031cf700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:28:46.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-mon[129107]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-05T15:28:46.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-mon[129107]: osdmap e6: 1 total, 0 up, 1 in 2023-10-05T15:28:46.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:46.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-mon[129107]: from='osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:28:46.369 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:46 smithi017 ceph-mon[129107]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:28:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:46 smithi167 ceph-mon[133366]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-05T15:28:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:46 smithi167 ceph-mon[133366]: osdmap e6: 1 total, 0 up, 1 in 2023-10-05T15:28:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:46 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:46 smithi167 ceph-mon[133366]: from='osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:28:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:46 smithi167 ceph-mon[133366]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:28:47.452 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-05T15:28:47.452 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-05T15:28:47.452 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2023-10-05T15:28:47.452 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2023-10-05T15:28:47.452 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0543409 s, 193 MB/s 2023-10-05T15:28:47.452 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2023-10-05T15:28:47.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:47 smithi079 ceph-mon[132936]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:28:47.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:47 smithi079 ceph-mon[132936]: osdmap e7: 1 total, 0 up, 1 in 2023-10-05T15:28:47.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:47.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:47.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:47 smithi079 ceph-mon[132936]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:47 smithi167 ceph-mon[133366]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:28:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:47 smithi167 ceph-mon[133366]: osdmap e7: 1 total, 0 up, 1 in 2023-10-05T15:28:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:47 smithi167 ceph-mon[133366]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:47 smithi017 ceph-mon[129107]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:28:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:47 smithi017 ceph-mon[129107]: osdmap e7: 1 total, 0 up, 1 in 2023-10-05T15:28:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:47 smithi017 ceph-mon[129107]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-05T15:28:47.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2023-10-05T15:28:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:48 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:28:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:48 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:28:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:48 smithi167 ceph-mon[133366]: osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] boot 2023-10-05T15:28:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:48 smithi167 ceph-mon[133366]: osdmap e8: 1 total, 1 up, 1 in 2023-10-05T15:28:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:48.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:48 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:28:48.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:48 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:28:48.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:48 smithi079 ceph-mon[132936]: osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] boot 2023-10-05T15:28:48.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:48 smithi079 ceph-mon[132936]: osdmap e8: 1 total, 1 up, 1 in 2023-10-05T15:28:48.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:48.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:28:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:48 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:28:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:48 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:28:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:48 smithi017 ceph-mon[129107]: osd.0 [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] boot 2023-10-05T15:28:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:48 smithi017 ceph-mon[129107]: osdmap e8: 1 total, 1 up, 1 in 2023-10-05T15:28:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-05T15:28:49.539 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: osdmap e9: 1 total, 1 up, 1 in 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi017 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi017 to 17272M 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.540 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:49 smithi079 ceph-mon[132936]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: osdmap e9: 1 total, 1 up, 1 in 2023-10-05T15:28:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi017 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi017 to 17272M 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:49 smithi167 ceph-mon[133366]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: osdmap e9: 1 total, 1 up, 1 in 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi017 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi017 to 17272M 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:28:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:28:49.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:49 smithi017 ceph-mon[129107]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:50.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 -- 172.21.15.79:0/2163512176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640102170 msgr2=0x7f06401025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:50.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 --2- 172.21.15.79:0/2163512176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640102170 0x7f06401025d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f06300099c0 tx=0x7f0630009cd0 comp rx=0 tx=0).stop 2023-10-05T15:28:50.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 -- 172.21.15.79:0/2163512176 shutdown_connections 2023-10-05T15:28:50.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 --2- 172.21.15.79:0/2163512176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102b10 0x7f06401093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:50.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 --2- 172.21.15.79:0/2163512176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640100f70 0x7f0640101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:50.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 --2- 172.21.15.79:0/2163512176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640102170 0x7f06401025d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:50.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 -- 172.21.15.79:0/2163512176 >> 172.21.15.79:0/2163512176 conn(0x7f06400fc4d0 msgr2=0x7f06400fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:28:50.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.150+0000 7f06472e0700 1 -- 172.21.15.79:0/2163512176 shutdown_connections 2023-10-05T15:28:50.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.151+0000 7f06472e0700 1 -- 172.21.15.79:0/2163512176 wait complete. 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.151+0000 7f06472e0700 1 Processor -- start 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 -- start start 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 0x7f0640198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102170 0x7f06401992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640102b10 0x7f06401a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401a08f0 con 0x7f0640102b10 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401a0a30 con 0x7f0640100f70 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f06472e0700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401a0bf0 con 0x7f0640102170 2023-10-05T15:28:50.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f064507c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 0x7f0640198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f064507c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 0x7f0640198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36750/0 (socket says 172.21.15.79:36750) 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f064507c700 1 -- 172.21.15.79:0/1090275076 learned_addr learned my addr 172.21.15.79:0/1090275076 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.152+0000 7f064587d700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640102b10 0x7f06401a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064487b700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102170 0x7f06401992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064507c700 1 -- 172.21.15.79:0/1090275076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102170 msgr2=0x7f06401992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064507c700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102170 0x7f06401992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064507c700 1 -- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640102b10 msgr2=0x7f06401a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064507c700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640102b10 0x7f06401a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064507c700 1 -- 172.21.15.79:0/1090275076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300095f0 con 0x7f0640100f70 2023-10-05T15:28:50.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064487b700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102170 0x7f06401992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064587d700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640102b10 0x7f06401a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f064507c700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 0x7f0640198da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f063c00d980 tx=0x7f063c00dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00bb60 con 0x7f0640100f70 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f063c007620 con 0x7f0640100f70 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06401a0ed0 con 0x7f0640100f70 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00f3c0 con 0x7f0640100f70 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.153+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06401a12f0 con 0x7f0640100f70 2023-10-05T15:28:50.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.154+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0640193460 con 0x7f0640100f70 2023-10-05T15:28:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.156+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f063c010460 con 0x7f0640100f70 2023-10-05T15:28:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.158+0000 7f06367fc700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f062c0a1470 0x7f062c0a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:28:50.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.158+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f063c0cbaa0 con 0x7f0640100f70 2023-10-05T15:28:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.158+0000 7f064487b700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f062c0a1470 0x7f062c0a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:28:50.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.159+0000 7f064487b700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f062c0a1470 0x7f062c0a3930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0630009fd0 tx=0x7f063000bfb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:28:50.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.161+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f063c096ad0 con 0x7f0640100f70 2023-10-05T15:28:50.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:28:50.367+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f064002d2f0 con 0x7f062c0a1470 2023-10-05T15:28:50.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:28:50.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:28:50.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:50.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:28:50.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:28:50.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:50.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:28:50.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:28:50.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:28:51.707 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:51 smithi079 ceph-mon[132936]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:51.707 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:51 smithi079 ceph-mon[132936]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:51 smithi017 ceph-mon[129107]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:51.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:51 smithi017 ceph-mon[129107]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:51 smithi167 ceph-mon[133366]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:28:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:51 smithi167 ceph-mon[133366]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:53 smithi017 ceph-mon[129107]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:53 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/3389097371' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]: dispatch 2023-10-05T15:28:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:53 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]: dispatch 2023-10-05T15:28:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:53 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]': finished 2023-10-05T15:28:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:53 smithi017 ceph-mon[129107]: osdmap e10: 2 total, 1 up, 2 in 2023-10-05T15:28:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:28:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:53 smithi167 ceph-mon[133366]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:54.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:53 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/3389097371' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]: dispatch 2023-10-05T15:28:54.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:53 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]: dispatch 2023-10-05T15:28:54.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:53 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]': finished 2023-10-05T15:28:54.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:53 smithi167 ceph-mon[133366]: osdmap e10: 2 total, 1 up, 2 in 2023-10-05T15:28:54.085 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:28:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:53 smithi079 ceph-mon[132936]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:53 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/3389097371' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]: dispatch 2023-10-05T15:28:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:53 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]: dispatch 2023-10-05T15:28:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:53 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d310ac43-5077-4247-b05c-b9abb149b3cb"}]': finished 2023-10-05T15:28:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:53 smithi079 ceph-mon[132936]: osdmap e10: 2 total, 1 up, 2 in 2023-10-05T15:28:54.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:28:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:54 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/1632135603' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:28:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:54 smithi017 ceph-mon[129107]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:55.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:54 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/1632135603' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:28:55.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:54 smithi167 ceph-mon[133366]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:55.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:54 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/1632135603' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:28:55.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:54 smithi079 ceph-mon[132936]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:57 smithi017 ceph-mon[129107]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:57 smithi167 ceph-mon[133366]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:57 smithi079 ceph-mon[132936]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:59.006 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:28:58 smithi079 ceph-mon[132936]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:59.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:28:58 smithi167 ceph-mon[133366]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:28:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:28:58 smithi017 ceph-mon[129107]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:00.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-05T15:29:00.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:00.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-05T15:29:00.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:00.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-05T15:29:00.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:01.698 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:01 smithi079 ceph-mon[132936]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:01.698 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:01 smithi079 ceph-mon[132936]: Deploying daemon osd.1 on smithi079 2023-10-05T15:29:01.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:01 smithi017 ceph-mon[129107]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:01 smithi017 ceph-mon[129107]: Deploying daemon osd.1 on smithi079 2023-10-05T15:29:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:01 smithi167 ceph-mon[133366]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:01 smithi167 ceph-mon[133366]: Deploying daemon osd.1 on smithi079 2023-10-05T15:29:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:02 smithi167 ceph-mon[133366]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:02 smithi079 ceph-mon[132936]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:02 smithi017 ceph-mon[129107]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:05.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:05 smithi167 ceph-mon[133366]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:05.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:05 smithi079 ceph-mon[132936]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:05.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:05 smithi017 ceph-mon[129107]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:07.935 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:07 smithi079 ceph-mon[132936]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:07.936 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:07.936 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:07.936 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:07.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:07 smithi017 ceph-mon[129107]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:07 smithi167 ceph-mon[133366]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:08.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:08 smithi079 ceph-mon[132936]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:08.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:08 smithi017 ceph-mon[129107]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:08 smithi167 ceph-mon[133366]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:09.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.941+0000 7f06367fc700 1 -- 172.21.15.79:0/1090275076 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f064002d2f0 con 0x7f062c0a1470 2023-10-05T15:29:09.944 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 1 on host 'smithi079' 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f062c0a1470 msgr2=0x7f062c0a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f062c0a1470 0x7f062c0a3930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0630009fd0 tx=0x7f063000bfb0 comp rx=0 tx=0).stop 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 msgr2=0x7f0640198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 0x7f0640198da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f063c00d980 tx=0x7f063c00dd40 comp rx=0 tx=0).stop 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 shutdown_connections 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f062c0a1470 0x7f062c0a3930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0640102b10 0x7f06401a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0640100f70 0x7f0640198da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:09.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 --2- 172.21.15.79:0/1090275076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0640102170 0x7f06401992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.944+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 >> 172.21.15.79:0/1090275076 conn(0x7f06400fc4d0 msgr2=0x7f0640107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.945+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 shutdown_connections 2023-10-05T15:29:09.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:29:09.945+0000 7f06472e0700 1 -- 172.21.15.79:0/1090275076 wait complete. 2023-10-05T15:29:10.124 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.124 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.124 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:10.124 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:10.125 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.125 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.125 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.125 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:10.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:10.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:10.388 DEBUG:teuthology.orchestra.run.smithi079:osd.1> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-05T15:29:10.392 INFO:tasks.cephadm:Deploying osd.2 on smithi167 with /dev/vg_nvme/lv_4... 2023-10-05T15:29:10.392 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:10.466 INFO:journalctl@ceph.osd.1.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:29:10.854 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1[138023]: 2023-10-05T15:29:10.597+0000 7fca760ab640 -1 osd.1 0 log_to_monitors true 2023-10-05T15:29:11.126 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:29:11.295 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:11 smithi079 ceph-mon[132936]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:11.295 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:11 smithi079 ceph-mon[132936]: from='osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:29:11.295 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:11 smithi079 ceph-mon[132936]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:29:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:11 smithi167 ceph-mon[133366]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:11 smithi167 ceph-mon[133366]: from='osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:29:11.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:11 smithi167 ceph-mon[133366]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:29:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:11 smithi017 ceph-mon[129107]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:11 smithi017 ceph-mon[129107]: from='osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:29:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:11 smithi017 ceph-mon[129107]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-05T15:29:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:12 smithi167 ceph-mon[133366]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-05T15:29:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:12 smithi167 ceph-mon[133366]: osdmap e11: 2 total, 1 up, 2 in 2023-10-05T15:29:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:12.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:12 smithi167 ceph-mon[133366]: from='osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:29:12.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:12 smithi167 ceph-mon[133366]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:29:12.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1[138023]: 2023-10-05T15:29:12.086+0000 7fca6b722700 -1 osd.1 0 waiting for initial osdmap 2023-10-05T15:29:12.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1[138023]: 2023-10-05T15:29:12.094+0000 7fca6350f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:29:12.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-mon[132936]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-05T15:29:12.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-mon[132936]: osdmap e11: 2 total, 1 up, 2 in 2023-10-05T15:29:12.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:12.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-mon[132936]: from='osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:29:12.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:12 smithi079 ceph-mon[132936]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:29:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:12 smithi017 ceph-mon[129107]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-05T15:29:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:12 smithi017 ceph-mon[129107]: osdmap e11: 2 total, 1 up, 2 in 2023-10-05T15:29:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:12 smithi017 ceph-mon[129107]: from='osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:29:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:12 smithi017 ceph-mon[129107]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:29:13.098 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-05T15:29:13.098 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-05T15:29:13.098 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2023-10-05T15:29:13.098 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2023-10-05T15:29:13.098 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0330144 s, 318 MB/s 2023-10-05T15:29:13.099 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2023-10-05T15:29:13.349 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:13 smithi167 ceph-mon[133366]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:29:13.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:13 smithi167 ceph-mon[133366]: osdmap e12: 2 total, 1 up, 2 in 2023-10-05T15:29:13.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:13.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:13.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:13 smithi167 ceph-mon[133366]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:13.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:13 smithi079 ceph-mon[132936]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:29:13.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:13 smithi079 ceph-mon[132936]: osdmap e12: 2 total, 1 up, 2 in 2023-10-05T15:29:13.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:13.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:13.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:13 smithi079 ceph-mon[132936]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:13.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:13 smithi017 ceph-mon[129107]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:29:13.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:13 smithi017 ceph-mon[129107]: osdmap e12: 2 total, 1 up, 2 in 2023-10-05T15:29:13.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:13.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:13.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:13 smithi017 ceph-mon[129107]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-05T15:29:13.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2023-10-05T15:29:14.357 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:29:14.357 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:29:14.357 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] boot 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: osdmap e13: 2 total, 2 up, 2 in 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi079 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi079 to 17267M 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:14.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:14 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.440 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] boot 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: osdmap e13: 2 total, 2 up, 2 in 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi079 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:29:14.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi079 to 17267M 2023-10-05T15:29:14.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:14.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:14.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:14 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:29:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: osd.1 [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] boot 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: osdmap e13: 2 total, 2 up, 2 in 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi079 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi079 to 17267M 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:14.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:14 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:15.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:15 smithi079 ceph-mon[132936]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:15.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:15 smithi079 ceph-mon[132936]: osdmap e14: 2 total, 2 up, 2 in 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1346550997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 msgr2=0x7fb734101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1346550997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734101390 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb730009990 tx=0x7fb730009ca0 comp rx=0 tx=0).stop 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1346550997 shutdown_connections 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1346550997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb734102b10 0x7fb7341093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1346550997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734101390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1346550997 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734102170 0x7fb7341025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1346550997 >> 172.21.15.167:0/1346550997 conn(0x7fb7340fc4d0 msgr2=0x7fb7340fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1346550997 shutdown_connections 2023-10-05T15:29:15.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.883+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1346550997 wait complete. 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.884+0000 7fb73c5b8700 1 Processor -- start 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 -- start start 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734102170 0x7fb734197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb734102b10 0x7fb73419e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419e750 con 0x7fb734102b10 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419e890 con 0x7fb734102170 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73c5b8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73419ea20 con 0x7fb734100f70 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73a354700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:15.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73a354700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59650/0 (socket says 172.21.15.167:59650) 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.885+0000 7fb73a354700 1 -- 172.21.15.167:0/1349843116 learned_addr learned my addr 172.21.15.167:0/1349843116 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb739b53700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734102170 0x7fb734197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73ab55700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb734102b10 0x7fb73419e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73a354700 1 -- 172.21.15.167:0/1349843116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734102170 msgr2=0x7fb734197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73a354700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734102170 0x7fb734197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73a354700 1 -- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb734102b10 msgr2=0x7fb73419e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73a354700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb734102b10 0x7fb73419e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73a354700 1 -- 172.21.15.167:0/1349843116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300095f0 con 0x7fb734100f70 2023-10-05T15:29:15.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73a354700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734196bc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb73000b9c0 tx=0x7fb73000baa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73001d070 con 0x7fb734100f70 2023-10-05T15:29:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb730003da0 con 0x7fb734100f70 2023-10-05T15:29:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300052c0 con 0x7fb734100f70 2023-10-05T15:29:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73419eca0 con 0x7fb734100f70 2023-10-05T15:29:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.886+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73419f050 con 0x7fb734100f70 2023-10-05T15:29:15.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.887+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73410c6e0 con 0x7fb734100f70 2023-10-05T15:29:15.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.889+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fb7300054e0 con 0x7fb734100f70 2023-10-05T15:29:15.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.891+0000 7fb72b7fe700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7200a1470 0x7fb7200a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.891+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fb7300ccbd0 con 0x7fb734100f70 2023-10-05T15:29:15.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.891+0000 7fb739b53700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7200a1470 0x7fb7200a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:15.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.892+0000 7fb739b53700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7200a1470 0x7fb7200a3930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb724009bf0 tx=0x7fb724009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:15.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:15.893+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb730097a70 con 0x7fb734100f70 2023-10-05T15:29:15.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:15 smithi017 ceph-mon[129107]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:15.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:15 smithi017 ceph-mon[129107]: osdmap e14: 2 total, 2 up, 2 in 2023-10-05T15:29:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:15 smithi167 ceph-mon[133366]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:15 smithi167 ceph-mon[133366]: osdmap e14: 2 total, 2 up, 2 in 2023-10-05T15:29:16.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:16.099+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7340612f0 con 0x7fb7200a1470 2023-10-05T15:29:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:16 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:29:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:16 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:29:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:16 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:17.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:16 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:29:17.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:16 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:29:17.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:16 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:17.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:16 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:29:17.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:16 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:29:17.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:16 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:17.722 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:17 smithi167 ceph-mon[133366]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:29:17.722 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:17 smithi167 ceph-mon[133366]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:17 smithi017 ceph-mon[129107]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:29:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:17 smithi017 ceph-mon[129107]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:17 smithi079 ceph-mon[132936]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:29:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:17 smithi079 ceph-mon[132936]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:18.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:18 smithi017 ceph-mon[129107]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:19.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:18 smithi167 ceph-mon[133366]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:19.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:18 smithi079 ceph-mon[132936]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:19 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/24981072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]: dispatch 2023-10-05T15:29:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:19 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]: dispatch 2023-10-05T15:29:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:19 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]': finished 2023-10-05T15:29:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:19 smithi017 ceph-mon[129107]: osdmap e15: 3 total, 2 up, 3 in 2023-10-05T15:29:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:19 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/24981072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]: dispatch 2023-10-05T15:29:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:19 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]: dispatch 2023-10-05T15:29:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:19 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]': finished 2023-10-05T15:29:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:19 smithi167 ceph-mon[133366]: osdmap e15: 3 total, 2 up, 3 in 2023-10-05T15:29:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:19 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/24981072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]: dispatch 2023-10-05T15:29:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:19 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]: dispatch 2023-10-05T15:29:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:19 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f6fd364-521b-41e1-861c-04fd2a5cb36c"}]': finished 2023-10-05T15:29:20.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:19 smithi079 ceph-mon[132936]: osdmap e15: 3 total, 2 up, 3 in 2023-10-05T15:29:20.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:20.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:20 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/2292482342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:29:20.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:20 smithi017 ceph-mon[129107]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:20 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/2292482342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:29:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:20 smithi167 ceph-mon[133366]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:21.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:20 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/2292482342' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:29:21.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:20 smithi079 ceph-mon[132936]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:23 smithi167 ceph-mon[133366]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:23.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:23 smithi079 ceph-mon[132936]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:23 smithi017 ceph-mon[129107]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:25.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:25 smithi167 ceph-mon[133366]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:25.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:25 smithi079 ceph-mon[132936]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:25 smithi017 ceph-mon[129107]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:26.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-05T15:29:26.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:26.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:26 smithi167 ceph-mon[133366]: Deploying daemon osd.2 on smithi167 2023-10-05T15:29:26.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:26 smithi167 ceph-mon[133366]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-05T15:29:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:26 smithi017 ceph-mon[129107]: Deploying daemon osd.2 on smithi167 2023-10-05T15:29:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:26 smithi017 ceph-mon[129107]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:27.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-05T15:29:27.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:27.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:26 smithi079 ceph-mon[132936]: Deploying daemon osd.2 on smithi167 2023-10-05T15:29:27.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:26 smithi079 ceph-mon[132936]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:29.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:29 smithi167 ceph-mon[133366]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:29.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:29 smithi079 ceph-mon[132936]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:29.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:29 smithi017 ceph-mon[129107]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:31.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:31 smithi167 ceph-mon[133366]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:31 smithi079 ceph-mon[132936]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:31 smithi017 ceph-mon[129107]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:33.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:33 smithi167 ceph-mon[133366]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:33.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:33.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:33.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:33 smithi079 ceph-mon[132936]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:33.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:33 smithi017 ceph-mon[129107]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:35.821 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:35 smithi167 ceph-mon[133366]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:35.821 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.821 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.821 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:35.821 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:35.821 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:35 smithi079 ceph-mon[132936]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:35.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:35 smithi017 ceph-mon[129107]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:36.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.128+0000 7fb72b7fe700 1 -- 172.21.15.167:0/1349843116 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb7340612f0 con 0x7fb7200a1470 2023-10-05T15:29:36.131 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 2 on host 'smithi167' 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.130+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7200a1470 msgr2=0x7fb7200a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.130+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7200a1470 0x7fb7200a3930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb724009bf0 tx=0x7fb724009260 comp rx=0 tx=0).stop 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 msgr2=0x7fb734196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734196bc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb73000b9c0 tx=0x7fb73000baa0 comp rx=0 tx=0).stop 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 shutdown_connections 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7200a1470 0x7fb7200a3930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb734102b10 0x7fb73419e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb734100f70 0x7fb734196bc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:36.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 --2- 172.21.15.167:0/1349843116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734102170 0x7fb734197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:36.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 >> 172.21.15.167:0/1349843116 conn(0x7fb7340fc4d0 msgr2=0x7fb7340fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:36.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 shutdown_connections 2023-10-05T15:29:36.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:29:36.131+0000 7fb73c5b8700 1 -- 172.21.15.167:0/1349843116 wait complete. 2023-10-05T15:29:36.561 DEBUG:teuthology.orchestra.run.smithi167:osd.2> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-05T15:29:36.565 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2023-10-05T15:29:36.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-05T15:29:36.641 INFO:journalctl@ceph.osd.2.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:29:36.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:36.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:36.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:36.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:36 smithi167 ceph-mon[133366]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:36.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:36 smithi167 ceph-mon[133366]: from='osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:29:36.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:36 smithi167 ceph-mon[133366]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:29:36.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:36 smithi017 ceph-mon[129107]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:36 smithi017 ceph-mon[129107]: from='osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:29:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:36 smithi017 ceph-mon[129107]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:29:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:29:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:36 smithi079 ceph-mon[132936]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:36 smithi079 ceph-mon[132936]: from='osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:29:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:36 smithi079 ceph-mon[132936]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-05T15:29:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:29:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:38 smithi017 ceph-mon[129107]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-05T15:29:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:38 smithi017 ceph-mon[129107]: osdmap e16: 3 total, 2 up, 3 in 2023-10-05T15:29:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:38 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:38 smithi017 ceph-mon[129107]: from='osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:29:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:38 smithi017 ceph-mon[129107]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:29:38.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-mon[133366]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-05T15:29:38.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-mon[133366]: osdmap e16: 3 total, 2 up, 3 in 2023-10-05T15:29:38.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:38.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-mon[133366]: from='osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:29:38.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-mon[133366]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:29:38.584 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-2[139216]: 2023-10-05T15:29:38.126+0000 7fbddb09a700 -1 osd.2 0 waiting for initial osdmap 2023-10-05T15:29:38.585 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-2[139216]: 2023-10-05T15:29:38.131+0000 7fbdd4e8b700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:29:38.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:38 smithi079 ceph-mon[132936]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-05T15:29:38.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:38 smithi079 ceph-mon[132936]: osdmap e16: 3 total, 2 up, 3 in 2023-10-05T15:29:38.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:38 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:38.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:38 smithi079 ceph-mon[132936]: from='osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:29:38.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:38 smithi079 ceph-mon[132936]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:29:39.298 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-05T15:29:39.298 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-05T15:29:39.299 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-10-05T15:29:39.299 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-10-05T15:29:39.299 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0298727 s, 351 MB/s 2023-10-05T15:29:39.299 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-10-05T15:29:39.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:39 smithi017 ceph-mon[129107]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:29:39.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:39 smithi017 ceph-mon[129107]: osdmap e17: 3 total, 2 up, 3 in 2023-10-05T15:29:39.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:39.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:39.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:39 smithi017 ceph-mon[129107]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:39 smithi167 ceph-mon[133366]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:29:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:39 smithi167 ceph-mon[133366]: osdmap e17: 3 total, 2 up, 3 in 2023-10-05T15:29:39.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:39.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:39.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:39 smithi167 ceph-mon[133366]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:39.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:39 smithi079 ceph-mon[132936]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:29:39.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:39 smithi079 ceph-mon[132936]: osdmap e17: 3 total, 2 up, 3 in 2023-10-05T15:29:39.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:39.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:39.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:39 smithi079 ceph-mon[132936]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-05T15:29:39.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2023-10-05T15:29:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:29:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:29:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] boot 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: osdmap e18: 3 total, 3 up, 3 in 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:40.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:29:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:29:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] boot 2023-10-05T15:29:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: osdmap e18: 3 total, 3 up, 3 in 2023-10-05T15:29:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.531 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: osd.2 [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] boot 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: osdmap e18: 3 total, 3 up, 3 in 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:40.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:40.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:29:40.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:41.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:41 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi167 2023-10-05T15:29:41.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:41 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi167 to 17267M 2023-10-05T15:29:41.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:41 smithi017 ceph-mon[129107]: osdmap e19: 3 total, 3 up, 3 in 2023-10-05T15:29:41.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:41 smithi017 ceph-mon[129107]: pgmap v87: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:41.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:41 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:29:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:41 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi167 2023-10-05T15:29:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:41 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi167 to 17267M 2023-10-05T15:29:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:41 smithi167 ceph-mon[133366]: osdmap e19: 3 total, 3 up, 3 in 2023-10-05T15:29:41.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:41 smithi167 ceph-mon[133366]: pgmap v87: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:41.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:41 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:29:41.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:41 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi167 2023-10-05T15:29:41.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:41 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi167 to 17267M 2023-10-05T15:29:41.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:41 smithi079 ceph-mon[132936]: osdmap e19: 3 total, 3 up, 3 in 2023-10-05T15:29:41.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:41 smithi079 ceph-mon[132936]: pgmap v87: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:41.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:41 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 -- 172.21.15.17:0/4132758263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 msgr2=0x7f90c0101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 --2- 172.21.15.17:0/4132758263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0101390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f90b00099c0 tx=0x7f90b0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 -- 172.21.15.17:0/4132758263 shutdown_connections 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 --2- 172.21.15.17:0/4132758263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102b10 0x7f90c01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 --2- 172.21.15.17:0/4132758263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0101390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 --2- 172.21.15.17:0/4132758263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0102170 0x7f90c01025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 -- 172.21.15.17:0/4132758263 >> 172.21.15.17:0/4132758263 conn(0x7f90c00fc4d0 msgr2=0x7f90c00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:29:42.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.296+0000 7f90c632f700 1 -- 172.21.15.17:0/4132758263 shutdown_connections 2023-10-05T15:29:42.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.297+0000 7f90c632f700 1 -- 172.21.15.17:0/4132758263 wait complete. 2023-10-05T15:29:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 Processor -- start 2023-10-05T15:29:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 -- start start 2023-10-05T15:29:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102170 0x7f90c0199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:42.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0102b10 0x7f90c01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01a0830 con 0x7f90c0100f70 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01a0970 con 0x7f90c0102170 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90c632f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01a0b30 con 0x7f90c0102b10 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.298+0000 7f90bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33880/0 (socket says 172.21.15.17:33880) 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 -- 172.21.15.17:0/2021757977 learned_addr learned my addr 172.21.15.17:0/2021757977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bf7fe700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102170 0x7f90c0199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90c48cc700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0102b10 0x7f90c01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 -- 172.21.15.17:0/2021757977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0102b10 msgr2=0x7f90c01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0102b10 0x7f90c01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:42.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 -- 172.21.15.17:0/2021757977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102170 msgr2=0x7f90c0199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102170 0x7f90c0199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 -- 172.21.15.17:0/2021757977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00095f0 con 0x7f90c0100f70 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bf7fe700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102170 0x7f90c0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bffff700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0198ce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009f50 tx=0x7f90b0003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.299+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b001d070 con 0x7f90c0100f70 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.300+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90b000bda0 con 0x7f90c0100f70 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.300+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000f460 con 0x7f90c0100f70 2023-10-05T15:29:42.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.300+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c01a0db0 con 0x7f90c0100f70 2023-10-05T15:29:42.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.300+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c01a11c0 con 0x7f90c0100f70 2023-10-05T15:29:42.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.301+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c010c670 con 0x7f90c0100f70 2023-10-05T15:29:42.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.303+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f90b0022700 con 0x7f90c0100f70 2023-10-05T15:29:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.304+0000 7f90bd7fa700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90a80a14f0 0x7f90a80a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:29:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.304+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f90b00cd4c0 con 0x7f90c0100f70 2023-10-05T15:29:42.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.305+0000 7f90bf7fe700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90a80a14f0 0x7f90a80a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:29:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.305+0000 7f90bf7fe700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90a80a14f0 0x7f90a80a39b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:29:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.308+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90b0097fc0 con 0x7f90c0100f70 2023-10-05T15:29:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:42 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-05T15:29:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:42 smithi017 ceph-mon[129107]: osdmap e20: 3 total, 3 up, 3 in 2023-10-05T15:29:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:42 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:29:42.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:42.528+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f90c0108ab0 con 0x7f90a80a14f0 2023-10-05T15:29:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:42 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-05T15:29:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:42 smithi167 ceph-mon[133366]: osdmap e20: 3 total, 3 up, 3 in 2023-10-05T15:29:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:42 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:29:42.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:42 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-05T15:29:42.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:42 smithi079 ceph-mon[132936]: osdmap e20: 3 total, 3 up, 3 in 2023-10-05T15:29:42.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:42 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-05T15:29:43.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:29:43.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: osdmap e21: 3 total, 3 up, 3 in 2023-10-05T15:29:43.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:43.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:29:43.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:29:43.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:29:43.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:29:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: osdmap e21: 3 total, 3 up, 3 in 2023-10-05T15:29:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:29:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:29:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:29:43.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:43.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-05T15:29:43.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: osdmap e21: 3 total, 3 up, 3 in 2023-10-05T15:29:43.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:43.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:29:43.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:29:43.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:29:43.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:43.716 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:43 smithi017 sudo[154013]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:29:43.716 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:43 smithi017 sudo[154013]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:43.716 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:43 smithi017 sudo[154013]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:43.717 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:43 smithi017 sudo[154013]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:44 smithi017 ceph-mon[129107]: osdmap e22: 3 total, 3 up, 3 in 2023-10-05T15:29:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:44.447 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:44 smithi017 sudo[154064]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:29:44.447 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:44 smithi017 sudo[154064]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:44.447 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:44 smithi017 sudo[154064]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:44.448 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:29:44 smithi017 sudo[154064]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:44 smithi167 ceph-mon[133366]: osdmap e22: 3 total, 3 up, 3 in 2023-10-05T15:29:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:44.585 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:44 smithi079 ceph-mon[132936]: osdmap e22: 3 total, 3 up, 3 in 2023-10-05T15:29:44.585 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:44.854 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:44 smithi079 sudo[142757]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:29:44.855 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:44 smithi079 sudo[142757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:44.855 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:44 smithi079 sudo[142757]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:44.855 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:44 smithi079 sudo[142757]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:45.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:29:45.170+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f90b0098390 con 0x7f90c0100f70 2023-10-05T15:29:45.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:45 smithi079 ceph-mon[132936]: pgmap v92: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:45.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:45.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:45 smithi079 sudo[142760]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:29:45.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:45 smithi079 sudo[142760]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:45.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:45 smithi079 sudo[142760]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:45.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:29:45 smithi079 sudo[142760]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:45.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:45 smithi017 ceph-mon[129107]: pgmap v92: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:45 smithi167 ceph-mon[133366]: pgmap v92: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:46.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:45 smithi167 sudo[144444]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:29:46.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:45 smithi167 sudo[144444]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:46.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:45 smithi167 sudo[144444]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:46.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:45 smithi167 sudo[144444]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:46.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 ceph-mon[129107]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-05T15:29:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3566368768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb98ddec-27ee-4273-91c7-2178495341fa"}]: dispatch 2023-10-05T15:29:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3566368768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb98ddec-27ee-4273-91c7-2178495341fa"}]': finished 2023-10-05T15:29:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 ceph-mon[129107]: osdmap e23: 4 total, 3 up, 4 in 2023-10-05T15:29:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:29:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:46 smithi167 ceph-mon[133366]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-05T15:29:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:46 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3566368768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb98ddec-27ee-4273-91c7-2178495341fa"}]: dispatch 2023-10-05T15:29:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:46 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3566368768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb98ddec-27ee-4273-91c7-2178495341fa"}]': finished 2023-10-05T15:29:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:46 smithi167 ceph-mon[133366]: osdmap e23: 4 total, 3 up, 4 in 2023-10-05T15:29:46.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:46 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:29:46.584 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:46 smithi167 sudo[144447]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:29:46.584 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:46 smithi167 sudo[144447]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:46.584 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:46 smithi167 sudo[144447]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:46.584 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:29:46 smithi167 sudo[144447]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:46.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:46 smithi079 ceph-mon[132936]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-10-05T15:29:46.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:46 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3566368768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb98ddec-27ee-4273-91c7-2178495341fa"}]: dispatch 2023-10-05T15:29:46.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:46 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3566368768' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb98ddec-27ee-4273-91c7-2178495341fa"}]': finished 2023-10-05T15:29:46.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:46 smithi079 ceph-mon[132936]: osdmap e23: 4 total, 3 up, 4 in 2023-10-05T15:29:46.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:46 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:29:47.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 sudo[154190]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:29:47.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 sudo[154190]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:47.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 sudo[154190]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:47.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:46 smithi017 sudo[154190]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:47 smithi167 ceph-mon[133366]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:47.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:47.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:47 smithi079 ceph-mon[132936]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:47 smithi017 sudo[154193]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:29:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:47 smithi017 sudo[154193]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:47 smithi017 sudo[154193]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:47 smithi017 sudo[154193]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:29:47.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:47 smithi017 ceph-mon[129107]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:47 smithi167 sudo[144450]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:29:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:47 smithi167 sudo[144450]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:47 smithi167 sudo[144450]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:47 smithi167 sudo[144450]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 sudo[144453]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:29:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 sudo[144453]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 sudo[144453]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 sudo[144453]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3596019900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:48.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3596019900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:48.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:49.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:48 smithi079 sudo[142763]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-05T15:29:49.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:48 smithi079 sudo[142763]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:49.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:48 smithi079 sudo[142763]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:49.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:48 smithi079 sudo[142763]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:49 smithi167 ceph-mon[133366]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:49 smithi167 ceph-mon[133366]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:49.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:49.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:49 smithi167 ceph-mon[133366]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 292 KiB/s wr, 18 op/s 2023-10-05T15:29:49.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 sudo[142766]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 sudo[142766]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 sudo[142766]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 sudo[142766]: pam_unix(sudo:session): session closed for user root 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: pgmap v94: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3596019900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:49.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:49.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:49 smithi079 ceph-mon[132936]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 292 KiB/s wr, 18 op/s 2023-10-05T15:29:49.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:49 smithi017 ceph-mon[129107]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:49 smithi017 ceph-mon[129107]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-05T15:29:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-05T15:29:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-05T15:29:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:49 smithi017 ceph-mon[129107]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 292 KiB/s wr, 18 op/s 2023-10-05T15:29:50.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:50 smithi167 ceph-mon[133366]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:50.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:50 smithi167 ceph-mon[133366]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:50.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:50 smithi079 ceph-mon[132936]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:50.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:50 smithi079 ceph-mon[132936]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:50.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:50 smithi017 ceph-mon[129107]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-05T15:29:50.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:50 smithi017 ceph-mon[129107]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-05T15:29:51.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:51 smithi167 ceph-mon[133366]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-10-05T15:29:51.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:51 smithi079 ceph-mon[132936]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-10-05T15:29:51.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:51 smithi017 ceph-mon[129107]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 213 KiB/s wr, 13 op/s 2023-10-05T15:29:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:53 smithi167 ceph-mon[133366]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-10-05T15:29:53.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:53 smithi079 ceph-mon[132936]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-10-05T15:29:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:53 smithi017 ceph-mon[129107]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 167 KiB/s wr, 10 op/s 2023-10-05T15:29:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-05T15:29:54.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:54.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-05T15:29:54.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:54.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-05T15:29:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:29:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:55 smithi167 ceph-mon[133366]: Deploying daemon osd.3 on smithi017 2023-10-05T15:29:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:55 smithi167 ceph-mon[133366]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-05T15:29:55.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:55 smithi079 ceph-mon[132936]: Deploying daemon osd.3 on smithi017 2023-10-05T15:29:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:55 smithi079 ceph-mon[132936]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-05T15:29:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:55 smithi017 ceph-mon[129107]: Deploying daemon osd.3 on smithi017 2023-10-05T15:29:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:55 smithi017 ceph-mon[129107]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2023-10-05T15:29:57.290 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:57 smithi017 ceph-mon[129107]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 169 KiB/s wr, 11 op/s 2023-10-05T15:29:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:57 smithi167 ceph-mon[133366]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 169 KiB/s wr, 11 op/s 2023-10-05T15:29:57.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:57 smithi079 ceph-mon[132936]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 169 KiB/s wr, 11 op/s 2023-10-05T15:29:59.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:29:59 smithi167 ceph-mon[133366]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-05T15:29:59.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:29:59 smithi079 ceph-mon[132936]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-05T15:29:59.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:29:59 smithi017 ceph-mon[129107]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-10-05T15:30:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:00 smithi017 ceph-mon[129107]: overall HEALTH_OK 2023-10-05T15:30:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:00.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:00 smithi167 ceph-mon[133366]: overall HEALTH_OK 2023-10-05T15:30:00.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:00.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:00.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:00.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:00 smithi079 ceph-mon[132936]: overall HEALTH_OK 2023-10-05T15:30:00.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:00.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:00.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:01 smithi167 ceph-mon[133366]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:01 smithi079 ceph-mon[132936]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:01 smithi017 ceph-mon[129107]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:03 smithi017 ceph-mon[129107]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:03.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:03.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:03 smithi079 ceph-mon[132936]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:03.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:03.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:03.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:03.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:03.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:03.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.937+0000 7f90bd7fa700 1 -- 172.21.15.17:0/2021757977 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f90c0108ab0 con 0x7f90a80a14f0 2023-10-05T15:30:03.940 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2023-10-05T15:30:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90a80a14f0 msgr2=0x7f90a80a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90a80a14f0 0x7f90a80a39b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005e30 comp rx=0 tx=0).stop 2023-10-05T15:30:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 msgr2=0x7f90c0198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0198ce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009f50 tx=0x7f90b0003b00 comp rx=0 tx=0).stop 2023-10-05T15:30:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 shutdown_connections 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90a80a14f0 0x7f90a80a39b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0102b10 0x7f90c01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90c0100f70 0x7f90c0198ce0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 --2- 172.21.15.17:0/2021757977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c0102170 0x7f90c0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 >> 172.21.15.17:0/2021757977 conn(0x7f90c00fc4d0 msgr2=0x7f90c00fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 shutdown_connections 2023-10-05T15:30:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:30:03.939+0000 7f90c632f700 1 -- 172.21.15.17:0/2021757977 wait complete. 2023-10-05T15:30:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:03 smithi167 ceph-mon[133366]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:04.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:04.451 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-05T15:30:04.455 INFO:tasks.cephadm:Deploying osd.4 on smithi079 with /dev/vg_nvme/lv_3... 2023-10-05T15:30:04.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-05T15:30:04.530 INFO:journalctl@ceph.osd.3.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:30:05.182 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:30:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:04 smithi017 ceph-mon[129107]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-05T15:30:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:04 smithi017 ceph-mon[129107]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:05.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:05.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:05.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:05.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:04 smithi167 ceph-mon[133366]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-05T15:30:05.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:04 smithi167 ceph-mon[133366]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:05.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:05.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:05.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:05.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:04 smithi079 ceph-mon[132936]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-05T15:30:05.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:04 smithi079 ceph-mon[132936]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-10-05T15:30:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:05 smithi079 ceph-mon[132936]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-05T15:30:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:05 smithi079 ceph-mon[132936]: osdmap e24: 4 total, 3 up, 4 in 2023-10-05T15:30:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:05 smithi079 ceph-mon[132936]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:30:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:05 smithi017 ceph-mon[129107]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-05T15:30:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:05 smithi017 ceph-mon[129107]: osdmap e24: 4 total, 3 up, 4 in 2023-10-05T15:30:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:05 smithi017 ceph-mon[129107]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:30:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:06.198 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:30:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:30:05.923+0000 7f475c67e700 -1 osd.3 0 waiting for initial osdmap 2023-10-05T15:30:06.198 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:30:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:30:05.930+0000 7f4755c6e700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:30:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:05 smithi167 ceph-mon[133366]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-05T15:30:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:05 smithi167 ceph-mon[133366]: osdmap e24: 4 total, 3 up, 4 in 2023-10-05T15:30:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:05 smithi167 ceph-mon[133366]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:30:06.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.016 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-05T15:30:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-05T15:30:07.017 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2023-10-05T15:30:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2023-10-05T15:30:07.017 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0294502 s, 356 MB/s 2023-10-05T15:30:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: osdmap e25: 4 total, 3 up, 4 in 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] boot 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: osdmap e26: 4 total, 4 up, 4 in 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.183 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:06 smithi079 ceph-mon[132936]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: osdmap e25: 4 total, 3 up, 4 in 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] boot 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: osdmap e26: 4 total, 4 up, 4 in 2023-10-05T15:30:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:06 smithi017 ceph-mon[129107]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:30:07.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: from='osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:30:07.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: osdmap e25: 4 total, 3 up, 4 in 2023-10-05T15:30:07.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: osd.3 [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] boot 2023-10-05T15:30:07.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: osdmap e26: 4 total, 4 up, 4 in 2023-10-05T15:30:07.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-05T15:30:07.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:06 smithi167 ceph-mon[133366]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-05T15:30:07.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2023-10-05T15:30:08.177 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:30:08.427 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:30:08.427 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:30:08.427 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: osdmap e27: 4 total, 4 up, 4 in 2023-10-05T15:30:08.427 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.427 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.428 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:08.428 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:08.428 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.428 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:08.428 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:08.428 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: osdmap e27: 4 total, 4 up, 4 in 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:08.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:08.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:08.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:30:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:30:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: osdmap e27: 4 total, 4 up, 4 in 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:09.315 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:09 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi017 2023-10-05T15:30:09.315 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:09 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi017 to 8636M 2023-10-05T15:30:09.315 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:09 smithi079 ceph-mon[132936]: osdmap e28: 4 total, 4 up, 4 in 2023-10-05T15:30:09.315 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:09 smithi079 ceph-mon[132936]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:09.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:09 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi017 2023-10-05T15:30:09.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:09 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi017 to 8636M 2023-10-05T15:30:09.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:09 smithi017 ceph-mon[129107]: osdmap e28: 4 total, 4 up, 4 in 2023-10-05T15:30:09.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:09 smithi017 ceph-mon[129107]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 -- 172.21.15.79:0/1258802732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8100f70 msgr2=0x7fb5d8101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/1258802732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8100f70 0x7fb5d8101390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80099c0 tx=0x7fb5c8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 -- 172.21.15.79:0/1258802732 shutdown_connections 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/1258802732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d8102b10 0x7fb5d81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/1258802732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8100f70 0x7fb5d8101390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/1258802732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5d8102170 0x7fb5d81025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 -- 172.21.15.79:0/1258802732 >> 172.21.15.79:0/1258802732 conn(0x7fb5d80fc4d0 msgr2=0x7fb5d80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 -- 172.21.15.79:0/1258802732 shutdown_connections 2023-10-05T15:30:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.533+0000 7fb5dcff8700 1 -- 172.21.15.79:0/1258802732 wait complete. 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.534+0000 7fb5dcff8700 1 Processor -- start 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.534+0000 7fb5dcff8700 1 -- start start 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5dcff8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d8100f70 0x7fb5d8198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5dcff8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 0x7fb5d8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5dcff8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5d8102b10 0x7fb5d81a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5dcff8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d81a0960 con 0x7fb5d8102b10 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5dcff8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d81a0aa0 con 0x7fb5d8102170 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5dcff8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d81a0c30 con 0x7fb5d8100f70 2023-10-05T15:30:09.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 0x7fb5d8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5d8102b10 0x7fb5d81a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 0x7fb5d8199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60350/0 (socket says 172.21.15.79:60350) 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 -- 172.21.15.79:0/2870745077 learned_addr learned my addr 172.21.15.79:0/2870745077 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d659c700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d8100f70 0x7fb5d8198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 -- 172.21.15.79:0/2870745077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d8100f70 msgr2=0x7fb5d8198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d8100f70 0x7fb5d8198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 -- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5d8102b10 msgr2=0x7fb5d81a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5d8102b10 0x7fb5d81a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.535+0000 7fb5d5d9b700 1 -- 172.21.15.79:0/2870745077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80095f0 con 0x7fb5d8102170 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.536+0000 7fb5d5d9b700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 0x7fb5d8199310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00e9a0 tx=0x7fb5cc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.536+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc009790 con 0x7fb5d8102170 2023-10-05T15:30:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.536+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5cc00cbd0 con 0x7fb5d8102170 2023-10-05T15:30:09.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.536+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d81a0f10 con 0x7fb5d8102170 2023-10-05T15:30:09.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.536+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc018680 con 0x7fb5d8102170 2023-10-05T15:30:09.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.536+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d81a1380 con 0x7fb5d8102170 2023-10-05T15:30:09.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.537+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d8193460 con 0x7fb5d8102170 2023-10-05T15:30:09.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.539+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb5cc00cd40 con 0x7fb5d8102170 2023-10-05T15:30:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.540+0000 7fb5c77fe700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5c00a1480 0x7fb5c00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.541+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3669+0+0 (secure 0 0 0) 0x7fb5cc014070 con 0x7fb5d8102170 2023-10-05T15:30:09.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.541+0000 7fb5d659c700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5c00a1480 0x7fb5c00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:09.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.542+0000 7fb5d659c700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5c00a1480 0x7fb5c00a3940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009990 tx=0x7fb5c801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:09.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.545+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb5cc052100 con 0x7fb5d8102170 2023-10-05T15:30:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:09 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi017 2023-10-05T15:30:09.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:09 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi017 to 8636M 2023-10-05T15:30:09.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:09 smithi167 ceph-mon[133366]: osdmap e28: 4 total, 4 up, 4 in 2023-10-05T15:30:09.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:09 smithi167 ceph-mon[133366]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:09.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:09.751+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d802d350 con 0x7fb5c00a1480 2023-10-05T15:30:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:10 smithi017 ceph-mon[129107]: osdmap e29: 4 total, 4 up, 4 in 2023-10-05T15:30:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:30:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:30:10.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:10 smithi167 ceph-mon[133366]: osdmap e29: 4 total, 4 up, 4 in 2023-10-05T15:30:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:30:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:30:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:10 smithi079 ceph-mon[132936]: osdmap e29: 4 total, 4 up, 4 in 2023-10-05T15:30:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:30:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:30:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:11 smithi017 ceph-mon[129107]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:11 smithi017 ceph-mon[129107]: osdmap e30: 4 total, 4 up, 4 in 2023-10-05T15:30:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:11 smithi017 ceph-mon[129107]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:11.572 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:11 smithi079 ceph-mon[132936]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:11.572 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:11 smithi079 ceph-mon[132936]: osdmap e30: 4 total, 4 up, 4 in 2023-10-05T15:30:11.572 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:11 smithi079 ceph-mon[132936]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:11 smithi167 ceph-mon[133366]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:11 smithi167 ceph-mon[133366]: osdmap e30: 4 total, 4 up, 4 in 2023-10-05T15:30:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:11 smithi167 ceph-mon[133366]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:12 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/3253175197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]: dispatch 2023-10-05T15:30:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:12 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]: dispatch 2023-10-05T15:30:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:12 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]': finished 2023-10-05T15:30:12.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:12 smithi167 ceph-mon[133366]: osdmap e31: 5 total, 4 up, 5 in 2023-10-05T15:30:12.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:12.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:12 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/3253175197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]: dispatch 2023-10-05T15:30:12.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:12 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]: dispatch 2023-10-05T15:30:12.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:12 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]': finished 2023-10-05T15:30:12.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:12 smithi079 ceph-mon[132936]: osdmap e31: 5 total, 4 up, 5 in 2023-10-05T15:30:12.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:12 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/3253175197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]: dispatch 2023-10-05T15:30:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:12 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]: dispatch 2023-10-05T15:30:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:12 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "11dee7d6-6a17-4531-8de5-323fd02055fc"}]': finished 2023-10-05T15:30:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:12 smithi017 ceph-mon[129107]: osdmap e31: 5 total, 4 up, 5 in 2023-10-05T15:30:12.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:13 smithi079 ceph-mon[132936]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:13 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/182131008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:30:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:13 smithi017 ceph-mon[129107]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:13 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/182131008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:30:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:13 smithi167 ceph-mon[133366]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:13 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/182131008' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:30:15.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:15 smithi079 ceph-mon[132936]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:30:15.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:15 smithi017 ceph-mon[129107]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:30:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:15 smithi167 ceph-mon[133366]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:30:17.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:17 smithi079 ceph-mon[132936]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:30:17.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:17 smithi017 ceph-mon[129107]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:30:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:17 smithi167 ceph-mon[133366]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:30:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:19 smithi167 ceph-mon[133366]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:30:19.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:19 smithi079 ceph-mon[132936]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:30:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:19 smithi017 ceph-mon[129107]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:30:20.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:20 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-05T15:30:20.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:20 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:20.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:20 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-05T15:30:20.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:20 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:20 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-05T15:30:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:20 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:21 smithi079 ceph-mon[132936]: Deploying daemon osd.4 on smithi079 2023-10-05T15:30:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:21 smithi079 ceph-mon[132936]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:30:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:21 smithi017 ceph-mon[129107]: Deploying daemon osd.4 on smithi079 2023-10-05T15:30:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:21 smithi017 ceph-mon[129107]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:30:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:21 smithi167 ceph-mon[133366]: Deploying daemon osd.4 on smithi079 2023-10-05T15:30:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:21 smithi167 ceph-mon[133366]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:30:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:23 smithi079 ceph-mon[132936]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:30:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:23 smithi017 ceph-mon[129107]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:30:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:23 smithi167 ceph-mon[133366]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:30:25.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:25 smithi079 ceph-mon[132936]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-05T15:30:25.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:25 smithi017 ceph-mon[129107]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-05T15:30:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:25 smithi167 ceph-mon[133366]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-05T15:30:27.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:27.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:27.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:26 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:27.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:26 smithi079 ceph-mon[132936]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:26 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:26 smithi167 ceph-mon[133366]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:26 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:27.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:26 smithi017 ceph-mon[129107]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:28.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.976+0000 7fb5c77fe700 1 -- 172.21.15.79:0/2870745077 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb5d802d350 con 0x7fb5c00a1480 2023-10-05T15:30:28.979 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 4 on host 'smithi079' 2023-10-05T15:30:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5c00a1480 msgr2=0x7fb5c00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5c00a1480 0x7fb5c00a3940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009990 tx=0x7fb5c801a040 comp rx=0 tx=0).stop 2023-10-05T15:30:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 msgr2=0x7fb5d8199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 0x7fb5d8199310 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00e9a0 tx=0x7fb5cc00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:30:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 shutdown_connections 2023-10-05T15:30:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5c00a1480 0x7fb5c00a3940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5d8102b10 0x7fb5d81a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5d8100f70 0x7fb5d8198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 --2- 172.21.15.79:0/2870745077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5d8102170 0x7fb5d8199310 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 >> 172.21.15.79:0/2870745077 conn(0x7fb5d80fc4d0 msgr2=0x7fb5d8107bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.978+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 shutdown_connections 2023-10-05T15:30:28.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:30:28.979+0000 7fb5dcff8700 1 -- 172.21.15.79:0/2870745077 wait complete. 2023-10-05T15:30:29.508 DEBUG:teuthology.orchestra.run.smithi079:osd.4> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-05T15:30:29.513 INFO:tasks.cephadm:Deploying osd.5 on smithi167 with /dev/vg_nvme/lv_3... 2023-10-05T15:30:29.513 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-05T15:30:29.603 INFO:journalctl@ceph.osd.4.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:30:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:29.705 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.705 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.705 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:29.705 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:29.706 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.706 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:29.706 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.706 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.706 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:29.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:30.075 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:30:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:30:29.701+0000 7f38913a2640 -1 osd.4 0 log_to_monitors true 2023-10-05T15:30:30.267 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:30:30.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:30 smithi079 ceph-mon[132936]: from='osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:30:30.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:30 smithi079 ceph-mon[132936]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:30:30.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:30 smithi017 ceph-mon[129107]: from='osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:30:30.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:30 smithi017 ceph-mon[129107]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:30:30.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:30 smithi167 ceph-mon[133366]: from='osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:30:30.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:30 smithi167 ceph-mon[133366]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-05T15:30:31.605 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:30:31.421+0000 7f3886a19700 -1 osd.4 0 waiting for initial osdmap 2023-10-05T15:30:31.605 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:30:31.429+0000 7f3880009700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:30:31.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-mon[132936]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-05T15:30:31.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-mon[132936]: osdmap e32: 5 total, 4 up, 5 in 2023-10-05T15:30:31.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:31.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-mon[132936]: from='osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:30:31.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-mon[132936]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:30:31.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:31 smithi079 ceph-mon[132936]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:31.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:31 smithi017 ceph-mon[129107]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-05T15:30:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:31 smithi017 ceph-mon[129107]: osdmap e32: 5 total, 4 up, 5 in 2023-10-05T15:30:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:31 smithi017 ceph-mon[129107]: from='osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:30:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:31 smithi017 ceph-mon[129107]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:30:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:31 smithi017 ceph-mon[129107]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:31.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:31 smithi167 ceph-mon[133366]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-05T15:30:31.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:31 smithi167 ceph-mon[133366]: osdmap e32: 5 total, 4 up, 5 in 2023-10-05T15:30:31.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:31.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:31 smithi167 ceph-mon[133366]: from='osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:30:31.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:31 smithi167 ceph-mon[133366]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:30:31.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:31 smithi167 ceph-mon[133366]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:32.232 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-05T15:30:32.233 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-05T15:30:32.233 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2023-10-05T15:30:32.233 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2023-10-05T15:30:32.233 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0294685 s, 356 MB/s 2023-10-05T15:30:32.233 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 2023-10-05T15:30:32.233 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2023-10-05T15:30:32.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:32 smithi167 ceph-mon[133366]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:30:32.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:32 smithi167 ceph-mon[133366]: osdmap e33: 5 total, 4 up, 5 in 2023-10-05T15:30:32.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:32.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:32.686 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:32 smithi079 ceph-mon[132936]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:30:32.686 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:32 smithi079 ceph-mon[132936]: osdmap e33: 5 total, 4 up, 5 in 2023-10-05T15:30:32.686 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:32.686 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:32.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:32 smithi017 ceph-mon[129107]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:30:32.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:32 smithi017 ceph-mon[129107]: osdmap e33: 5 total, 4 up, 5 in 2023-10-05T15:30:32.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:32.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:32.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2023-10-05T15:30:33.469 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] boot 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: osdmap e34: 5 total, 5 up, 5 in 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:33.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:33.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:33.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:33.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:33 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:30:33.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:30:33.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] boot 2023-10-05T15:30:33.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: osdmap e34: 5 total, 5 up, 5 in 2023-10-05T15:30:33.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:33.766 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:33 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: osd.4 [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] boot 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: osdmap e34: 5 total, 5 up, 5 in 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-05T15:30:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:33.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:33 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:34.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:34 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi079 2023-10-05T15:30:34.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:34 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi079 to 8633M 2023-10-05T15:30:34.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:34 smithi167 ceph-mon[133366]: osdmap e35: 5 total, 5 up, 5 in 2023-10-05T15:30:34.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:34 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi079 2023-10-05T15:30:34.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:34 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi079 to 8633M 2023-10-05T15:30:34.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:34 smithi017 ceph-mon[129107]: osdmap e35: 5 total, 5 up, 5 in 2023-10-05T15:30:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:34 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi079 2023-10-05T15:30:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:34 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi079 to 8633M 2023-10-05T15:30:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:34 smithi079 ceph-mon[132936]: osdmap e35: 5 total, 5 up, 5 in 2023-10-05T15:30:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 -- 172.21.15.167:0/870816717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578074ee0 msgr2=0x7f3578073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 --2- 172.21.15.167:0/870816717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578074ee0 0x7f3578073340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3568009990 tx=0x7f3568009ca0 comp rx=0 tx=0).stop 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 -- 172.21.15.167:0/870816717 shutdown_connections 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 --2- 172.21.15.167:0/870816717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3578108e40 0x7f357810b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 --2- 172.21.15.167:0/870816717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578074ee0 0x7f3578073340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 --2- 172.21.15.167:0/870816717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3578073910 0x7f3578073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 -- 172.21.15.167:0/870816717 >> 172.21.15.167:0/870816717 conn(0x7f35780fc4d0 msgr2=0x7f35780fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 -- 172.21.15.167:0/870816717 shutdown_connections 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.963+0000 7f357e5a7700 1 -- 172.21.15.167:0/870816717 wait complete. 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.964+0000 7f357e5a7700 1 Processor -- start 2023-10-05T15:30:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.964+0000 7f357e5a7700 1 -- start start 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357e5a7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3578073910 0x7f3578198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357e5a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3578074ee0 0x7f35781992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357e5a7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 0x7f35781a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357e5a7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781a08f0 con 0x7f3578073910 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357e5a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781a0a30 con 0x7f3578074ee0 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357e5a7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35781a0bf0 con 0x7f3578108e40 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 0x7f35781a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 0x7f35781a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60808/0 (socket says 172.21.15.167:60808) 2023-10-05T15:30:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 -- 172.21.15.167:0/3031863269 learned_addr learned my addr 172.21.15.167:0/3031863269 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f35777fe700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3578074ee0 0x7f35781992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f3577fff700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3578073910 0x7f3578198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 -- 172.21.15.167:0/3031863269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3578074ee0 msgr2=0x7f35781992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3578074ee0 0x7f35781992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 -- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3578073910 msgr2=0x7f3578198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3578073910 0x7f3578198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.965+0000 7f357cb44700 1 -- 172.21.15.167:0/3031863269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35680095f0 con 0x7f3578108e40 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.966+0000 7f357cb44700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 0x7f35781a0320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f357000ef30 tx=0x7f357000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.966+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570018070 con 0x7f3578108e40 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.966+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35781a0e70 con 0x7f3578108e40 2023-10-05T15:30:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.966+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f357000f040 con 0x7f3578108e40 2023-10-05T15:30:34.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.966+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357000cb80 con 0x7f3578108e40 2023-10-05T15:30:34.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.966+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35781a1290 con 0x7f3578108e40 2023-10-05T15:30:34.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.967+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35781074f0 con 0x7f3578108e40 2023-10-05T15:30:34.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.969+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f357000cd60 con 0x7f3578108e40 2023-10-05T15:30:34.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.970+0000 7f35757fa700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35600a1500 0x7f35600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:30:34.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.971+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f35700cb750 con 0x7f3578108e40 2023-10-05T15:30:34.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.971+0000 7f3577fff700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35600a1500 0x7f35600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:30:34.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.972+0000 7f3577fff700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35600a1500 0x7f35600a39c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f35680098e0 tx=0x7f356800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:30:34.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:34.975+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35700998a0 con 0x7f3578108e40 2023-10-05T15:30:35.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:35.181+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f357802d2b0 con 0x7f35600a1500 2023-10-05T15:30:35.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:35 smithi017 ceph-mon[129107]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:35.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:30:35.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:30:35.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:35.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:35 smithi167 ceph-mon[133366]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:35.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:30:35.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:30:35.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:35.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:35 smithi079 ceph-mon[132936]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:30:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:30:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:36.570 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:36 smithi167 ceph-mon[133366]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:36 smithi017 ceph-mon[129107]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:36.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:36 smithi079 ceph-mon[132936]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:30:37.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:37 smithi167 ceph-mon[133366]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:37.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:37 smithi079 ceph-mon[132936]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:37.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:37 smithi017 ceph-mon[129107]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:38.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:38 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/2573079824' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]: dispatch 2023-10-05T15:30:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:38 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]: dispatch 2023-10-05T15:30:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:38 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]': finished 2023-10-05T15:30:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:38 smithi167 ceph-mon[133366]: osdmap e36: 6 total, 5 up, 6 in 2023-10-05T15:30:38.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:38 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:38.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:38 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/2573079824' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]: dispatch 2023-10-05T15:30:38.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:38 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]: dispatch 2023-10-05T15:30:38.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:38 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]': finished 2023-10-05T15:30:38.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:38 smithi079 ceph-mon[132936]: osdmap e36: 6 total, 5 up, 6 in 2023-10-05T15:30:38.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:38 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:38 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/2573079824' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]: dispatch 2023-10-05T15:30:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:38 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]: dispatch 2023-10-05T15:30:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:38 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a0bd55e-6aec-46a3-8ce4-a3b18e9df728"}]': finished 2023-10-05T15:30:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:38 smithi017 ceph-mon[129107]: osdmap e36: 6 total, 5 up, 6 in 2023-10-05T15:30:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:38 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:39.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:39 smithi167 ceph-mon[133366]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:39.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:39 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/4280175278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:30:39.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:39 smithi079 ceph-mon[132936]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:39.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:39 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/4280175278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:30:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:39 smithi017 ceph-mon[129107]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:39 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/4280175278' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:30:41.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:41 smithi167 ceph-mon[133366]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:41.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:41 smithi079 ceph-mon[132936]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:41.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:41 smithi017 ceph-mon[129107]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:43.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:43 smithi079 ceph-mon[132936]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:43.936 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:43 smithi167 ceph-mon[133366]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:43.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:43 smithi017 ceph-mon[129107]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:45.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:45 smithi079 ceph-mon[132936]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:45 smithi017 ceph-mon[129107]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:45 smithi167 ceph-mon[133366]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:46.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:46 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-05T15:30:46.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:46 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:46.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:46 smithi167 ceph-mon[133366]: Deploying daemon osd.5 on smithi167 2023-10-05T15:30:46.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:46 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-05T15:30:46.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:46 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:46.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:46 smithi079 ceph-mon[132936]: Deploying daemon osd.5 on smithi167 2023-10-05T15:30:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-05T15:30:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:46 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:46.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:46 smithi017 ceph-mon[129107]: Deploying daemon osd.5 on smithi167 2023-10-05T15:30:47.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:47 smithi167 ceph-mon[133366]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:47.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:47 smithi079 ceph-mon[132936]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:47.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:47 smithi017 ceph-mon[129107]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:49.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:49 smithi079 ceph-mon[132936]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:49.855 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:49 smithi167 ceph-mon[133366]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:49 smithi017 ceph-mon[129107]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:51.653 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:51 smithi167 ceph-mon[133366]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:51.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:51 smithi079 ceph-mon[132936]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:51 smithi017 ceph-mon[129107]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:53.027 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:53.027 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:53.027 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:53.027 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:52 smithi167 ceph-mon[133366]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:52 smithi079 ceph-mon[132936]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:52 smithi017 ceph-mon[129107]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:55.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.256+0000 7f35757fa700 1 -- 172.21.15.167:0/3031863269 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f357802d2b0 con 0x7f35600a1500 2023-10-05T15:30:55.259 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 5 on host 'smithi167' 2023-10-05T15:30:55.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35600a1500 msgr2=0x7f35600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35600a1500 0x7f35600a39c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f35680098e0 tx=0x7f356800b260 comp rx=0 tx=0).stop 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 msgr2=0x7f35781a0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 0x7f35781a0320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f357000ef30 tx=0x7f357000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 shutdown_connections 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35600a1500 0x7f35600a39c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3578108e40 0x7f35781a0320 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:55.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3578073910 0x7f3578198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:55.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 --2- 172.21.15.167:0/3031863269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3578074ee0 0x7f35781992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:30:55.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 >> 172.21.15.167:0/3031863269 conn(0x7f35780fc4d0 msgr2=0x7f35780fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:30:55.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.259+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 shutdown_connections 2023-10-05T15:30:55.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:30:55.260+0000 7f357e5a7700 1 -- 172.21.15.167:0/3031863269 wait complete. 2023-10-05T15:30:55.688 DEBUG:teuthology.orchestra.run.smithi167:osd.5> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-05T15:30:55.692 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2023-10-05T15:30:55.693 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-05T15:30:55.748 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.749 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:55.768 INFO:journalctl@ceph.osd.5.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:30:55.782 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.782 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.782 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:55.782 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:55.783 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.783 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:55.783 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.783 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.783 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:55.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:55.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:30:56.460 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:30:56.757 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:56 smithi017 ceph-mon[129107]: from='osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:30:56.757 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:56 smithi017 ceph-mon[129107]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:30:56.776 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:56 smithi167 ceph-mon[133366]: from='osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:30:56.776 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:56 smithi167 ceph-mon[133366]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:30:56.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:56 smithi079 ceph-mon[132936]: from='osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:30:56.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:56 smithi079 ceph-mon[132936]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-05T15:30:57.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:57 smithi017 ceph-mon[129107]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-05T15:30:57.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:57 smithi017 ceph-mon[129107]: from='osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:30:57.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:57 smithi017 ceph-mon[129107]: osdmap e37: 6 total, 5 up, 6 in 2023-10-05T15:30:57.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:57.689 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:57 smithi017 ceph-mon[129107]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:30:57.690 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:57 smithi017 ceph-mon[129107]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:57.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-mon[133366]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-05T15:30:57.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-mon[133366]: from='osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:30:57.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-mon[133366]: osdmap e37: 6 total, 5 up, 6 in 2023-10-05T15:30:57.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:57.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-mon[133366]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:30:57.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-mon[133366]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:57.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:30:57.496+0000 7ff2e21a7700 -1 osd.5 0 waiting for initial osdmap 2023-10-05T15:30:57.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:30:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:30:57.504+0000 7ff2db797700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:30:57.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:57 smithi079 ceph-mon[132936]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-05T15:30:57.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:57 smithi079 ceph-mon[132936]: from='osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:30:57.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:57 smithi079 ceph-mon[132936]: osdmap e37: 6 total, 5 up, 6 in 2023-10-05T15:30:57.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:57.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:57 smithi079 ceph-mon[132936]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:30:57.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:57 smithi079 ceph-mon[132936]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-05T15:30:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-05T15:30:58.431 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-10-05T15:30:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-10-05T15:30:58.431 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0317611 s, 330 MB/s 2023-10-05T15:30:58.431 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-10-05T15:30:58.818 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:58 smithi167 ceph-mon[133366]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:30:58.818 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:58 smithi167 ceph-mon[133366]: osdmap e38: 6 total, 5 up, 6 in 2023-10-05T15:30:58.818 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:58.818 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:58.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:58 smithi017 ceph-mon[129107]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:30:58.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:58 smithi017 ceph-mon[129107]: osdmap e38: 6 total, 5 up, 6 in 2023-10-05T15:30:58.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:58.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:58.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2023-10-05T15:30:58.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:58 smithi079 ceph-mon[132936]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:30:58.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:58 smithi079 ceph-mon[132936]: osdmap e38: 6 total, 5 up, 6 in 2023-10-05T15:30:58.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:58.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:30:59.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:30:59.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:30:59.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] boot 2023-10-05T15:30:59.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: osdmap e39: 6 total, 6 up, 6 in 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:59.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:30:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] boot 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: osdmap e39: 6 total, 6 up, 6 in 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.835 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:59.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:59.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:59.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:59.836 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:30:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:30:59.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:30:59.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: osd.5 [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] boot 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: osdmap e39: 6 total, 6 up, 6 in 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:30:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:30:59.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:30:59.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:30:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:00 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi167 2023-10-05T15:31:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:00 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi167 to 8633M 2023-10-05T15:31:00.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:00 smithi017 ceph-mon[129107]: osdmap e40: 6 total, 6 up, 6 in 2023-10-05T15:31:00.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:00 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi167 2023-10-05T15:31:00.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:00 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi167 to 8633M 2023-10-05T15:31:00.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:00 smithi167 ceph-mon[133366]: osdmap e40: 6 total, 6 up, 6 in 2023-10-05T15:31:00.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:00 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi167 2023-10-05T15:31:00.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:00 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi167 to 8633M 2023-10-05T15:31:00.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:00 smithi079 ceph-mon[132936]: osdmap e40: 6 total, 6 up, 6 in 2023-10-05T15:31:01.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 -- 172.21.15.17:0/633316449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8102090 msgr2=0x7f25f8102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:01.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/633316449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8102090 0x7f25f8102510 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009990 tx=0x7f25ec009ca0 comp rx=0 tx=0).stop 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 -- 172.21.15.17:0/633316449 shutdown_connections 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/633316449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f8102a50 0x7f25f8109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/633316449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25f8100f30 0x7f25f8101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/633316449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8102090 0x7f25f8102510 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 -- 172.21.15.17:0/633316449 >> 172.21.15.17:0/633316449 conn(0x7f25f80fc4d0 msgr2=0x7f25f80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 -- 172.21.15.17:0/633316449 shutdown_connections 2023-10-05T15:31:01.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.086+0000 7f25fcc5a700 1 -- 172.21.15.17:0/633316449 wait complete. 2023-10-05T15:31:01.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.088+0000 7f25fcc5a700 1 Processor -- start 2023-10-05T15:31:01.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.088+0000 7f25fcc5a700 1 -- start start 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.088+0000 7f25fcc5a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 0x7f25f8074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.088+0000 7f25fcc5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f8102090 0x7f25f80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.088+0000 7f25fcc5a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25f8102a50 0x7f25f80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25fcc5a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f8073f60 con 0x7f25f8100f30 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25fcc5a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80740d0 con 0x7f25f8102090 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25fcc5a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f81a0b20 con 0x7f25f8102a50 2023-10-05T15:31:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 0x7f25f8074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 0x7f25f8074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54148/0 (socket says 172.21.15.17:54148) 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 -- 172.21.15.17:0/512135258 learned_addr learned my addr 172.21.15.17:0/512135258 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f5d9b700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f8102090 0x7f25f80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f6d9d700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25f8102a50 0x7f25f80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 -- 172.21.15.17:0/512135258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25f8102a50 msgr2=0x7f25f80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25f8102a50 0x7f25f80737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 -- 172.21.15.17:0/512135258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f8102090 msgr2=0x7f25f80732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f8102090 0x7f25f80732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:01.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.089+0000 7f25f659c700 1 -- 172.21.15.17:0/512135258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec0095f0 con 0x7f25f8100f30 2023-10-05T15:31:01.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.090+0000 7f25f659c700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 0x7f25f8074c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25e800d950 tx=0x7f25e800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:31:01.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.090+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800f890 con 0x7f25f8100f30 2023-10-05T15:31:01.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.090+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25e800fe80 con 0x7f25f8100f30 2023-10-05T15:31:01.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.090+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f81a0e00 con 0x7f25f8100f30 2023-10-05T15:31:01.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.090+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800e3b0 con 0x7f25f8100f30 2023-10-05T15:31:01.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.090+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f81a1220 con 0x7f25f8100f30 2023-10-05T15:31:01.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.091+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f8108540 con 0x7f25f8100f30 2023-10-05T15:31:01.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.095+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f25e8010460 con 0x7f25f8100f30 2023-10-05T15:31:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.096+0000 7f25e77fe700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f25e00a1500 0x7f25e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.096+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f25e80cbf70 con 0x7f25f8100f30 2023-10-05T15:31:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.096+0000 7f25f5d9b700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f25e00a1500 0x7f25e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.097+0000 7f25f5d9b700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f25e00a1500 0x7f25e00a39c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00b2e0 tx=0x7f25ec004000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:31:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.099+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f25e80963d0 con 0x7f25f8100f30 2023-10-05T15:31:01.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:01.320+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f25f810c5f0 con 0x7f25e00a1500 2023-10-05T15:31:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:01 smithi167 ceph-mon[133366]: osdmap e41: 6 total, 6 up, 6 in 2023-10-05T15:31:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:01 smithi167 ceph-mon[133366]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:01 smithi167 ceph-mon[133366]: osdmap e42: 6 total, 6 up, 6 in 2023-10-05T15:31:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:01 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:01.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:01 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:01.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:01 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:01 smithi079 ceph-mon[132936]: osdmap e41: 6 total, 6 up, 6 in 2023-10-05T15:31:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:01 smithi079 ceph-mon[132936]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:01 smithi079 ceph-mon[132936]: osdmap e42: 6 total, 6 up, 6 in 2023-10-05T15:31:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:01 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:01 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:01 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:01 smithi017 ceph-mon[129107]: osdmap e41: 6 total, 6 up, 6 in 2023-10-05T15:31:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:01 smithi017 ceph-mon[129107]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:01 smithi017 ceph-mon[129107]: osdmap e42: 6 total, 6 up, 6 in 2023-10-05T15:31:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:01 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:01 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:01 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:02.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:02 smithi017 ceph-mon[129107]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:02.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:02 smithi017 ceph-mon[129107]: osdmap e43: 6 total, 6 up, 6 in 2023-10-05T15:31:02.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:02 smithi167 ceph-mon[133366]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:02.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:02 smithi167 ceph-mon[133366]: osdmap e43: 6 total, 6 up, 6 in 2023-10-05T15:31:02.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:02 smithi079 ceph-mon[132936]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:02.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:02 smithi079 ceph-mon[132936]: osdmap e43: 6 total, 6 up, 6 in 2023-10-05T15:31:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:03 smithi017 ceph-mon[129107]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:03.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:03 smithi167 ceph-mon[133366]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:03.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:03 smithi079 ceph-mon[132936]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:04.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:04 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1755651400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be4fc642-f0e3-47fd-91e9-1e589c8218cb"}]: dispatch 2023-10-05T15:31:04.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:04 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1755651400' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be4fc642-f0e3-47fd-91e9-1e589c8218cb"}]': finished 2023-10-05T15:31:04.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:04 smithi167 ceph-mon[133366]: osdmap e44: 7 total, 6 up, 7 in 2023-10-05T15:31:04.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:04.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:04 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1755651400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be4fc642-f0e3-47fd-91e9-1e589c8218cb"}]: dispatch 2023-10-05T15:31:04.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:04 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1755651400' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be4fc642-f0e3-47fd-91e9-1e589c8218cb"}]': finished 2023-10-05T15:31:04.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:04 smithi079 ceph-mon[132936]: osdmap e44: 7 total, 6 up, 7 in 2023-10-05T15:31:04.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:04 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1755651400' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be4fc642-f0e3-47fd-91e9-1e589c8218cb"}]: dispatch 2023-10-05T15:31:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:04 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1755651400' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be4fc642-f0e3-47fd-91e9-1e589c8218cb"}]': finished 2023-10-05T15:31:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:04 smithi017 ceph-mon[129107]: osdmap e44: 7 total, 6 up, 7 in 2023-10-05T15:31:04.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:05.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:05 smithi167 ceph-mon[133366]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 143 KiB/s, 0 objects/s recovering 2023-10-05T15:31:05.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:05 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3701079285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:05.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:05 smithi079 ceph-mon[132936]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 143 KiB/s, 0 objects/s recovering 2023-10-05T15:31:05.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:05 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3701079285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:05 smithi017 ceph-mon[129107]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 143 KiB/s, 0 objects/s recovering 2023-10-05T15:31:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:05 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3701079285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:07.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:07 smithi017 ceph-mon[129107]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:31:07.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:07 smithi167 ceph-mon[133366]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:31:07.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:07 smithi079 ceph-mon[132936]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:31:09.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:09 smithi079 ceph-mon[132936]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:31:09.901 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:09 smithi017 ceph-mon[129107]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:31:10.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:09 smithi167 ceph-mon[133366]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:31:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:11 smithi017 ceph-mon[129107]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:31:11.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:11 smithi079 ceph-mon[132936]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:31:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:11 smithi167 ceph-mon[133366]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:31:12.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-05T15:31:12.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:12.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-05T15:31:12.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:13.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-05T15:31:13.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:13 smithi079 ceph-mon[132936]: Deploying daemon osd.6 on smithi017 2023-10-05T15:31:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:13 smithi079 ceph-mon[132936]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:31:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:13 smithi017 ceph-mon[129107]: Deploying daemon osd.6 on smithi017 2023-10-05T15:31:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:13 smithi017 ceph-mon[129107]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:31:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:13 smithi167 ceph-mon[133366]: Deploying daemon osd.6 on smithi017 2023-10-05T15:31:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:13 smithi167 ceph-mon[133366]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:31:15.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:15 smithi017 ceph-mon[129107]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:15 smithi167 ceph-mon[133366]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:15 smithi079 ceph-mon[132936]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:17.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:17 smithi017 ceph-mon[129107]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:17 smithi167 ceph-mon[133366]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:17.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:17 smithi079 ceph-mon[132936]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:19.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:19.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:19.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:19.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:19 smithi167 ceph-mon[133366]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:19.336 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:19 smithi017 ceph-mon[129107]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:19.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:19.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:19.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:19.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:19 smithi079 ceph-mon[132936]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:21.389 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2023-10-05T15:31:21.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.387+0000 7f25e77fe700 1 -- 172.21.15.17:0/512135258 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f25f810c5f0 con 0x7f25e00a1500 2023-10-05T15:31:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f25e00a1500 msgr2=0x7f25e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f25e00a1500 0x7f25e00a39c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00b2e0 tx=0x7f25ec004000 comp rx=0 tx=0).stop 2023-10-05T15:31:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 msgr2=0x7f25f8074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 0x7f25f8074c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25e800d950 tx=0x7f25e800dc60 comp rx=0 tx=0).stop 2023-10-05T15:31:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 shutdown_connections 2023-10-05T15:31:21.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f25e00a1500 0x7f25e00a39c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25f8102a50 0x7f25f80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25f8100f30 0x7f25f8074c50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 --2- 172.21.15.17:0/512135258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f8102090 0x7f25f80732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 >> 172.21.15.17:0/512135258 conn(0x7f25f80fc4d0 msgr2=0x7f25f8105680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:31:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 shutdown_connections 2023-10-05T15:31:21.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:31:21.390+0000 7f25fcc5a700 1 -- 172.21.15.17:0/512135258 wait complete. 2023-10-05T15:31:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:21.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:21.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:21.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:21.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:22.015 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-05T15:31:22.020 INFO:tasks.cephadm:Deploying osd.7 on smithi079 with /dev/vg_nvme/lv_2... 2023-10-05T15:31:22.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-05T15:31:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:22.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:22.097 INFO:journalctl@ceph.osd.6.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:31:22.597 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:31:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:31:22.240+0000 7ffb827a8640 -1 osd.6 0 log_to_monitors true 2023-10-05T15:31:22.754 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:31:22.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:22 smithi079 ceph-mon[132936]: from='osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:31:22.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:22 smithi079 ceph-mon[132936]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:31:22.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:22 smithi017 ceph-mon[129107]: from='osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:31:22.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:22 smithi017 ceph-mon[129107]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:31:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:22 smithi167 ceph-mon[133366]: from='osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:31:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:22 smithi167 ceph-mon[133366]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-05T15:31:23.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:23 smithi079 ceph-mon[132936]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:23 smithi079 ceph-mon[132936]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-05T15:31:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:23 smithi079 ceph-mon[132936]: osdmap e45: 7 total, 6 up, 7 in 2023-10-05T15:31:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:23 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:23 smithi079 ceph-mon[132936]: from='osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:31:23.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:23 smithi079 ceph-mon[132936]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:31:23.947 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:31:23.605+0000 7ffb77e1f700 -1 osd.6 0 waiting for initial osdmap 2023-10-05T15:31:23.947 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:31:23.621+0000 7ffb71c10700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:31:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-mon[129107]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-mon[129107]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-05T15:31:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-mon[129107]: osdmap e45: 7 total, 6 up, 7 in 2023-10-05T15:31:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-mon[129107]: from='osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:31:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:23 smithi017 ceph-mon[129107]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:31:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:23 smithi167 ceph-mon[133366]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:23 smithi167 ceph-mon[133366]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-05T15:31:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:23 smithi167 ceph-mon[133366]: osdmap e45: 7 total, 6 up, 7 in 2023-10-05T15:31:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:23 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:24.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:23 smithi167 ceph-mon[133366]: from='osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:31:24.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:23 smithi167 ceph-mon[133366]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:31:24.681 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-05T15:31:24.681 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-05T15:31:24.681 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2023-10-05T15:31:24.682 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2023-10-05T15:31:24.682 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0310165 s, 338 MB/s 2023-10-05T15:31:24.682 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2023-10-05T15:31:24.864 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:24 smithi079 ceph-mon[132936]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:31:24.864 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:24 smithi079 ceph-mon[132936]: osdmap e46: 7 total, 6 up, 7 in 2023-10-05T15:31:24.864 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:24.864 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:24 smithi017 ceph-mon[129107]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:31:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:24 smithi017 ceph-mon[129107]: osdmap e46: 7 total, 6 up, 7 in 2023-10-05T15:31:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:24 smithi167 ceph-mon[133366]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:31:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:24 smithi167 ceph-mon[133366]: osdmap e46: 7 total, 6 up, 7 in 2023-10-05T15:31:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:25.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] boot 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: osdmap e47: 7 total, 7 up, 7 in 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:25.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:25.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:25.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:25.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:25.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:25.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:25.853 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:31:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:31:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:31:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] boot 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: osdmap e47: 7 total, 7 up, 7 in 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: osd.6 [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] boot 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: osdmap e47: 7 total, 7 up, 7 in 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-05T15:31:26.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:26.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:26.668 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:26 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi017 2023-10-05T15:31:26.668 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:26 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi017 to 5757M 2023-10-05T15:31:26.668 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:26 smithi079 ceph-mon[132936]: osdmap e48: 7 total, 7 up, 7 in 2023-10-05T15:31:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:26 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi017 2023-10-05T15:31:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:26 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi017 to 5757M 2023-10-05T15:31:26.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:26 smithi017 ceph-mon[129107]: osdmap e48: 7 total, 7 up, 7 in 2023-10-05T15:31:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:26 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi017 2023-10-05T15:31:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:26 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi017 to 5757M 2023-10-05T15:31:27.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:26 smithi167 ceph-mon[133366]: osdmap e48: 7 total, 7 up, 7 in 2023-10-05T15:31:27.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 -- 172.21.15.79:0/1675089318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0074ee0 msgr2=0x7fb7b0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:27.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 --2- 172.21.15.79:0/1675089318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0074ee0 0x7fb7b0073340 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009990 tx=0x7fb7a0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:31:27.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 -- 172.21.15.79:0/1675089318 shutdown_connections 2023-10-05T15:31:27.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 --2- 172.21.15.79:0/1675089318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0108e40 0x7fb7b010b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 --2- 172.21.15.79:0/1675089318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0074ee0 0x7fb7b0073340 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 --2- 172.21.15.79:0/1675089318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7b0073910 0x7fb7b0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 -- 172.21.15.79:0/1675089318 >> 172.21.15.79:0/1675089318 conn(0x7fb7b00fc4d0 msgr2=0x7fb7b00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:31:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 -- 172.21.15.79:0/1675089318 shutdown_connections 2023-10-05T15:31:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.233+0000 7fb7b601a700 1 -- 172.21.15.79:0/1675089318 wait complete. 2023-10-05T15:31:27.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.234+0000 7fb7b601a700 1 Processor -- start 2023-10-05T15:31:27.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.234+0000 7fb7b601a700 1 -- start start 2023-10-05T15:31:27.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7b601a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7b0073910 0x7fb7b0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:27.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7b601a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0074ee0 0x7fb7b0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:27.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7b601a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 0x7fb7b01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:27.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7b601a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01a08e0 con 0x7fb7b0074ee0 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7b601a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01a0a20 con 0x7fb7b0108e40 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7b601a700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01a0bb0 con 0x7fb7b0073910 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7affff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 0x7fb7b01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7affff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 0x7fb7b01a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40428/0 (socket says 172.21.15.79:40428) 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7affff700 1 -- 172.21.15.79:0/2693747583 learned_addr learned my addr 172.21.15.79:0/2693747583 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7aeffd700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0074ee0 0x7fb7b0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7af7fe700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7b0073910 0x7fb7b0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7affff700 1 -- 172.21.15.79:0/2693747583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7b0073910 msgr2=0x7fb7b0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.235+0000 7fb7affff700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7b0073910 0x7fb7b0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:27.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7affff700 1 -- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0074ee0 msgr2=0x7fb7b0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7affff700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0074ee0 0x7fb7b0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7affff700 1 -- 172.21.15.79:0/2693747583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a00095f0 con 0x7fb7b0108e40 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7affff700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 0x7fb7b01a0310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800ef30 tx=0x7fb7a800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8018070 con 0x7fb7b0108e40 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7a800f040 con 0x7fb7b0108e40 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b01a0e30 con 0x7fb7b0108e40 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800cc90 con 0x7fb7b0108e40 2023-10-05T15:31:27.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.236+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b01a12a0 con 0x7fb7b0108e40 2023-10-05T15:31:27.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.237+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b01074f0 con 0x7fb7b0108e40 2023-10-05T15:31:27.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.239+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb7a8007500 con 0x7fb7b0108e40 2023-10-05T15:31:27.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.240+0000 7fb7acff9700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7980a1500 0x7fb7980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:27.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.241+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fb7a80cbb10 con 0x7fb7b0108e40 2023-10-05T15:31:27.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.241+0000 7fb7af7fe700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7980a1500 0x7fb7980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:27.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.242+0000 7fb7af7fe700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7980a1500 0x7fb7980a39c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0005910 tx=0x7fb7a000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:31:27.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.245+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb7a8095e70 con 0x7fb7b0108e40 2023-10-05T15:31:27.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:27.453+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7b002d350 con 0x7fb7980a1500 2023-10-05T15:31:27.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:27 smithi017 ceph-mon[129107]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:27.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:27.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:27.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:27 smithi167 ceph-mon[133366]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:27 smithi079 ceph-mon[132936]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:28.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:28.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:28 smithi079 ceph-mon[132936]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:28.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:28 smithi017 ceph-mon[129107]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:28 smithi167 ceph-mon[133366]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:29.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:29 smithi079 ceph-mon[132936]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:29.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:29 smithi017 ceph-mon[129107]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:29 smithi167 ceph-mon[133366]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:30 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/2664063046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]: dispatch 2023-10-05T15:31:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:30 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]: dispatch 2023-10-05T15:31:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:30 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]': finished 2023-10-05T15:31:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:30 smithi017 ceph-mon[129107]: osdmap e49: 8 total, 7 up, 8 in 2023-10-05T15:31:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:30 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/2664063046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]: dispatch 2023-10-05T15:31:31.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:30 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]: dispatch 2023-10-05T15:31:31.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:30 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]': finished 2023-10-05T15:31:31.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:30 smithi167 ceph-mon[133366]: osdmap e49: 8 total, 7 up, 8 in 2023-10-05T15:31:31.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:31.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:30 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/2664063046' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]: dispatch 2023-10-05T15:31:31.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:30 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]: dispatch 2023-10-05T15:31:31.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:30 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "846db2d8-4524-4e02-8667-6a7d56e10453"}]': finished 2023-10-05T15:31:31.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:30 smithi079 ceph-mon[132936]: osdmap e49: 8 total, 7 up, 8 in 2023-10-05T15:31:31.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:31 smithi017 ceph-mon[129107]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:31 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/2916590620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:31 smithi167 ceph-mon[133366]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:31 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/2916590620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:31 smithi079 ceph-mon[132936]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:31 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/2916590620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:33 smithi017 ceph-mon[129107]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:33 smithi167 ceph-mon[133366]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:33 smithi079 ceph-mon[132936]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:35.942 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:35 smithi079 ceph-mon[132936]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:35.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:35 smithi017 ceph-mon[129107]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:35 smithi167 ceph-mon[133366]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:37.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:37 smithi017 ceph-mon[129107]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:37.580 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:37 smithi079 ceph-mon[132936]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:37.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:37 smithi167 ceph-mon[133366]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:38 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-05T15:31:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:38 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:38.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:38 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-05T15:31:38.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:38 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:38.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:38 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-05T15:31:38.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:38 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:39.417 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:39 smithi079 ceph-mon[132936]: Deploying daemon osd.7 on smithi079 2023-10-05T15:31:39.417 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:39 smithi079 ceph-mon[132936]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:39.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:39 smithi017 ceph-mon[129107]: Deploying daemon osd.7 on smithi079 2023-10-05T15:31:39.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:39 smithi017 ceph-mon[129107]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:39 smithi167 ceph-mon[133366]: Deploying daemon osd.7 on smithi079 2023-10-05T15:31:39.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:39 smithi167 ceph-mon[133366]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:41.664 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:41 smithi079 ceph-mon[132936]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:41.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:41 smithi017 ceph-mon[129107]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:41 smithi167 ceph-mon[133366]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:43.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:43 smithi079 ceph-mon[132936]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:43.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:43 smithi017 ceph-mon[129107]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:43 smithi167 ceph-mon[133366]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:45.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:45.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:45.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:45.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:45 smithi079 ceph-mon[132936]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:45 smithi017 ceph-mon[129107]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:45 smithi167 ceph-mon[133366]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:47.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.279+0000 7fb7acff9700 1 -- 172.21.15.79:0/2693747583 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb7b002d350 con 0x7fb7980a1500 2023-10-05T15:31:47.282 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 7 on host 'smithi079' 2023-10-05T15:31:47.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7980a1500 msgr2=0x7fb7980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7980a1500 0x7fb7980a39c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0005910 tx=0x7fb7a000b260 comp rx=0 tx=0).stop 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 msgr2=0x7fb7b01a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 0x7fb7b01a0310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800ef30 tx=0x7fb7a800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 shutdown_connections 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb7980a1500 0x7fb7980a39c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7b0108e40 0x7fb7b01a0310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7b0073910 0x7fb7b0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 --2- 172.21.15.79:0/2693747583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7b0074ee0 0x7fb7b0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 >> 172.21.15.79:0/2693747583 conn(0x7fb7b00fc4d0 msgr2=0x7fb7b00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 shutdown_connections 2023-10-05T15:31:47.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:31:47.281+0000 7fb7b601a700 1 -- 172.21.15.79:0/2693747583 wait complete. 2023-10-05T15:31:47.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:47 smithi017 ceph-mon[129107]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:47 smithi079 ceph-mon[132936]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:47.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:47.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:47.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:47 smithi167 ceph-mon[133366]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:47.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:47.774 DEBUG:teuthology.orchestra.run.smithi079:osd.7> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-05T15:31:47.779 INFO:tasks.cephadm:Deploying osd.8 on smithi167 with /dev/vg_nvme/lv_2... 2023-10-05T15:31:47.779 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-05T15:31:47.849 INFO:journalctl@ceph.osd.7.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:31:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:48.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:48.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:48 smithi079 ceph-mon[132936]: from='osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:31:48.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:48 smithi079 ceph-mon[132936]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:31:48.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:31:48 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:31:48.070+0000 7f6bd6155640 -1 osd.7 0 log_to_monitors true 2023-10-05T15:31:48.513 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:31:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:48 smithi167 ceph-mon[133366]: from='osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:31:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:48 smithi167 ceph-mon[133366]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:31:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:31:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:48 smithi017 ceph-mon[129107]: from='osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:31:48.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:48 smithi017 ceph-mon[129107]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-05T15:31:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-mon[132936]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-05T15:31:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-mon[132936]: osdmap e50: 8 total, 7 up, 8 in 2023-10-05T15:31:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-mon[132936]: from='osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:31:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-mon[132936]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:31:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-mon[132936]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:49.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:31:49.250+0000 7f6bcb7cc700 -1 osd.7 0 waiting for initial osdmap 2023-10-05T15:31:49.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:31:49 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:31:49.266+0000 7f6bc55bd700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:31:49.415 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:49 smithi167 ceph-mon[133366]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-05T15:31:49.416 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:49 smithi167 ceph-mon[133366]: osdmap e50: 8 total, 7 up, 8 in 2023-10-05T15:31:49.416 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:49.416 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:49 smithi167 ceph-mon[133366]: from='osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:31:49.416 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:49 smithi167 ceph-mon[133366]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:31:49.416 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:49 smithi167 ceph-mon[133366]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:49 smithi017 ceph-mon[129107]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-05T15:31:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:49 smithi017 ceph-mon[129107]: osdmap e50: 8 total, 7 up, 8 in 2023-10-05T15:31:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:49 smithi017 ceph-mon[129107]: from='osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:31:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:49 smithi017 ceph-mon[129107]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:31:49.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:49 smithi017 ceph-mon[129107]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-05T15:31:50.502 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-05T15:31:50.502 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-05T15:31:50.502 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2023-10-05T15:31:50.502 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2023-10-05T15:31:50.502 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0294285 s, 356 MB/s 2023-10-05T15:31:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2023-10-05T15:31:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:50 smithi167 ceph-mon[133366]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:31:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:50 smithi167 ceph-mon[133366]: osdmap e51: 8 total, 7 up, 8 in 2023-10-05T15:31:50.538 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:50.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:50.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:50 smithi079 ceph-mon[132936]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:31:50.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:50 smithi079 ceph-mon[132936]: osdmap e51: 8 total, 7 up, 8 in 2023-10-05T15:31:50.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:50.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:50.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:50 smithi017 ceph-mon[129107]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:31:50.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:50 smithi017 ceph-mon[129107]: osdmap e51: 8 total, 7 up, 8 in 2023-10-05T15:31:50.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:50.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:50.991 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2023-10-05T15:31:51.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:31:51.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:31:51.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] boot 2023-10-05T15:31:51.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: osdmap e52: 8 total, 8 up, 8 in 2023-10-05T15:31:51.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:51.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: pgmap v185: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:51.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:51 smithi167 ceph-mon[133366]: osdmap e53: 8 total, 8 up, 8 in 2023-10-05T15:31:51.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:31:51.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:31:51.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] boot 2023-10-05T15:31:51.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: osdmap e52: 8 total, 8 up, 8 in 2023-10-05T15:31:51.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:51.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: pgmap v185: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:51.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:51 smithi079 ceph-mon[132936]: osdmap e53: 8 total, 8 up, 8 in 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: osd.7 [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] boot 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: osdmap e52: 8 total, 8 up, 8 in 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: pgmap v185: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:51.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:51 smithi017 ceph-mon[129107]: osdmap e53: 8 total, 8 up, 8 in 2023-10-05T15:31:51.726 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi079 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.687 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi079 to 5755M 2023-10-05T15:31:52.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:52.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:52.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.688 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:52 smithi167 ceph-mon[133366]: osdmap e54: 8 total, 8 up, 8 in 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi079 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi079 to 5755M 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:52.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:52.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:52 smithi017 ceph-mon[129107]: osdmap e54: 8 total, 8 up, 8 in 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi079 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:31:52.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi079 to 5755M 2023-10-05T15:31:52.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:52.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:31:52.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:31:52.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:52 smithi079 ceph-mon[132936]: osdmap e54: 8 total, 8 up, 8 in 2023-10-05T15:31:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 -- 172.21.15.167:0/11268681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48102170 msgr2=0x7fcd481025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 --2- 172.21.15.167:0/11268681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48102170 0x7fcd481025d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009990 tx=0x7fcd38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:31:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 -- 172.21.15.167:0/11268681 shutdown_connections 2023-10-05T15:31:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 --2- 172.21.15.167:0/11268681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd48102b10 0x7fcd481093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:53.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 --2- 172.21.15.167:0/11268681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd48100f70 0x7fcd48101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 --2- 172.21.15.167:0/11268681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48102170 0x7fcd481025d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 -- 172.21.15.167:0/11268681 >> 172.21.15.167:0/11268681 conn(0x7fcd480fc4d0 msgr2=0x7fcd480fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:31:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 -- 172.21.15.167:0/11268681 shutdown_connections 2023-10-05T15:31:53.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.211+0000 7fcd4f556700 1 -- 172.21.15.167:0/11268681 wait complete. 2023-10-05T15:31:53.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.212+0000 7fcd4f556700 1 Processor -- start 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.212+0000 7fcd4f556700 1 -- start start 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.212+0000 7fcd4f556700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 0x7fcd48074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.212+0000 7fcd4f556700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd48102170 0x7fcd480732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.212+0000 7fcd4f556700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd48102b10 0x7fcd480737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4f556700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48073f60 con 0x7fcd48102170 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4f556700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480740d0 con 0x7fcd48102b10 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4f556700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481a0c10 con 0x7fcd48100f70 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 0x7fcd48074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 0x7fcd48074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:44276/0 (socket says 172.21.15.167:44276) 2023-10-05T15:31:53.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 -- 172.21.15.167:0/3826096084 learned_addr learned my addr 172.21.15.167:0/3826096084 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4caf1700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd48102170 0x7fcd480732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4daf3700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd48102b10 0x7fcd480737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 -- 172.21.15.167:0/3826096084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd48102b10 msgr2=0x7fcd480737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd48102b10 0x7fcd480737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 -- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd48102170 msgr2=0x7fcd480732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd48102170 0x7fcd480732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 -- 172.21.15.167:0/3826096084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380095f0 con 0x7fcd48100f70 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.213+0000 7fcd4d2f2700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 0x7fcd48074c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400d980 tx=0x7fcd4400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.214+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44004020 con 0x7fcd48100f70 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.214+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd44009730 con 0x7fcd48100f70 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.214+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd481a0ef0 con 0x7fcd48100f70 2023-10-05T15:31:53.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.214+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44003a00 con 0x7fcd48100f70 2023-10-05T15:31:53.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.214+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd481a1300 con 0x7fcd48100f70 2023-10-05T15:31:53.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.215+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4810c6e0 con 0x7fcd48100f70 2023-10-05T15:31:53.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.217+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcd440098a0 con 0x7fcd48100f70 2023-10-05T15:31:53.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.218+0000 7fcd3e7fc700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcd340a1480 0x7fcd340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:31:53.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.218+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7fcd440cbf00 con 0x7fcd48100f70 2023-10-05T15:31:53.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.219+0000 7fcd4caf1700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcd340a1480 0x7fcd340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:31:53.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.219+0000 7fcd4caf1700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcd340a1480 0x7fcd340a3940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b5c0 tx=0x7fcd38005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:31:53.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.223+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd44096000 con 0x7fcd48100f70 2023-10-05T15:31:53.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:31:53.438+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd480612f0 con 0x7fcd340a1480 2023-10-05T15:31:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:53 smithi017 ceph-mon[129107]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:53.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:53 smithi167 ceph-mon[133366]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:53.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:53 smithi079 ceph-mon[132936]: pgmap v188: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:54.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:54 smithi017 ceph-mon[129107]: osdmap e55: 8 total, 8 up, 8 in 2023-10-05T15:31:54.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:54 smithi017 ceph-mon[129107]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:54.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:54.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:54.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:54.800 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:54 smithi167 ceph-mon[133366]: osdmap e55: 8 total, 8 up, 8 in 2023-10-05T15:31:54.801 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:54 smithi167 ceph-mon[133366]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:54.801 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:54.801 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:54.801 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:54.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:54 smithi079 ceph-mon[132936]: osdmap e55: 8 total, 8 up, 8 in 2023-10-05T15:31:54.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:54 smithi079 ceph-mon[132936]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:31:54.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:31:54.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:31:54.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:31:55.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:55 smithi017 ceph-mon[129107]: osdmap e56: 8 total, 8 up, 8 in 2023-10-05T15:31:55.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:55 smithi017 ceph-mon[129107]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:55.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:55 smithi167 ceph-mon[133366]: osdmap e56: 8 total, 8 up, 8 in 2023-10-05T15:31:55.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:55 smithi167 ceph-mon[133366]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:55.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:55 smithi079 ceph-mon[132936]: osdmap e56: 8 total, 8 up, 8 in 2023-10-05T15:31:55.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:55 smithi079 ceph-mon[132936]: pgmap v191: 1 pgs: 1 unknown; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/3006537014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]: dispatch 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]: dispatch 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]': finished 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: osdmap e57: 9 total, 8 up, 9 in 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:57.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:57 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/1237984468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/3006537014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]: dispatch 2023-10-05T15:31:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]: dispatch 2023-10-05T15:31:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]': finished 2023-10-05T15:31:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: osdmap e57: 9 total, 8 up, 9 in 2023-10-05T15:31:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:31:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:57.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:57 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/1237984468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:57.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/3006537014' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]: dispatch 2023-10-05T15:31:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]: dispatch 2023-10-05T15:31:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "207e8b8a-3383-4888-ab40-8f8117eba824"}]': finished 2023-10-05T15:31:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: osdmap e57: 9 total, 8 up, 9 in 2023-10-05T15:31:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:31:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:57 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/1237984468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:31:59.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:31:59 smithi079 ceph-mon[132936]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:31:59.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:31:59 smithi017 ceph-mon[129107]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:31:59 smithi167 ceph-mon[133366]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:01.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:01 smithi079 ceph-mon[132936]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:01.905 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:01 smithi167 ceph-mon[133366]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:01 smithi017 ceph-mon[129107]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:03.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:03 smithi167 ceph-mon[133366]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:03.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:03 smithi017 ceph-mon[129107]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:03 smithi079 ceph-mon[132936]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:04.878 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-05T15:32:04.878 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-05T15:32:04.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-05T15:32:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:05.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:05 smithi167 ceph-mon[133366]: Deploying daemon osd.8 on smithi167 2023-10-05T15:32:05.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:05 smithi167 ceph-mon[133366]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:05.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:05 smithi017 ceph-mon[129107]: Deploying daemon osd.8 on smithi167 2023-10-05T15:32:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:05 smithi017 ceph-mon[129107]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:05 smithi079 ceph-mon[132936]: Deploying daemon osd.8 on smithi167 2023-10-05T15:32:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:05 smithi079 ceph-mon[132936]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:07.419 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:07 smithi167 ceph-mon[133366]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:07.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:07 smithi017 ceph-mon[129107]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:07.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:07 smithi079 ceph-mon[132936]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:09.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:09 smithi079 ceph-mon[132936]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:09.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:09 smithi167 ceph-mon[133366]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:09.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:09 smithi017 ceph-mon[129107]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:11.423 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:11.423 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:11.423 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:11.424 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:11 smithi167 ceph-mon[133366]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:11.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:11.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:11 smithi017 ceph-mon[129107]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:11.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:11.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:11 smithi079 ceph-mon[132936]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:13.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.270+0000 7fcd3e7fc700 1 -- 172.21.15.167:0/3826096084 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcd480612f0 con 0x7fcd340a1480 2023-10-05T15:32:13.273 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 8 on host 'smithi167' 2023-10-05T15:32:13.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcd340a1480 msgr2=0x7fcd340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcd340a1480 0x7fcd340a3940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b5c0 tx=0x7fcd38005fb0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 msgr2=0x7fcd48074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:13.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 0x7fcd48074c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400d980 tx=0x7fcd4400dc90 comp rx=0 tx=0).stop 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 shutdown_connections 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcd340a1480 0x7fcd340a3940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd48102b10 0x7fcd480737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd48100f70 0x7fcd48074c50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 --2- 172.21.15.167:0/3826096084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd48102170 0x7fcd480732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 >> 172.21.15.167:0/3826096084 conn(0x7fcd480fc4d0 msgr2=0x7fcd480fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 shutdown_connections 2023-10-05T15:32:13.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:32:13.272+0000 7fcd4f556700 1 -- 172.21.15.167:0/3826096084 wait complete. 2023-10-05T15:32:13.760 DEBUG:teuthology.orchestra.run.smithi167:osd.8> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-05T15:32:13.765 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2023-10-05T15:32:13.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-05T15:32:13.837 INFO:journalctl@ceph.osd.8.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:32:13.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:13.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:13 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:13.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:13 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.057 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:14.057 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:14.058 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:13 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:14.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:32:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:32:14.054+0000 7f0fb4576640 -1 osd.8 0 log_to_monitors true 2023-10-05T15:32:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:32:14.822 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:14 smithi167 ceph-mon[133366]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:32:14.863 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:14 smithi017 ceph-mon[129107]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:32:15.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:14 smithi079 ceph-mon[132936]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-05T15:32:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:15 smithi017 ceph-mon[129107]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:15 smithi017 ceph-mon[129107]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-05T15:32:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:15 smithi017 ceph-mon[129107]: osdmap e58: 9 total, 8 up, 9 in 2023-10-05T15:32:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:15 smithi017 ceph-mon[129107]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:32:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:15.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:32:15.618+0000 7f0fa9bed700 -1 osd.8 0 waiting for initial osdmap 2023-10-05T15:32:15.833 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:32:15.631+0000 7f0fa59e2700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:32:15.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-mon[133366]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-mon[133366]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-05T15:32:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-mon[133366]: osdmap e58: 9 total, 8 up, 9 in 2023-10-05T15:32:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-mon[133366]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:32:15.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:15 smithi079 ceph-mon[132936]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:15 smithi079 ceph-mon[132936]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-05T15:32:16.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:15 smithi079 ceph-mon[132936]: osdmap e58: 9 total, 8 up, 9 in 2023-10-05T15:32:16.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:15 smithi079 ceph-mon[132936]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:32:16.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-05T15:32:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-05T15:32:16.502 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-10-05T15:32:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-10-05T15:32:16.502 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0438573 s, 239 MB/s 2023-10-05T15:32:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-10-05T15:32:16.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:32:16.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: osdmap e59: 9 total, 8 up, 9 in 2023-10-05T15:32:16.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.882 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] boot 2023-10-05T15:32:16.882 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: osdmap e60: 9 total, 9 up, 9 in 2023-10-05T15:32:16.882 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:16 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:32:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: osdmap e59: 9 total, 8 up, 9 in 2023-10-05T15:32:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] boot 2023-10-05T15:32:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: osdmap e60: 9 total, 9 up, 9 in 2023-10-05T15:32:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:16 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:16.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2023-10-05T15:32:17.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: from='osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:32:17.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: osdmap e59: 9 total, 8 up, 9 in 2023-10-05T15:32:17.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:17.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:17.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: osd.8 [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] boot 2023-10-05T15:32:17.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: osdmap e60: 9 total, 9 up, 9 in 2023-10-05T15:32:17.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:16 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-05T15:32:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:32:17.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: osdmap e61: 9 total, 9 up, 9 in 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:32:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:32:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: osdmap e61: 9 total, 9 up, 9 in 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:18.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:32:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: osdmap e61: 9 total, 9 up, 9 in 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:18.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:18.897 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:18 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi167 2023-10-05T15:32:18.897 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:18 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi167 to 5755M 2023-10-05T15:32:18.897 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:18 smithi017 ceph-mon[129107]: osdmap e62: 9 total, 9 up, 9 in 2023-10-05T15:32:19.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:18 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi167 2023-10-05T15:32:19.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:18 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi167 to 5755M 2023-10-05T15:32:19.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:18 smithi167 ceph-mon[133366]: osdmap e62: 9 total, 9 up, 9 in 2023-10-05T15:32:19.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:18 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi167 2023-10-05T15:32:19.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:18 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi167 to 5755M 2023-10-05T15:32:19.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:18 smithi079 ceph-mon[132936]: osdmap e62: 9 total, 9 up, 9 in 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 -- 172.21.15.17:0/3980573556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec102170 msgr2=0x7fb0ec1025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/3980573556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec102170 0x7fb0ec1025d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0099c0 tx=0x7fb0dc009cd0 comp rx=0 tx=0).stop 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 -- 172.21.15.17:0/3980573556 shutdown_connections 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/3980573556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ec102b10 0x7fb0ec1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/3980573556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec100f70 0x7fb0ec101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/3980573556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec102170 0x7fb0ec1025d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 -- 172.21.15.17:0/3980573556 >> 172.21.15.17:0/3980573556 conn(0x7fb0ec0fc4d0 msgr2=0x7fb0ec0fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 -- 172.21.15.17:0/3980573556 shutdown_connections 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.167+0000 7fb0f38a7700 1 -- 172.21.15.17:0/3980573556 wait complete. 2023-10-05T15:32:19.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.168+0000 7fb0f38a7700 1 Processor -- start 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 -- start start 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 0x7fb0ec196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec102170 0x7fb0ec1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ec102b10 0x7fb0ec19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec19e730 con 0x7fb0ec100f70 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec19e870 con 0x7fb0ec102170 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f38a7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec19ea00 con 0x7fb0ec102b10 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f1643700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 0x7fb0ec196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f1643700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 0x7fb0ec196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32916/0 (socket says 172.21.15.17:32916) 2023-10-05T15:32:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.169+0000 7fb0f1643700 1 -- 172.21.15.17:0/2652454280 learned_addr learned my addr 172.21.15.17:0/2652454280 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f0e42700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec102170 0x7fb0ec1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1e44700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ec102b10 0x7fb0ec19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1643700 1 -- 172.21.15.17:0/2652454280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ec102b10 msgr2=0x7fb0ec19e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1643700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ec102b10 0x7fb0ec19e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1643700 1 -- 172.21.15.17:0/2652454280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec102170 msgr2=0x7fb0ec1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1643700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec102170 0x7fb0ec1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1643700 1 -- 172.21.15.17:0/2652454280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc0095f0 con 0x7fb0ec100f70 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f1643700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 0x7fb0ec196ba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800d9b0 tx=0x7fb0e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8004020 con 0x7fb0ec100f70 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec19ece0 con 0x7fb0ec100f70 2023-10-05T15:32:19.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0e8009730 con 0x7fb0ec100f70 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.170+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80039c0 con 0x7fb0ec100f70 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.171+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec19f180 con 0x7fb0ec100f70 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.171+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec10c6e0 con 0x7fb0ec100f70 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.173+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb0e80098a0 con 0x7fb0ec100f70 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.175+0000 7fb0e27fc700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb0d80a1480 0x7fb0d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.175+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5858+0+0 (secure 0 0 0) 0x7fb0e80cc100 con 0x7fb0ec100f70 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.175+0000 7fb0f0e42700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb0d80a1480 0x7fb0d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.176+0000 7fb0f0e42700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb0d80a1480 0x7fb0d80a3940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc006010 tx=0x7fb0dc0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:19.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.179+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb0e8096050 con 0x7fb0ec100f70 2023-10-05T15:32:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:19.414+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0ec0612f0 con 0x7fb0d80a1480 2023-10-05T15:32:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:19 smithi017 ceph-mon[129107]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:19 smithi017 ceph-mon[129107]: osdmap e63: 9 total, 9 up, 9 in 2023-10-05T15:32:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:32:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:32:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:19 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:19 smithi167 ceph-mon[133366]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:20.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:19 smithi167 ceph-mon[133366]: osdmap e63: 9 total, 9 up, 9 in 2023-10-05T15:32:20.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:32:20.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:32:20.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:19 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:19 smithi079 ceph-mon[132936]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:19 smithi079 ceph-mon[132936]: osdmap e63: 9 total, 9 up, 9 in 2023-10-05T15:32:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:32:20.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:32:20.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:19 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:20.935 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:20 smithi017 ceph-mon[129107]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:32:20.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:20 smithi017 ceph-mon[129107]: osdmap e64: 9 total, 9 up, 9 in 2023-10-05T15:32:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:20 smithi167 ceph-mon[133366]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:32:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:20 smithi167 ceph-mon[133366]: osdmap e64: 9 total, 9 up, 9 in 2023-10-05T15:32:21.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:20 smithi079 ceph-mon[132936]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:32:21.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:20 smithi079 ceph-mon[132936]: osdmap e64: 9 total, 9 up, 9 in 2023-10-05T15:32:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:21 smithi017 ceph-mon[129107]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-05T15:32:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:21 smithi167 ceph-mon[133366]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-05T15:32:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:21 smithi079 ceph-mon[132936]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-05T15:32:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:23 smithi017 ceph-mon[129107]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2023-10-05T15:32:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:23 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3531230172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6012aed-94f6-4c37-bcf7-82dc08b176f9"}]: dispatch 2023-10-05T15:32:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:23 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3531230172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6012aed-94f6-4c37-bcf7-82dc08b176f9"}]': finished 2023-10-05T15:32:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:23 smithi017 ceph-mon[129107]: osdmap e65: 10 total, 9 up, 10 in 2023-10-05T15:32:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:23 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:23.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:23 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/620251636' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:32:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:23 smithi167 ceph-mon[133366]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2023-10-05T15:32:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:23 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3531230172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6012aed-94f6-4c37-bcf7-82dc08b176f9"}]: dispatch 2023-10-05T15:32:24.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:23 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3531230172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6012aed-94f6-4c37-bcf7-82dc08b176f9"}]': finished 2023-10-05T15:32:24.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:23 smithi167 ceph-mon[133366]: osdmap e65: 10 total, 9 up, 10 in 2023-10-05T15:32:24.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:23 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:24.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:23 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/620251636' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:32:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:23 smithi079 ceph-mon[132936]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 107 KiB/s, 0 objects/s recovering 2023-10-05T15:32:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:23 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3531230172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6012aed-94f6-4c37-bcf7-82dc08b176f9"}]: dispatch 2023-10-05T15:32:24.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:23 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3531230172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6012aed-94f6-4c37-bcf7-82dc08b176f9"}]': finished 2023-10-05T15:32:24.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:23 smithi079 ceph-mon[132936]: osdmap e65: 10 total, 9 up, 10 in 2023-10-05T15:32:24.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:23 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:24.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:23 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/620251636' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:32:25.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:25 smithi017 ceph-mon[129107]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:32:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:25 smithi167 ceph-mon[133366]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:32:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:25 smithi079 ceph-mon[132936]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-05T15:32:27.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:27 smithi017 ceph-mon[129107]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:32:27.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:27 smithi167 ceph-mon[133366]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:32:27.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:27 smithi079 ceph-mon[132936]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-05T15:32:29.902 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:29 smithi017 ceph-mon[129107]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:32:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:29 smithi167 ceph-mon[133366]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:32:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:29 smithi079 ceph-mon[132936]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-05T15:32:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-05T15:32:30.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-05T15:32:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:31.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-05T15:32:31.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:31 smithi017 ceph-mon[129107]: Deploying daemon osd.9 on smithi017 2023-10-05T15:32:31.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:31 smithi017 ceph-mon[129107]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:31 smithi167 ceph-mon[133366]: Deploying daemon osd.9 on smithi017 2023-10-05T15:32:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:31 smithi167 ceph-mon[133366]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:31 smithi079 ceph-mon[132936]: Deploying daemon osd.9 on smithi017 2023-10-05T15:32:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:31 smithi079 ceph-mon[132936]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:33.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:33 smithi017 ceph-mon[129107]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:34.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:33 smithi167 ceph-mon[133366]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:33 smithi079 ceph-mon[132936]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:35 smithi017 ceph-mon[129107]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:35 smithi167 ceph-mon[133366]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:36.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:35 smithi079 ceph-mon[132936]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:37.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:37 smithi079 ceph-mon[132936]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:37.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:37.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:37.657 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:37.658 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:37 smithi017 ceph-mon[129107]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:37.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:37.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:37 smithi167 ceph-mon[133366]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:39.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.723+0000 7fb0e27fc700 1 -- 172.21.15.17:0/2652454280 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb0ec0612f0 con 0x7fb0d80a1480 2023-10-05T15:32:39.726 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb0d80a1480 msgr2=0x7fb0d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb0d80a1480 0x7fb0d80a3940 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc006010 tx=0x7fb0dc0058e0 comp rx=0 tx=0).stop 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 msgr2=0x7fb0ec196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 0x7fb0ec196ba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800d9b0 tx=0x7fb0e800dcc0 comp rx=0 tx=0).stop 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 shutdown_connections 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb0d80a1480 0x7fb0d80a3940 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0ec102b10 0x7fb0ec19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:39.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0ec100f70 0x7fb0ec196ba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 --2- 172.21.15.17:0/2652454280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0ec102170 0x7fb0ec1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 >> 172.21.15.17:0/2652454280 conn(0x7fb0ec0fc4d0 msgr2=0x7fb0ec0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 shutdown_connections 2023-10-05T15:32:39.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:32:39.726+0000 7fb0f38a7700 1 -- 172.21.15.17:0/2652454280 wait complete. 2023-10-05T15:32:39.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:39 smithi017 ceph-mon[129107]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:39.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:39.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:39.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:39.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:39.875 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:39 smithi167 ceph-mon[133366]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:39 smithi079 ceph-mon[132936]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:40.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:40.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.181 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-05T15:32:40.186 INFO:tasks.cephadm:Deploying osd.10 on smithi079 with /dev/vg_nvme/lv_1... 2023-10-05T15:32:40.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-05T15:32:40.258 INFO:journalctl@ceph.osd.9.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:32:40.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:32:40 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:32:40.335+0000 7f4f72fcf640 -1 osd.9 0 log_to_monitors true 2023-10-05T15:32:40.916 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:32:40.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:40 smithi017 ceph-mon[129107]: from='osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:32:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:40 smithi017 ceph-mon[129107]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:32:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:40 smithi167 ceph-mon[133366]: from='osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:32:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:40 smithi167 ceph-mon[133366]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:32:41.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:41.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:41.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:32:41.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:40 smithi079 ceph-mon[132936]: from='osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:32:41.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:40 smithi079 ceph-mon[132936]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-05T15:32:41.744 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:41 smithi079 ceph-mon[132936]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:41.745 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:41 smithi079 ceph-mon[132936]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-05T15:32:41.745 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:41 smithi079 ceph-mon[132936]: osdmap e66: 10 total, 9 up, 10 in 2023-10-05T15:32:41.745 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:41 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:41.745 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:41 smithi079 ceph-mon[132936]: from='osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:32:41.745 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:41 smithi079 ceph-mon[132936]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:32:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:41 smithi167 ceph-mon[133366]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:41 smithi167 ceph-mon[133366]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-05T15:32:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:41 smithi167 ceph-mon[133366]: osdmap e66: 10 total, 9 up, 10 in 2023-10-05T15:32:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:41 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:41 smithi167 ceph-mon[133366]: from='osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:32:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:41 smithi167 ceph-mon[133366]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:32:42.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:32:41.707+0000 7f4f68646700 -1 osd.9 0 waiting for initial osdmap 2023-10-05T15:32:42.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:32:41.721+0000 7f4f60c34700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:32:42.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-mon[129107]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:42.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-mon[129107]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-05T15:32:42.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-mon[129107]: osdmap e66: 10 total, 9 up, 10 in 2023-10-05T15:32:42.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:42.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-mon[129107]: from='osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:32:42.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:41 smithi017 ceph-mon[129107]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-10-05T15:32:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-05T15:32:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-05T15:32:42.827 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10+0 records in 2023-10-05T15:32:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:10+0 records out 2023-10-05T15:32:42.827 INFO:teuthology.orchestra.run.smithi079.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0318798 s, 329 MB/s 2023-10-05T15:32:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:--> Zapping successful for: 2023-10-05T15:32:42.974 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:42 smithi079 ceph-mon[132936]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:32:42.975 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:42 smithi079 ceph-mon[132936]: osdmap e67: 10 total, 9 up, 10 in 2023-10-05T15:32:42.975 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:42 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:42.975 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:42 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:42.975 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:42 smithi079 ceph-mon[132936]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:42 smithi167 ceph-mon[133366]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:32:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:42 smithi167 ceph-mon[133366]: osdmap e67: 10 total, 9 up, 10 in 2023-10-05T15:32:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:42 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:42 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:42 smithi167 ceph-mon[133366]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:43.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:42 smithi017 ceph-mon[129107]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-10-05T15:32:43.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:42 smithi017 ceph-mon[129107]: osdmap e67: 10 total, 9 up, 10 in 2023-10-05T15:32:43.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:42 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:43.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:42 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:43.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:42 smithi017 ceph-mon[129107]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-05T15:32:43.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi079:vg_nvme/lv_1 2023-10-05T15:32:44.014 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:32:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:43 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:32:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:43 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:32:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:43 smithi167 ceph-mon[133366]: osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] boot 2023-10-05T15:32:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:43 smithi167 ceph-mon[133366]: osdmap e68: 10 total, 10 up, 10 in 2023-10-05T15:32:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:43 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:32:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:43 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:32:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:43 smithi079 ceph-mon[132936]: osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] boot 2023-10-05T15:32:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:43 smithi079 ceph-mon[132936]: osdmap e68: 10 total, 10 up, 10 in 2023-10-05T15:32:44.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:44.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:43 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:32:44.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:43 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:32:44.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:43 smithi017 ceph-mon[129107]: osd.9 [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] boot 2023-10-05T15:32:44.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:43 smithi017 ceph-mon[129107]: osdmap e68: 10 total, 10 up, 10 in 2023-10-05T15:32:44.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-05T15:32:44.885 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: osdmap e69: 10 total, 10 up, 10 in 2023-10-05T15:32:44.885 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi017 2023-10-05T15:32:44.885 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:44.885 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:44.885 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi017 to 4318M 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:44.886 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:44 smithi079 ceph-mon[132936]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: osdmap e69: 10 total, 10 up, 10 in 2023-10-05T15:32:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi017 2023-10-05T15:32:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi017 to 4318M 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:44 smithi167 ceph-mon[133366]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: osdmap e69: 10 total, 10 up, 10 in 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi017 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:32:45.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi017 to 4318M 2023-10-05T15:32:45.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:45.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:32:45.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:32:45.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:44 smithi017 ceph-mon[129107]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 -- 172.21.15.79:0/3033819463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102170 msgr2=0x7fec741025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 --2- 172.21.15.79:0/3033819463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102170 0x7fec741025d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fec640099c0 tx=0x7fec64009cd0 comp rx=0 tx=0).stop 2023-10-05T15:32:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 -- 172.21.15.79:0/3033819463 shutdown_connections 2023-10-05T15:32:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 --2- 172.21.15.79:0/3033819463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102b10 0x7fec741093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 --2- 172.21.15.79:0/3033819463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec74100f70 0x7fec74101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:45.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 --2- 172.21.15.79:0/3033819463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102170 0x7fec741025d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 -- 172.21.15.79:0/3033819463 >> 172.21.15.79:0/3033819463 conn(0x7fec740fc4d0 msgr2=0x7fec740fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:32:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 -- 172.21.15.79:0/3033819463 shutdown_connections 2023-10-05T15:32:45.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.466+0000 7fec7b759700 1 -- 172.21.15.79:0/3033819463 wait complete. 2023-10-05T15:32:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.467+0000 7fec7b759700 1 Processor -- start 2023-10-05T15:32:45.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 -- start start 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec74100f70 0x7fec74196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102170 0x7fec74197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 0x7fec7419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7419e770 con 0x7fec74100f70 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7419e8b0 con 0x7fec74102b10 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec7b759700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7419ea70 con 0x7fec74102170 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec79cf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 0x7fec7419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec794f5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec74100f70 0x7fec74196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec79cf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 0x7fec7419e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46212/0 (socket says 172.21.15.79:46212) 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec79cf6700 1 -- 172.21.15.79:0/1143407130 learned_addr learned my addr 172.21.15.79:0/1143407130 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-05T15:32:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.468+0000 7fec78cf4700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102170 0x7fec74197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec79cf6700 1 -- 172.21.15.79:0/1143407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102170 msgr2=0x7fec74197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec79cf6700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102170 0x7fec74197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec79cf6700 1 -- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec74100f70 msgr2=0x7fec74196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec79cf6700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec74100f70 0x7fec74196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec79cf6700 1 -- 172.21.15.79:0/1143407130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640095f0 con 0x7fec74102b10 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec78cf4700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102170 0x7fec74197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec79cf6700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 0x7fec7419e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00b970 tx=0x7fec6c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00c930 con 0x7fec74102b10 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec6c014440 con 0x7fec74102b10 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7419ed50 con 0x7fec74102b10 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0075d0 con 0x7fec74102b10 2023-10-05T15:32:45.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.469+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7419f1a0 con 0x7fec74102b10 2023-10-05T15:32:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.470+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec74107f60 con 0x7fec74102b10 2023-10-05T15:32:45.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.472+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fec6c0145b0 con 0x7fec74102b10 2023-10-05T15:32:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.473+0000 7fec6a7fc700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec600a1500 0x7fec600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:32:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.474+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fec6c006e40 con 0x7fec74102b10 2023-10-05T15:32:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.474+0000 7fec794f5700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec600a1500 0x7fec600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:32:45.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.474+0000 7fec794f5700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec600a1500 0x7fec600a39c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec74198100 tx=0x7fec7000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:32:45.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.478+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec6c095c00 con 0x7fec74102b10 2023-10-05T15:32:45.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:32:45.682+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fec7402d2b0 con 0x7fec600a1500 2023-10-05T15:32:46.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:45 smithi017 ceph-mon[129107]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:32:46.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:32:46.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:32:46.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:45 smithi167 ceph-mon[133366]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:32:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:32:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:32:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:45 smithi079 ceph-mon[132936]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:32:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:32:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:32:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:47.334 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:47 smithi079 ceph-mon[132936]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:47.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:47 smithi017 ceph-mon[129107]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:47 smithi167 ceph-mon[133366]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/3637069615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]: dispatch 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]: dispatch 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]': finished 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: osdmap e70: 11 total, 10 up, 11 in 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:32:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:49 smithi017 ceph-mon[129107]: from='client.? 172.21.15.79:0/182200231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:32:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/3637069615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]: dispatch 2023-10-05T15:32:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]: dispatch 2023-10-05T15:32:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]': finished 2023-10-05T15:32:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: osdmap e70: 11 total, 10 up, 11 in 2023-10-05T15:32:50.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:32:50.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:49 smithi167 ceph-mon[133366]: from='client.? 172.21.15.79:0/182200231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:32:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/3637069615' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]: dispatch 2023-10-05T15:32:50.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]: dispatch 2023-10-05T15:32:50.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0d1cd24-7df4-47a3-8143-247ffd402689"}]': finished 2023-10-05T15:32:50.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: osdmap e70: 11 total, 10 up, 11 in 2023-10-05T15:32:50.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:32:50.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.79:0/182200231' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:32:51.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:51 smithi017 ceph-mon[129107]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:51 smithi167 ceph-mon[133366]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:51 smithi079 ceph-mon[132936]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:53.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:53 smithi017 ceph-mon[129107]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:54.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:53 smithi167 ceph-mon[133366]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:53 smithi079 ceph-mon[132936]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:55 smithi017 ceph-mon[129107]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:55 smithi167 ceph-mon[133366]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:55 smithi079 ceph-mon[132936]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:56.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-05T15:32:56.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:57.073 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:56 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-05T15:32:57.073 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:56 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-05T15:32:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:32:57.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:57 smithi017 ceph-mon[129107]: Deploying daemon osd.10 on smithi079 2023-10-05T15:32:57.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:57 smithi017 ceph-mon[129107]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:58.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:57 smithi079 ceph-mon[132936]: Deploying daemon osd.10 on smithi079 2023-10-05T15:32:58.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:57 smithi079 ceph-mon[132936]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:57 smithi167 ceph-mon[133366]: Deploying daemon osd.10 on smithi079 2023-10-05T15:32:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:57 smithi167 ceph-mon[133366]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:59.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:32:59 smithi079 ceph-mon[132936]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:32:59.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:32:59 smithi017 ceph-mon[129107]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:32:59 smithi167 ceph-mon[133366]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:01.890 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:01 smithi079 ceph-mon[132936]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:01 smithi017 ceph-mon[129107]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:01 smithi167 ceph-mon[133366]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:03.552 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:03.552 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:03.552 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:03 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:03.553 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:03 smithi079 ceph-mon[132936]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:03.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:03.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:03.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:03 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:03.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:03 smithi167 ceph-mon[133366]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:03 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:03.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:03 smithi017 ceph-mon[129107]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:05.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.760+0000 7fec6a7fc700 1 -- 172.21.15.79:0/1143407130 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fec7402d2b0 con 0x7fec600a1500 2023-10-05T15:33:05.762 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 10 on host 'smithi079' 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec600a1500 msgr2=0x7fec600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec600a1500 0x7fec600a39c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec74198100 tx=0x7fec7000b410 comp rx=0 tx=0).stop 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 msgr2=0x7fec7419e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 0x7fec7419e1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00b970 tx=0x7fec6c00bc80 comp rx=0 tx=0).stop 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 shutdown_connections 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec600a1500 0x7fec600a39c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec74102b10 0x7fec7419e1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:05.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec74100f70 0x7fec74196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:05.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 --2- 172.21.15.79:0/1143407130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec74102170 0x7fec74197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:05.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.762+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 >> 172.21.15.79:0/1143407130 conn(0x7fec740fc4d0 msgr2=0x7fec740fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:05.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.763+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 shutdown_connections 2023-10-05T15:33:05.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-05T15:33:05.763+0000 7fec7b759700 1 -- 172.21.15.79:0/1143407130 wait complete. 2023-10-05T15:33:05.911 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:05 smithi079 ceph-mon[132936]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:05.911 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:05.911 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:05.911 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:05.911 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:05.911 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:05.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:05 smithi017 ceph-mon[129107]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:05 smithi167 ceph-mon[133366]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:06.235 DEBUG:teuthology.orchestra.run.smithi079:osd.10> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-05T15:33:06.239 INFO:tasks.cephadm:Deploying osd.11 on smithi167 with /dev/vg_nvme/lv_1... 2023-10-05T15:33:06.239 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-05T15:33:06.313 INFO:journalctl@ceph.osd.10.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:33:06.975 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:33:07.008 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:07.008 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:07.008 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:07.009 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:06 smithi079 ceph-mon[132936]: from='osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:33:07.009 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:06 smithi079 ceph-mon[132936]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:33:07.009 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:06 smithi079 ceph-mon[132936]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:06 smithi167 ceph-mon[133366]: from='osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:33:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:06 smithi167 ceph-mon[133366]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:33:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:06 smithi167 ceph-mon[133366]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:06 smithi017 ceph-mon[129107]: from='osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:33:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:06 smithi017 ceph-mon[129107]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-05T15:33:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:06 smithi017 ceph-mon[129107]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:08 smithi167 ceph-mon[133366]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-05T15:33:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:08 smithi167 ceph-mon[133366]: osdmap e71: 11 total, 10 up, 11 in 2023-10-05T15:33:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:08 smithi167 ceph-mon[133366]: from='osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:33:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:08 smithi167 ceph-mon[133366]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:33:08.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-mon[132936]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-05T15:33:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-mon[132936]: osdmap e71: 11 total, 10 up, 11 in 2023-10-05T15:33:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-mon[132936]: from='osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:33:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-mon[132936]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:33:08.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:33:08.201+0000 7f269f00b700 -1 osd.10 0 waiting for initial osdmap 2023-10-05T15:33:08.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:33:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:33:08.216+0000 7f2696df8700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:33:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:08 smithi017 ceph-mon[129107]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-05T15:33:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:08 smithi017 ceph-mon[129107]: osdmap e71: 11 total, 10 up, 11 in 2023-10-05T15:33:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:08 smithi017 ceph-mon[129107]: from='osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:33:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:08 smithi017 ceph-mon[129107]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2023-10-05T15:33:09.059 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-05T15:33:09.059 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-05T15:33:09.059 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2023-10-05T15:33:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2023-10-05T15:33:09.060 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0463058 s, 226 MB/s 2023-10-05T15:33:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: osdmap e72: 11 total, 10 up, 11 in 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:09.495 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:09 smithi167 ceph-mon[133366]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:09.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi167:vg_nvme/lv_1 2023-10-05T15:33:09.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:33:09.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:33:09.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:33:09.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: osdmap e72: 11 total, 10 up, 11 in 2023-10-05T15:33:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:09 smithi079 ceph-mon[132936]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: osdmap e72: 11 total, 10 up, 11 in 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:09 smithi017 ceph-mon[129107]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-05T15:33:10.285 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] boot 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: osdmap e73: 11 total, 11 up, 11 in 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi079 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.525 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.526 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi079 to 4316M 2023-10-05T15:33:10.526 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.526 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:10.526 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:10.526 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] boot 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: osdmap e73: 11 total, 11 up, 11 in 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi079 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi079 to 4316M 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:10.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:10.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: osd.10 [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] boot 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: osdmap e73: 11 total, 11 up, 11 in 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi079 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:10.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi079 to 4316M 2023-10-05T15:33:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:11.428 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:11 smithi167 ceph-mon[133366]: osdmap e74: 11 total, 11 up, 11 in 2023-10-05T15:33:11.428 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:11 smithi167 ceph-mon[133366]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:11 smithi079 ceph-mon[132936]: osdmap e74: 11 total, 11 up, 11 in 2023-10-05T15:33:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:11 smithi079 ceph-mon[132936]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 -- 172.21.15.167:0/2509003135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 msgr2=0x7fd3181025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 --2- 172.21.15.167:0/2509003135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181025d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009990 tx=0x7fd30c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:33:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 -- 172.21.15.167:0/2509003135 shutdown_connections 2023-10-05T15:33:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 --2- 172.21.15.167:0/2509003135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 0x7fd3181093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 --2- 172.21.15.167:0/2509003135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318100f70 0x7fd318101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:11.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 --2- 172.21.15.167:0/2509003135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181025d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 -- 172.21.15.167:0/2509003135 >> 172.21.15.167:0/2509003135 conn(0x7fd3180fc4d0 msgr2=0x7fd3180fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 -- 172.21.15.167:0/2509003135 shutdown_connections 2023-10-05T15:33:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.676+0000 7fd31c85c700 1 -- 172.21.15.167:0/2509003135 wait complete. 2023-10-05T15:33:11.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.677+0000 7fd31c85c700 1 Processor -- start 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.677+0000 7fd31c85c700 1 -- start start 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31c85c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318100f70 0x7fd318196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31c85c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31c85c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 0x7fd31819e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31c85c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31819e730 con 0x7fd318102b10 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31c85c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31819e870 con 0x7fd318100f70 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31c85c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31819ea00 con 0x7fd318102170 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:56078/0 (socket says 172.21.15.167:56078) 2023-10-05T15:33:11.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 -- 172.21.15.167:0/611495606 learned_addr learned my addr 172.21.15.167:0/611495606 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd31659c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318100f70 0x7fd318196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 -- 172.21.15.167:0/611495606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318100f70 msgr2=0x7fd318196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318100f70 0x7fd318196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd316d9d700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 0x7fd31819e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 -- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 msgr2=0x7fd31819e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 0x7fd31819e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.678+0000 7fd315d9b700 1 -- 172.21.15.167:0/611495606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0095f0 con 0x7fd318102170 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd316d9d700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 0x7fd31819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd315d9b700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181970e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00bab0 tx=0x7fd30c00bae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c01d070 con 0x7fd318102170 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd30c003da0 con 0x7fd318102170 2023-10-05T15:33:11.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31819ec80 con 0x7fd318102170 2023-10-05T15:33:11.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00f460 con 0x7fd318102170 2023-10-05T15:33:11.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.679+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31819f0f0 con 0x7fd318102170 2023-10-05T15:33:11.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.680+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31810c670 con 0x7fd318102170 2023-10-05T15:33:11.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.682+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd30c022670 con 0x7fd318102170 2023-10-05T15:33:11.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.683+0000 7fd3077fe700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3000a1580 0x7fd3000a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:11.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.683+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fd30c0cdd50 con 0x7fd318102170 2023-10-05T15:33:11.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.684+0000 7fd31659c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3000a1580 0x7fd3000a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:11.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.684+0000 7fd31659c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3000a1580 0x7fd3000a3a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd318101fd0 tx=0x7fd308007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:11.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.687+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd30c0979d0 con 0x7fd318102170 2023-10-05T15:33:11.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:11 smithi017 ceph-mon[129107]: osdmap e74: 11 total, 11 up, 11 in 2023-10-05T15:33:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:11 smithi017 ceph-mon[129107]: pgmap v247: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:11.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:11.893+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3180612f0 con 0x7fd3000a1580 2023-10-05T15:33:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:12 smithi167 ceph-mon[133366]: osdmap e75: 11 total, 11 up, 11 in 2023-10-05T15:33:12.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:33:12.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:33:12.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:12.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:12 smithi079 ceph-mon[132936]: osdmap e75: 11 total, 11 up, 11 in 2023-10-05T15:33:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:33:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:33:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:12.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:12 smithi017 ceph-mon[129107]: osdmap e75: 11 total, 11 up, 11 in 2023-10-05T15:33:12.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-05T15:33:12.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-05T15:33:12.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:13.281 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:13 smithi167 ceph-mon[133366]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:33:13.281 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:13 smithi167 ceph-mon[133366]: osdmap e76: 11 total, 11 up, 11 in 2023-10-05T15:33:13.282 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:13 smithi167 ceph-mon[133366]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:13.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:13 smithi079 ceph-mon[132936]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:33:13.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:13 smithi079 ceph-mon[132936]: osdmap e76: 11 total, 11 up, 11 in 2023-10-05T15:33:13.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:13 smithi079 ceph-mon[132936]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:13.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:13 smithi017 ceph-mon[129107]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:33:13.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:13 smithi017 ceph-mon[129107]: osdmap e76: 11 total, 11 up, 11 in 2023-10-05T15:33:13.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:13 smithi017 ceph-mon[129107]: pgmap v250: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:14 smithi167 ceph-mon[133366]: osdmap e77: 11 total, 11 up, 11 in 2023-10-05T15:33:14.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:14 smithi079 ceph-mon[132936]: osdmap e77: 11 total, 11 up, 11 in 2023-10-05T15:33:14.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:14 smithi017 ceph-mon[129107]: osdmap e77: 11 total, 11 up, 11 in 2023-10-05T15:33:15.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:15 smithi167 ceph-mon[133366]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:15.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:15 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/3901598904' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]: dispatch 2023-10-05T15:33:15.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:15 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]: dispatch 2023-10-05T15:33:15.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:15 smithi167 ceph-mon[133366]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]': finished 2023-10-05T15:33:15.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:15 smithi167 ceph-mon[133366]: osdmap e78: 12 total, 11 up, 12 in 2023-10-05T15:33:15.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:15.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:15 smithi079 ceph-mon[132936]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:15.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:15 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/3901598904' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]: dispatch 2023-10-05T15:33:15.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:15 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]: dispatch 2023-10-05T15:33:15.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:15 smithi079 ceph-mon[132936]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]': finished 2023-10-05T15:33:15.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:15 smithi079 ceph-mon[132936]: osdmap e78: 12 total, 11 up, 12 in 2023-10-05T15:33:15.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:15 smithi017 ceph-mon[129107]: pgmap v252: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:15 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/3901598904' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]: dispatch 2023-10-05T15:33:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:15 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]: dispatch 2023-10-05T15:33:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:15 smithi017 ceph-mon[129107]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e961ada4-773e-40ad-8dfb-30356919eedc"}]': finished 2023-10-05T15:33:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:15 smithi017 ceph-mon[129107]: osdmap e78: 12 total, 11 up, 12 in 2023-10-05T15:33:15.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:16.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:16 smithi167 ceph-mon[133366]: from='client.? 172.21.15.167:0/2710190049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:33:16.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:16 smithi079 ceph-mon[132936]: from='client.? 172.21.15.167:0/2710190049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:33:16.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:16 smithi017 ceph-mon[129107]: from='client.? 172.21.15.167:0/2710190049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-05T15:33:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:17 smithi167 ceph-mon[133366]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-05T15:33:17.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:17 smithi079 ceph-mon[132936]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-05T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:17 smithi017 ceph-mon[129107]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-05T15:33:19.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:19 smithi167 ceph-mon[133366]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-05T15:33:19.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:19 smithi017 ceph-mon[129107]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-05T15:33:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:19 smithi079 ceph-mon[132936]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-05T15:33:21.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:21 smithi167 ceph-mon[133366]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:33:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:21 smithi017 ceph-mon[129107]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:33:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:21 smithi079 ceph-mon[132936]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-05T15:33:22.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:22 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-05T15:33:22.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:22 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:22 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-05T15:33:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:22 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:23.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:22 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-05T15:33:23.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:22 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:23.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:23 smithi167 ceph-mon[133366]: Deploying daemon osd.11 on smithi167 2023-10-05T15:33:23.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:23 smithi167 ceph-mon[133366]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-05T15:33:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:23 smithi017 ceph-mon[129107]: Deploying daemon osd.11 on smithi167 2023-10-05T15:33:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:23 smithi017 ceph-mon[129107]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-05T15:33:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:23 smithi079 ceph-mon[132936]: Deploying daemon osd.11 on smithi167 2023-10-05T15:33:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:23 smithi079 ceph-mon[132936]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-05T15:33:25.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:25 smithi167 ceph-mon[133366]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:33:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:25 smithi017 ceph-mon[129107]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:33:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:25 smithi079 ceph-mon[132936]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-05T15:33:27.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:27 smithi017 ceph-mon[129107]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-05T15:33:27.522 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:27 smithi167 ceph-mon[133366]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-05T15:33:27.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:27 smithi079 ceph-mon[132936]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-10-05T15:33:29.880 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:29 smithi167 ceph-mon[133366]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:29.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:29.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:29.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:29.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:29 smithi017 ceph-mon[129107]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:29.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:29.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:29.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:29 smithi079 ceph-mon[132936]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:30.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:31.912 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:31 smithi167 ceph-mon[133366]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:31.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:31 smithi017 ceph-mon[129107]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:31 smithi079 ceph-mon[132936]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:32.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.321+0000 7fd3077fe700 1 -- 172.21.15.167:0/611495606 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd3180612f0 con 0x7fd3000a1580 2023-10-05T15:33:32.324 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 11 on host 'smithi167' 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3000a1580 msgr2=0x7fd3000a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3000a1580 0x7fd3000a3a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd318101fd0 tx=0x7fd308007400 comp rx=0 tx=0).stop 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 msgr2=0x7fd3181970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181970e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00bab0 tx=0x7fd30c00bae0 comp rx=0 tx=0).stop 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 shutdown_connections 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3000a1580 0x7fd3000a3a40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd318102b10 0x7fd31819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd318100f70 0x7fd318196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:32.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 --2- 172.21.15.167:0/611495606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd318102170 0x7fd3181970e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:32.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 >> 172.21.15.167:0/611495606 conn(0x7fd3180fc4d0 msgr2=0x7fd3180fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:32.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 shutdown_connections 2023-10-05T15:33:32.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:32.324+0000 7fd31c85c700 1 -- 172.21.15.167:0/611495606 wait complete. 2023-10-05T15:33:32.722 DEBUG:teuthology.orchestra.run.smithi167:osd.11> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-05T15:33:32.727 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-05T15:33:32.727 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-05T15:33:32.800 INFO:journalctl@ceph.osd.11.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:33:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:33:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:32 smithi167 ceph-mon[133366]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:33.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:33:33.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:32 smithi079 ceph-mon[132936]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:33:33.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:33:33.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:32 smithi017 ceph-mon[129107]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-05T15:33:33.473 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:33:34.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:34 smithi017 ceph-mon[129107]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-05T15:33:34.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:34 smithi017 ceph-mon[129107]: osdmap e79: 12 total, 11 up, 12 in 2023-10-05T15:33:34.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:34 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:34.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:34 smithi017 ceph-mon[129107]: from='osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:33:34.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:34 smithi017 ceph-mon[129107]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:33:34.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-mon[133366]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-05T15:33:34.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-mon[133366]: osdmap e79: 12 total, 11 up, 12 in 2023-10-05T15:33:34.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:34.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-mon[133366]: from='osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:33:34.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-mon[133366]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:33:34.584 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:33:34.297+0000 7f2172a19700 -1 osd.11 0 waiting for initial osdmap 2023-10-05T15:33:34.584 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:33:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:33:34.317+0000 7f216e80e700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T15:33:34.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:34 smithi079 ceph-mon[132936]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-05T15:33:34.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:34 smithi079 ceph-mon[132936]: osdmap e79: 12 total, 11 up, 12 in 2023-10-05T15:33:34.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:34 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:34.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:34 smithi079 ceph-mon[132936]: from='osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:33:34.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:34 smithi079 ceph-mon[132936]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2023-10-05T15:33:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 -- 172.21.15.17:0/1913593724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102170 msgr2=0x7faa781025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1913593724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102170 0x7faa781025d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa680099c0 tx=0x7faa68009cd0 comp rx=0 tx=0).stop 2023-10-05T15:33:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 -- 172.21.15.17:0/1913593724 shutdown_connections 2023-10-05T15:33:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1913593724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa78102b10 0x7faa781093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1913593724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 0x7faa78101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1913593724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102170 0x7faa781025d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 -- 172.21.15.17:0/1913593724 >> 172.21.15.17:0/1913593724 conn(0x7faa780fc4d0 msgr2=0x7faa780fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 -- 172.21.15.17:0/1913593724 shutdown_connections 2023-10-05T15:33:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.945+0000 7faa7f84f700 1 -- 172.21.15.17:0/1913593724 wait complete. 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.946+0000 7faa7f84f700 1 Processor -- start 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.946+0000 7faa7f84f700 1 -- start start 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7f84f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 0x7faa78198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7f84f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa78102170 0x7faa781992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7f84f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 0x7faa781a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7f84f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781a08e0 con 0x7faa78102b10 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7f84f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781a0a20 con 0x7faa78100f70 2023-10-05T15:33:34.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7f84f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781a0be0 con 0x7faa78102170 2023-10-05T15:33:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7ddec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 0x7faa781a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7cdea700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa78102170 0x7faa781992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7ddec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 0x7faa781a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40918/0 (socket says 172.21.15.17:40918) 2023-10-05T15:33:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7ddec700 1 -- 172.21.15.17:0/1716291587 learned_addr learned my addr 172.21.15.17:0/1716291587 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.947+0000 7faa7d5eb700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 0x7faa78198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7ddec700 1 -- 172.21.15.17:0/1716291587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa78102170 msgr2=0x7faa781992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7ddec700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa78102170 0x7faa781992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7ddec700 1 -- 172.21.15.17:0/1716291587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 msgr2=0x7faa78198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7ddec700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 0x7faa78198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:34.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7ddec700 1 -- 172.21.15.17:0/1716291587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680095f0 con 0x7faa78102b10 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7d5eb700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 0x7faa78198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7ddec700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 0x7faa781a0310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa7000ef30 tx=0x7faa7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70018070 con 0x7faa78102b10 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa781a0e60 con 0x7faa78102b10 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa7000f040 con 0x7faa78102b10 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000cc70 con 0x7faa78102b10 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.948+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa781a1220 con 0x7faa78102b10 2023-10-05T15:33:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.949+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7810c6e0 con 0x7faa78102b10 2023-10-05T15:33:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.951+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faa70007500 con 0x7faa78102b10 2023-10-05T15:33:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.953+0000 7faa6e7fc700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa640a1480 0x7faa640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.953+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7faa700cc2e0 con 0x7faa78102b10 2023-10-05T15:33:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.953+0000 7faa7d5eb700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa640a1480 0x7faa640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.954+0000 7faa7d5eb700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa640a1480 0x7faa640a3940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa7819a270 tx=0x7faa740092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:34.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:34.958+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faa70095ef0 con 0x7faa78102b10 2023-10-05T15:33:35.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.167+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7faa781a1440 con 0x7faa78102b10 2023-10-05T15:33:35.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.168+0000 7faa6e7fc700 1 -- 172.21.15.17:0/1716291587 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7faa70099510 con 0x7faa78102b10 2023-10-05T15:33:35.171 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:35.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.170+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa640a1480 msgr2=0x7faa640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.170+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa640a1480 0x7faa640a3940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa7819a270 tx=0x7faa740092a0 comp rx=0 tx=0).stop 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.170+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 msgr2=0x7faa781a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.170+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 0x7faa781a0310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa7000ef30 tx=0x7faa7000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 shutdown_connections 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa640a1480 0x7faa640a3940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa78102b10 0x7faa781a0310 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa78100f70 0x7faa78198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 --2- 172.21.15.17:0/1716291587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa78102170 0x7faa781992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 >> 172.21.15.17:0/1716291587 conn(0x7faa780fc4d0 msgr2=0x7faa780fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 shutdown_connections 2023-10-05T15:33:35.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:35.171+0000 7faa7f84f700 1 -- 172.21.15.17:0/1716291587 wait complete. 2023-10-05T15:33:35.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:35 smithi017 ceph-mon[129107]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:33:35.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:35 smithi017 ceph-mon[129107]: osdmap e80: 12 total, 11 up, 12 in 2023-10-05T15:33:35.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:35.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:35.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:35 smithi017 ceph-mon[129107]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:35.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:35 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1716291587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:33:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:35 smithi167 ceph-mon[133366]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:33:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:35 smithi167 ceph-mon[133366]: osdmap e80: 12 total, 11 up, 12 in 2023-10-05T15:33:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:35 smithi167 ceph-mon[133366]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:35.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:35 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1716291587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:33:35.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:35 smithi079 ceph-mon[132936]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2023-10-05T15:33:35.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:35 smithi079 ceph-mon[132936]: osdmap e80: 12 total, 11 up, 12 in 2023-10-05T15:33:35.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:35.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:35.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:35 smithi079 ceph-mon[132936]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-05T15:33:35.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:35 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1716291587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:33:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":80,"num_osds":12,"num_up_osds":11,"osd_up_since":1696519989,"num_in_osds":12,"osd_in_since":1696519994,"num_remapped_pgs":0} 2023-10-05T15:33:36.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: purged_snaps scrub starts 2023-10-05T15:33:36.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: purged_snaps scrub ok 2023-10-05T15:33:36.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] boot 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: osdmap e81: 12 total, 12 up, 12 in 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:36.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:36.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: purged_snaps scrub starts 2023-10-05T15:33:36.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: purged_snaps scrub ok 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] boot 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: osdmap e81: 12 total, 12 up, 12 in 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:36.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:36.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: purged_snaps scrub starts 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: purged_snaps scrub ok 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: osd.11 [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] boot 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: osdmap e81: 12 total, 12 up, 12 in 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:33:36.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:36.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:36.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:36.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-05T15:33:37.486 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:33:37.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:37 smithi167 ceph-mon[133366]: Detected new or changed devices on smithi167 2023-10-05T15:33:37.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:37 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi167 to 4316M 2023-10-05T15:33:37.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:37 smithi167 ceph-mon[133366]: osdmap e82: 12 total, 12 up, 12 in 2023-10-05T15:33:37.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:37 smithi167 ceph-mon[133366]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:37 smithi079 ceph-mon[132936]: Detected new or changed devices on smithi167 2023-10-05T15:33:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:37 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi167 to 4316M 2023-10-05T15:33:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:37 smithi079 ceph-mon[132936]: osdmap e82: 12 total, 12 up, 12 in 2023-10-05T15:33:37.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:37 smithi079 ceph-mon[132936]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:37.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:37 smithi017 ceph-mon[129107]: Detected new or changed devices on smithi167 2023-10-05T15:33:37.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:37 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi167 to 4316M 2023-10-05T15:33:37.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:37 smithi017 ceph-mon[129107]: osdmap e82: 12 total, 12 up, 12 in 2023-10-05T15:33:37.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:37 smithi017 ceph-mon[129107]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.986+0000 7f7b7ed84700 1 -- 172.21.15.17:0/1805993168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 msgr2=0x7f7b78073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.986+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/1805993168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78073d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b640098f0 tx=0x7f7b64009c00 comp rx=0 tx=0).stop 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 -- 172.21.15.17:0/1805993168 shutdown_connections 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/1805993168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 0x7f7b7810b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/1805993168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 0x7f7b78073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/1805993168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78073d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 -- 172.21.15.17:0/1805993168 >> 172.21.15.17:0/1805993168 conn(0x7f7b780fc4d0 msgr2=0x7f7b780fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 -- 172.21.15.17:0/1805993168 shutdown_connections 2023-10-05T15:33:38.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.987+0000 7f7b7ed84700 1 -- 172.21.15.17:0/1805993168 wait complete. 2023-10-05T15:33:38.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 Processor -- start 2023-10-05T15:33:38.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 -- start start 2023-10-05T15:33:38.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 0x7f7b78199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 0x7f7b781a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781a0960 con 0x7f7b78073910 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781a0aa0 con 0x7f7b78074ee0 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7ed84700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781a0c30 con 0x7f7b78108e40 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7cb20700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.988+0000 7f7b7cb20700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40932/0 (socket says 172.21.15.17:40932) 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 -- 172.21.15.17:0/691173650 learned_addr learned my addr 172.21.15.17:0/691173650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b77fff700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 0x7f7b78199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7d321700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 0x7f7b781a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 -- 172.21.15.17:0/691173650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 msgr2=0x7f7b781a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:38.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 0x7f7b781a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 -- 172.21.15.17:0/691173650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 msgr2=0x7f7b78199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 0x7f7b78199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 -- 172.21.15.17:0/691173650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009520 con 0x7f7b78073910 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7d321700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 0x7f7b781a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b77fff700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 0x7f7b78199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7cb20700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78198dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00ea20 tx=0x7f7b6c00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c009690 con 0x7f7b78073910 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b6c00cbd0 con 0x7f7b78073910 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.989+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b781a0f10 con 0x7f7b78073910 2023-10-05T15:33:38.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.990+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c018420 con 0x7f7b78073910 2023-10-05T15:33:38.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.990+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b781a1330 con 0x7f7b78073910 2023-10-05T15:33:38.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.991+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b781074f0 con 0x7f7b78073910 2023-10-05T15:33:38.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.993+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7b6c00cd40 con 0x7f7b78073910 2023-10-05T15:33:38.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.994+0000 7f7b75ffb700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b680a1500 0x7f7b680a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:38.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.994+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7b6c014070 con 0x7f7b78073910 2023-10-05T15:33:38.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.994+0000 7f7b77fff700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b680a1500 0x7f7b680a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:38.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.995+0000 7f7b77fff700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b680a1500 0x7f7b680a39c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b640098c0 tx=0x7f7b64019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:39.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:38.998+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7b6c052100 con 0x7f7b78073910 2023-10-05T15:33:39.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.207+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7b7810e890 con 0x7f7b78073910 2023-10-05T15:33:39.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.208+0000 7f7b75ffb700 1 -- 172.21.15.17:0/691173650 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v82) v1 ==== 74+0+133 (secure 0 0 0) 0x7f7b6c0964d0 con 0x7f7b78073910 2023-10-05T15:33:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b680a1500 msgr2=0x7f7b680a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b680a1500 0x7f7b680a39c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b640098c0 tx=0x7f7b64019040 comp rx=0 tx=0).stop 2023-10-05T15:33:39.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 msgr2=0x7f7b78198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78198dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00ea20 tx=0x7f7b6c00ede0 comp rx=0 tx=0).stop 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 shutdown_connections 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b680a1500 0x7f7b680a39c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b78108e40 0x7f7b781a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b78073910 0x7f7b78198dd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 --2- 172.21.15.17:0/691173650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b78074ee0 0x7f7b78199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 >> 172.21.15.17:0/691173650 conn(0x7f7b780fc4d0 msgr2=0x7f7b780fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 shutdown_connections 2023-10-05T15:33:39.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:39.210+0000 7f7b7ed84700 1 -- 172.21.15.17:0/691173650 wait complete. 2023-10-05T15:33:39.768 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"num_osds":12,"num_up_osds":12,"osd_up_since":1696520015,"num_in_osds":12,"osd_in_since":1696519994,"num_remapped_pgs":0} 2023-10-05T15:33:39.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-05T15:33:39.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:39 smithi017 ceph-mon[129107]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:39 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/691173650' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:33:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:39 smithi167 ceph-mon[133366]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:39 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/691173650' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:33:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:39 smithi079 ceph-mon[132936]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:40.143 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:39 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/691173650' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-05T15:33:40.502 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:33:41.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:41 smithi017 ceph-mon[129107]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:41 smithi167 ceph-mon[133366]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 -- 172.21.15.17:0/916478503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0074ef0 msgr2=0x7fd4e00730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/916478503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0074ef0 0x7fd4e00730e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009990 tx=0x7fd4d0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 -- 172.21.15.17:0/916478503 shutdown_connections 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/916478503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0111bc0 0x7fd4e0113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/916478503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0074ef0 0x7fd4e00730e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/916478503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e0073620 0x7fd4e0073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 -- 172.21.15.17:0/916478503 >> 172.21.15.17:0/916478503 conn(0x7fd4e00780a0 msgr2=0x7fd4e00784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 -- 172.21.15.17:0/916478503 shutdown_connections 2023-10-05T15:33:42.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.094+0000 7fd4e5a39700 1 -- 172.21.15.17:0/916478503 wait complete. 2023-10-05T15:33:42.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.096+0000 7fd4e5a39700 1 Processor -- start 2023-10-05T15:33:42.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.096+0000 7fd4e5a39700 1 -- start start 2023-10-05T15:33:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.096+0000 7fd4e5a39700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0073620 0x7fd4e019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4e5a39700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e0074ef0 0x7fd4e019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:42.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4e5a39700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 0x7fd4e01a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4e5a39700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e01a24e0 con 0x7fd4e0111bc0 2023-10-05T15:33:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4e5a39700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e01a2650 con 0x7fd4e0073620 2023-10-05T15:33:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4e5a39700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e01a2810 con 0x7fd4e0074ef0 2023-10-05T15:33:42.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 0x7fd4e01a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 0x7fd4e01a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40946/0 (socket says 172.21.15.17:40946) 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 -- 172.21.15.17:0/3792692605 learned_addr learned my addr 172.21.15.17:0/3792692605 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4deffd700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0073620 0x7fd4e019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4de7fc700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e0074ef0 0x7fd4e019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 -- 172.21.15.17:0/3792692605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e0074ef0 msgr2=0x7fd4e019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e0074ef0 0x7fd4e019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 -- 172.21.15.17:0/3792692605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0073620 msgr2=0x7fd4e019d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0073620 0x7fd4e019d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4df7fe700 1 -- 172.21.15.17:0/3792692605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d00095f0 con 0x7fd4e0111bc0 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.097+0000 7fd4deffd700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0073620 0x7fd4e019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.098+0000 7fd4df7fe700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 0x7fd4e01a1ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8007f10 tx=0x7fd4d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.098+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004db0 con 0x7fd4e0111bc0 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.098+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4d800f040 con 0x7fd4e0111bc0 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.098+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e01a2af0 con 0x7fd4e0111bc0 2023-10-05T15:33:42.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.098+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8005850 con 0x7fd4e0111bc0 2023-10-05T15:33:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.098+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e01aa350 con 0x7fd4e0111bc0 2023-10-05T15:33:42.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.100+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e004ebb0 con 0x7fd4e0111bc0 2023-10-05T15:33:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:41 smithi079 ceph-mon[132936]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:42.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.103+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd4d8004f10 con 0x7fd4e0111bc0 2023-10-05T15:33:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.104+0000 7fd4e4a37700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd4c80a1500 0x7fd4c80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.104+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4d80cbf30 con 0x7fd4e0111bc0 2023-10-05T15:33:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.104+0000 7fd4deffd700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd4c80a1500 0x7fd4c80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:42.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.105+0000 7fd4deffd700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd4c80a1500 0x7fd4c80a39c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000b5c0 tx=0x7fd4d0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.109+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd4d804f100 con 0x7fd4e0111bc0 2023-10-05T15:33:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.317+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4e0117530 con 0x7fd4e0111bc0 2023-10-05T15:33:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.318+0000 7fd4e4a37700 1 -- 172.21.15.17:0/3792692605 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18376 (secure 0 0 0) 0x7fd4d8095990 con 0x7fd4e0111bc0 2023-10-05T15:33:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:42.322 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:33:36.303724+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:33:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd4c80a1500 msgr2=0x7fd4c80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd4c80a1500 0x7fd4c80a39c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000b5c0 tx=0x7fd4d0005fb0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 msgr2=0x7fd4e01a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 0x7fd4e01a1ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8007f10 tx=0x7fd4d800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 shutdown_connections 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd4c80a1500 0x7fd4c80a39c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4e0111bc0 0x7fd4e01a1ed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4e0073620 0x7fd4e019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 --2- 172.21.15.17:0/3792692605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4e0074ef0 0x7fd4e019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 >> 172.21.15.17:0/3792692605 conn(0x7fd4e00780a0 msgr2=0x7fd4e01106e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 shutdown_connections 2023-10-05T15:33:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:42.321+0000 7fd4e5a39700 1 -- 172.21.15.17:0/3792692605 wait complete. 2023-10-05T15:33:42.784 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-05T15:33:42.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-05T15:33:42.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:42 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3792692605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:33:43.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:42 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3792692605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:33:43.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:42 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3792692605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:33:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:33:43.931 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:43 smithi017 ceph-mon[129107]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:43 smithi167 ceph-mon[133366]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:43 smithi079 ceph-mon[132936]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 -- 172.21.15.17:0/4227370827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac34101110 msgr2=0x7fac341014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 --2- 172.21.15.17:0/4227370827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac34101110 0x7fac341014f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac30009990 tx=0x7fac30009ca0 comp rx=0 tx=0).stop 2023-10-05T15:33:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 -- 172.21.15.17:0/4227370827 shutdown_connections 2023-10-05T15:33:44.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 --2- 172.21.15.17:0/4227370827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac341061f0 0x7fac3410ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 --2- 172.21.15.17:0/4227370827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac34101110 0x7fac341014f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 --2- 172.21.15.17:0/4227370827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac34101ac0 0x7fac34105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 -- 172.21.15.17:0/4227370827 >> 172.21.15.17:0/4227370827 conn(0x7fac340fc9c0 msgr2=0x7fac340fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 -- 172.21.15.17:0/4227370827 shutdown_connections 2023-10-05T15:33:44.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.896+0000 7fac3c154700 1 -- 172.21.15.17:0/4227370827 wait complete. 2023-10-05T15:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.897+0000 7fac3c154700 1 Processor -- start 2023-10-05T15:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.897+0000 7fac3c154700 1 -- start start 2023-10-05T15:33:44.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3c154700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac34101110 0x7fac340731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3c154700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34101ac0 0x7fac340736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3c154700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 0x7fac34073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3c154700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341a5380 con 0x7fac341061f0 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3c154700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341a54f0 con 0x7fac34101ac0 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3c154700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341a56b0 con 0x7fac34101110 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3a6f1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 0x7fac34073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3a6f1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 0x7fac34073c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37926/0 (socket says 172.21.15.17:37926) 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3a6f1700 1 -- 172.21.15.17:0/1467877909 learned_addr learned my addr 172.21.15.17:0/1467877909 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:44.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac39ef0700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac34101110 0x7fac340731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac396ef700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34101ac0 0x7fac340736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3a6f1700 1 -- 172.21.15.17:0/1467877909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac34101110 msgr2=0x7fac340731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.898+0000 7fac3a6f1700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac34101110 0x7fac340731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac3a6f1700 1 -- 172.21.15.17:0/1467877909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34101ac0 msgr2=0x7fac340736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac3a6f1700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34101ac0 0x7fac340736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac3a6f1700 1 -- 172.21.15.17:0/1467877909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300095f0 con 0x7fac341061f0 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac396ef700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34101ac0 0x7fac340736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:33:44.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac3a6f1700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 0x7fac34073c70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007ee0 tx=0x7fac2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:44.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c017070 con 0x7fac341061f0 2023-10-05T15:33:44.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac2c00f040 con 0x7fac341061f0 2023-10-05T15:33:44.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c005710 con 0x7fac341061f0 2023-10-05T15:33:44.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac341a5990 con 0x7fac341061f0 2023-10-05T15:33:44.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.899+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac341a5e40 con 0x7fac341061f0 2023-10-05T15:33:44.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.900+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3404ebb0 con 0x7fac341061f0 2023-10-05T15:33:44.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.902+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fac2c005870 con 0x7fac341061f0 2023-10-05T15:33:44.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.905+0000 7fac2affd700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fac200a1500 0x7fac200a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:44.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.905+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fac2c0cc0d0 con 0x7fac341061f0 2023-10-05T15:33:44.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.905+0000 7fac39ef0700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fac200a1500 0x7fac200a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:44.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.906+0000 7fac39ef0700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fac200a1500 0x7fac200a39c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac30006010 tx=0x7fac3000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:44.909+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fac2c095b30 con 0x7fac341061f0 2023-10-05T15:33:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.118+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac34110f50 con 0x7fac341061f0 2023-10-05T15:33:45.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.119+0000 7fac2affd700 1 -- 172.21.15.17:0/1467877909 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac2c099150 con 0x7fac341061f0 2023-10-05T15:33:45.122 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:33:45.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fac200a1500 msgr2=0x7fac200a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:45.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fac200a1500 0x7fac200a39c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac30006010 tx=0x7fac3000b260 comp rx=0 tx=0).stop 2023-10-05T15:33:45.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 msgr2=0x7fac34073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:45.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 0x7fac34073c70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007ee0 tx=0x7fac2c00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 shutdown_connections 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fac200a1500 0x7fac200a39c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac341061f0 0x7fac34073c70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac34101110 0x7fac340731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 --2- 172.21.15.17:0/1467877909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34101ac0 0x7fac340736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.121+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 >> 172.21.15.17:0/1467877909 conn(0x7fac340fc9c0 msgr2=0x7fac340fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.122+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 shutdown_connections 2023-10-05T15:33:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:45.122+0000 7fac3c154700 1 -- 172.21.15.17:0/1467877909 wait complete. 2023-10-05T15:33:45.598 INFO:tasks.cephadm:Adding mds.a on smithi017 2023-10-05T15:33:45.598 INFO:tasks.cephadm:Adding mds.d on smithi017 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.g on smithi017 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.j on smithi017 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.b on smithi079 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.e on smithi079 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.h on smithi079 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.k on smithi079 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.c on smithi167 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.f on smithi167 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.i on smithi167 2023-10-05T15:33:45.599 INFO:tasks.cephadm:Adding mds.l on smithi167 2023-10-05T15:33:45.599 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l' 2023-10-05T15:33:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:45 smithi017 ceph-mon[129107]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:45.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1467877909' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:33:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:45 smithi167 ceph-mon[133366]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1467877909' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:33:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:45 smithi079 ceph-mon[132936]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1467877909' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:33:46.339 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:33:47.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:47 smithi017 ceph-mon[129107]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:47.473 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:47 smithi167 ceph-mon[133366]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:47.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:47 smithi079 ceph-mon[132936]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:47.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 -- 172.21.15.167:0/2119124073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102b10 msgr2=0x7fed081093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:47.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 --2- 172.21.15.167:0/2119124073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102b10 0x7fed081093c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed0000b0a0 tx=0x7fed0000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 -- 172.21.15.167:0/2119124073 shutdown_connections 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 --2- 172.21.15.167:0/2119124073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102b10 0x7fed081093c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 --2- 172.21.15.167:0/2119124073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 0x7fed08101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 --2- 172.21.15.167:0/2119124073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102170 0x7fed081025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 -- 172.21.15.167:0/2119124073 >> 172.21.15.167:0/2119124073 conn(0x7fed080fc4d0 msgr2=0x7fed080fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 -- 172.21.15.167:0/2119124073 shutdown_connections 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.712+0000 7fed0e88e700 1 -- 172.21.15.167:0/2119124073 wait complete. 2023-10-05T15:33:47.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.714+0000 7fed0e88e700 1 Processor -- start 2023-10-05T15:33:47.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.714+0000 7fed0e88e700 1 -- start start 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.714+0000 7fed0e88e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 0x7fed08198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.714+0000 7fed0e88e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 0x7fed081993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.714+0000 7fed0e88e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102b10 0x7fed081a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed0e88e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed081a09f0 con 0x7fed08100f70 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed0e88e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed081a0b30 con 0x7fed08102b10 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed0e88e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed081a0cc0 con 0x7fed08102170 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 0x7fed081993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed07fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 0x7fed08198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 0x7fed081993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48312/0 (socket says 172.21.15.167:48312) 2023-10-05T15:33:47.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 -- 172.21.15.167:0/1323572089 learned_addr learned my addr 172.21.15.167:0/1323572089 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed0ce2b700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102b10 0x7fed081a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 -- 172.21.15.167:0/1323572089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102b10 msgr2=0x7fed081a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102b10 0x7fed081a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 -- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 msgr2=0x7fed08198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 0x7fed08198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed077fe700 1 -- 172.21.15.167:0/1323572089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00009d00 con 0x7fed08102170 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed0ce2b700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102b10 0x7fed081a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.715+0000 7fed07fff700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 0x7fed08198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.716+0000 7fed077fe700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 0x7fed081993a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00e9d0 tx=0x7fecfc00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.716+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc009790 con 0x7fed08102170 2023-10-05T15:33:47.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.716+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecfc00cbd0 con 0x7fed08102170 2023-10-05T15:33:47.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.716+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed081a0fa0 con 0x7fed08102170 2023-10-05T15:33:47.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.716+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc018680 con 0x7fed08102170 2023-10-05T15:33:47.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.716+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed081a1460 con 0x7fed08102170 2023-10-05T15:33:47.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.717+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed081933d0 con 0x7fed08102170 2023-10-05T15:33:47.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.720+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fecfc00cd40 con 0x7fed08102170 2023-10-05T15:33:47.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.722+0000 7fed057fa700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecf00a1500 0x7fecf00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:47.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.722+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fecfc014070 con 0x7fed08102170 2023-10-05T15:33:47.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.722+0000 7fed07fff700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecf00a1500 0x7fecf00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:47.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.723+0000 7fed07fff700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecf00a1500 0x7fecf00a39c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed08101fd0 tx=0x7fecf8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:47.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.724+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fecfc0968e0 con 0x7fed08102170 2023-10-05T15:33:47.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.932+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fed0802d320 con 0x7fecf00a1500 2023-10-05T15:33:47.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.941+0000 7fed057fa700 1 -- 172.21.15.167:0/1323572089 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fed0802d320 con 0x7fecf00a1500 2023-10-05T15:33:47.943 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mds.all update... 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecf00a1500 msgr2=0x7fecf00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecf00a1500 0x7fecf00a39c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed08101fd0 tx=0x7fecf8009260 comp rx=0 tx=0).stop 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 msgr2=0x7fed081993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 0x7fed081993a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00e9d0 tx=0x7fecfc00ece0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 shutdown_connections 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecf00a1500 0x7fecf00a39c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed08102b10 0x7fed081a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed08100f70 0x7fed08198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 --2- 172.21.15.167:0/1323572089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed08102170 0x7fed081993a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:47.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 >> 172.21.15.167:0/1323572089 conn(0x7fed080fc4d0 msgr2=0x7fed08107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:47.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 shutdown_connections 2023-10-05T15:33:47.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T15:33:47.944+0000 7fed0e88e700 1 -- 172.21.15.167:0/1323572089 wait complete. 2023-10-05T15:33:48.416 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-05T15:33:48.421 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-05T15:33:48.466 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-05T15:33:48.503 INFO:journalctl@ceph.mds.a.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:33:48.506 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-05T15:33:48.541 INFO:journalctl@ceph.mds.d.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:33:48.544 DEBUG:teuthology.orchestra.run.smithi079:mds.b> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-05T15:33:48.548 DEBUG:teuthology.orchestra.run.smithi079:mds.e> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-05T15:33:48.579 INFO:journalctl@ceph.mds.g.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:33:48.592 DEBUG:teuthology.orchestra.run.smithi079:mds.h> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-05T15:33:48.614 INFO:journalctl@ceph.mds.j.smithi017.stdout:-- Logs begin at Thu 2023-10-05 15:06:44 UTC. -- 2023-10-05T15:33:48.621 INFO:journalctl@ceph.mds.b.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:33:48.625 DEBUG:teuthology.orchestra.run.smithi079:mds.k> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-05T15:33:48.662 INFO:journalctl@ceph.mds.e.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:33:48.665 DEBUG:teuthology.orchestra.run.smithi167:mds.c> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-05T15:33:48.669 DEBUG:teuthology.orchestra.run.smithi167:mds.f> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-05T15:33:48.694 INFO:journalctl@ceph.mds.h.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:33:48.714 DEBUG:teuthology.orchestra.run.smithi167:mds.i> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-05T15:33:48.733 INFO:journalctl@ceph.mds.k.smithi079.stdout:-- Logs begin at Thu 2023-10-05 15:06:43 UTC. -- 2023-10-05T15:33:48.741 INFO:journalctl@ceph.mds.c.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:33:48.745 DEBUG:teuthology.orchestra.run.smithi167:mds.l> sudo journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-05T15:33:48.787 INFO:journalctl@ceph.mds.f.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:33:48.790 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-05T15:33:48.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:33:48.820 INFO:journalctl@ceph.mds.i.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:33:48.864 INFO:journalctl@ceph.mds.l.smithi167.stdout:-- Logs begin at Thu 2023-10-05 15:07:00 UTC. -- 2023-10-05T15:33:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.045+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/929563136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88101930 msgr2=0x7f7b88108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.045+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/929563136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88101930 0x7f7b88108250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000b0a0 tx=0x7f7b8000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/929563136 shutdown_connections 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/929563136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88101930 0x7f7b88108250 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/929563136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b880ffe20 0x7f7b88100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/929563136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b88100f70 0x7f7b881013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/929563136 >> 172.21.15.17:0/929563136 conn(0x7f7b880fb3b0 msgr2=0x7f7b880fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/929563136 shutdown_connections 2023-10-05T15:33:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.046+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/929563136 wait complete. 2023-10-05T15:33:49.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 Processor -- start 2023-10-05T15:33:49.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 -- start start 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b880ffe20 0x7f7b88198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 0x7f7b88199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b88101930 0x7f7b881a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881a08d0 con 0x7f7b88100f70 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881a0a10 con 0x7f7b88101930 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b8d3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881a0ba0 con 0x7f7b880ffe20 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.047+0000 7f7b867fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 0x7f7b88199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 0x7f7b88199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37948/0 (socket says 172.21.15.17:37948) 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 -- 172.21.15.17:0/2361971917 learned_addr learned my addr 172.21.15.17:0/2361971917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b86ffd700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b880ffe20 0x7f7b88198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b877fe700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b88101930 0x7f7b881a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 -- 172.21.15.17:0/2361971917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b880ffe20 msgr2=0x7f7b88198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b880ffe20 0x7f7b88198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 -- 172.21.15.17:0/2361971917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b88101930 msgr2=0x7f7b881a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b88101930 0x7f7b881a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 -- 172.21.15.17:0/2361971917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80009d00 con 0x7f7b88100f70 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b877fe700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b88101930 0x7f7b881a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b867fc700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 0x7f7b88199290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00e9a0 tx=0x7f7b7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c009790 con 0x7f7b88100f70 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b7c00cbd0 con 0x7f7b88100f70 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c018680 con 0x7f7b88100f70 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.048+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b881a0e80 con 0x7f7b88100f70 2023-10-05T15:33:49.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.049+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b881a1300 con 0x7f7b88100f70 2023-10-05T15:33:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.050+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8810b4d0 con 0x7f7b88100f70 2023-10-05T15:33:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.052+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7b7c00cd40 con 0x7f7b88100f70 2023-10-05T15:33:49.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.054+0000 7f7b6ffff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b700a1550 0x7f7b700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.054+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7b7c014070 con 0x7f7b88100f70 2023-10-05T15:33:49.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.054+0000 7f7b86ffd700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b700a1550 0x7f7b700a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.055+0000 7f7b86ffd700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b700a1550 0x7f7b700a3a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7b78005950 tx=0x7f7b7800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:49.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.058+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7b7c096500 con 0x7f7b88100f70 2023-10-05T15:33:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:33:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2023-10-05T15:33:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:49.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:49.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:49.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:49.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:49.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:48 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:49.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:49.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:48 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:49.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.270+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b881a14f0 con 0x7f7b88100f70 2023-10-05T15:33:49.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.271+0000 7f7b6ffff700 1 -- 172.21.15.17:0/2361971917 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f7b7c099b20 con 0x7f7b88100f70 2023-10-05T15:33:49.273 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:33:36.303724+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:33:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.273+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b700a1550 msgr2=0x7f7b700a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.273+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b700a1550 0x7f7b700a3a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7b78005950 tx=0x7f7b7800b410 comp rx=0 tx=0).stop 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 msgr2=0x7f7b88199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 0x7f7b88199290 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00e9a0 tx=0x7f7b7c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 shutdown_connections 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b700a1550 0x7f7b700a3a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b88101930 0x7f7b881a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b880ffe20 0x7f7b88198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 --2- 172.21.15.17:0/2361971917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b88100f70 0x7f7b88199290 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 >> 172.21.15.17:0/2361971917 conn(0x7f7b880fb3b0 msgr2=0x7f7b88069030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 shutdown_connections 2023-10-05T15:33:49.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.274+0000 7f7b8d3ff700 1 -- 172.21.15.17:0/2361971917 wait complete. 2023-10-05T15:33:49.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-05T15:33:49.295 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:33:49.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:33:49.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2023-10-05T15:33:49.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:49.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:48 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:49.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/1349095510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88102a30 msgr2=0x7f4f88109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/1349095510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88102a30 0x7f4f88109350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000b0a0 tx=0x7f4f8000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/1349095510 shutdown_connections 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/1349095510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88102a30 0x7f4f88109350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/1349095510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f88100e90 0x7f4f881012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/1349095510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f88102070 0x7f4f881024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/1349095510 >> 172.21.15.17:0/1349095510 conn(0x7f4f880fc430 msgr2=0x7f4f880fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/1349095510 shutdown_connections 2023-10-05T15:33:49.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.501+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/1349095510 wait complete. 2023-10-05T15:33:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 Processor -- start 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 -- start start 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 0x7f4f88198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f88102070 0x7f4f881992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f88102a30 0x7f4f881a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881a0930 con 0x7f4f88100e90 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881a0a70 con 0x7f4f88102070 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.502+0000 7f4f8d7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881a0c00 con 0x7f4f88102a30 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 0x7f4f88198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 0x7f4f88198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37962/0 (socket says 172.21.15.17:37962) 2023-10-05T15:33:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 -- 172.21.15.17:0/4138089679 learned_addr learned my addr 172.21.15.17:0/4138089679 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f86ffd700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f88102070 0x7f4f881992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f877fe700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f88102a30 0x7f4f881a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 -- 172.21.15.17:0/4138089679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f88102a30 msgr2=0x7f4f881a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f88102a30 0x7f4f881a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 -- 172.21.15.17:0/4138089679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f88102070 msgr2=0x7f4f881992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f88102070 0x7f4f881992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 -- 172.21.15.17:0/4138089679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009520 con 0x7f4f88100e90 2023-10-05T15:33:49.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f7effd700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 0x7f4f88198db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800e970 tx=0x7f4f7800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78009790 con 0x7f4f88100e90 2023-10-05T15:33:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.503+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f80009d00 con 0x7f4f88100e90 2023-10-05T15:33:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.504+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f7800c7e0 con 0x7f4f88100e90 2023-10-05T15:33:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.504+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f78003bd0 con 0x7f4f88100e90 2023-10-05T15:33:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.504+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f881a11f0 con 0x7f4f88100e90 2023-10-05T15:33:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.505+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f881933a0 con 0x7f4f88100e90 2023-10-05T15:33:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.506+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4f7800c950 con 0x7f4f88100e90 2023-10-05T15:33:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.508+0000 7f4f84ff9700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4f740a1480 0x7f4f740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.508+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4f78014070 con 0x7f4f88100e90 2023-10-05T15:33:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.508+0000 7f4f86ffd700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4f740a1480 0x7f4f740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.508+0000 7f4f86ffd700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4f740a1480 0x7f4f740a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f88100bb0 tx=0x7f4f70009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.512+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4f78096540 con 0x7f4f88100e90 2023-10-05T15:33:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.722+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f8802cfa0 con 0x7f4f88100e90 2023-10-05T15:33:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.723+0000 7f4f84ff9700 1 -- 172.21.15.17:0/4138089679 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f78099b60 con 0x7f4f88100e90 2023-10-05T15:33:49.724 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4f740a1480 msgr2=0x7f4f740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4f740a1480 0x7f4f740a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4f88100bb0 tx=0x7f4f70009260 comp rx=0 tx=0).stop 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 msgr2=0x7f4f88198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 0x7f4f88198db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800e970 tx=0x7f4f7800ec80 comp rx=0 tx=0).stop 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 shutdown_connections 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4f740a1480 0x7f4f740a3940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f88102a30 0x7f4f881a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f88100e90 0x7f4f88198db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 --2- 172.21.15.17:0/4138089679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f88102070 0x7f4f881992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 >> 172.21.15.17:0/4138089679 conn(0x7f4f880fc430 msgr2=0x7f4f881079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:49.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 shutdown_connections 2023-10-05T15:33:49.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.725+0000 7f4f8d7ff700 1 -- 172.21.15.17:0/4138089679 wait complete. 2023-10-05T15:33:49.746 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:33:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 -- 172.21.15.17:0/3525395633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e41013e0 msgr2=0x7f54e4101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3525395633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e41013e0 0x7f54e4101800 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009990 tx=0x7f54e0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 -- 172.21.15.17:0/3525395633 shutdown_connections 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3525395633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e40ff900 0x7f54e40ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3525395633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e41013e0 0x7f54e4101800 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3525395633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40fef60 0x7f54e40ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.948+0000 7f54ebdff700 1 -- 172.21.15.17:0/3525395633 >> 172.21.15.17:0/3525395633 conn(0x7f54e40faac0 msgr2=0x7f54e40fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.949+0000 7f54ebdff700 1 -- 172.21.15.17:0/3525395633 shutdown_connections 2023-10-05T15:33:49.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.949+0000 7f54ebdff700 1 -- 172.21.15.17:0/3525395633 wait complete. 2023-10-05T15:33:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 Processor -- start 2023-10-05T15:33:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 -- start start 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 0x7f54e4198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40ff900 0x7f54e4199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e41013e0 0x7f54e41a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e41a0850 con 0x7f54e40fef60 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e41a09c0 con 0x7f54e40ff900 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ebdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e41a0b80 con 0x7f54e41013e0 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54e9b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 0x7f54e4198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54e9b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 0x7f54e4198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37984/0 (socket says 172.21.15.17:37984) 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54e9b9b700 1 -- 172.21.15.17:0/3873734692 learned_addr learned my addr 172.21.15.17:0/3873734692 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54e939a700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40ff900 0x7f54e4199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.950+0000 7f54ea39c700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e41013e0 0x7f54e41a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54e9b9b700 1 -- 172.21.15.17:0/3873734692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e41013e0 msgr2=0x7f54e41a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54e9b9b700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e41013e0 0x7f54e41a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54e9b9b700 1 -- 172.21.15.17:0/3873734692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40ff900 msgr2=0x7f54e4199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54e9b9b700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40ff900 0x7f54e4199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54e9b9b700 1 -- 172.21.15.17:0/3873734692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e00095f0 con 0x7f54e40fef60 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54e9b9b700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 0x7f54e4198d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54e00098e0 tx=0x7f54e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e001d070 con 0x7f54e40fef60 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54e000bdb0 con 0x7f54e40fef60 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e41a0e00 con 0x7f54e40fef60 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0022cf0 con 0x7f54e40fef60 2023-10-05T15:33:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.951+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e41a11d0 con 0x7f54e40fef60 2023-10-05T15:33:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.952+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e410ae10 con 0x7f54e40fef60 2023-10-05T15:33:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.954+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f54e0022470 con 0x7f54e40fef60 2023-10-05T15:33:49.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.956+0000 7f54daffd700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d00a14d0 0x7f54d00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:49.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.957+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54e00cdf00 con 0x7f54e40fef60 2023-10-05T15:33:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.957+0000 7f54e939a700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d00a14d0 0x7f54d00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.957+0000 7f54e939a700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d00a14d0 0x7f54d00a3990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009c60 tx=0x7f54d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:49.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:49.960+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f54e0097b10 con 0x7f54e40fef60 2023-10-05T15:33:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:49 smithi167 ceph-mon[133366]: Deploying daemon mds.l on smithi167 2023-10-05T15:33:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:49 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2361971917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:33:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:49 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4138089679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:33:50.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:49 smithi017 ceph-mon[129107]: Deploying daemon mds.l on smithi167 2023-10-05T15:33:50.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:49 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2361971917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:33:50.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:49 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4138089679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:33:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.216+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54e410e7d0 con 0x7f54e40fef60 2023-10-05T15:33:50.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.217+0000 7f54daffd700 1 -- 172.21.15.17:0/3873734692 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f54e0027020 con 0x7f54e40fef60 2023-10-05T15:33:50.219 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:50.219 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-05T15:33:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d00a14d0 msgr2=0x7f54d00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d00a14d0 0x7f54d00a3990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009c60 tx=0x7f54d4009260 comp rx=0 tx=0).stop 2023-10-05T15:33:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 msgr2=0x7f54e4198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:50.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 0x7f54e4198d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54e00098e0 tx=0x7f54e0004730 comp rx=0 tx=0).stop 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 shutdown_connections 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d00a14d0 0x7f54d00a3990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e41013e0 0x7f54e41a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e40fef60 0x7f54e4198d10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 --2- 172.21.15.17:0/3873734692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e40ff900 0x7f54e4199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 >> 172.21.15.17:0/3873734692 conn(0x7f54e40faac0 msgr2=0x7f54e40fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 shutdown_connections 2023-10-05T15:33:50.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:50.219+0000 7f54ebdff700 1 -- 172.21.15.17:0/3873734692 wait complete. 2023-10-05T15:33:50.223 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2023-10-05T15:33:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:49 smithi079 ceph-mon[132936]: Deploying daemon mds.l on smithi167 2023-10-05T15:33:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2361971917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:33:50.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4138089679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:33:51.120 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:50 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3873734692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:51.120 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:50 smithi167 ceph-mon[133366]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:51.120 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:33:51 smithi167 systemd[1]: Starting Ceph mds.l for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:51.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:50 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3873734692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:51.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:50 smithi079 ceph-mon[132936]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:51.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3873734692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:51.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:50 smithi017 ceph-mon[129107]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:51.887 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:33:51 smithi167 podman[170414]: 2023-10-05T15:33:51.888 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:33:51 smithi167 bash[170414]: 258d817afe9894113e2d1dd7fe8714645e49af4d4c945c591aadb7d1ecdd7d33 2023-10-05T15:33:51.888 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:33:51 smithi167 ceph-mds[170454]: -- 172.21.15.167:0/2198465971 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562af674f1e0 con 0x562af6725000 2023-10-05T15:33:51.888 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:33:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-l[170430]: starting mds.l at 2023-10-05T15:33:52.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:33:52.333 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:33:51 smithi167 systemd[1]: Started Ceph mds.l for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:33:52.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 -- 172.21.15.17:0/2732543465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34104270 msgr2=0x7fba34106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:52.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 --2- 172.21.15.17:0/2732543465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34104270 0x7fba34106660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fba28009990 tx=0x7fba28009ca0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 -- 172.21.15.17:0/2732543465 shutdown_connections 2023-10-05T15:33:52.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 --2- 172.21.15.17:0/2732543465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba34106ba0 0x7fba34109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 --2- 172.21.15.17:0/2732543465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 --2- 172.21.15.17:0/2732543465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34104270 0x7fba34106660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 -- 172.21.15.17:0/2732543465 >> 172.21.15.17:0/2732543465 conn(0x7fba340fb310 msgr2=0x7fba340fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 -- 172.21.15.17:0/2732543465 shutdown_connections 2023-10-05T15:33:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.453+0000 7fba38fff700 1 -- 172.21.15.17:0/2732543465 wait complete. 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.454+0000 7fba38fff700 1 Processor -- start 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.454+0000 7fba38fff700 1 -- start start 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba38fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba38fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba34104270 0x7fba341991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba38fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34106ba0 0x7fba341a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba38fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341a0810 con 0x7fba34106ba0 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba38fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341a0980 con 0x7fba34104270 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba38fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341a0b40 con 0x7fba34101940 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba32d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34106ba0 0x7fba341a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58712/0 (socket says 172.21.15.17:58712) 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 -- 172.21.15.17:0/769711417 learned_addr learned my addr 172.21.15.17:0/769711417 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba31d9b700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba34104270 0x7fba341991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 -- 172.21.15.17:0/769711417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba34104270 msgr2=0x7fba341991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba34104270 0x7fba341991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 -- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34106ba0 msgr2=0x7fba341a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34106ba0 0x7fba341a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba3259c700 1 -- 172.21.15.17:0/769711417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280095f0 con 0x7fba34101940 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.455+0000 7fba32d9d700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34106ba0 0x7fba341a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.456+0000 7fba3259c700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34198ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba2400e9a0 tx=0x7fba2400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.456+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24009790 con 0x7fba34101940 2023-10-05T15:33:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.456+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba341a0e20 con 0x7fba34101940 2023-10-05T15:33:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.456+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba24010430 con 0x7fba34101940 2023-10-05T15:33:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.456+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400cea0 con 0x7fba34101940 2023-10-05T15:33:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.456+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba341a1250 con 0x7fba34101940 2023-10-05T15:33:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.457+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba34108770 con 0x7fba34101940 2023-10-05T15:33:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.459+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fba240105a0 con 0x7fba34101940 2023-10-05T15:33:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.460+0000 7fba237fe700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba1c0a1550 0x7fba1c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.460+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fba24014070 con 0x7fba34101940 2023-10-05T15:33:52.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.461+0000 7fba31d9b700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba1c0a1550 0x7fba1c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.461+0000 7fba31d9b700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba1c0a1550 0x7fba1c0a3a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba3419a1a0 tx=0x7fba2800b280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:52.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.463+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fba24096410 con 0x7fba34101940 2023-10-05T15:33:52.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.725+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba3410c7d0 con 0x7fba34101940 2023-10-05T15:33:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.726+0000 7fba237fe700 1 -- 172.21.15.17:0/769711417 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7fba24099a30 con 0x7fba34101940 2023-10-05T15:33:52.727 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-05T15:33:52.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba1c0a1550 msgr2=0x7fba1c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:52.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba1c0a1550 0x7fba1c0a3a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba3419a1a0 tx=0x7fba2800b280 comp rx=0 tx=0).stop 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 msgr2=0x7fba34198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34198ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba2400e9a0 tx=0x7fba2400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 shutdown_connections 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fba1c0a1550 0x7fba1c0a3a10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba34106ba0 0x7fba341a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba34101940 0x7fba34198ca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 --2- 172.21.15.17:0/769711417 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba34104270 0x7fba341991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.728+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 >> 172.21.15.17:0/769711417 conn(0x7fba340fb310 msgr2=0x7fba340fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.729+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 shutdown_connections 2023-10-05T15:33:52.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:52.729+0000 7fba38fff700 1 -- 172.21.15.17:0/769711417 wait complete. 2023-10-05T15:33:52.732 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.167:6832/978373819,v1:172.21.15.167:6833/978373819] up:boot 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: fsmap 1 up:standby 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:53.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:53.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:53.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: Deploying daemon mds.k on smithi079 2023-10-05T15:33:53.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:53.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:52 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/769711417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.167:6832/978373819,v1:172.21.15.167:6833/978373819] up:boot 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: fsmap 1 up:standby 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:53.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:53.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: Deploying daemon mds.k on smithi079 2023-10-05T15:33:53.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:53.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:52 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/769711417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:53.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.167:6832/978373819,v1:172.21.15.167:6833/978373819] up:boot 2023-10-05T15:33:53.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: fsmap 1 up:standby 2023-10-05T15:33:53.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-05T15:33:53.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: Deploying daemon mds.k on smithi079 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:53.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:52 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/769711417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:54.605 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:33:54 smithi079 systemd[1]: Starting Ceph mds.k for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:54.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:33:54.923 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:33:54 smithi079 podman[168961]: 2023-10-05T15:33:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 -- 172.21.15.17:0/2562734825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c100ea0 msgr2=0x7f8f3c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 --2- 172.21.15.17:0/2562734825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c100ea0 0x7f8f3c1012c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009990 tx=0x7f8f38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:33:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 -- 172.21.15.17:0/2562734825 shutdown_connections 2023-10-05T15:33:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 --2- 172.21.15.17:0/2562734825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102a40 0x7f8f3c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 --2- 172.21.15.17:0/2562734825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c100ea0 0x7f8f3c1012c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:54.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 --2- 172.21.15.17:0/2562734825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f3c102080 0x7f8f3c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:54.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 -- 172.21.15.17:0/2562734825 >> 172.21.15.17:0/2562734825 conn(0x7f8f3c0fc420 msgr2=0x7f8f3c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:54.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 -- 172.21.15.17:0/2562734825 shutdown_connections 2023-10-05T15:33:54.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.962+0000 7f8f445ff700 1 -- 172.21.15.17:0/2562734825 wait complete. 2023-10-05T15:33:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 Processor -- start 2023-10-05T15:33:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 -- start start 2023-10-05T15:33:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f3c100ea0 0x7f8f3c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102080 0x7f8f3c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c102a40 0x7f8f3c19e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c19e6f0 con 0x7f8f3c102a40 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c19e830 con 0x7f8f3c102080 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.963+0000 7f8f445ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c19e9c0 con 0x7f8f3c100ea0 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c102a40 0x7f8f3c19e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f41b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102080 0x7f8f3c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f41b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102080 0x7f8f3c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37176/0 (socket says 172.21.15.17:37176) 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f41b9a700 1 -- 172.21.15.17:0/723502772 learned_addr learned my addr 172.21.15.17:0/723502772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f4239b700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f3c100ea0 0x7f8f3c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:54.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 -- 172.21.15.17:0/723502772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f3c100ea0 msgr2=0x7f8f3c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f3c100ea0 0x7f8f3c196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 -- 172.21.15.17:0/723502772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102080 msgr2=0x7f8f3c1970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102080 0x7f8f3c1970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 -- 172.21.15.17:0/723502772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f380095f0 con 0x7f8f3c102a40 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f42b9c700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c102a40 0x7f8f3c19e120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400be20 tx=0x7f8f34009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400cc10 con 0x7f8f3c102a40 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f3400cd70 con 0x7f8f3c102a40 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.964+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340125c0 con 0x7f8f3c102a40 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.965+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c19eca0 con 0x7f8f3c102a40 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.965+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c19f160 con 0x7f8f3c102a40 2023-10-05T15:33:54.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.966+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c108550 con 0x7f8f3c102a40 2023-10-05T15:33:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.968+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8f34014440 con 0x7f8f3c102a40 2023-10-05T15:33:54.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.969+0000 7f8f337fe700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f280a14d0 0x7f8f280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:54.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.969+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8f34006e40 con 0x7f8f3c102a40 2023-10-05T15:33:54.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.969+0000 7f8f4239b700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f280a14d0 0x7f8f280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:54.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.970+0000 7f8f4239b700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f280a14d0 0x7f8f280a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800c010 tx=0x7f8f3800b810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:54.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:54.973+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f3404f100 con 0x7f8f3c102a40 2023-10-05T15:33:55.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.242+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f3c10c690 con 0x7f8f3c102a40 2023-10-05T15:33:55.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.242+0000 7f8f337fe700 1 -- 172.21.15.17:0/723502772 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7f8f34095c90 con 0x7f8f3c102a40 2023-10-05T15:33:55.244 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:55.244 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-05T15:33:55.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f280a14d0 msgr2=0x7f8f280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:55.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f280a14d0 0x7f8f280a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800c010 tx=0x7f8f3800b810 comp rx=0 tx=0).stop 2023-10-05T15:33:55.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c102a40 msgr2=0x7f8f3c19e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:55.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c102a40 0x7f8f3c19e120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400be20 tx=0x7f8f34009ed0 comp rx=0 tx=0).stop 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 shutdown_connections 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f280a14d0 0x7f8f280a3990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f3c102a40 0x7f8f3c19e120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f3c100ea0 0x7f8f3c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 --2- 172.21.15.17:0/723502772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f3c102080 0x7f8f3c1970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 >> 172.21.15.17:0/723502772 conn(0x7f8f3c0fc420 msgr2=0x7f8f3c105690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 shutdown_connections 2023-10-05T15:33:55.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:55.245+0000 7f8f445ff700 1 -- 172.21.15.17:0/723502772 wait complete. 2023-10-05T15:33:55.248 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2023-10-05T15:33:55.354 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:33:54 smithi079 bash[168961]: eb381ae965e254e883f947c436277b3a869c7df914e3fe1119d474a26c0fdc88 2023-10-05T15:33:55.354 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:33:54 smithi079 ceph-mds[169001]: -- 172.21.15.79:0/829117981 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a23d1ad1e0 con 0x55a23d182c00 2023-10-05T15:33:55.355 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:33:54 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-k[168977]: starting mds.k at 2023-10-05T15:33:55.355 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:33:54 smithi079 systemd[1]: Started Ceph mds.k for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:33:55.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:55 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/723502772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:56.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:56.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:56.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:56.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:55 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/723502772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:56.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:56.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:56.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:56.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:56.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:55 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/723502772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:56.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:56 smithi017 ceph-mon[129107]: Deploying daemon mds.j on smithi017 2023-10-05T15:33:56.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:56 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.79:6832/926038497,v1:172.21.15.79:6833/926038497] up:boot 2023-10-05T15:33:56.901 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:56 smithi017 ceph-mon[129107]: fsmap 2 up:standby 2023-10-05T15:33:56.901 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:56 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:33:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:56 smithi167 ceph-mon[133366]: Deploying daemon mds.j on smithi017 2023-10-05T15:33:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:56 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.79:6832/926038497,v1:172.21.15.79:6833/926038497] up:boot 2023-10-05T15:33:57.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:56 smithi167 ceph-mon[133366]: fsmap 2 up:standby 2023-10-05T15:33:57.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:56 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:33:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:56 smithi079 ceph-mon[132936]: Deploying daemon mds.j on smithi017 2023-10-05T15:33:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:56 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.79:6832/926038497,v1:172.21.15.79:6833/926038497] up:boot 2023-10-05T15:33:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:56 smithi079 ceph-mon[132936]: fsmap 2 up:standby 2023-10-05T15:33:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:56 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-05T15:33:57.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:33:57.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.532+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/3951384653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 msgr2=0x7ff5e4113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:57.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.532+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/3951384653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e4113a40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009f90 tx=0x7ff5dc00b330 comp rx=0 tx=0).stop 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/3951384653 shutdown_connections 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/3951384653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e4113a40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/3951384653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5e406c220 0x7ff5e406a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/3951384653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5e406ac40 0x7ff5e406b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/3951384653 >> 172.21.15.17:0/3951384653 conn(0x7ff5e406fe50 msgr2=0x7ff5e40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/3951384653 shutdown_connections 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.533+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/3951384653 wait complete. 2023-10-05T15:33:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.535+0000 7ff5ec5ff700 1 Processor -- start 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 -- start start 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5e406ac40 0x7ff5e419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5e406c220 0x7ff5e419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e41a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41a4db0 con 0x7ff5e41115b0 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41a4f20 con 0x7ff5e406c220 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.536+0000 7ff5ec5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41a5090 con 0x7ff5e406ac40 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.538+0000 7ff5eab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e41a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.538+0000 7ff5eab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e41a47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43638/0 (socket says 172.21.15.17:43638) 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.538+0000 7ff5eab9c700 1 -- 172.21.15.17:0/1639564211 learned_addr learned my addr 172.21.15.17:0/1639564211 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.539+0000 7ff5eab9c700 1 -- 172.21.15.17:0/1639564211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5e406ac40 msgr2=0x7ff5e419d1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.539+0000 7ff5eab9c700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5e406ac40 0x7ff5e419d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.539+0000 7ff5eab9c700 1 -- 172.21.15.17:0/1639564211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5e406c220 msgr2=0x7ff5e419d700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.539+0000 7ff5eab9c700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5e406c220 0x7ff5e419d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.539+0000 7ff5eab9c700 1 -- 172.21.15.17:0/1639564211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009c40 con 0x7ff5e41115b0 2023-10-05T15:33:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.540+0000 7ff5eab9c700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e41a47b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007890 tx=0x7ff5dc008d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.541+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00e040 con 0x7ff5e41115b0 2023-10-05T15:33:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.541+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5dc00be00 con 0x7ff5e41115b0 2023-10-05T15:33:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.541+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0053c0 con 0x7ff5e41115b0 2023-10-05T15:33:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.541+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e41a5310 con 0x7ff5e41115b0 2023-10-05T15:33:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.541+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e41a57d0 con 0x7ff5e41115b0 2023-10-05T15:33:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.543+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e410b850 con 0x7ff5e41115b0 2023-10-05T15:33:57.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.547+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff5dc005520 con 0x7ff5e41115b0 2023-10-05T15:33:57.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.549+0000 7ff5db7fe700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5d00a1680 0x7ff5d00a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:33:57.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.549+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff5dc0ced90 con 0x7ff5e41115b0 2023-10-05T15:33:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.550+0000 7ff5ea39b700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5d00a1680 0x7ff5d00a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:33:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.551+0000 7ff5ea39b700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5d00a1680 0x7ff5d00a3b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5e419e710 tx=0x7ff5e0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:33:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.555+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff5dc098880 con 0x7ff5e41115b0 2023-10-05T15:33:57.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.822+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5e4117030 con 0x7ff5e41115b0 2023-10-05T15:33:57.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.823+0000 7ff5db7fe700 1 -- 172.21.15.17:0/1639564211 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2113 (secure 0 0 0) 0x7ff5dc09bea0 con 0x7ff5e41115b0 2023-10-05T15:33:57.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:33:57.825 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-05T15:33:57.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5d00a1680 msgr2=0x7ff5d00a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:57.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5d00a1680 0x7ff5d00a3b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5e419e710 tx=0x7ff5e0009310 comp rx=0 tx=0).stop 2023-10-05T15:33:57.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 msgr2=0x7ff5e41a47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:33:57.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e41a47b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007890 tx=0x7ff5dc008d30 comp rx=0 tx=0).stop 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 shutdown_connections 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5d00a1680 0x7ff5d00a3b40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e41115b0 0x7ff5e41a47b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5e406ac40 0x7ff5e419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 --2- 172.21.15.17:0/1639564211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5e406c220 0x7ff5e419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.825+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 >> 172.21.15.17:0/1639564211 conn(0x7ff5e406fe50 msgr2=0x7ff5e4072240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.826+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 shutdown_connections 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:33:57.826+0000 7ff5ec5ff700 1 -- 172.21.15.17:0/1639564211 wait complete. 2023-10-05T15:33:57.828 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2023-10-05T15:33:57.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:57 smithi017 ceph-mon[129107]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:57.947 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:33:57 smithi017 systemd[1]: Starting Ceph mds.j for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:33:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:57 smithi167 ceph-mon[133366]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:57 smithi079 ceph-mon[132936]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:58.479 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:33:58 smithi017 podman[179506]: 2023-10-05T15:33:58.947 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:33:58 smithi017 bash[179506]: 131ba25cb7181526afde198dc00b66f834602fc50c406ac824060b2a28baa175 2023-10-05T15:33:58.947 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mds[179546]: -- 172.21.15.17:0/3378188504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5651dea151e0 con 0x5651de9eb000 2023-10-05T15:33:58.947 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-j[179522]: starting mds.j at 2023-10-05T15:33:58.947 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:33:58 smithi017 systemd[1]: Started Ceph mds.j for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:33:58.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1639564211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:58.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:58.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:58.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:58.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:58.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:58.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1639564211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:59.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1639564211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:33:59.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:33:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:33:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:33:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:33:59.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:33:59.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:59 smithi017 ceph-mon[129107]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:33:59.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:59 smithi017 ceph-mon[129107]: Deploying daemon mds.d on smithi017 2023-10-05T15:33:59.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:59 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.17:6834/906244086,v1:172.21.15.17:6835/906244086] up:boot 2023-10-05T15:33:59.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:59 smithi017 ceph-mon[129107]: fsmap 3 up:standby 2023-10-05T15:33:59.900 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:33:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:34:00.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 -- 172.21.15.17:0/2924796068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 msgr2=0x7fc958109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:00.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/2924796068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc958109360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc95000b0a0 tx=0x7fc95000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 -- 172.21.15.17:0/2924796068 shutdown_connections 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/2924796068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc958109360 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/2924796068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958100ea0 0x7fc9581012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/2924796068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc958102080 0x7fc958102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 -- 172.21.15.17:0/2924796068 >> 172.21.15.17:0/2924796068 conn(0x7fc9580fc420 msgr2=0x7fc9580fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 -- 172.21.15.17:0/2924796068 shutdown_connections 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.057+0000 7fc95e7ff700 1 -- 172.21.15.17:0/2924796068 wait complete. 2023-10-05T15:34:00.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.059+0000 7fc95e7ff700 1 Processor -- start 2023-10-05T15:34:00.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.059+0000 7fc95e7ff700 1 -- start start 2023-10-05T15:34:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.059+0000 7fc95e7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc958100ea0 0x7fc958198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95e7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958102080 0x7fc9581992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95e7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc9581a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95e7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9581a08f0 con 0x7fc958102a40 2023-10-05T15:34:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95e7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9581a0a60 con 0x7fc958100ea0 2023-10-05T15:34:00.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95e7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9581a0c20 con 0x7fc958102080 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc9581a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc9581a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43692/0 (socket says 172.21.15.17:43692) 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 -- 172.21.15.17:0/3615489971 learned_addr learned my addr 172.21.15.17:0/3615489971 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc957fff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc958100ea0 0x7fc958198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc9577fe700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958102080 0x7fc9581992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 -- 172.21.15.17:0/3615489971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958102080 msgr2=0x7fc9581992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958102080 0x7fc9581992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 -- 172.21.15.17:0/3615489971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc958100ea0 msgr2=0x7fc958198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc958100ea0 0x7fc958198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.060+0000 7fc95cd9c700 1 -- 172.21.15.17:0/3615489971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc950009d00 con 0x7fc958102a40 2023-10-05T15:34:00.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.061+0000 7fc95cd9c700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc9581a0320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc95000d010 tx=0x7fc95000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.061+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95000e040 con 0x7fc958102a40 2023-10-05T15:34:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.061+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc950003e10 con 0x7fc958102a40 2023-10-05T15:34:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.061+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9581a0ea0 con 0x7fc958102a40 2023-10-05T15:34:00.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.061+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950005260 con 0x7fc958102a40 2023-10-05T15:34:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.061+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9581a1260 con 0x7fc958102a40 2023-10-05T15:34:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.062+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95810c5c0 con 0x7fc958102a40 2023-10-05T15:34:00.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.064+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc95001da10 con 0x7fc958102a40 2023-10-05T15:34:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.065+0000 7fc9557fa700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9400a1550 0x7fc9400a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.065+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc9500cd9f0 con 0x7fc958102a40 2023-10-05T15:34:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.065+0000 7fc957fff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9400a1550 0x7fc9400a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:00.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.066+0000 7fc957fff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9400a1550 0x7fc9400a3a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc95819a280 tx=0x7fc94800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:00.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.069+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9500974e0 con 0x7fc958102a40 2023-10-05T15:34:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:59 smithi167 ceph-mon[133366]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:59 smithi167 ceph-mon[133366]: Deploying daemon mds.d on smithi017 2023-10-05T15:34:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:59 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.17:6834/906244086,v1:172.21.15.17:6835/906244086] up:boot 2023-10-05T15:34:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:59 smithi167 ceph-mon[133366]: fsmap 3 up:standby 2023-10-05T15:34:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:33:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:34:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:59 smithi079 ceph-mon[132936]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:59 smithi079 ceph-mon[132936]: Deploying daemon mds.d on smithi017 2023-10-05T15:34:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:59 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.17:6834/906244086,v1:172.21.15.17:6835/906244086] up:boot 2023-10-05T15:34:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:59 smithi079 ceph-mon[132936]: fsmap 3 up:standby 2023-10-05T15:34:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:33:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-05T15:34:00.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.350+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9581a13f0 con 0x7fc958102a40 2023-10-05T15:34:00.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.351+0000 7fc9557fa700 1 -- 172.21.15.17:0/3615489971 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2901 (secure 0 0 0) 0x7fc950024310 con 0x7fc958102a40 2023-10-05T15:34:00.357 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:00.357 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-05T15:34:00.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9400a1550 msgr2=0x7fc9400a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9400a1550 0x7fc9400a3a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc95819a280 tx=0x7fc94800b410 comp rx=0 tx=0).stop 2023-10-05T15:34:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 msgr2=0x7fc9581a0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc9581a0320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc95000d010 tx=0x7fc95000bcc0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 shutdown_connections 2023-10-05T15:34:00.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9400a1550 0x7fc9400a3a10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc958102a40 0x7fc9581a0320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc958100ea0 0x7fc958198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 --2- 172.21.15.17:0/3615489971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc958102080 0x7fc9581992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.357+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 >> 172.21.15.17:0/3615489971 conn(0x7fc9580fc420 msgr2=0x7fc9581079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.358+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 shutdown_connections 2023-10-05T15:34:00.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:00.358+0000 7fc95e7ff700 1 -- 172.21.15.17:0/3615489971 wait complete. 2023-10-05T15:34:00.361 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2023-10-05T15:34:00.904 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:00 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3615489971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:00 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3615489971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3615489971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:01.197 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:34:00 smithi017 systemd[1]: Starting Ceph mds.d for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:01.649 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:34:01 smithi017 podman[179889]: 2023-10-05T15:34:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:01 smithi017 ceph-mon[129107]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:01.947 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:34:01 smithi017 bash[179889]: 72f825ebd3bbd70445c75614e74f8dea90789744d2d54a94136679bc46e0ae4a 2023-10-05T15:34:01.947 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:34:01 smithi017 ceph-mds[179930]: -- 172.21.15.17:0/3951078466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563d618351e0 con 0x563d6180a800 2023-10-05T15:34:01.947 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:34:01 smithi017 systemd[1]: Started Ceph mds.d for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:01.947 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:34:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-d[179906]: starting mds.d at 2023-10-05T15:34:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:01 smithi167 ceph-mon[133366]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:01 smithi079 ceph-mon[132936]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:02.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:02.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 -- 172.21.15.17:0/178039751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 msgr2=0x7f70d01024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 --2- 172.21.15.17:0/178039751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d01024f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009990 tx=0x7f70c4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 -- 172.21.15.17:0/178039751 shutdown_connections 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 --2- 172.21.15.17:0/178039751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 0x7f70d0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 --2- 172.21.15.17:0/178039751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d0100e90 0x7f70d01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 --2- 172.21.15.17:0/178039751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d01024f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 -- 172.21.15.17:0/178039751 >> 172.21.15.17:0/178039751 conn(0x7f70d00fc430 msgr2=0x7f70d00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 -- 172.21.15.17:0/178039751 shutdown_connections 2023-10-05T15:34:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.596+0000 7f70d4bff700 1 -- 172.21.15.17:0/178039751 wait complete. 2023-10-05T15:34:02.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.598+0000 7f70d4bff700 1 Processor -- start 2023-10-05T15:34:02.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.598+0000 7f70d4bff700 1 -- start start 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70d4bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d0100e90 0x7f70d0196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70d4bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d0197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70d4bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 0x7f70d019e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70d4bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d019e680 con 0x7f70d0102070 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70d4bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d019e7c0 con 0x7f70d0102a30 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70d4bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d019e950 con 0x7f70d0100e90 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d0197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d0197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43736/0 (socket says 172.21.15.17:43736) 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 -- 172.21.15.17:0/1784728935 learned_addr learned my addr 172.21.15.17:0/1784728935 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70ce59c700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d0100e90 0x7f70d0196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70ced9d700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 0x7f70d019e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 -- 172.21.15.17:0/1784728935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d0100e90 msgr2=0x7f70d0196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d0100e90 0x7f70d0196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 -- 172.21.15.17:0/1784728935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 msgr2=0x7f70d019e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 0x7f70d019e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70cdd9b700 1 -- 172.21.15.17:0/1784728935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c40095f0 con 0x7f70d0102070 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.599+0000 7f70ced9d700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 0x7f70d019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.600+0000 7f70cdd9b700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d0197040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70c40098e0 tx=0x7f70c4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.600+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c401d070 con 0x7f70d0102070 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.600+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70c400f460 con 0x7f70d0102070 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.600+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d019ebd0 con 0x7f70d0102070 2023-10-05T15:34:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.600+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4021670 con 0x7f70d0102070 2023-10-05T15:34:02.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.600+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d019eff0 con 0x7f70d0102070 2023-10-05T15:34:02.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.601+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d010c600 con 0x7f70d0102070 2023-10-05T15:34:02.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.603+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f70c400f5d0 con 0x7f70d0102070 2023-10-05T15:34:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.604+0000 7f70bf7fe700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70b80a14d0 0x7f70b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.605+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f70c40cda40 con 0x7f70d0102070 2023-10-05T15:34:02.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.605+0000 7f70ce59c700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70b80a14d0 0x7f70b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:02.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.605+0000 7f70ce59c700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70b80a14d0 0x7f70b80a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70c0005950 tx=0x7f70c00058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:02.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.609+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f70c4097530 con 0x7f70d0102070 2023-10-05T15:34:02.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.869+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70d0107eb0 con 0x7f70d0102070 2023-10-05T15:34:02.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.870+0000 7f70bf7fe700 1 -- 172.21.15.17:0/1784728935 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f70c4026e80 con 0x7f70d0102070 2023-10-05T15:34:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:02.872 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[]} 2023-10-05T15:34:02.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70b80a14d0 msgr2=0x7f70b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:02.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70b80a14d0 0x7f70b80a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70c0005950 tx=0x7f70c00058e0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 msgr2=0x7f70d0197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:02.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d0197040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70c40098e0 tx=0x7f70c4005ef0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 shutdown_connections 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70b80a14d0 0x7f70b80a3990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70d0102a30 0x7f70d019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d0100e90 0x7f70d0196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 --2- 172.21.15.17:0/1784728935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0102070 0x7f70d0197040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.872+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 >> 172.21.15.17:0/1784728935 conn(0x7f70d00fc430 msgr2=0x7f70d00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.873+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 shutdown_connections 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:02.873+0000 7f70d4bff700 1 -- 172.21.15.17:0/1784728935 wait complete. 2023-10-05T15:34:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2023-10-05T15:34:03.023 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: Deploying daemon mds.e on smithi079 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.17:6836/3739441472,v1:172.21.15.17:6837/3739441472] up:boot 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: fsmap 4 up:standby 2023-10-05T15:34:03.024 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:34:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: Deploying daemon mds.e on smithi079 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.17:6836/3739441472,v1:172.21.15.17:6837/3739441472] up:boot 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: fsmap 4 up:standby 2023-10-05T15:34:03.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:34:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: Deploying daemon mds.e on smithi079 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.17:6836/3739441472,v1:172.21.15.17:6837/3739441472] up:boot 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: fsmap 4 up:standby 2023-10-05T15:34:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-05T15:34:03.984 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:03 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1784728935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:03.984 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:34:03 smithi079 systemd[1]: Starting Ceph mds.e for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:03 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1784728935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:03 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1784728935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:04.722 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:34:04 smithi079 podman[169307]: 2023-10-05T15:34:04.722 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:34:04 smithi079 bash[169307]: 2e91ba23dc5c7e55c267bd7f8640d769848b9b349f1cf66b9332447a1659e64f 2023-10-05T15:34:04.722 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:34:04 smithi079 ceph-mds[169347]: -- 172.21.15.79:0/4224103209 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f47e7cd1e0 con 0x55f47e7a2800 2023-10-05T15:34:04.893 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:05.085 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:04 smithi167 ceph-mon[133366]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:04 smithi079 ceph-mon[132936]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:05.105 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:34:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-e[169323]: starting mds.e at 2023-10-05T15:34:05.105 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:34:04 smithi079 systemd[1]: Started Ceph mds.e for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:05.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 -- 172.21.15.17:0/616822493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 msgr2=0x7f64141012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:05.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 --2- 172.21.15.17:0/616822493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f64141012c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6404009990 tx=0x7f6404009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 -- 172.21.15.17:0/616822493 shutdown_connections 2023-10-05T15:34:05.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 --2- 172.21.15.17:0/616822493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6414102a40 0x7f6414109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 --2- 172.21.15.17:0/616822493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f64141012c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 --2- 172.21.15.17:0/616822493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6414102080 0x7f6414102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 -- 172.21.15.17:0/616822493 >> 172.21.15.17:0/616822493 conn(0x7f64140fc420 msgr2=0x7f64140fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:05.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.104+0000 7f6419dff700 1 -- 172.21.15.17:0/616822493 shutdown_connections 2023-10-05T15:34:05.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.105+0000 7f6419dff700 1 -- 172.21.15.17:0/616822493 wait complete. 2023-10-05T15:34:05.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.105+0000 7f6419dff700 1 Processor -- start 2023-10-05T15:34:05.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 -- start start 2023-10-05T15:34:05.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f6414196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:05.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6414102080 0x7f6414197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6414102a40 0x7f641419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641419e760 con 0x7f6414100ea0 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641419e8a0 con 0x7f6414102a40 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6419dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641419ea30 con 0x7f6414102080 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f64137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f6414196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f64137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f6414196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46766/0 (socket says 172.21.15.17:46766) 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f64137fe700 1 -- 172.21.15.17:0/3779486898 learned_addr learned my addr 172.21.15.17:0/3779486898 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6412ffd700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6414102080 0x7f6414197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.106+0000 7f6413fff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6414102a40 0x7f641419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f64137fe700 1 -- 172.21.15.17:0/3779486898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6414102080 msgr2=0x7f6414197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:05.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f64137fe700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6414102080 0x7f6414197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f64137fe700 1 -- 172.21.15.17:0/3779486898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6414102a40 msgr2=0x7f641419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:05.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f64137fe700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6414102a40 0x7f641419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f64137fe700 1 -- 172.21.15.17:0/3779486898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64040095f0 con 0x7f6414100ea0 2023-10-05T15:34:05.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f64137fe700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f6414196be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64040098e0 tx=0x7f6404004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640401d070 con 0x7f6414100ea0 2023-10-05T15:34:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f640400be30 con 0x7f6414100ea0 2023-10-05T15:34:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641419ecb0 con 0x7f6414100ea0 2023-10-05T15:34:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404022d80 con 0x7f6414100ea0 2023-10-05T15:34:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.107+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641419f0d0 con 0x7f6414100ea0 2023-10-05T15:34:05.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.108+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6414108610 con 0x7f6414100ea0 2023-10-05T15:34:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.110+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6404022470 con 0x7f6414100ea0 2023-10-05T15:34:05.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.113+0000 7f6410ff9700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f63fc0a14d0 0x7f63fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.113+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f64040cddd0 con 0x7f6414100ea0 2023-10-05T15:34:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.113+0000 7f6412ffd700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f63fc0a14d0 0x7f63fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.114+0000 7f6412ffd700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f63fc0a14d0 0x7f63fc0a3990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6414100bc0 tx=0x7f6408009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:05.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.117+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f64040978c0 con 0x7f6414100ea0 2023-10-05T15:34:05.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:04 smithi017 ceph-mon[129107]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:05.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.372+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f641410c610 con 0x7f6414100ea0 2023-10-05T15:34:05.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.373+0000 7f6410ff9700 1 -- 172.21.15.17:0/3779486898 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f640409aee0 con 0x7f6414100ea0 2023-10-05T15:34:05.375 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:05.375 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-05T15:34:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f63fc0a14d0 msgr2=0x7f63fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f63fc0a14d0 0x7f63fc0a3990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6414100bc0 tx=0x7f6408009260 comp rx=0 tx=0).stop 2023-10-05T15:34:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 msgr2=0x7f6414196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f6414196be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64040098e0 tx=0x7f6404004730 comp rx=0 tx=0).stop 2023-10-05T15:34:05.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 shutdown_connections 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f63fc0a14d0 0x7f63fc0a3990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6414102a40 0x7f641419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6414100ea0 0x7f6414196be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 --2- 172.21.15.17:0/3779486898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6414102080 0x7f6414197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.375+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 >> 172.21.15.17:0/3779486898 conn(0x7f64140fc420 msgr2=0x7f6414105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.376+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 shutdown_connections 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:05.376+0000 7f6419dff700 1 -- 172.21.15.17:0/3779486898 wait complete. 2023-10-05T15:34:05.378 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-05T15:34:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.79:6834/331259911,v1:172.21.15.79:6835/331259911] up:boot 2023-10-05T15:34:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: fsmap 5 up:standby 2023-10-05T15:34:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:34:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: Deploying daemon mds.f on smithi167 2023-10-05T15:34:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:05 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3779486898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.79:6834/331259911,v1:172.21.15.79:6835/331259911] up:boot 2023-10-05T15:34:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: fsmap 5 up:standby 2023-10-05T15:34:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:34:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: Deploying daemon mds.f on smithi167 2023-10-05T15:34:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:05 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3779486898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.79:6834/331259911,v1:172.21.15.79:6835/331259911] up:boot 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: fsmap 5 up:standby 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: Deploying daemon mds.f on smithi167 2023-10-05T15:34:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:05 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3779486898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:07.131 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:34:07 smithi167 systemd[1]: Starting Ceph mds.f for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:07.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:07.464 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:07 smithi017 ceph-mon[129107]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:07.561 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:07 smithi167 ceph-mon[133366]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:07.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:07 smithi079 ceph-mon[132936]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 -- 172.21.15.17:0/2627223694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 msgr2=0x7f8ed8073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 --2- 172.21.15.17:0/2627223694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8073d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009990 tx=0x7f8ec8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 -- 172.21.15.17:0/2627223694 shutdown_connections 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 --2- 172.21.15.17:0/2627223694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8108dc0 0x7f8ed810b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 --2- 172.21.15.17:0/2627223694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8074e70 0x7f8ed80732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 --2- 172.21.15.17:0/2627223694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8073d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 -- 172.21.15.17:0/2627223694 >> 172.21.15.17:0/2627223694 conn(0x7f8ed80fc420 msgr2=0x7f8ed80fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 -- 172.21.15.17:0/2627223694 shutdown_connections 2023-10-05T15:34:07.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.609+0000 7f8edffff700 1 -- 172.21.15.17:0/2627223694 wait complete. 2023-10-05T15:34:07.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 Processor -- start 2023-10-05T15:34:07.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 -- start start 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8074e70 0x7f8ed81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8108dc0 0x7f8ed81a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81a07f0 con 0x7f8ed8073890 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81a0960 con 0x7f8ed8108dc0 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.610+0000 7f8edffff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81a0b20 con 0x7f8ed8074e70 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46786/0 (socket says 172.21.15.17:46786) 2023-10-05T15:34:07.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 -- 172.21.15.17:0/2731781178 learned_addr learned my addr 172.21.15.17:0/2731781178 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8edd59a700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8074e70 0x7f8ed81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8ede59c700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8108dc0 0x7f8ed81a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 -- 172.21.15.17:0/2731781178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8074e70 msgr2=0x7f8ed81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8074e70 0x7f8ed81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 -- 172.21.15.17:0/2731781178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8108dc0 msgr2=0x7f8ed81a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8108dc0 0x7f8ed81a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 -- 172.21.15.17:0/2731781178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80095f0 con 0x7f8ed8073890 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eddd9b700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8198c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400d980 tx=0x7f8ed400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.611+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004220 con 0x7f8ed8073890 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.612+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed81a0e00 con 0x7f8ed8073890 2023-10-05T15:34:07.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.612+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ed4007640 con 0x7f8ed8073890 2023-10-05T15:34:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.612+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40055e0 con 0x7f8ed8073890 2023-10-05T15:34:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.612+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed81a1280 con 0x7f8ed8073890 2023-10-05T15:34:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.613+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed81074c0 con 0x7f8ed8073890 2023-10-05T15:34:07.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.615+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8ed4004750 con 0x7f8ed8073890 2023-10-05T15:34:07.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.616+0000 7f8eceffd700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8ec40a1550 0x7f8ec40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:07.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.616+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8ed40cc6f0 con 0x7f8ed8073890 2023-10-05T15:34:07.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.616+0000 7f8edd59a700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8ec40a1550 0x7f8ec40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:07.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.617+0000 7f8edd59a700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8ec40a1550 0x7f8ec40a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8006010 tx=0x7f8ec800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:07.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.620+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ed4096150 con 0x7f8ed8073890 2023-10-05T15:34:07.833 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:34:07 smithi167 podman[170756]: 2023-10-05T15:34:07.833 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:34:07 smithi167 bash[170756]: 61460d96e9e38b73441c25e29aa32dcf87bc902792a76b4cc85dc173a560c4df 2023-10-05T15:34:07.833 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:34:07 smithi167 ceph-mds[170796]: -- 172.21.15.167:0/1974428416 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f53eca51e0 con 0x55f53ec7b000 2023-10-05T15:34:07.833 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:34:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-f[170772]: starting mds.f at 2023-10-05T15:34:07.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.878+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ed810e7c0 con 0x7f8ed8073890 2023-10-05T15:34:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.878+0000 7f8eceffd700 1 -- 172.21.15.17:0/2731781178 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f8ed4005740 con 0x7f8ed8073890 2023-10-05T15:34:07.880 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:07.880 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-05T15:34:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8ec40a1550 msgr2=0x7f8ec40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8ec40a1550 0x7f8ec40a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8006010 tx=0x7f8ec800b260 comp rx=0 tx=0).stop 2023-10-05T15:34:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 msgr2=0x7f8ed8198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8198c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400d980 tx=0x7f8ed400dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 shutdown_connections 2023-10-05T15:34:07.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8ec40a1550 0x7f8ec40a3a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8108dc0 0x7f8ed81a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ed8073890 0x7f8ed8198c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 --2- 172.21.15.17:0/2731781178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ed8074e70 0x7f8ed81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 >> 172.21.15.17:0/2731781178 conn(0x7f8ed80fc420 msgr2=0x7f8ed80fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 shutdown_connections 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:07.881+0000 7f8edffff700 1 -- 172.21.15.17:0/2731781178 wait complete. 2023-10-05T15:34:07.884 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-10-05T15:34:08.206 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:34:07 smithi167 systemd[1]: Started Ceph mds.f for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:08.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2731781178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:08.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:08.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2731781178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:08.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:08.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:08.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2731781178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:08.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:09.576 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:09 smithi167 ceph-mon[133366]: Deploying daemon mds.c on smithi167 2023-10-05T15:34:09.576 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:09 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.167:6834/4056762327,v1:172.21.15.167:6835/4056762327] up:boot 2023-10-05T15:34:09.576 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:09 smithi167 ceph-mon[133366]: fsmap 6 up:standby 2023-10-05T15:34:09.576 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:09 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:34:09.576 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:09 smithi167 ceph-mon[133366]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:09.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:09 smithi079 ceph-mon[132936]: Deploying daemon mds.c on smithi167 2023-10-05T15:34:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:09 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.167:6834/4056762327,v1:172.21.15.167:6835/4056762327] up:boot 2023-10-05T15:34:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:09 smithi079 ceph-mon[132936]: fsmap 6 up:standby 2023-10-05T15:34:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:09 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:34:09.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:09 smithi079 ceph-mon[132936]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:09.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:09 smithi017 ceph-mon[129107]: Deploying daemon mds.c on smithi167 2023-10-05T15:34:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:09 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.167:6834/4056762327,v1:172.21.15.167:6835/4056762327] up:boot 2023-10-05T15:34:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:09 smithi017 ceph-mon[129107]: fsmap 6 up:standby 2023-10-05T15:34:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:09 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-05T15:34:09.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:09 smithi017 ceph-mon[129107]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:09.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.114+0000 7feb719ff700 1 -- 172.21.15.17:0/2752289493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 msgr2=0x7feb6c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.114+0000 7feb719ff700 1 --2- 172.21.15.17:0/2752289493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c1012c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009990 tx=0x7feb5c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 -- 172.21.15.17:0/2752289493 shutdown_connections 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 --2- 172.21.15.17:0/2752289493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb6c102a40 0x7feb6c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 --2- 172.21.15.17:0/2752289493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c1012c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 --2- 172.21.15.17:0/2752289493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c102080 0x7feb6c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 -- 172.21.15.17:0/2752289493 >> 172.21.15.17:0/2752289493 conn(0x7feb6c0fc420 msgr2=0x7feb6c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 -- 172.21.15.17:0/2752289493 shutdown_connections 2023-10-05T15:34:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.115+0000 7feb719ff700 1 -- 172.21.15.17:0/2752289493 wait complete. 2023-10-05T15:34:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.116+0000 7feb719ff700 1 Processor -- start 2023-10-05T15:34:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.116+0000 7feb719ff700 1 -- start start 2023-10-05T15:34:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb719ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb719ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb6c102080 0x7feb6c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb719ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c102a40 0x7feb6c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb719ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c073f80 con 0x7feb6c100ea0 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb719ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0740f0 con 0x7feb6c102080 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb719ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c1a0bf0 con 0x7feb6c102a40 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb6affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb6affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46810/0 (socket says 172.21.15.17:46810) 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb6affd700 1 -- 172.21.15.17:0/4045236961 learned_addr learned my addr 172.21.15.17:0/4045236961 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.117+0000 7feb6b7fe700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c102a40 0x7feb6c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6a7fc700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb6c102080 0x7feb6c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6affd700 1 -- 172.21.15.17:0/4045236961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c102a40 msgr2=0x7feb6c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6affd700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c102a40 0x7feb6c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6affd700 1 -- 172.21.15.17:0/4045236961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb6c102080 msgr2=0x7feb6c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6affd700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb6c102080 0x7feb6c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6affd700 1 -- 172.21.15.17:0/4045236961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c0095f0 con 0x7feb6c100ea0 2023-10-05T15:34:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb6affd700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c074c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0059d0 tx=0x7feb5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c01d070 con 0x7feb6c100ea0 2023-10-05T15:34:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb5c00beb0 con 0x7feb6c100ea0 2023-10-05T15:34:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c1a0e70 con 0x7feb6c100ea0 2023-10-05T15:34:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.118+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c022e40 con 0x7feb6c100ea0 2023-10-05T15:34:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.119+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c1a11e0 con 0x7feb6c100ea0 2023-10-05T15:34:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.120+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6c108610 con 0x7feb6c100ea0 2023-10-05T15:34:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.121+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7feb5c022600 con 0x7feb6c100ea0 2023-10-05T15:34:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.123+0000 7feb709fd700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7feb540a14d0 0x7feb540a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.123+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feb5c0cdec0 con 0x7feb6c100ea0 2023-10-05T15:34:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.123+0000 7feb6a7fc700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7feb540a14d0 0x7feb540a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.124+0000 7feb6a7fc700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7feb540a14d0 0x7feb540a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb6c100bc0 tx=0x7feb60009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:10.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.127+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feb5c05d100 con 0x7feb6c100ea0 2023-10-05T15:34:10.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.385+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb6c10c5c0 con 0x7feb6c100ea0 2023-10-05T15:34:10.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.386+0000 7feb709fd700 1 -- 172.21.15.17:0/4045236961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5274 (secure 0 0 0) 0x7feb5c0979b0 con 0x7feb6c100ea0 2023-10-05T15:34:10.388 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:10.388 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7feb540a14d0 msgr2=0x7feb540a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7feb540a14d0 0x7feb540a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb6c100bc0 tx=0x7feb60009260 comp rx=0 tx=0).stop 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 msgr2=0x7feb6c074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c074c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0059d0 tx=0x7feb5c004730 comp rx=0 tx=0).stop 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 shutdown_connections 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7feb540a14d0 0x7feb540a3990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c102a40 0x7feb6c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb6c100ea0 0x7feb6c074c60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 --2- 172.21.15.17:0/4045236961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb6c102080 0x7feb6c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 >> 172.21.15.17:0/4045236961 conn(0x7feb6c0fc420 msgr2=0x7feb6c105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 shutdown_connections 2023-10-05T15:34:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:10.388+0000 7feb719ff700 1 -- 172.21.15.17:0/4045236961 wait complete. 2023-10-05T15:34:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-10-05T15:34:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:10 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4045236961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:10.583 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:34:10 smithi167 systemd[1]: Starting Ceph mds.c for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:10 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4045236961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:10.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:10 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4045236961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:10.994 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:34:10 smithi167 podman[171108]: 2023-10-05T15:34:10.995 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:34:10 smithi167 bash[171108]: 9abddbfc6f87b0df180a9800fc3242a20ce2f21f0c1edceca6b1bd1c2eb48b7b 2023-10-05T15:34:10.995 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:34:10 smithi167 ceph-mds[171148]: -- 172.21.15.167:0/2891224024 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5566ef14f1e0 con 0x5566ef124800 2023-10-05T15:34:10.995 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:34:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-c[171124]: starting mds.c at 2023-10-05T15:34:11.333 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:34:10 smithi167 systemd[1]: Started Ceph mds.c for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:11 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:11.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:11.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:11.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:11.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:11 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:11.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:11.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:11.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:11.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:11.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:11 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:12.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:12.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:12 smithi079 ceph-mon[132936]: Deploying daemon mds.h on smithi079 2023-10-05T15:34:12.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:12 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] up:boot 2023-10-05T15:34:12.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:12 smithi079 ceph-mon[132936]: fsmap 7 up:standby 2023-10-05T15:34:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 -- 172.21.15.17:0/2060233602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102080 msgr2=0x7fa61c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 --2- 172.21.15.17:0/2060233602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102080 0x7fa61c102500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa610009990 tx=0x7fa610009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 -- 172.21.15.17:0/2060233602 shutdown_connections 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 --2- 172.21.15.17:0/2060233602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa61c102a40 0x7fa61c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 --2- 172.21.15.17:0/2060233602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa61c100ea0 0x7fa61c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 --2- 172.21.15.17:0/2060233602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102080 0x7fa61c102500 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 -- 172.21.15.17:0/2060233602 >> 172.21.15.17:0/2060233602 conn(0x7fa61c0fc420 msgr2=0x7fa61c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:12.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 -- 172.21.15.17:0/2060233602 shutdown_connections 2023-10-05T15:34:12.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.622+0000 7fa6221ff700 1 -- 172.21.15.17:0/2060233602 wait complete. 2023-10-05T15:34:12.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.623+0000 7fa6221ff700 1 Processor -- start 2023-10-05T15:34:12.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 -- start start 2023-10-05T15:34:12.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa61c100ea0 0x7fa61c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:12.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa61c102080 0x7fa61c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:12.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 0x7fa61c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:12.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c19e6e0 con 0x7fa61c102a40 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c19e820 con 0x7fa61c102080 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa6221ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c19e9b0 con 0x7fa61c100ea0 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa61bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 0x7fa61c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa61affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa61c102080 0x7fa61c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa61bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 0x7fa61c19e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46822/0 (socket says 172.21.15.17:46822) 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa61bfff700 1 -- 172.21.15.17:0/1694291684 learned_addr learned my addr 172.21.15.17:0/1694291684 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.624+0000 7fa61b7fe700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa61c100ea0 0x7fa61c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa61bfff700 1 -- 172.21.15.17:0/1694291684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa61c100ea0 msgr2=0x7fa61c196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:12.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa61bfff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa61c100ea0 0x7fa61c196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa61bfff700 1 -- 172.21.15.17:0/1694291684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa61c102080 msgr2=0x7fa61c1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa61bfff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa61c102080 0x7fa61c1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa61bfff700 1 -- 172.21.15.17:0/1694291684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6100095f0 con 0x7fa61c102a40 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa61bfff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 0x7fa61c19e110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa614007ee0 tx=0x7fa61400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614017070 con 0x7fa61c102a40 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c19ec90 con 0x7fa61c102a40 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa61400f040 con 0x7fa61c102a40 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614005570 con 0x7fa61c102a40 2023-10-05T15:34:12.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.625+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c19f150 con 0x7fa61c102a40 2023-10-05T15:34:12.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.626+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c10c610 con 0x7fa61c102a40 2023-10-05T15:34:12.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.628+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa61400db20 con 0x7fa61c102a40 2023-10-05T15:34:12.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.630+0000 7fa618ff9700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6040a14d0 0x7fa6040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:12.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.630+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa6140cc6b0 con 0x7fa61c102a40 2023-10-05T15:34:12.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.630+0000 7fa61b7fe700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6040a14d0 0x7fa6040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:12.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.630+0000 7fa61b7fe700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6040a14d0 0x7fa6040a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa61c101bf0 tx=0x7fa60c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:12.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.632+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa614096110 con 0x7fa61c102a40 2023-10-05T15:34:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:12 smithi167 ceph-mon[133366]: Deploying daemon mds.h on smithi079 2023-10-05T15:34:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:12 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] up:boot 2023-10-05T15:34:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:12 smithi167 ceph-mon[133366]: fsmap 7 up:standby 2023-10-05T15:34:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:34:12.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.892+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa61c10c800 con 0x7fa61c102a40 2023-10-05T15:34:12.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.892+0000 7fa618ff9700 1 -- 172.21.15.17:0/1694291684 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6068 (secure 0 0 0) 0x7fa614099730 con 0x7fa61c102a40 2023-10-05T15:34:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:12.894 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6040a14d0 msgr2=0x7fa6040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6040a14d0 0x7fa6040a3990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa61c101bf0 tx=0x7fa60c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 msgr2=0x7fa61c19e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 0x7fa61c19e110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa614007ee0 tx=0x7fa61400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 shutdown_connections 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6040a14d0 0x7fa6040a3990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa61c102a40 0x7fa61c19e110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa61c100ea0 0x7fa61c196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 --2- 172.21.15.17:0/1694291684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa61c102080 0x7fa61c1970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 >> 172.21.15.17:0/1694291684 conn(0x7fa61c0fc420 msgr2=0x7fa61c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 shutdown_connections 2023-10-05T15:34:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:12.895+0000 7fa6221ff700 1 -- 172.21.15.17:0/1694291684 wait complete. 2023-10-05T15:34:12.898 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-10-05T15:34:12.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:12 smithi017 ceph-mon[129107]: Deploying daemon mds.h on smithi079 2023-10-05T15:34:12.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:12 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] up:boot 2023-10-05T15:34:12.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:12 smithi017 ceph-mon[129107]: fsmap 7 up:standby 2023-10-05T15:34:12.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-05T15:34:13.248 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:34:13 smithi079 systemd[1]: Starting Ceph mds.h for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:13.721 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:13 smithi079 ceph-mon[132936]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:13.721 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:13 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1694291684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:13 smithi167 ceph-mon[133366]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:13 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1694291684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:13.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:13 smithi017 ceph-mon[129107]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:13.963 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:13 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1694291684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:14.009 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:34:13 smithi079 podman[169650]: 2023-10-05T15:34:14.009 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:34:13 smithi079 bash[169650]: 5ac66f0e601082749983d929cf7e62907bfadc3eed7f9e32052fbca39842d9ed 2023-10-05T15:34:14.009 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:34:13 smithi079 ceph-mds[169690]: -- 172.21.15.79:0/2611698631 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d88eeb51e0 con 0x55d88ee8b000 2023-10-05T15:34:14.009 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:34:13 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-h[169666]: starting mds.h at 2023-10-05T15:34:14.354 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:34:14 smithi079 systemd[1]: Started Ceph mds.h for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:14.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:15.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 -- 172.21.15.17:0/3953553693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102a40 msgr2=0x7f95a0109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:15.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3953553693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102a40 0x7f95a0109360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f959800b0a0 tx=0x7f959800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 -- 172.21.15.17:0/3953553693 shutdown_connections 2023-10-05T15:34:15.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3953553693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102a40 0x7f95a0109360 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3953553693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95a0100ea0 0x7f95a01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3953553693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0102080 0x7f95a0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 -- 172.21.15.17:0/3953553693 >> 172.21.15.17:0/3953553693 conn(0x7f95a00fc420 msgr2=0x7f95a00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:15.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 -- 172.21.15.17:0/3953553693 shutdown_connections 2023-10-05T15:34:15.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.129+0000 7f95a6fff700 1 -- 172.21.15.17:0/3953553693 wait complete. 2023-10-05T15:34:15.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.130+0000 7f95a6fff700 1 Processor -- start 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.130+0000 7f95a6fff700 1 -- start start 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a6fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95a0100ea0 0x7f95a0196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a6fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 0x7f95a0197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a6fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0102a40 0x7f95a019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a6fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a019e770 con 0x7f95a0102080 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a6fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a019e8e0 con 0x7f95a0102a40 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a6fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a019eaa0 con 0x7f95a0100ea0 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 0x7f95a0197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 0x7f95a0197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34884/0 (socket says 172.21.15.17:34884) 2023-10-05T15:34:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 -- 172.21.15.17:0/3228565234 learned_addr learned my addr 172.21.15.17:0/3228565234 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a4d9b700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95a0100ea0 0x7f95a0196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f95a559c700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0102a40 0x7f95a019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 -- 172.21.15.17:0/3228565234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95a0100ea0 msgr2=0x7f95a0196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95a0100ea0 0x7f95a0196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 -- 172.21.15.17:0/3228565234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0102a40 msgr2=0x7f95a019e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0102a40 0x7f95a019e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.131+0000 7f959ffff700 1 -- 172.21.15.17:0/3228565234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009d00 con 0x7f95a0102080 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.132+0000 7f959ffff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 0x7f95a0197170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f958c00e970 tx=0x7f958c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.132+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c009790 con 0x7f95a0102080 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.132+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f958c00c7e0 con 0x7f95a0102080 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.132+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c003bd0 con 0x7f95a0102080 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.132+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a019ed80 con 0x7f95a0102080 2023-10-05T15:34:15.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.132+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a019f1d0 con 0x7f95a0102080 2023-10-05T15:34:15.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.133+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0108510 con 0x7f95a0102080 2023-10-05T15:34:15.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.135+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f958c00c950 con 0x7f95a0102080 2023-10-05T15:34:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.136+0000 7f959dffb700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95900a1550 0x7f95900a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.137+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f958c014070 con 0x7f95a0102080 2023-10-05T15:34:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.137+0000 7f95a4d9b700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95900a1550 0x7f95900a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:15.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.137+0000 7f95a4d9b700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95900a1550 0x7f95900a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95a0198100 tx=0x7f9594009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:15.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.138+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f958c096550 con 0x7f95a0102080 2023-10-05T15:34:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:15.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:15.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: Deploying daemon mds.i on smithi167 2023-10-05T15:34:15.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] up:boot 2023-10-05T15:34:15.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: fsmap 8 up:standby 2023-10-05T15:34:15.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:34:15.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:15 smithi167 ceph-mon[133366]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:15.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: Deploying daemon mds.i on smithi167 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] up:boot 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: fsmap 8 up:standby 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:34:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:15 smithi079 ceph-mon[132936]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:15.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.401+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95a002d020 con 0x7f95a0102080 2023-10-05T15:34:15.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.402+0000 7f959dffb700 1 -- 172.21.15.17:0/3228565234 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6859 (secure 0 0 0) 0x7f958c099b70 con 0x7f95a0102080 2023-10-05T15:34:15.404 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:15.404 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-10-05T15:34:15.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95900a1550 msgr2=0x7f95900a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:15.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95900a1550 0x7f95900a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95a0198100 tx=0x7f9594009260 comp rx=0 tx=0).stop 2023-10-05T15:34:15.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 msgr2=0x7f95a0197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 0x7f95a0197170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f958c00e970 tx=0x7f958c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 shutdown_connections 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95900a1550 0x7f95900a3a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0102a40 0x7f95a019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95a0100ea0 0x7f95a0196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 --2- 172.21.15.17:0/3228565234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95a0102080 0x7f95a0197170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.404+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 >> 172.21.15.17:0/3228565234 conn(0x7f95a00fc420 msgr2=0x7f95a0105650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.405+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 shutdown_connections 2023-10-05T15:34:15.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:15.405+0000 7f95a6fff700 1 -- 172.21.15.17:0/3228565234 wait complete. 2023-10-05T15:34:15.408 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: Deploying daemon mds.i on smithi167 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] up:boot 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: fsmap 8 up:standby 2023-10-05T15:34:15.423 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-05T15:34:15.424 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:15 smithi017 ceph-mon[129107]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:16 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3228565234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:16 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3228565234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:16.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:16 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3228565234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:16.834 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:34:16 smithi167 systemd[1]: Starting Ceph mds.i for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:17.188 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:34:16 smithi167 podman[171448]: 2023-10-05T15:34:17.188 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:34:17 smithi167 bash[171448]: a0eef803d8d5f94318d286ebeb8eb2804988fc8ff78b729ac09a094f891e0598 2023-10-05T15:34:17.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:17.490 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:17 smithi017 ceph-mon[129107]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:17.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:17 smithi167 ceph-mon[133366]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:17.583 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:34:17 smithi167 ceph-mds[171488]: -- 172.21.15.167:0/282794853 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f8c5d31e0 con 0x558f8c5a9000 2023-10-05T15:34:17.583 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:34:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-i[171464]: starting mds.i at 2023-10-05T15:34:17.583 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:34:17 smithi167 systemd[1]: Started Ceph mds.i for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:17.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:17 smithi079 ceph-mon[132936]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/156963891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14074ef0 msgr2=0x7f6e14073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/156963891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14074ef0 0x7f6e14073340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009990 tx=0x7f6e10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/156963891 shutdown_connections 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/156963891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e1410b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/156963891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14074ef0 0x7f6e14073340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/156963891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14073910 0x7f6e14073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/156963891 >> 172.21.15.17:0/156963891 conn(0x7f6e140fc420 msgr2=0x7f6e140fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:17.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/156963891 shutdown_connections 2023-10-05T15:34:17.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.635+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/156963891 wait complete. 2023-10-05T15:34:17.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 Processor -- start 2023-10-05T15:34:17.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 -- start start 2023-10-05T15:34:17.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14073910 0x7f6e14198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14074ef0 0x7f6e141991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e141a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141a0800 con 0x7f6e14108db0 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141a0970 con 0x7f6e14073910 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.636+0000 7f6e1c7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141a0b30 con 0x7f6e14074ef0 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e141a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e141a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34898/0 (socket says 172.21.15.17:34898) 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1a59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14073910 0x7f6e14198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 -- 172.21.15.17:0/3600118374 learned_addr learned my addr 172.21.15.17:0/3600118374 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e19d9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14074ef0 0x7f6e141991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 -- 172.21.15.17:0/3600118374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14074ef0 msgr2=0x7f6e141991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:17.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14074ef0 0x7f6e141991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 -- 172.21.15.17:0/3600118374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14073910 msgr2=0x7f6e14198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14073910 0x7f6e14198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 -- 172.21.15.17:0/3600118374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100095f0 con 0x7f6e14108db0 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e19d9a700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14074ef0 0x7f6e141991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1a59b700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14073910 0x7f6e14198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.637+0000 7f6e1ad9c700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e141a0230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00ef30 tx=0x7f6e0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.638+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c018070 con 0x7f6e14108db0 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.638+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e0c00f040 con 0x7f6e14108db0 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.638+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e141a0db0 con 0x7f6e14108db0 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.638+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00cbc0 con 0x7f6e14108db0 2023-10-05T15:34:17.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.638+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e141a1230 con 0x7f6e14108db0 2023-10-05T15:34:17.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.639+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e14107460 con 0x7f6e14108db0 2023-10-05T15:34:17.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.641+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6e0c007500 con 0x7f6e14108db0 2023-10-05T15:34:17.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.642+0000 7f6e0b7fe700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6e000a1550 0x7f6e000a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:17.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.643+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6e0c0cc380 con 0x7f6e14108db0 2023-10-05T15:34:17.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.643+0000 7f6e1a59b700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6e000a1550 0x7f6e000a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:17.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.643+0000 7f6e1a59b700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6e000a1550 0x7f6e000a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e10006010 tx=0x7f6e1000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:17.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.647+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6e0c095e70 con 0x7f6e14108db0 2023-10-05T15:34:17.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.913+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e1410e7e0 con 0x7f6e14108db0 2023-10-05T15:34:17.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.914+0000 7f6e0b7fe700 1 -- 172.21.15.17:0/3600118374 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7f6e0c099490 con 0x7f6e14108db0 2023-10-05T15:34:17.916 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:17.916 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-05T15:34:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6e000a1550 msgr2=0x7f6e000a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6e000a1550 0x7f6e000a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e10006010 tx=0x7f6e1000b260 comp rx=0 tx=0).stop 2023-10-05T15:34:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 msgr2=0x7f6e141a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:17.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e141a0230 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00ef30 tx=0x7f6e0c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 shutdown_connections 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6e000a1550 0x7f6e000a3a10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e14108db0 0x7f6e141a0230 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e14073910 0x7f6e14198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 --2- 172.21.15.17:0/3600118374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e14074ef0 0x7f6e141991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.916+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 >> 172.21.15.17:0/3600118374 conn(0x7f6e140fc420 msgr2=0x7f6e140fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.917+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 shutdown_connections 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:17.917+0000 7f6e1c7ff700 1 -- 172.21.15.17:0/3600118374 wait complete. 2023-10-05T15:34:17.919 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2023-10-05T15:34:18.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] up:boot 2023-10-05T15:34:18.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: fsmap 9 up:standby 2023-10-05T15:34:18.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:34:18.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.462 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:18.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:18.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:18.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: Deploying daemon mds.g on smithi017 2023-10-05T15:34:18.463 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:18 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3600118374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] up:boot 2023-10-05T15:34:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: fsmap 9 up:standby 2023-10-05T15:34:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:34:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: Deploying daemon mds.g on smithi017 2023-10-05T15:34:18.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:18 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3600118374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:18.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] up:boot 2023-10-05T15:34:18.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: fsmap 9 up:standby 2023-10-05T15:34:18.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: Deploying daemon mds.g on smithi017 2023-10-05T15:34:18.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:18 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3600118374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:19.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:19 smithi167 ceph-mon[133366]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:19.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:19 smithi079 ceph-mon[132936]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:19.683 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:19 smithi017 ceph-mon[129107]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:19.940 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:19.946 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:34:19 smithi017 systemd[1]: Starting Ceph mds.g for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:20.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 -- 172.21.15.17:0/1432052196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964100ea0 msgr2=0x7f59641012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:20.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 --2- 172.21.15.17:0/1432052196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964100ea0 0x7f59641012c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59540098f0 tx=0x7f5954009c00 comp rx=0 tx=0).stop 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 -- 172.21.15.17:0/1432052196 shutdown_connections 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 --2- 172.21.15.17:0/1432052196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 0x7f5964109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 --2- 172.21.15.17:0/1432052196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964100ea0 0x7f59641012c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 --2- 172.21.15.17:0/1432052196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964102080 0x7f5964102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 -- 172.21.15.17:0/1432052196 >> 172.21.15.17:0/1432052196 conn(0x7f59640fc420 msgr2=0x7f59640fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 -- 172.21.15.17:0/1432052196 shutdown_connections 2023-10-05T15:34:20.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.157+0000 7f5968bff700 1 -- 172.21.15.17:0/1432052196 wait complete. 2023-10-05T15:34:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.158+0000 7f5968bff700 1 Processor -- start 2023-10-05T15:34:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 -- start start 2023-10-05T15:34:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 0x7f5964196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964102080 0x7f5964197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 0x7f596419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:20.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596419e6a0 con 0x7f5964100ea0 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596419e7e0 con 0x7f5964102080 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5968bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596419e970 con 0x7f5964102a40 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f595a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 0x7f5964196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f595a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 0x7f5964196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34910/0 (socket says 172.21.15.17:34910) 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f595a59c700 1 -- 172.21.15.17:0/291661972 learned_addr learned my addr 172.21.15.17:0/291661972 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f596259c700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964102080 0x7f5964197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.159+0000 7f5962d9d700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 0x7f596419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595a59c700 1 -- 172.21.15.17:0/291661972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 msgr2=0x7f596419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595a59c700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 0x7f596419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595a59c700 1 -- 172.21.15.17:0/291661972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964102080 msgr2=0x7f5964197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:20.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595a59c700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964102080 0x7f5964197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595a59c700 1 -- 172.21.15.17:0/291661972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009520 con 0x7f5964100ea0 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f5962d9d700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 0x7f596419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595a59c700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 0x7f5964196b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f595400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595401c070 con 0x7f5964100ea0 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f595400f7b0 con 0x7f5964100ea0 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596419ebf0 con 0x7f5964100ea0 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540038e0 con 0x7f5964100ea0 2023-10-05T15:34:20.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.160+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596419f010 con 0x7f5964100ea0 2023-10-05T15:34:20.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.161+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596410c5c0 con 0x7f5964100ea0 2023-10-05T15:34:20.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.163+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5954020030 con 0x7f5964100ea0 2023-10-05T15:34:20.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.165+0000 7f595bfff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59500a14d0 0x7f59500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:20.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.165+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59540cda10 con 0x7f5964100ea0 2023-10-05T15:34:20.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.165+0000 7f596259c700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59500a14d0 0x7f59500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:20.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.165+0000 7f596259c700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59500a14d0 0x7f59500a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5964100bc0 tx=0x7f594c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:20.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.169+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5954097500 con 0x7f5964100ea0 2023-10-05T15:34:20.332 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:34:20 smithi017 podman[180571]: 2023-10-05T15:34:20.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.440+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f596410c7d0 con 0x7f5964100ea0 2023-10-05T15:34:20.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.440+0000 7f595bfff700 1 -- 172.21.15.17:0/291661972 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7f595409ab20 con 0x7f5964100ea0 2023-10-05T15:34:20.442 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:20.443 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-05T15:34:20.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59500a14d0 msgr2=0x7f59500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59500a14d0 0x7f59500a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5964100bc0 tx=0x7f594c009310 comp rx=0 tx=0).stop 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 msgr2=0x7f5964196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 0x7f5964196b20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5954000c00 tx=0x7f595400b840 comp rx=0 tx=0).stop 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 shutdown_connections 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59500a14d0 0x7f59500a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5964102a40 0x7f596419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5964100ea0 0x7f5964196b20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 --2- 172.21.15.17:0/291661972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5964102080 0x7f5964197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 >> 172.21.15.17:0/291661972 conn(0x7f59640fc420 msgr2=0x7f59640fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:20.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 shutdown_connections 2023-10-05T15:34:20.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:20.444+0000 7f5968bff700 1 -- 172.21.15.17:0/291661972 wait complete. 2023-10-05T15:34:20.447 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2023-10-05T15:34:20.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:20 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/291661972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:20.697 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:34:20 smithi017 bash[180571]: 64d3e4dec7374827927d2accfc35898104278df80d11d4f03bcb7dc392b6fa92 2023-10-05T15:34:20.697 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:34:20 smithi017 ceph-mds[180635]: -- 172.21.15.17:0/923406481 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560cef6971e0 con 0x560cef66cc00 2023-10-05T15:34:20.697 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:34:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-g[180611]: starting mds.g at 2023-10-05T15:34:20.697 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:34:20 smithi017 systemd[1]: Started Ceph mds.g for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:20.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:20 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/291661972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:20.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:20 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/291661972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:21.828 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] up:boot 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: fsmap 10 up:standby 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:21.829 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:21 smithi017 ceph-mon[129107]: Deploying daemon mds.a on smithi017 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] up:boot 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: fsmap 10 up:standby 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:21.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:21.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:21.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:21.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:21 smithi167 ceph-mon[133366]: Deploying daemon mds.a on smithi017 2023-10-05T15:34:21.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] up:boot 2023-10-05T15:34:21.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: fsmap 10 up:standby 2023-10-05T15:34:21.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:21.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:21 smithi079 ceph-mon[132936]: Deploying daemon mds.a on smithi017 2023-10-05T15:34:22.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 -- 172.21.15.17:0/2219418937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4074e70 msgr2=0x7f75b40732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 --2- 172.21.15.17:0/2219418937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4074e70 0x7f75b40732c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009990 tx=0x7f75a4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:22.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 -- 172.21.15.17:0/2219418937 shutdown_connections 2023-10-05T15:34:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 --2- 172.21.15.17:0/2219418937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4108c50 0x7f75b410b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 --2- 172.21.15.17:0/2219418937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4074e70 0x7f75b40732c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 --2- 172.21.15.17:0/2219418937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4073890 0x7f75b4073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 -- 172.21.15.17:0/2219418937 >> 172.21.15.17:0/2219418937 conn(0x7f75b40fc2b0 msgr2=0x7f75b40fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 -- 172.21.15.17:0/2219418937 shutdown_connections 2023-10-05T15:34:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.708+0000 7f75b939d700 1 -- 172.21.15.17:0/2219418937 wait complete. 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.709+0000 7f75b939d700 1 Processor -- start 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.709+0000 7f75b939d700 1 -- start start 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b939d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4073890 0x7f75b4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b939d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4074e70 0x7f75b4198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b939d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 0x7f75b41a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b939d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b41a05d0 con 0x7f75b4108c50 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b939d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b41a0710 con 0x7f75b4073890 2023-10-05T15:34:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b939d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b41a08a0 con 0x7f75b4074e70 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 0x7f75b41a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 0x7f75b41a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34952/0 (socket says 172.21.15.17:34952) 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 -- 172.21.15.17:0/905357486 learned_addr learned my addr 172.21.15.17:0/905357486 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b3fff700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4073890 0x7f75b4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b37fe700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4074e70 0x7f75b4198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 -- 172.21.15.17:0/905357486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4074e70 msgr2=0x7f75b4198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4074e70 0x7f75b4198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 -- 172.21.15.17:0/905357486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4073890 msgr2=0x7f75b4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4073890 0x7f75b4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b8b9c700 1 -- 172.21.15.17:0/905357486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40095f0 con 0x7f75b4108c50 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.710+0000 7f75b37fe700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4074e70 0x7f75b4198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.711+0000 7f75b8b9c700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 0x7f75b41a0000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00ef30 tx=0x7f75ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.711+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac018070 con 0x7f75b4108c50 2023-10-05T15:34:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.711+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75ac00f040 con 0x7f75b4108c50 2023-10-05T15:34:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.711+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b41a0b20 con 0x7f75b4108c50 2023-10-05T15:34:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.711+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00cc70 con 0x7f75b4108c50 2023-10-05T15:34:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.711+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b41a0fe0 con 0x7f75b4108c50 2023-10-05T15:34:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.712+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b4107350 con 0x7f75b4108c50 2023-10-05T15:34:22.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.714+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f75ac007500 con 0x7f75b4108c50 2023-10-05T15:34:22.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.715+0000 7f75b17fa700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f759c0a1570 0x7f759c0a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:22.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.715+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f75ac0cc3e0 con 0x7f75b4108c50 2023-10-05T15:34:22.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.716+0000 7f75b3fff700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f759c0a1570 0x7f759c0a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:22.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.716+0000 7f75b3fff700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f759c0a1570 0x7f759c0a3a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75a4006010 tx=0x7f75a400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:22.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.720+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f75ac095ed0 con 0x7f75b4108c50 2023-10-05T15:34:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.994+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75b402d0c0 con 0x7f75b4108c50 2023-10-05T15:34:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.995+0000 7f75b17fa700 1 -- 172.21.15.17:0/905357486 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8447 (secure 0 0 0) 0x7f75ac0994f0 con 0x7f75b4108c50 2023-10-05T15:34:22.997 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:22.997 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24569,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[]} 2023-10-05T15:34:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f759c0a1570 msgr2=0x7f759c0a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f759c0a1570 0x7f759c0a3a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75a4006010 tx=0x7f75a400b260 comp rx=0 tx=0).stop 2023-10-05T15:34:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 msgr2=0x7f75b41a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 0x7f75b41a0000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00ef30 tx=0x7f75ac00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 shutdown_connections 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f759c0a1570 0x7f759c0a3a30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75b4108c50 0x7f75b41a0000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75b4073890 0x7f75b4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 --2- 172.21.15.17:0/905357486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b4074e70 0x7f75b4198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 >> 172.21.15.17:0/905357486 conn(0x7f75b40fc2b0 msgr2=0x7f75b410afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 shutdown_connections 2023-10-05T15:34:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:22.998+0000 7f75b939d700 1 -- 172.21.15.17:0/905357486 wait complete. 2023-10-05T15:34:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2023-10-05T15:34:23.196 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:34:22 smithi017 systemd[1]: Starting Ceph mds.a for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:23.576 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:34:23 smithi017 podman[180983]: 2023-10-05T15:34:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:23 smithi017 ceph-mon[129107]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:23 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/905357486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:23.947 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:34:23 smithi017 bash[180983]: 856aea266b90eaa774c4c95f4dcf5885b575fb35c91a945c74fe5baf9ef57592 2023-10-05T15:34:23.947 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:34:23 smithi017 ceph-mds[181023]: -- 172.21.15.17:0/1449670562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55677f9a51e0 con 0x55677f97a800 2023-10-05T15:34:23.947 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:34:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-a[180999]: starting mds.a at 2023-10-05T15:34:23.948 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:34:23 smithi017 systemd[1]: Started Ceph mds.a for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:23 smithi167 ceph-mon[133366]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:23 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/905357486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:23 smithi079 ceph-mon[132936]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:23 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/905357486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.17:6840/3361787400,v1:172.21.15.17:6841/3361787400] up:boot 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: fsmap 11 up:standby 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:24.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:24.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:24 smithi017 ceph-mon[129107]: Deploying daemon mds.b on smithi079 2023-10-05T15:34:24.951 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.17:6840/3361787400,v1:172.21.15.17:6841/3361787400] up:boot 2023-10-05T15:34:24.951 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: fsmap 11 up:standby 2023-10-05T15:34:24.951 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:24.952 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:24 smithi079 ceph-mon[132936]: Deploying daemon mds.b on smithi079 2023-10-05T15:34:25.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.17:6840/3361787400,v1:172.21.15.17:6841/3361787400] up:boot 2023-10-05T15:34:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: fsmap 11 up:standby 2023-10-05T15:34:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-05T15:34:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:25.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:25.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-05T15:34:25.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-05T15:34:25.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:25.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:24 smithi167 ceph-mon[133366]: Deploying daemon mds.b on smithi079 2023-10-05T15:34:25.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.239+0000 7fa5813ff700 1 -- 172.21.15.17:0/535099362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c102a40 msgr2=0x7fa57c109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.239+0000 7fa5813ff700 1 --2- 172.21.15.17:0/535099362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c102a40 0x7fa57c109360 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa57400b0a0 tx=0x7fa57400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 -- 172.21.15.17:0/535099362 shutdown_connections 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 --2- 172.21.15.17:0/535099362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c102a40 0x7fa57c109360 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 --2- 172.21.15.17:0/535099362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa57c100ea0 0x7fa57c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 --2- 172.21.15.17:0/535099362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57c102080 0x7fa57c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 -- 172.21.15.17:0/535099362 >> 172.21.15.17:0/535099362 conn(0x7fa57c0fc420 msgr2=0x7fa57c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 -- 172.21.15.17:0/535099362 shutdown_connections 2023-10-05T15:34:25.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.240+0000 7fa5813ff700 1 -- 172.21.15.17:0/535099362 wait complete. 2023-10-05T15:34:25.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 Processor -- start 2023-10-05T15:34:25.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 -- start start 2023-10-05T15:34:25.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 0x7fa57c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:25.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa57c102080 0x7fa57c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:25.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57c102a40 0x7fa57c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c1a0940 con 0x7fa57c100ea0 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c1a0a80 con 0x7fa57c102a40 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa5813ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c1a0c10 con 0x7fa57c102080 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa57affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 0x7fa57c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa57affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 0x7fa57c198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49912/0 (socket says 172.21.15.17:49912) 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.241+0000 7fa57affd700 1 -- 172.21.15.17:0/160548892 learned_addr learned my addr 172.21.15.17:0/160548892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57b7fe700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57c102a40 0x7fa57c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57affd700 1 -- 172.21.15.17:0/160548892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa57c102080 msgr2=0x7fa57c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57affd700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa57c102080 0x7fa57c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57affd700 1 -- 172.21.15.17:0/160548892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57c102a40 msgr2=0x7fa57c1a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57affd700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57c102a40 0x7fa57c1a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57affd700 1 -- 172.21.15.17:0/160548892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574009d00 con 0x7fa57c100ea0 2023-10-05T15:34:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa57affd700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 0x7fa57c198dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e970 tx=0x7fa56c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c009790 con 0x7fa57c100ea0 2023-10-05T15:34:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa56c00eec0 con 0x7fa57c100ea0 2023-10-05T15:34:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c003c10 con 0x7fa57c100ea0 2023-10-05T15:34:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c1a0ef0 con 0x7fa57c100ea0 2023-10-05T15:34:25.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.242+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c1a12c0 con 0x7fa57c100ea0 2023-10-05T15:34:25.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.243+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c1933b0 con 0x7fa57c100ea0 2023-10-05T15:34:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.245+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa56c003db0 con 0x7fa57c100ea0 2023-10-05T15:34:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.247+0000 7fa563fff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5640a1550 0x7fa5640a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.247+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa56c014070 con 0x7fa57c100ea0 2023-10-05T15:34:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.247+0000 7fa57a7fc700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5640a1550 0x7fa5640a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:25.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.247+0000 7fa57a7fc700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5640a1550 0x7fa5640a3a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa57c100bc0 tx=0x7fa5700096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:25.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.251+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa56c096560 con 0x7fa57c100ea0 2023-10-05T15:34:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.509+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa57c02d0c0 con 0x7fa57c100ea0 2023-10-05T15:34:25.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.510+0000 7fa563fff700 1 -- 172.21.15.17:0/160548892 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9239 (secure 0 0 0) 0x7fa56c099b80 con 0x7fa57c100ea0 2023-10-05T15:34:25.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:25.512 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24569,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[]} 2023-10-05T15:34:25.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.512+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5640a1550 msgr2=0x7fa5640a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.512+0000 7fa5813ff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5640a1550 0x7fa5640a3a10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa57c100bc0 tx=0x7fa5700096c0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.512+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 msgr2=0x7fa57c198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.512+0000 7fa5813ff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 0x7fa57c198dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e970 tx=0x7fa56c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 shutdown_connections 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5640a1550 0x7fa5640a3a10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa57c102a40 0x7fa57c1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa57c100ea0 0x7fa57c198dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 --2- 172.21.15.17:0/160548892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa57c102080 0x7fa57c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 >> 172.21.15.17:0/160548892 conn(0x7fa57c0fc420 msgr2=0x7fa57c1079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 shutdown_connections 2023-10-05T15:34:25.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:25.513+0000 7fa5813ff700 1 -- 172.21.15.17:0/160548892 wait complete. 2023-10-05T15:34:25.516 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2023-10-05T15:34:25.915 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:25 smithi079 ceph-mon[132936]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:25.915 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:25 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/160548892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:25 smithi017 ceph-mon[129107]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:25 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/160548892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:25 smithi167 ceph-mon[133366]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:25 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/160548892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:26.354 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:25 smithi079 systemd[1]: Starting Ceph mds.b for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:34:26.649 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:26 smithi079 podman[169996]: 2023-10-05T15:34:26.649 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:26 smithi079 bash[169996]: 47c2665ebdd0687a7d702d1557ba9dc54c53d08280d2cedf86006a052c9205f2 2023-10-05T15:34:27.104 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:26 smithi079 ceph-mds[170036]: -- 172.21.15.79:0/3162981869 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56242e2f91e0 con 0x56242e2cec00 2023-10-05T15:34:27.105 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: starting mds.b at 2023-10-05T15:34:27.105 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:26 smithi079 systemd[1]: Started Ceph mds.b for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:34:27.535 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:27.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:27.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:34:27.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:27.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:27.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:34:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 -- 172.21.15.17:0/2070285973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102a40 msgr2=0x7f3e9c109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/2070285973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102a40 0x7f3e9c109360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009f90 tx=0x7f3e9400b330 comp rx=0 tx=0).stop 2023-10-05T15:34:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 -- 172.21.15.17:0/2070285973 shutdown_connections 2023-10-05T15:34:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/2070285973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102a40 0x7f3e9c109360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/2070285973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e9c100ea0 0x7f3e9c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/2070285973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102080 0x7f3e9c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 -- 172.21.15.17:0/2070285973 >> 172.21.15.17:0/2070285973 conn(0x7f3e9c0fc420 msgr2=0x7f3e9c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 -- 172.21.15.17:0/2070285973 shutdown_connections 2023-10-05T15:34:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.750+0000 7f3ea27ff700 1 -- 172.21.15.17:0/2070285973 wait complete. 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 Processor -- start 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 -- start start 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e9c100ea0 0x7f3e9c196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102080 0x7f3e9c197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 0x7f3e9c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c19e770 con 0x7f3e9c102a40 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c19e8b0 con 0x7f3e9c100ea0 2023-10-05T15:34:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.751+0000 7f3ea27ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c19ea40 con 0x7f3e9c102080 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3ea0d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 0x7f3e9c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102080 0x7f3e9c197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3ea0d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 0x7f3e9c19e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49932/0 (socket says 172.21.15.17:49932) 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3ea0d9c700 1 -- 172.21.15.17:0/232936789 learned_addr learned my addr 172.21.15.17:0/232936789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9bfff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e9c100ea0 0x7f3e9c196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 -- 172.21.15.17:0/232936789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e9c100ea0 msgr2=0x7f3e9c196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e9c100ea0 0x7f3e9c196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 -- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 msgr2=0x7f3e9c19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 0x7f3e9c19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 -- 172.21.15.17:0/232936789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900095f0 con 0x7f3e9c102080 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3ea0d9c700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 0x7f3e9c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.752+0000 7f3e9b7fe700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102080 0x7f3e9c197130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005fd0 tx=0x7f3e9000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.753+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000cbd0 con 0x7f3e9c102080 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.753+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9000cd30 con 0x7f3e9c102080 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.753+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90018680 con 0x7f3e9c102080 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.753+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e94009c40 con 0x7f3e9c102080 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.753+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c19f0a0 con 0x7f3e9c102080 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.754+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c10c610 con 0x7f3e9c102080 2023-10-05T15:34:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.756+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3e90010430 con 0x7f3e9c102080 2023-10-05T15:34:27.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.757+0000 7f3e997fa700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e840a1550 0x7f3e840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:27.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.757+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3e90014070 con 0x7f3e9c102080 2023-10-05T15:34:27.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.757+0000 7f3e9bfff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e840a1550 0x7f3e840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:27.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.758+0000 7f3e9bfff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e840a1550 0x7f3e840a3a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c101bf0 tx=0x7f3e8c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:27.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:27.759+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e90096d80 con 0x7f3e9c102080 2023-10-05T15:34:28.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.021+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e9c107e20 con 0x7f3e9c102080 2023-10-05T15:34:28.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.022+0000 7f3e997fa700 1 -- 172.21.15.17:0/232936789 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10031 (secure 0 0 0) 0x7f3e900106e0 con 0x7f3e9c102080 2023-10-05T15:34:28.024 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:28.024 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24569,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-05T15:34:28.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.024+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e840a1550 msgr2=0x7f3e840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.024+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e840a1550 0x7f3e840a3a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c101bf0 tx=0x7f3e8c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.024+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102080 msgr2=0x7f3e9c197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.024+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102080 0x7f3e9c197130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e90005fd0 tx=0x7f3e9000ee70 comp rx=0 tx=0).stop 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 shutdown_connections 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e840a1550 0x7f3e840a3a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e9c102a40 0x7f3e9c19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e9c100ea0 0x7f3e9c196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 --2- 172.21.15.17:0/232936789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e9c102080 0x7f3e9c197130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 >> 172.21.15.17:0/232936789 conn(0x7f3e9c0fc420 msgr2=0x7f3e9c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 shutdown_connections 2023-10-05T15:34:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.025+0000 7f3ea27ff700 1 -- 172.21.15.17:0/232936789 wait complete. 2023-10-05T15:34:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2023-10-05T15:34:28.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 -- 172.21.15.17:0/3959275964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24074ef0 msgr2=0x7fab24073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/3959275964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24074ef0 0x7fab24073340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab20009990 tx=0x7fab20009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 -- 172.21.15.17:0/3959275964 shutdown_connections 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/3959275964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24108db0 0x7fab2410b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/3959275964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24074ef0 0x7fab24073340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/3959275964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24073910 0x7fab24073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 -- 172.21.15.17:0/3959275964 >> 172.21.15.17:0/3959275964 conn(0x7fab240fc420 msgr2=0x7fab240fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 -- 172.21.15.17:0/3959275964 shutdown_connections 2023-10-05T15:34:28.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.260+0000 7fab2b5ff700 1 -- 172.21.15.17:0/3959275964 wait complete. 2023-10-05T15:34:28.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 Processor -- start 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 -- start start 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24073910 0x7fab24198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24074ef0 0x7fab24199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 0x7fab241a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab241a08c0 con 0x7fab24108db0 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab241a0a00 con 0x7fab24073910 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.261+0000 7fab2b5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab241a0b90 con 0x7fab24074ef0 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 0x7fab241a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 0x7fab241a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49942/0 (socket says 172.21.15.17:49942) 2023-10-05T15:34:28.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 -- 172.21.15.17:0/890882493 learned_addr learned my addr 172.21.15.17:0/890882493 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab2939b700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24073910 0x7fab24198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab28b9a700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24074ef0 0x7fab24199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 -- 172.21.15.17:0/890882493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24074ef0 msgr2=0x7fab24199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24074ef0 0x7fab24199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 -- 172.21.15.17:0/890882493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24073910 msgr2=0x7fab24198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24073910 0x7fab24198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 -- 172.21.15.17:0/890882493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200095f0 con 0x7fab24108db0 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab28b9a700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24074ef0 0x7fab24199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab2939b700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24073910 0x7fab24198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.262+0000 7fab29b9c700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 0x7fab241a02f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab1c007ee0 tx=0x7fab1c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:28.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.263+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00ddd0 con 0x7fab24108db0 2023-10-05T15:34:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.263+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab1c00f040 con 0x7fab24108db0 2023-10-05T15:34:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.263+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab241a0e70 con 0x7fab24108db0 2023-10-05T15:34:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.263+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0047d0 con 0x7fab24108db0 2023-10-05T15:34:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.263+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab241a12f0 con 0x7fab24108db0 2023-10-05T15:34:28.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.264+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24107460 con 0x7fab24108db0 2023-10-05T15:34:28.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.268+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fab1c003f20 con 0x7fab24108db0 2023-10-05T15:34:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.269+0000 7fab1a7fc700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fab100a1550 0x7fab100a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.270+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fab1c0cc960 con 0x7fab24108db0 2023-10-05T15:34:28.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.270+0000 7fab2939b700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fab100a1550 0x7fab100a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.271+0000 7fab2939b700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fab100a1550 0x7fab100a3a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b5c0 tx=0x7fab20005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.273+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fab1c0963c0 con 0x7fab24108db0 2023-10-05T15:34:28.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:28 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] up:boot 2023-10-05T15:34:28.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:28 smithi017 ceph-mon[129107]: fsmap 12 up:standby 2023-10-05T15:34:28.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:28 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:34:28.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:28 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/232936789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:28.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.492+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab2410e7e0 con 0x7fab24108db0 2023-10-05T15:34:28.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.493+0000 7fab1a7fc700 1 -- 172.21.15.17:0/890882493 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18376 (secure 0 0 0) 0x7fab1c0999e0 con 0x7fab24108db0 2023-10-05T15:34:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:28.495 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:33:36.303724+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:28.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fab100a1550 msgr2=0x7fab100a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fab100a1550 0x7fab100a3a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b5c0 tx=0x7fab20005fb0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 msgr2=0x7fab241a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 0x7fab241a02f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab1c007ee0 tx=0x7fab1c00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 shutdown_connections 2023-10-05T15:34:28.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fab100a1550 0x7fab100a3a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24108db0 0x7fab241a02f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab24073910 0x7fab24198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 --2- 172.21.15.17:0/890882493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab24074ef0 0x7fab24199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 >> 172.21.15.17:0/890882493 conn(0x7fab240fc420 msgr2=0x7fab240fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:28.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 shutdown_connections 2023-10-05T15:34:28.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.495+0000 7fab2b5ff700 1 -- 172.21.15.17:0/890882493 wait complete. 2023-10-05T15:34:28.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-05T15:34:28.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:34:28.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:28 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] up:boot 2023-10-05T15:34:28.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:28 smithi167 ceph-mon[133366]: fsmap 12 up:standby 2023-10-05T15:34:28.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:28 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:34:28.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:28 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/232936789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:28.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:28 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] up:boot 2023-10-05T15:34:28.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:28 smithi079 ceph-mon[132936]: fsmap 12 up:standby 2023-10-05T15:34:28.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:28 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-05T15:34:28.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:28 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/232936789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 -- 172.21.15.17:0/3806661133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 msgr2=0x7f6cc8073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3806661133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8073d30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009990 tx=0x7f6cbc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 -- 172.21.15.17:0/3806661133 shutdown_connections 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3806661133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc8108dc0 0x7f6cc810b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3806661133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 0x7f6cc80732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3806661133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8073d30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 -- 172.21.15.17:0/3806661133 >> 172.21.15.17:0/3806661133 conn(0x7f6cc80fc460 msgr2=0x7f6cc80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 -- 172.21.15.17:0/3806661133 shutdown_connections 2023-10-05T15:34:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.733+0000 7f6cccfff700 1 -- 172.21.15.17:0/3806661133 wait complete. 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.734+0000 7f6cccfff700 1 Processor -- start 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.734+0000 7f6cccfff700 1 -- start start 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cccfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cccfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 0x7f6cc8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cccfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc8108dc0 0x7f6cc81a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cccfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81a08c0 con 0x7f6cc80738b0 2023-10-05T15:34:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cccfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81a0a00 con 0x7f6cc8108dc0 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cccfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81a0b90 con 0x7f6cc8074e90 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49964/0 (socket says 172.21.15.17:49964) 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 -- 172.21.15.17:0/3432834170 learned_addr learned my addr 172.21.15.17:0/3432834170 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc5d9b700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 0x7f6cc8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc6d9d700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc8108dc0 0x7f6cc81a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 -- 172.21.15.17:0/3432834170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 msgr2=0x7f6cc8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 0x7f6cc8199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 -- 172.21.15.17:0/3432834170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc8108dc0 msgr2=0x7f6cc81a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc8108dc0 0x7f6cc81a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc659c700 1 -- 172.21.15.17:0/3432834170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0009c40 con 0x7f6cc80738b0 2023-10-05T15:34:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.735+0000 7f6cc5d9b700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 0x7f6cc8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.736+0000 7f6cc659c700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8198d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800e9a0 tx=0x7f6cb800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.736+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8009790 con 0x7f6cc80738b0 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.736+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cb800ce50 con 0x7f6cc80738b0 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.736+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc0095f0 con 0x7f6cc80738b0 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.736+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8018420 con 0x7f6cc80738b0 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.736+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc81a1190 con 0x7f6cc80738b0 2023-10-05T15:34:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.737+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc81074c0 con 0x7f6cc80738b0 2023-10-05T15:34:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.739+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6cb8010430 con 0x7f6cc80738b0 2023-10-05T15:34:28.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.741+0000 7f6cb77fe700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6cb00a1500 0x7f6cb00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.742+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6cb8014070 con 0x7f6cc80738b0 2023-10-05T15:34:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.742+0000 7f6cc5d9b700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6cb00a1500 0x7f6cb00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:28.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.743+0000 7f6cc5d9b700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6cb00a1500 0x7f6cb00a39c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc006010 tx=0x7f6cbc00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.746+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6cb8052100 con 0x7f6cc80738b0 2023-10-05T15:34:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.968+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cc80008d0 con 0x7f6cc80738b0 2023-10-05T15:34:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.968+0000 7f6cb77fe700 1 -- 172.21.15.17:0/3432834170 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cb8096440 con 0x7f6cc80738b0 2023-10-05T15:34:28.970 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:34:28.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6cb00a1500 msgr2=0x7f6cb00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6cb00a1500 0x7f6cb00a39c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc006010 tx=0x7f6cbc00b260 comp rx=0 tx=0).stop 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 msgr2=0x7f6cc8198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8198d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800e9a0 tx=0x7f6cb800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 shutdown_connections 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6cb00a1500 0x7f6cb00a39c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc8108dc0 0x7f6cc81a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cc80738b0 0x7f6cc8198d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 --2- 172.21.15.17:0/3432834170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc8074e90 0x7f6cc8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 >> 172.21.15.17:0/3432834170 conn(0x7f6cc80fc460 msgr2=0x7f6cc80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 shutdown_connections 2023-10-05T15:34:28.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:28.971+0000 7f6cccfff700 1 -- 172.21.15.17:0/3432834170 wait complete. 2023-10-05T15:34:28.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-05T15:34:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 -- 172.21.15.17:0/3013500112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102a40 msgr2=0x7f2618109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 --2- 172.21.15.17:0/3013500112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102a40 0x7f2618109360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2610009f90 tx=0x7f261000b330 comp rx=0 tx=0).stop 2023-10-05T15:34:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 -- 172.21.15.17:0/3013500112 shutdown_connections 2023-10-05T15:34:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 --2- 172.21.15.17:0/3013500112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102a40 0x7f2618109360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 --2- 172.21.15.17:0/3013500112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f26181012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 --2- 172.21.15.17:0/3013500112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2618102080 0x7f2618102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 -- 172.21.15.17:0/3013500112 >> 172.21.15.17:0/3013500112 conn(0x7f26180fc420 msgr2=0x7f26180fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:29.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 -- 172.21.15.17:0/3013500112 shutdown_connections 2023-10-05T15:34:29.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.202+0000 7f261e5ff700 1 -- 172.21.15.17:0/3013500112 wait complete. 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.203+0000 7f261e5ff700 1 Processor -- start 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.203+0000 7f261e5ff700 1 -- start start 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261e5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f2618196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261e5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102080 0x7f26181971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261e5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2618102a40 0x7f261819e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261e5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261819e7a0 con 0x7f2618100ea0 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261e5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261819e910 con 0x7f2618102080 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261e5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261819ead0 con 0x7f2618102a40 2023-10-05T15:34:29.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f2618196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f2618196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49986/0 (socket says 172.21.15.17:49986) 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 -- 172.21.15.17:0/193739774 learned_addr learned my addr 172.21.15.17:0/193739774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f26177fe700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102080 0x7f26181971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f261cb9c700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2618102a40 0x7f261819e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 -- 172.21.15.17:0/193739774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2618102a40 msgr2=0x7f261819e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2618102a40 0x7f261819e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 -- 172.21.15.17:0/193739774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102080 msgr2=0x7f26181971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102080 0x7f26181971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 -- 172.21.15.17:0/193739774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080095f0 con 0x7f2618100ea0 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.204+0000 7f2617fff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f2618196c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f260800ebf0 tx=0x7f260800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.205+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608009a10 con 0x7f2618100ea0 2023-10-05T15:34:29.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.205+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f260800cc90 con 0x7f2618100ea0 2023-10-05T15:34:29.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.205+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608018680 con 0x7f2618100ea0 2023-10-05T15:34:29.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.205+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2610009c40 con 0x7f2618100ea0 2023-10-05T15:34:29.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.205+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261819f0e0 con 0x7f2618100ea0 2023-10-05T15:34:29.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.206+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261810c610 con 0x7f2618100ea0 2023-10-05T15:34:29.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.208+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2608010430 con 0x7f2618100ea0 2023-10-05T15:34:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.209+0000 7f26157fa700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26000a1550 0x7f26000a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.209+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2608014070 con 0x7f2618100ea0 2023-10-05T15:34:29.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.210+0000 7f26177fe700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26000a1550 0x7f26000a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.210+0000 7f26177fe700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26000a1550 0x7f26000a3a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2618100bc0 tx=0x7f260c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:29.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.216+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f26080968b0 con 0x7f2618100ea0 2023-10-05T15:34:29.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:29 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/890882493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:29.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:29 smithi017 ceph-mon[129107]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:29.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:29 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3432834170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:29.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.461+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f261819f270 con 0x7f2618100ea0 2023-10-05T15:34:29.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.461+0000 7f26157fa700 1 -- 172.21.15.17:0/193739774 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2608099ed0 con 0x7f2618100ea0 2023-10-05T15:34:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:29.463 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-10-05T15:34:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:34:29.463 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-10-05T15:34:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-10-05T15:34:29.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:34:29.464 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26000a1550 msgr2=0x7f26000a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26000a1550 0x7f26000a3a10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2618100bc0 tx=0x7f260c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 msgr2=0x7f2618196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f2618196c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f260800ebf0 tx=0x7f260800ef00 comp rx=0 tx=0).stop 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 shutdown_connections 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26000a1550 0x7f26000a3a10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2618102a40 0x7f261819e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2618100ea0 0x7f2618196c60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 --2- 172.21.15.17:0/193739774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2618102080 0x7f26181971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 >> 172.21.15.17:0/193739774 conn(0x7f26180fc420 msgr2=0x7f26180fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 shutdown_connections 2023-10-05T15:34:29.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.464+0000 7f261e5ff700 1 -- 172.21.15.17:0/193739774 wait complete. 2023-10-05T15:34:29.485 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-05T15:34:29.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-05T15:34:29.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:29 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/890882493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:29.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:29 smithi167 ceph-mon[133366]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:29.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:29 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3432834170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:29.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:29 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/890882493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:29.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:29 smithi079 ceph-mon[132936]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:29.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:29 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3432834170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 -- 172.21.15.17:0/4258777680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f129810d510 msgr2=0x7f129810f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 --2- 172.21.15.17:0/4258777680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f129810d510 0x7f129810f900 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f129000b0a0 tx=0x7f129000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 -- 172.21.15.17:0/4258777680 shutdown_connections 2023-10-05T15:34:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 --2- 172.21.15.17:0/4258777680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f129810d510 0x7f129810f900 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 --2- 172.21.15.17:0/4258777680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1298074ef0 0x7f1298073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 --2- 172.21.15.17:0/4258777680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1298073910 0x7f1298073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 -- 172.21.15.17:0/4258777680 >> 172.21.15.17:0/4258777680 conn(0x7f12980fc4d0 msgr2=0x7f12980fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 -- 172.21.15.17:0/4258777680 shutdown_connections 2023-10-05T15:34:29.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.704+0000 7f129dfff700 1 -- 172.21.15.17:0/4258777680 wait complete. 2023-10-05T15:34:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.705+0000 7f129dfff700 1 Processor -- start 2023-10-05T15:34:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.705+0000 7f129dfff700 1 -- start start 2023-10-05T15:34:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f129dfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1298073910 0x7f129819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f129dfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 0x7f129819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f129dfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129810d510 0x7f12981a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f129dfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12981a4d60 con 0x7f1298074ef0 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f129dfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12981a4ea0 con 0x7f1298073910 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f129dfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12981a5030 con 0x7f129810d510 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 0x7f129819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 0x7f129819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49996/0 (socket says 172.21.15.17:49996) 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 -- 172.21.15.17:0/3740395915 learned_addr learned my addr 172.21.15.17:0/3740395915 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1297fff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129810d510 0x7f12981a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f12977fe700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1298073910 0x7f129819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 -- 172.21.15.17:0/3740395915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129810d510 msgr2=0x7f12981a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129810d510 0x7f12981a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 -- 172.21.15.17:0/3740395915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1298073910 msgr2=0x7f129819d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1298073910 0x7f129819d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.706+0000 7f1296ffd700 1 -- 172.21.15.17:0/3740395915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290009d00 con 0x7f1298074ef0 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.707+0000 7f1296ffd700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 0x7f129819d720 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f128c00d980 tx=0x7f128c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.707+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c004020 con 0x7f1298074ef0 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.707+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f128c00f690 con 0x7f1298074ef0 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.707+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12981a5310 con 0x7f1298074ef0 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.707+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c0039e0 con 0x7f1298074ef0 2023-10-05T15:34:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.707+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12981a5870 con 0x7f1298074ef0 2023-10-05T15:34:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.708+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1298103060 con 0x7f1298074ef0 2023-10-05T15:34:29.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.710+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f128c00f800 con 0x7f1298074ef0 2023-10-05T15:34:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.712+0000 7f1294ff9700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12800a1500 0x7f12800a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.713+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f128c0cc460 con 0x7f1298074ef0 2023-10-05T15:34:29.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.713+0000 7f12977fe700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12800a1500 0x7f12800a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:29.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.713+0000 7f12977fe700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12800a1500 0x7f12800a39c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1288009c60 tx=0x7f1288009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.717+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f128c095ec0 con 0x7f1298074ef0 2023-10-05T15:34:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:29.941+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1298112b90 con 0x7f1298074ef0 2023-10-05T15:34:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.559+0000 7f1294ff9700 1 -- 172.21.15.17:0/3740395915 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f128c0994e0 con 0x7f1298074ef0 2023-10-05T15:34:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12800a1500 msgr2=0x7f12800a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:30.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12800a1500 0x7f12800a39c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1288009c60 tx=0x7f1288009260 comp rx=0 tx=0).stop 2023-10-05T15:34:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 msgr2=0x7f129819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 0x7f129819d720 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f128c00d980 tx=0x7f128c00dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 shutdown_connections 2023-10-05T15:34:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12800a1500 0x7f12800a39c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f129810d510 0x7f12981a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1298073910 0x7f129819d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 --2- 172.21.15.17:0/3740395915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1298074ef0 0x7f129819d720 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 >> 172.21.15.17:0/3740395915 conn(0x7f12980fc4d0 msgr2=0x7f12980fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.562+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 shutdown_connections 2023-10-05T15:34:30.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.563+0000 7f129dfff700 1 -- 172.21.15.17:0/3740395915 wait complete. 2023-10-05T15:34:30.568 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-10-05T15:34:30.588 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.812+0000 7f36a65ff700 1 -- 172.21.15.17:0/1817341438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a0073910 msgr2=0x7f36a0073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.812+0000 7f36a65ff700 1 --2- 172.21.15.17:0/1817341438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a0073910 0x7f36a0073d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3694009990 tx=0x7f3694009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 -- 172.21.15.17:0/1817341438 shutdown_connections 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 --2- 172.21.15.17:0/1817341438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a010d4c0 0x7f36a010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 --2- 172.21.15.17:0/1817341438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0074ef0 0x7f36a0073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 --2- 172.21.15.17:0/1817341438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a0073910 0x7f36a0073d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 -- 172.21.15.17:0/1817341438 >> 172.21.15.17:0/1817341438 conn(0x7f36a00fc460 msgr2=0x7f36a00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 -- 172.21.15.17:0/1817341438 shutdown_connections 2023-10-05T15:34:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.813+0000 7f36a65ff700 1 -- 172.21.15.17:0/1817341438 wait complete. 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 Processor -- start 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 -- start start 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 0x7f36a019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a0074ef0 0x7f36a019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a010d4c0 0x7f36a01a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01a4cd0 con 0x7f36a0073910 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.814+0000 7f36a65ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01a4e10 con 0x7f36a010d4c0 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f36a65ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01a4fa0 con 0x7f36a0074ef0 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 0x7f36a019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:30.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 0x7f36a019d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50016/0 (socket says 172.21.15.17:50016) 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 -- 172.21.15.17:0/2619716365 learned_addr learned my addr 172.21.15.17:0/2619716365 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369f7fe700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a0074ef0 0x7f36a019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f36a4b9c700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a010d4c0 0x7f36a01a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 -- 172.21.15.17:0/2619716365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a0074ef0 msgr2=0x7f36a019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a0074ef0 0x7f36a019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 -- 172.21.15.17:0/2619716365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a010d4c0 msgr2=0x7f36a01a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a010d4c0 0x7f36a01a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 -- 172.21.15.17:0/2619716365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940095f0 con 0x7f36a0073910 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f36a4b9c700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a010d4c0 0x7f36a01a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.815+0000 7f369ffff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 0x7f36a019d150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f369000e9a0 tx=0x7f369000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.816+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690009790 con 0x7f36a0073910 2023-10-05T15:34:30.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.816+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f369000cbd0 con 0x7f36a0073910 2023-10-05T15:34:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.816+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a01a5280 con 0x7f36a0073910 2023-10-05T15:34:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.816+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690018680 con 0x7f36a0073910 2023-10-05T15:34:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.816+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a01a57e0 con 0x7f36a0073910 2023-10-05T15:34:30.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.817+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a0103010 con 0x7f36a0073910 2023-10-05T15:34:30.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.820+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f369000cd40 con 0x7f36a0073910 2023-10-05T15:34:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.821+0000 7f369d7fa700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36880a1500 0x7f36880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.821+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f3690014070 con 0x7f36a0073910 2023-10-05T15:34:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.821+0000 7f369f7fe700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36880a1500 0x7f36880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:30.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.822+0000 7f369f7fe700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36880a1500 0x7f36880a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3694005910 tx=0x7f369400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:30.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:30.824+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3690096930 con 0x7f36a0073910 2023-10-05T15:34:30.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:30 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/193739774' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-05T15:34:30.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:30.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:30 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/193739774' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-05T15:34:30.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:30.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:30 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/193739774' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-05T15:34:30.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.052+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f36a0112be0 con 0x7f36a0073910 2023-10-05T15:34:31.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.582+0000 7f369d7fa700 1 -- 172.21.15.17:0/2619716365 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v84) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3690099f50 con 0x7f36a0073910 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.585+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36880a1500 msgr2=0x7f36880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.585+0000 7f36a65ff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36880a1500 0x7f36880a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3694005910 tx=0x7f369400b260 comp rx=0 tx=0).stop 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.585+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 msgr2=0x7f36a019d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.585+0000 7f36a65ff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 0x7f36a019d150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f369000e9a0 tx=0x7f369000ecb0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 shutdown_connections 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36880a1500 0x7f36880a39c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a010d4c0 0x7f36a01a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a0073910 0x7f36a019d150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 --2- 172.21.15.17:0/2619716365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a0074ef0 0x7f36a019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 >> 172.21.15.17:0/2619716365 conn(0x7f36a00fc460 msgr2=0x7f36a00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 shutdown_connections 2023-10-05T15:34:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.586+0000 7f36a65ff700 1 -- 172.21.15.17:0/2619716365 wait complete. 2023-10-05T15:34:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-10-05T15:34:31.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-05T15:34:31.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 -- 172.21.15.17:0/1586113276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 msgr2=0x7f88ac1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:31.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 --2- 172.21.15.17:0/1586113276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac1024f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009990 tx=0x7f88a0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 -- 172.21.15.17:0/1586113276 shutdown_connections 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 --2- 172.21.15.17:0/1586113276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac102a30 0x7f88ac109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 --2- 172.21.15.17:0/1586113276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac100e90 0x7f88ac1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 --2- 172.21.15.17:0/1586113276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac1024f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.829+0000 7f88b19ff700 1 -- 172.21.15.17:0/1586113276 >> 172.21.15.17:0/1586113276 conn(0x7f88ac0fc430 msgr2=0x7f88ac0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.830+0000 7f88b19ff700 1 -- 172.21.15.17:0/1586113276 shutdown_connections 2023-10-05T15:34:31.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.830+0000 7f88b19ff700 1 -- 172.21.15.17:0/1586113276 wait complete. 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.830+0000 7f88b19ff700 1 Processor -- start 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 -- start start 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac100e90 0x7f88ac074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac102a30 0x7f88ac0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac073f80 con 0x7f88ac102070 2023-10-05T15:34:31.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0740f0 con 0x7f88ac102a30 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88b19ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac1a0bb0 con 0x7f88ac100e90 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88aa7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88aa7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50032/0 (socket says 172.21.15.17:50032) 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88aa7fc700 1 -- 172.21.15.17:0/893713395 learned_addr learned my addr 172.21.15.17:0/893713395 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88ab7fe700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac102a30 0x7f88ac0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.831+0000 7f88aaffd700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac100e90 0x7f88ac074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aa7fc700 1 -- 172.21.15.17:0/893713395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac100e90 msgr2=0x7f88ac074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aa7fc700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac100e90 0x7f88ac074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aa7fc700 1 -- 172.21.15.17:0/893713395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac102a30 msgr2=0x7f88ac0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aa7fc700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac102a30 0x7f88ac0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:31.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aa7fc700 1 -- 172.21.15.17:0/893713395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00095f0 con 0x7f88ac102070 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aaffd700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac100e90 0x7f88ac074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88aa7fc700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac0732a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005910 tx=0x7f88a0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a001d070 con 0x7f88ac102070 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac1a0e30 con 0x7f88ac102070 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88a0022470 con 0x7f88ac102070 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000f6c0 con 0x7f88ac102070 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.832+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac1a11f0 con 0x7f88ac102070 2023-10-05T15:34:31.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.834+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac107f20 con 0x7f88ac102070 2023-10-05T15:34:31.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.836+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f88a0022850 con 0x7f88ac102070 2023-10-05T15:34:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.837+0000 7f88b09fd700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88940a1480 0x7f88940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.837+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f88a00ce950 con 0x7f88ac102070 2023-10-05T15:34:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.837+0000 7f88aaffd700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88940a1480 0x7f88940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:31.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.838+0000 7f88aaffd700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88940a1480 0x7f88940a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88ac101be0 tx=0x7f889c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:31.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:31.840+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f88a0098150 con 0x7f88ac102070 2023-10-05T15:34:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3740395915' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-05T15:34:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3740395915' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-05T15:34:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: osdmap e83: 12 total, 12 up, 12 in 2023-10-05T15:34:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: pgmap v296: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3740395915' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-05T15:34:31.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3740395915' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: osdmap e83: 12 total, 12 up, 12 in 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: pgmap v296: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3740395915' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-05T15:34:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3740395915' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-05T15:34:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: osdmap e83: 12 total, 12 up, 12 in 2023-10-05T15:34:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: pgmap v296: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.116+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f88ac02d390 con 0x7f88ac102070 2023-10-05T15:34:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.625+0000 7f88b09fd700 1 -- 172.21.15.17:0/893713395 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f88a009b770 con 0x7f88ac102070 2023-10-05T15:34:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88940a1480 msgr2=0x7f88940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88940a1480 0x7f88940a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88ac101be0 tx=0x7f889c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 msgr2=0x7f88ac0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac0732a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005910 tx=0x7f88a0005740 comp rx=0 tx=0).stop 2023-10-05T15:34:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 shutdown_connections 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88940a1480 0x7f88940a3940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac102a30 0x7f88ac0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac100e90 0x7f88ac074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 --2- 172.21.15.17:0/893713395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ac102070 0x7f88ac0732a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 >> 172.21.15.17:0/893713395 conn(0x7f88ac0fc430 msgr2=0x7f88ac0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 shutdown_connections 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.628+0000 7f88b19ff700 1 -- 172.21.15.17:0/893713395 wait complete. 2023-10-05T15:34:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2023-10-05T15:34:32.653 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-05T15:34:32.653 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-05T15:34:32.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2619716365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2619716365' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: osdmap e84: 12 total, 12 up, 12 in 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/893713395' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-05T15:34:32.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:32 smithi079 ceph-mon[132936]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-05T15:34:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 -- 172.21.15.17:0/962881799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102a40 msgr2=0x7f52ac109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 --2- 172.21.15.17:0/962881799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102a40 0x7f52ac109360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52a400b0a0 tx=0x7f52a400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 -- 172.21.15.17:0/962881799 shutdown_connections 2023-10-05T15:34:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 --2- 172.21.15.17:0/962881799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102a40 0x7f52ac109360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 --2- 172.21.15.17:0/962881799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 --2- 172.21.15.17:0/962881799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac102080 0x7f52ac102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 -- 172.21.15.17:0/962881799 >> 172.21.15.17:0/962881799 conn(0x7f52ac0fc460 msgr2=0x7f52ac0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:32.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.870+0000 7f52b1fff700 1 -- 172.21.15.17:0/962881799 shutdown_connections 2023-10-05T15:34:32.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.871+0000 7f52b1fff700 1 -- 172.21.15.17:0/962881799 wait complete. 2023-10-05T15:34:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.871+0000 7f52b1fff700 1 Processor -- start 2023-10-05T15:34:32.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 -- start start 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102080 0x7f52ac199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac102a40 0x7f52ac1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1a0940 con 0x7f52ac102080 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1a0a80 con 0x7f52ac100ea0 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52b1fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac1a0c10 con 0x7f52ac102a40 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52aaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102080 0x7f52ac199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52ab7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39630/0 (socket says 172.21.15.17:39630) 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52ab7fe700 1 -- 172.21.15.17:0/3168264136 learned_addr learned my addr 172.21.15.17:0/3168264136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.872+0000 7f52abfff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac102a40 0x7f52ac1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:32.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52ab7fe700 1 -- 172.21.15.17:0/3168264136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac102a40 msgr2=0x7f52ac1a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52ab7fe700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac102a40 0x7f52ac1a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52ab7fe700 1 -- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102080 msgr2=0x7f52ac199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52ab7fe700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102080 0x7f52ac199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52ab7fe700 1 -- 172.21.15.17:0/3168264136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c009520 con 0x7f52ac100ea0 2023-10-05T15:34:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52aaffd700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102080 0x7f52ac199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:32.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52ab7fe700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac198dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f529c00ea50 tx=0x7f529c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00cbd0 con 0x7f52ac100ea0 2023-10-05T15:34:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f529c00cd30 con 0x7f52ac100ea0 2023-10-05T15:34:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c018680 con 0x7f52ac100ea0 2023-10-05T15:34:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.873+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a4009d00 con 0x7f52ac100ea0 2023-10-05T15:34:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.874+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ac1a11c0 con 0x7f52ac100ea0 2023-10-05T15:34:32.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.874+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ac1933b0 con 0x7f52ac100ea0 2023-10-05T15:34:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.877+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f529c010430 con 0x7f52ac100ea0 2023-10-05T15:34:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.878+0000 7f52a8ff9700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52940a1480 0x7f52940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.878+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f529c014070 con 0x7f52ac100ea0 2023-10-05T15:34:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.878+0000 7f52aaffd700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52940a1480 0x7f52940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.879+0000 7f52aaffd700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52940a1480 0x7f52940a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52ac100bc0 tx=0x7f52a0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:32.880+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f529c096c10 con 0x7f52ac100ea0 2023-10-05T15:34:32.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2619716365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2619716365' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: osdmap e84: 12 total, 12 up, 12 in 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/893713395' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-05T15:34:32.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:32 smithi017 ceph-mon[129107]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-05T15:34:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2619716365' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-05T15:34:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:34:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2619716365' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-05T15:34:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: osdmap e84: 12 total, 12 up, 12 in 2023-10-05T15:34:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:34:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:34:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/893713395' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-05T15:34:33.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:32 smithi167 ceph-mon[133366]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-05T15:34:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.115+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f52ac10c850 con 0x7f52ac100ea0 2023-10-05T15:34:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.593+0000 7f52a8ff9700 1 -- 172.21.15.17:0/3168264136 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v86) v1 ==== 157+0+0 (secure 0 0 0) 0x7f529c09a230 con 0x7f52ac100ea0 2023-10-05T15:34:33.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.595+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52940a1480 msgr2=0x7f52940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.595+0000 7f52b1fff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52940a1480 0x7f52940a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f52ac100bc0 tx=0x7f52a0009260 comp rx=0 tx=0).stop 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 msgr2=0x7f52ac198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac198dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f529c00ea50 tx=0x7f529c00ed60 comp rx=0 tx=0).stop 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 shutdown_connections 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52940a1480 0x7f52940a3940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac102a40 0x7f52ac1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ac100ea0 0x7f52ac198dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 --2- 172.21.15.17:0/3168264136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ac102080 0x7f52ac199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 >> 172.21.15.17:0/3168264136 conn(0x7f52ac0fc460 msgr2=0x7f52ac1079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 shutdown_connections 2023-10-05T15:34:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.596+0000 7f52b1fff700 1 -- 172.21.15.17:0/3168264136 wait complete. 2023-10-05T15:34:33.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-05T15:34:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 -- 172.21.15.17:0/1629085271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 msgr2=0x7fdb5c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1629085271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c1012b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0098f0 tx=0x7fdb4c009c00 comp rx=0 tx=0).stop 2023-10-05T15:34:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 -- 172.21.15.17:0/1629085271 shutdown_connections 2023-10-05T15:34:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1629085271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102a30 0x7fdb5c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1629085271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c1012b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1629085271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c102070 0x7fdb5c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 -- 172.21.15.17:0/1629085271 >> 172.21.15.17:0/1629085271 conn(0x7fdb5c0fc450 msgr2=0x7fdb5c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 -- 172.21.15.17:0/1629085271 shutdown_connections 2023-10-05T15:34:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.843+0000 7fdb617ff700 1 -- 172.21.15.17:0/1629085271 wait complete. 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.844+0000 7fdb617ff700 1 Processor -- start 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.844+0000 7fdb617ff700 1 -- start start 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb617ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb617ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102070 0x7fdb5c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb617ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c102a30 0x7fdb5c1a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb617ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1a0810 con 0x7fdb5c100e90 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb617ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1a0980 con 0x7fdb5c102a30 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb617ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c1a0b40 con 0x7fdb5c102070 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44354/0 (socket says 172.21.15.17:44354) 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5affd700 1 -- 172.21.15.17:0/1070871733 learned_addr learned my addr 172.21.15.17:0/1070871733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5a7fc700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102070 0x7fdb5c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5b7fe700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c102a30 0x7fdb5c1a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5a7fc700 1 -- 172.21.15.17:0/1070871733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c102a30 msgr2=0x7fdb5c1a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5a7fc700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c102a30 0x7fdb5c1a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5a7fc700 1 -- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 msgr2=0x7fdb5c198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5a7fc700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.845+0000 7fdb5a7fc700 1 -- 172.21.15.17:0/1070871733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500095f0 con 0x7fdb5c102070 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.846+0000 7fdb5a7fc700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102070 0x7fdb5c1991e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb50005fd0 tx=0x7fdb5000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.846+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000cbd0 con 0x7fdb5c102070 2023-10-05T15:34:33.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.846+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5000cd30 con 0x7fdb5c102070 2023-10-05T15:34:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.846+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c009520 con 0x7fdb5c102070 2023-10-05T15:34:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.846+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50018680 con 0x7fdb5c102070 2023-10-05T15:34:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.846+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5c1a11a0 con 0x7fdb5c102070 2023-10-05T15:34:33.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.847+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5c10c5b0 con 0x7fdb5c102070 2023-10-05T15:34:33.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.849+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdb50010430 con 0x7fdb5c102070 2023-10-05T15:34:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.851+0000 7fdb43fff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb440a1520 0x7fdb440a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:33.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.851+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8205+0+0 (secure 0 0 0) 0x7fdb50014070 con 0x7fdb5c102070 2023-10-05T15:34:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.851+0000 7fdb5affd700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb440a1520 0x7fdb440a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.852+0000 7fdb5affd700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb440a1520 0x7fdb440a39e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009fd0 tx=0x7fdb4c019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: pgmap v298: 97 pgs: 12 creating+peering, 9 active+clean, 76 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: osdmap e85: 12 total, 12 up, 12 in 2023-10-05T15:34:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/893713395' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-05T15:34:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-05T15:34:33.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-05T15:34:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3168264136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:34:33.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:33 smithi079 ceph-mon[132936]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:34:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:33.855+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdb500967c0 con 0x7fdb5c102070 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: pgmap v298: 97 pgs: 12 creating+peering, 9 active+clean, 76 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: osdmap e85: 12 total, 12 up, 12 in 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/893713395' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3168264136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:34:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:33 smithi017 ceph-mon[129107]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:34:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: pgmap v298: 97 pgs: 12 creating+peering, 9 active+clean, 76 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-05T15:34:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: osdmap e85: 12 total, 12 up, 12 in 2023-10-05T15:34:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/893713395' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-05T15:34:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-05T15:34:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-05T15:34:34.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3168264136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:34:34.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:33 smithi167 ceph-mon[133366]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-05T15:34:34.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:34.110+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdb5c10c740 con 0x7fdb5c102070 2023-10-05T15:34:34.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-05T15:34:34.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: osdmap e86: 12 total, 12 up, 12 in 2023-10-05T15:34:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] up:active 2023-10-05T15:34:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1070871733' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:34:34.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:34 smithi079 ceph-mon[132936]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:34:34.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-05T15:34:34.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: osdmap e86: 12 total, 12 up, 12 in 2023-10-05T15:34:34.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] up:active 2023-10-05T15:34:34.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:34.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:34.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1070871733' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:34:34.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:34 smithi017 ceph-mon[129107]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:34:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-05T15:34:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: osdmap e86: 12 total, 12 up, 12 in 2023-10-05T15:34:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] up:active 2023-10-05T15:34:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:35.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1070871733' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:34:35.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:34 smithi167 ceph-mon[133366]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-05T15:34:35.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.643+0000 7fdb43fff700 1 -- 172.21.15.17:0/1070871733 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v88) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdb500106e0 con 0x7fdb5c102070 2023-10-05T15:34:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.651+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb440a1520 msgr2=0x7fdb440a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.651+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb440a1520 0x7fdb440a39e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009fd0 tx=0x7fdb4c019040 comp rx=0 tx=0).stop 2023-10-05T15:34:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.651+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102070 msgr2=0x7fdb5c1991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:35.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.651+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102070 0x7fdb5c1991e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb50005fd0 tx=0x7fdb5000ee70 comp rx=0 tx=0).stop 2023-10-05T15:34:35.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.653+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 shutdown_connections 2023-10-05T15:34:35.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.653+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb440a1520 0x7fdb440a39e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.653+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb5c102a30 0x7fdb5c1a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.653+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb5c100e90 0x7fdb5c198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.653+0000 7fdb617ff700 1 --2- 172.21.15.17:0/1070871733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb5c102070 0x7fdb5c1991e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.653+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 >> 172.21.15.17:0/1070871733 conn(0x7fdb5c0fc450 msgr2=0x7fdb5c0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.654+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 shutdown_connections 2023-10-05T15:34:35.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.654+0000 7fdb617ff700 1 -- 172.21.15.17:0/1070871733 wait complete. 2023-10-05T15:34:35.657 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' created 2023-10-05T15:34:35.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-05T15:34:35.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: pgmap v301: 97 pgs: 12 creating+peering, 58 active+clean, 27 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: Cluster is now healthy 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: osdmap e87: 12 total, 12 up, 12 in 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:35 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 -- 172.21.15.17:0/2056387773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70100e90 msgr2=0x7fde701012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:35.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 --2- 172.21.15.17:0/2056387773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70100e90 0x7fde701012b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde600098f0 tx=0x7fde60009c00 comp rx=0 tx=0).stop 2023-10-05T15:34:35.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 -- 172.21.15.17:0/2056387773 shutdown_connections 2023-10-05T15:34:35.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 --2- 172.21.15.17:0/2056387773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70102a30 0x7fde70109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 --2- 172.21.15.17:0/2056387773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70100e90 0x7fde701012b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 --2- 172.21.15.17:0/2056387773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde70102070 0x7fde701024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 -- 172.21.15.17:0/2056387773 >> 172.21.15.17:0/2056387773 conn(0x7fde700fc430 msgr2=0x7fde700fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:35.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 -- 172.21.15.17:0/2056387773 shutdown_connections 2023-10-05T15:34:35.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.891+0000 7fde75fff700 1 -- 172.21.15.17:0/2056387773 wait complete. 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 Processor -- start 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 -- start start 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 0x7fde70198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde70102070 0x7fde701992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 0x7fde701a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde701a0930 con 0x7fde70100e90 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde701a0a70 con 0x7fde70102a30 2023-10-05T15:34:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.893+0000 7fde75fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde701a0c00 con 0x7fde70102070 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 0x7fde70198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 0x7fde701a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 0x7fde701a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57186/0 (socket says 172.21.15.17:57186) 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6ffff700 1 -- 172.21.15.17:0/948139843 learned_addr learned my addr 172.21.15.17:0/948139843 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 0x7fde70198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44364/0 (socket says 172.21.15.17:44364) 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6effd700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde70102070 0x7fde701992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 -- 172.21.15.17:0/948139843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde70102070 msgr2=0x7fde701992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde70102070 0x7fde701992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 -- 172.21.15.17:0/948139843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 msgr2=0x7fde701a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 0x7fde701a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 -- 172.21.15.17:0/948139843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68009c40 con 0x7fde70100e90 2023-10-05T15:34:35.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6ffff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 0x7fde701a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:35.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.894+0000 7fde6f7fe700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 0x7fde70198db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde60000c00 tx=0x7fde6000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:35.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.895+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6001c070 con 0x7fde70100e90 2023-10-05T15:34:35.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.895+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde6000f7b0 con 0x7fde70100e90 2023-10-05T15:34:35.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.895+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde60009520 con 0x7fde70100e90 2023-10-05T15:34:35.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.895+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde600038e0 con 0x7fde70100e90 2023-10-05T15:34:35.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.895+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde701a1170 con 0x7fde70100e90 2023-10-05T15:34:35.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.896+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde701933f0 con 0x7fde70100e90 2023-10-05T15:34:35.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.898+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fde60020030 con 0x7fde70100e90 2023-10-05T15:34:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.899+0000 7fde6cff9700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde580a1500 0x7fde580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.899+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fde600ce0a0 con 0x7fde70100e90 2023-10-05T15:34:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.900+0000 7fde6effd700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde580a1500 0x7fde580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.900+0000 7fde6effd700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde580a1500 0x7fde580a39c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde70100bb0 tx=0x7fde64009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:35.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:35.902+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fde60097560 con 0x7fde70100e90 2023-10-05T15:34:35.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: pgmap v301: 97 pgs: 12 creating+peering, 58 active+clean, 27 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: Cluster is now healthy 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: osdmap e87: 12 total, 12 up, 12 in 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:35.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:35 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: pgmap v301: 97 pgs: 12 creating+peering, 58 active+clean, 27 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:34:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-10-05T15:34:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: Cluster is now healthy 2023-10-05T15:34:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: osdmap e87: 12 total, 12 up, 12 in 2023-10-05T15:34:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:35 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.115+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fde7002d250 con 0x7fde70100e90 2023-10-05T15:34:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.641+0000 7fde6cff9700 1 -- 172.21.15.17:0/948139843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7fde6009ab80 con 0x7fde70100e90 2023-10-05T15:34:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde580a1500 msgr2=0x7fde580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde580a1500 0x7fde580a39c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde70100bb0 tx=0x7fde64009310 comp rx=0 tx=0).stop 2023-10-05T15:34:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 msgr2=0x7fde70198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 0x7fde70198db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fde60000c00 tx=0x7fde6000b790 comp rx=0 tx=0).stop 2023-10-05T15:34:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 shutdown_connections 2023-10-05T15:34:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde580a1500 0x7fde580a39c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde70102a30 0x7fde701a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde70100e90 0x7fde70198db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 --2- 172.21.15.17:0/948139843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde70102070 0x7fde701992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.645+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 >> 172.21.15.17:0/948139843 conn(0x7fde700fc430 msgr2=0x7fde70107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.646+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 shutdown_connections 2023-10-05T15:34:36.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.646+0000 7fde75fff700 1 -- 172.21.15.17:0/948139843 wait complete. 2023-10-05T15:34:36.657 INFO:teuthology.orchestra.run.smithi017.stderr:set pool 4 allow_ec_overwrites to true 2023-10-05T15:34:36.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-05T15:34:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 -- 172.21.15.17:0/340325829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58102a30 msgr2=0x7fae58109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 --2- 172.21.15.17:0/340325829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58102a30 0x7fae58109350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae5000b0a0 tx=0x7fae5000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 -- 172.21.15.17:0/340325829 shutdown_connections 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 --2- 172.21.15.17:0/340325829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58102a30 0x7fae58109350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 --2- 172.21.15.17:0/340325829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae58100e90 0x7fae581012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 --2- 172.21.15.17:0/340325829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae58102070 0x7fae581024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.897+0000 7fae5fdff700 1 -- 172.21.15.17:0/340325829 >> 172.21.15.17:0/340325829 conn(0x7fae580fc430 msgr2=0x7fae580fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.898+0000 7fae5fdff700 1 -- 172.21.15.17:0/340325829 shutdown_connections 2023-10-05T15:34:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.898+0000 7fae5fdff700 1 -- 172.21.15.17:0/340325829 wait complete. 2023-10-05T15:34:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.898+0000 7fae5fdff700 1 Processor -- start 2023-10-05T15:34:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 -- start start 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 0x7fae58198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae58102070 0x7fae58199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae58102a30 0x7fae581a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae581a0950 con 0x7fae58100e90 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae581a0a90 con 0x7fae58102070 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5fdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae581a0c20 con 0x7fae58102a30 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5db9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 0x7fae58198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5db9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 0x7fae58198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44382/0 (socket says 172.21.15.17:44382) 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5db9b700 1 -- 172.21.15.17:0/4069073866 learned_addr learned my addr 172.21.15.17:0/4069073866 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.899+0000 7fae5d39a700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae58102070 0x7fae58199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5e39c700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae58102a30 0x7fae581a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5db9b700 1 -- 172.21.15.17:0/4069073866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae58102a30 msgr2=0x7fae581a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5db9b700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae58102a30 0x7fae581a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5db9b700 1 -- 172.21.15.17:0/4069073866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae58102070 msgr2=0x7fae58199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5db9b700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae58102070 0x7fae58199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5db9b700 1 -- 172.21.15.17:0/4069073866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50009d00 con 0x7fae58100e90 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5db9b700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 0x7fae58198dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e970 tx=0x7fae5400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54009790 con 0x7fae58100e90 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae5400eec0 con 0x7fae58100e90 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae581a0f00 con 0x7fae58100e90 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54003c10 con 0x7fae58100e90 2023-10-05T15:34:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.900+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae581a1320 con 0x7fae58100e90 2023-10-05T15:34:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.901+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5810c5b0 con 0x7fae58100e90 2023-10-05T15:34:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.903+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fae54003db0 con 0x7fae58100e90 2023-10-05T15:34:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.905+0000 7fae4effd700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fae440a1480 0x7fae440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.905+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fae54014070 con 0x7fae58100e90 2023-10-05T15:34:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.905+0000 7fae5d39a700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fae440a1480 0x7fae440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.905+0000 7fae5d39a700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fae440a1480 0x7fae440a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae58100bb0 tx=0x7fae4800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:36.909+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae540965d0 con 0x7fae58100e90 2023-10-05T15:34:36.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-05T15:34:36.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: osdmap e88: 12 total, 12 up, 12 in 2023-10-05T15:34:36.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:34:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:36.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:36 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/948139843' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-05T15:34:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-05T15:34:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: osdmap e88: 12 total, 12 up, 12 in 2023-10-05T15:34:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:37.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:37.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:34:37.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:37.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:36 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/948139843' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-05T15:34:37.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-05T15:34:37.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: osdmap e88: 12 total, 12 up, 12 in 2023-10-05T15:34:37.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:34:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:34:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:34:37.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:36 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/948139843' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-05T15:34:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.167+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fae581a1820 con 0x7fae58100e90 2023-10-05T15:34:37.604 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:34:37 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:34:37.218+0000 7f8dddca6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-05T15:34:37.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.724+0000 7fae4effd700 1 -- 172.21.15.17:0/4069073866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7fae54099bf0 con 0x7fae58100e90 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fae440a1480 msgr2=0x7fae440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fae440a1480 0x7fae440a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae58100bb0 tx=0x7fae4800b410 comp rx=0 tx=0).stop 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 msgr2=0x7fae58198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 0x7fae58198dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e970 tx=0x7fae5400ec80 comp rx=0 tx=0).stop 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 shutdown_connections 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fae440a1480 0x7fae440a3940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae58102a30 0x7fae581a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae58100e90 0x7fae58198dd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 --2- 172.21.15.17:0/4069073866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae58102070 0x7fae58199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 >> 172.21.15.17:0/4069073866 conn(0x7fae580fc430 msgr2=0x7fae580fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 shutdown_connections 2023-10-05T15:34:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.727+0000 7fae5fdff700 1 -- 172.21.15.17:0/4069073866 wait complete. 2023-10-05T15:34:37.730 INFO:teuthology.orchestra.run.smithi017.stderr:added data pool 4 to fsmap 2023-10-05T15:34:37.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:37.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:37 smithi017 ceph-mon[129107]: pgmap v304: 129 pgs: 15 creating+peering, 85 active+clean, 29 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:34:37.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:37 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/948139843' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-05T15:34:37.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:37 smithi017 ceph-mon[129107]: osdmap e89: 12 total, 12 up, 12 in 2023-10-05T15:34:37.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:37 smithi017 ceph-mon[129107]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:34:37.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:37 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4069073866' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-05T15:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 -- 172.21.15.17:0/2698641262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102a40 msgr2=0x7f95b4109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 --2- 172.21.15.17:0/2698641262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102a40 0x7f95b4109360 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00b0a0 tx=0x7f95ac00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 -- 172.21.15.17:0/2698641262 shutdown_connections 2023-10-05T15:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 --2- 172.21.15.17:0/2698641262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102a40 0x7f95b4109360 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 --2- 172.21.15.17:0/2698641262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 0x7f95b41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 --2- 172.21.15.17:0/2698641262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95b4102080 0x7f95b4102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 -- 172.21.15.17:0/2698641262 >> 172.21.15.17:0/2698641262 conn(0x7f95b40fc420 msgr2=0x7f95b40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 -- 172.21.15.17:0/2698641262 shutdown_connections 2023-10-05T15:34:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.960+0000 7f95b8fff700 1 -- 172.21.15.17:0/2698641262 wait complete. 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.961+0000 7f95b8fff700 1 Processor -- start 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.961+0000 7f95b8fff700 1 -- start start 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.961+0000 7f95b8fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 0x7f95b4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.961+0000 7f95b8fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 0x7f95b4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b8fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95b4102a40 0x7f95b41a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b8fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41a0940 con 0x7f95b4102080 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b8fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41a0a80 con 0x7f95b4100ea0 2023-10-05T15:34:37.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b8fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b41a0c10 con 0x7f95b4102a40 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 0x7f95b4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 0x7f95b4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44392/0 (socket says 172.21.15.17:44392) 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 -- 172.21.15.17:0/4237165248 learned_addr learned my addr 172.21.15.17:0/4237165248 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b259c700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 0x7f95b4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b2d9d700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95b4102a40 0x7f95b41a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 -- 172.21.15.17:0/4237165248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95b4102a40 msgr2=0x7f95b41a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95b4102a40 0x7f95b41a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 -- 172.21.15.17:0/4237165248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 msgr2=0x7f95b4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 0x7f95b4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 -- 172.21.15.17:0/4237165248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac009d00 con 0x7f95b4102080 2023-10-05T15:34:37.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b259c700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 0x7f95b4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.962+0000 7f95b1d9b700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 0x7f95b4199300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f95a800d980 tx=0x7f95a800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.963+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800bb60 con 0x7f95b4102080 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.963+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95a8007620 con 0x7f95b4102080 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.963+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b41a0ef0 con 0x7f95b4102080 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.963+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800f3c0 con 0x7f95b4102080 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.963+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b41a1370 con 0x7f95b4102080 2023-10-05T15:34:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.964+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b410c5c0 con 0x7f95b4102080 2023-10-05T15:34:37.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.966+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f95a8010460 con 0x7f95b4102080 2023-10-05T15:34:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.967+0000 7f95a37fe700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f959c0a14d0 0x7f959c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.967+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f95a80cd6f0 con 0x7f95b4102080 2023-10-05T15:34:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.968+0000 7f95b259c700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f959c0a14d0 0x7f959c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.968+0000 7f95b259c700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f959c0a14d0 0x7f959c0a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95b4101bf0 tx=0x7f95a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:37.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:37.969+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95a8096b00 con 0x7f95b4102080 2023-10-05T15:34:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:37 smithi167 ceph-mon[133366]: pgmap v304: 129 pgs: 15 creating+peering, 85 active+clean, 29 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:34:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:37 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/948139843' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-05T15:34:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:37 smithi167 ceph-mon[133366]: osdmap e89: 12 total, 12 up, 12 in 2023-10-05T15:34:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:37 smithi167 ceph-mon[133366]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:34:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:37 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4069073866' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-05T15:34:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:37 smithi079 ceph-mon[132936]: pgmap v304: 129 pgs: 15 creating+peering, 85 active+clean, 29 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2023-10-05T15:34:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:37 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/948139843' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-05T15:34:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:37 smithi079 ceph-mon[132936]: osdmap e89: 12 total, 12 up, 12 in 2023-10-05T15:34:38.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:37 smithi079 ceph-mon[132936]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T15:34:38.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:37 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4069073866' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-05T15:34:38.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.224+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b41a1560 con 0x7f95b4102080 2023-10-05T15:34:38.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.225+0000 7f95a37fe700 1 -- 172.21.15.17:0/4237165248 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11249 (secure 0 0 0) 0x7f95a8010710 con 0x7f95b4102080 2023-10-05T15:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:38.226 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24569,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:34:37.168820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-05T15:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f959c0a14d0 msgr2=0x7f959c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f959c0a14d0 0x7f959c0a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95b4101bf0 tx=0x7f95a4009260 comp rx=0 tx=0).stop 2023-10-05T15:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 msgr2=0x7f95b4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 0x7f95b4199300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f95a800d980 tx=0x7f95a800dd40 comp rx=0 tx=0).stop 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 shutdown_connections 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f959c0a14d0 0x7f959c0a3990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95b4102a40 0x7f95b41a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95b4100ea0 0x7f95b4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 --2- 172.21.15.17:0/4237165248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95b4102080 0x7f95b4199300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 >> 172.21.15.17:0/4237165248 conn(0x7f95b40fc420 msgr2=0x7f95b40fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 shutdown_connections 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.227+0000 7f95b8fff700 1 -- 172.21.15.17:0/4237165248 wait complete. 2023-10-05T15:34:38.230 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-05T15:34:38.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.447+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3301863470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc100ea0 msgr2=0x7fe2cc1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3301863470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc100ea0 0x7fe2cc1012c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009990 tx=0x7fe2c8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3301863470 shutdown_connections 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3301863470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2cc102a40 0x7fe2cc109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3301863470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc100ea0 0x7fe2cc1012c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3301863470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2cc102080 0x7fe2cc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3301863470 >> 172.21.15.17:0/3301863470 conn(0x7fe2cc0fc420 msgr2=0x7fe2cc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3301863470 shutdown_connections 2023-10-05T15:34:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.448+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3301863470 wait complete. 2023-10-05T15:34:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 Processor -- start 2023-10-05T15:34:38.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 -- start start 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2cc100ea0 0x7fe2cc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 0x7fe2cc1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2cc102a40 0x7fe2cc1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1a08e0 con 0x7fe2cc102080 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1a0a20 con 0x7fe2cc102a40 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.449+0000 7fe2d45ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1a0bb0 con 0x7fe2cc100ea0 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 0x7fe2cc1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 0x7fe2cc1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44404/0 (socket says 172.21.15.17:44404) 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 -- 172.21.15.17:0/3874325023 learned_addr learned my addr 172.21.15.17:0/3874325023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d239b700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2cc100ea0 0x7fe2cc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d2b9c700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2cc102a40 0x7fe2cc1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 -- 172.21.15.17:0/3874325023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2cc100ea0 msgr2=0x7fe2cc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2cc100ea0 0x7fe2cc198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 -- 172.21.15.17:0/3874325023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2cc102a40 msgr2=0x7fe2cc1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2cc102a40 0x7fe2cc1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 -- 172.21.15.17:0/3874325023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80095f0 con 0x7fe2cc102080 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d1b9a700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 0x7fe2cc1992a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d980 tx=0x7fe2bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc004020 con 0x7fe2cc102080 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2bc009730 con 0x7fe2cc102080 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc003a00 con 0x7fe2cc102080 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.450+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc1a0e90 con 0x7fe2cc102080 2023-10-05T15:34:38.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.451+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc1a12c0 con 0x7fe2cc102080 2023-10-05T15:34:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.452+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc193400 con 0x7fe2cc102080 2023-10-05T15:34:38.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.454+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe2bc0098a0 con 0x7fe2cc102080 2023-10-05T15:34:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.455+0000 7fe2c37fe700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2b80a14d0 0x7fe2b80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.455+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe2bc0ccbf0 con 0x7fe2cc102080 2023-10-05T15:34:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.455+0000 7fe2d239b700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2b80a14d0 0x7fe2b80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.456+0000 7fe2d239b700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2b80a14d0 0x7fe2b80a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8000c00 tx=0x7fe2c800b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.459+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe2bc096000 con 0x7fe2cc102080 2023-10-05T15:34:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.672+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2cc10c660 con 0x7fe2cc102080 2023-10-05T15:34:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.674+0000 7fe2c37fe700 1 -- 172.21.15.17:0/3874325023 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7fe2bc099620 con 0x7fe2cc102080 2023-10-05T15:34:38.676 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:38.676 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2b80a14d0 msgr2=0x7fe2b80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2b80a14d0 0x7fe2b80a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8000c00 tx=0x7fe2c800b560 comp rx=0 tx=0).stop 2023-10-05T15:34:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 msgr2=0x7fe2cc1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 0x7fe2cc1992a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d980 tx=0x7fe2bc00dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 shutdown_connections 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2b80a14d0 0x7fe2b80a3990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2cc102a40 0x7fe2cc1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2cc100ea0 0x7fe2cc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 --2- 172.21.15.17:0/3874325023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2cc102080 0x7fe2cc1992a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.676+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 >> 172.21.15.17:0/3874325023 conn(0x7fe2cc0fc420 msgr2=0x7fe2cc107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.677+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 shutdown_connections 2023-10-05T15:34:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.677+0000 7fe2d45ff700 1 -- 172.21.15.17:0/3874325023 wait complete. 2023-10-05T15:34:38.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:38.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.899+0000 7f3b195ff700 1 -- 172.21.15.17:0/4265557420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14100ea0 msgr2=0x7f3b141012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.899+0000 7f3b195ff700 1 --2- 172.21.15.17:0/4265557420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14100ea0 0x7f3b141012c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009990 tx=0x7f3b04009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 -- 172.21.15.17:0/4265557420 shutdown_connections 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 --2- 172.21.15.17:0/4265557420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b14102a40 0x7f3b14109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 --2- 172.21.15.17:0/4265557420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14100ea0 0x7f3b141012c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 --2- 172.21.15.17:0/4265557420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b14102080 0x7f3b14102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 -- 172.21.15.17:0/4265557420 >> 172.21.15.17:0/4265557420 conn(0x7f3b140fc420 msgr2=0x7f3b140fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 -- 172.21.15.17:0/4265557420 shutdown_connections 2023-10-05T15:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.900+0000 7f3b195ff700 1 -- 172.21.15.17:0/4265557420 wait complete. 2023-10-05T15:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 Processor -- start 2023-10-05T15:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 -- start start 2023-10-05T15:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b14100ea0 0x7f3b14074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 0x7f3b140732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b14102a40 0x7f3b140737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14073f80 con 0x7f3b14102080 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140740f0 con 0x7f3b14100ea0 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.901+0000 7f3b195ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141a0c40 con 0x7f3b14102a40 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 0x7f3b140732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 0x7f3b140732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44436/0 (socket says 172.21.15.17:44436) 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 -- 172.21.15.17:0/3512579085 learned_addr learned my addr 172.21.15.17:0/3512579085 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b14100ea0 0x7f3b14074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b137fe700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b14102a40 0x7f3b140737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 -- 172.21.15.17:0/3512579085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b14102a40 msgr2=0x7f3b140737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b14102a40 0x7f3b140737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 -- 172.21.15.17:0/3512579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b14100ea0 msgr2=0x7f3b14074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b14100ea0 0x7f3b14074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 -- 172.21.15.17:0/3512579085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040095f0 con 0x7f3b14102080 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3b127fc700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 0x7f3b140732a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800d980 tx=0x7f3b0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08004020 con 0x7f3b14102080 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.902+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b08009730 con 0x7f3b14102080 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.903+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141a0f20 con 0x7f3b14102080 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.903+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08003a00 con 0x7f3b14102080 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.903+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b141a13a0 con 0x7f3b14102080 2023-10-05T15:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.904+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14108610 con 0x7f3b14102080 2023-10-05T15:34:38.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.906+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3b080098a0 con 0x7f3b14102080 2023-10-05T15:34:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.908+0000 7f3afbfff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3afc0a14d0 0x7f3afc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.908+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3b080ccc10 con 0x7f3b14102080 2023-10-05T15:34:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.908+0000 7f3b12ffd700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3afc0a14d0 0x7f3afc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.909+0000 7f3b12ffd700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3afc0a14d0 0x7f3afc0a3990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400b5c0 tx=0x7f3b04005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:38.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:38.912+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b08096020 con 0x7f3b14102080 2023-10-05T15:34:38.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:38 smithi017 ceph-mon[129107]: osdmap e90: 12 total, 12 up, 12 in 2023-10-05T15:34:38.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:38 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4069073866' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-05T15:34:38.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:38 smithi017 ceph-mon[129107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:38 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4237165248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:39.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:38 smithi167 ceph-mon[133366]: osdmap e90: 12 total, 12 up, 12 in 2023-10-05T15:34:39.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:38 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4069073866' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-05T15:34:39.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:38 smithi167 ceph-mon[133366]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:39.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:38 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4237165248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:39.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:38 smithi079 ceph-mon[132936]: osdmap e90: 12 total, 12 up, 12 in 2023-10-05T15:34:39.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:38 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4069073866' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-05T15:34:39.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:38 smithi079 ceph-mon[132936]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:39.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:38 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4237165248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.125+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b1410c610 con 0x7f3b14102080 2023-10-05T15:34:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.127+0000 7f3afbfff700 1 -- 172.21.15.17:0/3512579085 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7f3b08099640 con 0x7f3b14102080 2023-10-05T15:34:39.129 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:39.129 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3afc0a14d0 msgr2=0x7f3afc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3afc0a14d0 0x7f3afc0a3990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400b5c0 tx=0x7f3b04005fb0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 msgr2=0x7f3b140732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 0x7f3b140732a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800d980 tx=0x7f3b0800dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 shutdown_connections 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3afc0a14d0 0x7f3afc0a3990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b14102a40 0x7f3b140737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b14100ea0 0x7f3b14074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 --2- 172.21.15.17:0/3512579085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b14102080 0x7f3b140732a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.129+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 >> 172.21.15.17:0/3512579085 conn(0x7f3b140fc420 msgr2=0x7f3b14105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.130+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 shutdown_connections 2023-10-05T15:34:39.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.130+0000 7f3b195ff700 1 -- 172.21.15.17:0/3512579085 wait complete. 2023-10-05T15:34:39.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:34:39.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 -- 172.21.15.17:0/3208559583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc102a40 msgr2=0x7f9bdc109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 --2- 172.21.15.17:0/3208559583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc102a40 0x7f9bdc109360 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400b0a0 tx=0x7f9bd400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 -- 172.21.15.17:0/3208559583 shutdown_connections 2023-10-05T15:34:39.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 --2- 172.21.15.17:0/3208559583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc102a40 0x7f9bdc109360 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 --2- 172.21.15.17:0/3208559583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 --2- 172.21.15.17:0/3208559583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bdc102080 0x7f9bdc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 -- 172.21.15.17:0/3208559583 >> 172.21.15.17:0/3208559583 conn(0x7f9bdc0fc420 msgr2=0x7f9bdc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 -- 172.21.15.17:0/3208559583 shutdown_connections 2023-10-05T15:34:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.365+0000 7f9be3dff700 1 -- 172.21.15.17:0/3208559583 wait complete. 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 Processor -- start 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 -- start start 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bdc102080 0x7f9bdc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc102a40 0x7f9bdc1a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc1a0990 con 0x7f9bdc100ea0 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc1a0ad0 con 0x7f9bdc102080 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.366+0000 7f9be3dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc1a0c60 con 0x7f9bdc102a40 2023-10-05T15:34:39.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44450/0 (socket says 172.21.15.17:44450) 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 -- 172.21.15.17:0/344878624 learned_addr learned my addr 172.21.15.17:0/344878624 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be239c700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc102a40 0x7f9bdc1a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be139a700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bdc102080 0x7f9bdc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 -- 172.21.15.17:0/344878624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc102a40 msgr2=0x7f9bdc1a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc102a40 0x7f9bdc1a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 -- 172.21.15.17:0/344878624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bdc102080 msgr2=0x7f9bdc199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bdc102080 0x7f9bdc199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 -- 172.21.15.17:0/344878624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd4009d00 con 0x7f9bdc100ea0 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be239c700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc102a40 0x7f9bdc1a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9be1b9b700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc198e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800d980 tx=0x7f9bd800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.367+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800de60 con 0x7f9bdc100ea0 2023-10-05T15:34:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.368+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bd80044b0 con 0x7f9bdc100ea0 2023-10-05T15:34:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.368+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc1a0f40 con 0x7f9bdc100ea0 2023-10-05T15:34:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.368+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8003b40 con 0x7f9bdc100ea0 2023-10-05T15:34:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.368+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc1a1360 con 0x7f9bdc100ea0 2023-10-05T15:34:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.369+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc193400 con 0x7f9bdc100ea0 2023-10-05T15:34:39.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.371+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9bd8003ca0 con 0x7f9bdc100ea0 2023-10-05T15:34:39.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.372+0000 7f9bd2ffd700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9bc80a14d0 0x7f9bc80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.372+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9bd80ccc40 con 0x7f9bdc100ea0 2023-10-05T15:34:39.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.372+0000 7f9be139a700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9bc80a14d0 0x7f9bc80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.373+0000 7f9be139a700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9bc80a14d0 0x7f9bc80a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc005950 tx=0x7f9bcc0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:39.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.376+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9bd8096050 con 0x7f9bdc100ea0 2023-10-05T15:34:39.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.634+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bdc02d090 con 0x7f9bdc100ea0 2023-10-05T15:34:39.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.634+0000 7f9bd2ffd700 1 -- 172.21.15.17:0/344878624 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11249 (secure 0 0 0) 0x7f9bd8009940 con 0x7f9bdc100ea0 2023-10-05T15:34:39.636 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:39.636 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24514,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24569,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:34:37.168820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-05T15:34:39.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9bc80a14d0 msgr2=0x7f9bc80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9bc80a14d0 0x7f9bc80a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc005950 tx=0x7f9bcc0058e0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 msgr2=0x7f9bdc198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc198e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800d980 tx=0x7f9bd800dd40 comp rx=0 tx=0).stop 2023-10-05T15:34:39.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 shutdown_connections 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9bc80a14d0 0x7f9bc80a3990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bdc102a40 0x7f9bdc1a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bdc100ea0 0x7f9bdc198e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 --2- 172.21.15.17:0/344878624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9bdc102080 0x7f9bdc199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 >> 172.21.15.17:0/344878624 conn(0x7f9bdc0fc420 msgr2=0x7f9bdc1079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 shutdown_connections 2023-10-05T15:34:39.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.637+0000 7f9be3dff700 1 -- 172.21.15.17:0/344878624 wait complete. 2023-10-05T15:34:39.641 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 17 2023-10-05T15:34:39.658 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 -- 172.21.15.17:0/1841885901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54102060 msgr2=0x7f6a541024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 --2- 172.21.15.17:0/1841885901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54102060 0x7f6a541024e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009990 tx=0x7f6a40009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 -- 172.21.15.17:0/1841885901 shutdown_connections 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 --2- 172.21.15.17:0/1841885901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 0x7f6a54109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 --2- 172.21.15.17:0/1841885901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54100e80 0x7f6a541012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 --2- 172.21.15.17:0/1841885901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54102060 0x7f6a541024e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 -- 172.21.15.17:0/1841885901 >> 172.21.15.17:0/1841885901 conn(0x7f6a540fc420 msgr2=0x7f6a540fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 -- 172.21.15.17:0/1841885901 shutdown_connections 2023-10-05T15:34:39.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.860+0000 7f6a5adff700 1 -- 172.21.15.17:0/1841885901 wait complete. 2023-10-05T15:34:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.861+0000 7f6a5adff700 1 Processor -- start 2023-10-05T15:34:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 -- start start 2023-10-05T15:34:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 0x7f6a54074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54102060 0x7f6a540732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 0x7f6a540737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54073f80 con 0x7f6a54100e80 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540740f0 con 0x7f6a54102a20 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5adff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a541a0cd0 con 0x7f6a54102060 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a58b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 0x7f6a54074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a58b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 0x7f6a54074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44460/0 (socket says 172.21.15.17:44460) 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a58b9b700 1 -- 172.21.15.17:0/2389474257 learned_addr learned my addr 172.21.15.17:0/2389474257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a5939c700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 0x7f6a540737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.862+0000 7f6a53fff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54102060 0x7f6a540732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a58b9b700 1 -- 172.21.15.17:0/2389474257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54102060 msgr2=0x7f6a540732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a58b9b700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54102060 0x7f6a540732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a58b9b700 1 -- 172.21.15.17:0/2389474257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 msgr2=0x7f6a540737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a58b9b700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 0x7f6a540737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a58b9b700 1 -- 172.21.15.17:0/2389474257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400095f0 con 0x7f6a54100e80 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a5939c700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 0x7f6a540737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a53fff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54102060 0x7f6a540732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a58b9b700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 0x7f6a54074c60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800b500 tx=0x7f6a4800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48011830 con 0x7f6a54100e80 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a48011e20 con 0x7f6a54100e80 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48010dd0 con 0x7f6a54100e80 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a541a0fb0 con 0x7f6a54100e80 2023-10-05T15:34:39.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.863+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a541a1400 con 0x7f6a54100e80 2023-10-05T15:34:39.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.864+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a54108590 con 0x7f6a54100e80 2023-10-05T15:34:39.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.866+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6a48011990 con 0x7f6a54100e80 2023-10-05T15:34:39.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.867+0000 7f6a51ffb700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a440a1550 0x7f6a440a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:39.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.868+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6a480cc9e0 con 0x7f6a54100e80 2023-10-05T15:34:39.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.868+0000 7f6a53fff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a440a1550 0x7f6a440a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:39.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.868+0000 7f6a53fff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a440a1550 0x7f6a440a3a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005f50 tx=0x7f6a40005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:39.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:39.872+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a48095df0 con 0x7f6a54100e80 2023-10-05T15:34:39.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:39 smithi017 ceph-mon[129107]: pgmap v307: 129 pgs: 4 creating+peering, 109 active+clean, 16 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-05T15:34:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:39 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3874325023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:39 smithi017 ceph-mon[129107]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:34:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:39 smithi017 ceph-mon[129107]: Cluster is now healthy 2023-10-05T15:34:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:39 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3512579085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:39 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/344878624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:39 smithi167 ceph-mon[133366]: pgmap v307: 129 pgs: 4 creating+peering, 109 active+clean, 16 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-05T15:34:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:39 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3874325023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:39 smithi167 ceph-mon[133366]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:34:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:39 smithi167 ceph-mon[133366]: Cluster is now healthy 2023-10-05T15:34:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:39 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3512579085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:39 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/344878624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.084+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a5410c760 con 0x7f6a54100e80 2023-10-05T15:34:40.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.086+0000 7f6a51ffb700 1 -- 172.21.15.17:0/2389474257 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7f6a48099410 con 0x7f6a54100e80 2023-10-05T15:34:40.088 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:40.088 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a440a1550 msgr2=0x7f6a440a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a440a1550 0x7f6a440a3a10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005f50 tx=0x7f6a40005e80 comp rx=0 tx=0).stop 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 msgr2=0x7f6a54074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 0x7f6a54074c60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800b500 tx=0x7f6a4800b8c0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 shutdown_connections 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a440a1550 0x7f6a440a3a10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a54102a20 0x7f6a540737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a54100e80 0x7f6a54074c60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 --2- 172.21.15.17:0/2389474257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a54102060 0x7f6a540732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 >> 172.21.15.17:0/2389474257 conn(0x7f6a540fc420 msgr2=0x7f6a541056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 shutdown_connections 2023-10-05T15:34:40.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.088+0000 7f6a5adff700 1 -- 172.21.15.17:0/2389474257 wait complete. 2023-10-05T15:34:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:39 smithi079 ceph-mon[132936]: pgmap v307: 129 pgs: 4 creating+peering, 109 active+clean, 16 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2023-10-05T15:34:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:39 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3874325023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:39 smithi079 ceph-mon[132936]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-05T15:34:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:39 smithi079 ceph-mon[132936]: Cluster is now healthy 2023-10-05T15:34:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:39 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3512579085' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:39 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/344878624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:34:40.109 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-05T15:34:32.118456+0000', 'modified': '2023-10-05T15:34:37.168820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6839/2052945872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 2052945872}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 2052945872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-05T15:34:40.109 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-05T15:34:40.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-05T15:34:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 -- 172.21.15.17:0/2401730978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102a30 msgr2=0x7f3ad4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/2401730978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102a30 0x7f3ad4109350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b0a0 tx=0x7f3acc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 -- 172.21.15.17:0/2401730978 shutdown_connections 2023-10-05T15:34:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/2401730978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102a30 0x7f3ad4109350 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/2401730978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ad4100e90 0x7f3ad41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/2401730978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad4102070 0x7f3ad41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 -- 172.21.15.17:0/2401730978 >> 172.21.15.17:0/2401730978 conn(0x7f3ad40fc430 msgr2=0x7f3ad40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 -- 172.21.15.17:0/2401730978 shutdown_connections 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.310+0000 7f3adb7ff700 1 -- 172.21.15.17:0/2401730978 wait complete. 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 Processor -- start 2023-10-05T15:34:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 -- start start 2023-10-05T15:34:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ad4100e90 0x7f3ad4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 0x7f3ad40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad4102a30 0x7f3ad40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4073f80 con 0x7f3ad4102070 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad40740f0 con 0x7f3ad4100e90 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.312+0000 7f3adb7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad41a0c90 con 0x7f3ad4102a30 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 0x7f3ad40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 0x7f3ad40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44492/0 (socket says 172.21.15.17:44492) 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/4179586477 learned_addr learned my addr 172.21.15.17:0/4179586477 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad959b700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ad4100e90 0x7f3ad4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad4102a30 0x7f3ad40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/4179586477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad4102a30 msgr2=0x7f3ad40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad4102a30 0x7f3ad40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/4179586477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ad4100e90 msgr2=0x7f3ad4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ad4100e90 0x7f3ad4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/4179586477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc009d00 con 0x7f3ad4102070 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 0x7f3ad40732a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400d980 tx=0x7f3ac400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.313+0000 7f3aca7fc700 1 -- 172.21.15.17:0/4179586477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4004020 con 0x7f3ad4102070 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.314+0000 7f3aca7fc700 1 -- 172.21.15.17:0/4179586477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ac4009730 con 0x7f3ad4102070 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.314+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad41a0f70 con 0x7f3ad4102070 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.314+0000 7f3aca7fc700 1 -- 172.21.15.17:0/4179586477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4003a00 con 0x7f3ad4102070 2023-10-05T15:34:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.314+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad41a13f0 con 0x7f3ad4102070 2023-10-05T15:34:40.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.317+0000 7f3aca7fc700 1 -- 172.21.15.17:0/4179586477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3ac40098a0 con 0x7f3ad4102070 2023-10-05T15:34:40.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.318+0000 7f3aef15cb80 1 Processor -- start 2023-10-05T15:34:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.318+0000 7f3aef15cb80 1 -- start start 2023-10-05T15:34:40.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.318+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fad210 0x562589fad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.318+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589faee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589f15410 con 0x562589fad210 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589f06bd0 con 0x562589faea10 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589f044f0 con 0x562589fadb70 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3aca7fc700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3ac00a1480 0x7f3ac00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42128/0 (socket says 172.21.15.17:42128) 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 -- 172.21.15.17:0/2511629625 learned_addr learned my addr 172.21.15.17:0/2511629625 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fad210 0x562589fad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3aca7fc700 1 -- 172.21.15.17:0/4179586477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3ac40ccc10 con 0x7f3ad4102070 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3ac00a1480 0x7f3ac00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589faee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 -- 172.21.15.17:0/2511629625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 msgr2=0x562589faee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589faee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 -- 172.21.15.17:0/2511629625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fad210 msgr2=0x562589fad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fad210 0x562589fad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.319+0000 7f3ad959b700 1 -- 172.21.15.17:0/2511629625 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562589d2ad90 con 0x562589fadb70 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.320+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fae430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000bd40 tx=0x7f3ad00106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be36a29af10eedf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.320+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3ac00a1480 0x7f3ac00a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40752c0 tx=0x7f3acc0099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.320+0000 7f3abf7fe700 1 -- 172.21.15.17:0/2511629625 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0010e10 con 0x562589fadb70 2023-10-05T15:34:40.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.320+0000 7f3abf7fe700 1 -- 172.21.15.17:0/2511629625 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ad0015070 con 0x562589fadb70 2023-10-05T15:34:40.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.320+0000 7f3abf7fe700 1 -- 172.21.15.17:0/2511629625 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0004df0 con 0x562589fadb70 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2511629625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 msgr2=0x562589fae430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fae430 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000bd40 tx=0x7f3ad00106b0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2511629625 shutdown_connections 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589faee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fad210 0x562589fad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2511629625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fae430 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2511629625 >> 172.21.15.17:0/2511629625 conn(0x562589f21210 msgr2=0x562589fa80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2511629625 shutdown_connections 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.321+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2511629625 wait complete. 2023-10-05T15:34:40.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 -- start start 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 Processor -- start 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fb7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 0x562589fbe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589effde0 con 0x562589faea10 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589e9c6c0 con 0x562589fad210 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589e9c360 con 0x562589fadb70 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.322+0000 7f3aef15cb80 10 client.0 _ll_register_callbacks cb 0x562589cf97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 0x562589fbe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 0x562589fbe4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44522/0 (socket says 172.21.15.17:44522) 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 -- 172.21.15.17:0/3122958717 learned_addr learned my addr 172.21.15.17:0/3122958717 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:40.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad959b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fb7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 -- 172.21.15.17:0/3122958717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 msgr2=0x562589fb7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fb7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 -- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 msgr2=0x562589fb6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 -- 172.21.15.17:0/3122958717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad000b9a0 con 0x562589faea10 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 0x562589fbe4b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b0a0 tx=0x7f3acc00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae98c0c0a5bc99 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3abcff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.323+0000 7f3abcff9700 1 -- 172.21.15.17:0/3122958717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00e070 con 0x562589faea10 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562589f9fec0 con 0x562589faea10 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3abcff9700 1 -- 172.21.15.17:0/3122958717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3acc0091f0 con 0x562589faea10 2023-10-05T15:34:40.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3abcff9700 1 -- 172.21.15.17:0/3122958717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3acc007600 con 0x562589faea10 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 10 client.14814 fetch_fsmap learned FSMap version 17 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x562589d13c10 con 0x562589faea10 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3abcff9700 1 -- 172.21.15.17:0/3122958717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562589f9fec0 con 0x562589faea10 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3abcff9700 1 -- 172.21.15.17:0/3122958717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f3acc02c420 con 0x562589faea10 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 10 client.14814 fetch_fsmap finished waiting for FSMap version 17 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 10 client.14814 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 20 client.14814 populate_metadata read hostname 'smithi017' 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562589fc2b40 0x562589fc15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 4 client.14814 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.324+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562589ef8dc0 con 0x562589fc2b40 2023-10-05T15:34:40.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.325+0000 7f3ad959b700 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562589fc2b40 0x562589fc15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.326+0000 7f3ad959b700 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562589fc2b40 0x562589fc15b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703283d3c811529d server_cookie=57af3e0585661ea1 in_seq=0 out_seq=0 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.326+0000 7f3abcff9700 10 client.14814 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3abcff9700 1 -- 172.21.15.17:0/3122958717 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562589ef8dc0 con 0x562589fc2b40 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3abcff9700 10 client.14814 handle_command_reply: tid=0 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 client.14814 shutdown 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 msgr2=0x562589fbe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 0x562589fbe4b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b0a0 tx=0x7f3acc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 shutdown_connections 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562589fc2b40 0x562589fc15b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589faea10 0x562589fbe4b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/3122958717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fadb70 0x562589fb7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3abcff9700 0 client.14814 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 >> 172.21.15.17:0/3122958717 conn(0x562589f21210 msgr2=0x562589fa7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 shutdown_connections 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 1 -- 172.21.15.17:0/3122958717 wait complete. 2023-10-05T15:34:40.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.327+0000 7f3aef15cb80 20 client.14814 trim_cache size 0 max 16384 2023-10-05T15:34:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 Processor -- start 2023-10-05T15:34:40.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 -- start start 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fad210 0x562589fa6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fbe3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589fb1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589d808d0 con 0x562589fadb70 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589d8cde0 con 0x562589faea10 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589fb63e0 con 0x562589fad210 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3ad8d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fbe3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3ad8d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fbe3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44532/0 (socket says 172.21.15.17:44532) 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/1609756037 learned_addr learned my addr 172.21.15.17:0/1609756037 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3ad959b700 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fad210 0x562589fa6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.346+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589fb1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/1609756037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fad210 msgr2=0x562589fa6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fad210 0x562589fa6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/1609756037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 msgr2=0x562589fb1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589fb1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/1609756037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562589d51200 con 0x562589fadb70 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fbe3d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4096750 tx=0x7f3ac400d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37426579731f3d9a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3abffff700 1 -- 172.21.15.17:0/1609756037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4099ce0 con 0x562589fadb70 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3abffff700 1 -- 172.21.15.17:0/1609756037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ac409de30 con 0x562589fadb70 2023-10-05T15:34:40.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.347+0000 7f3abffff700 1 -- 172.21.15.17:0/1609756037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac409a1a0 con 0x562589fadb70 2023-10-05T15:34:40.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 -- 172.21.15.17:0/1609756037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 msgr2=0x562589fbe3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fbe3d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4096750 tx=0x7f3ac400d8d0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 -- 172.21.15.17:0/1609756037 shutdown_connections 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589faea10 0x562589fb1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589fad210 0x562589fa6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/1609756037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fbe3d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 -- 172.21.15.17:0/1609756037 >> 172.21.15.17:0/1609756037 conn(0x562589f21210 msgr2=0x562589fb5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 -- 172.21.15.17:0/1609756037 shutdown_connections 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 -- 172.21.15.17:0/1609756037 wait complete. 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 -- start start 2023-10-05T15:34:40.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.348+0000 7f3aef15cb80 1 Processor -- start 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fb9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589faea10 0x562589fbe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589fbe650 con 0x562589fadb70 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562589fbe7c0 con 0x562589fad210 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56258a016530 con 0x562589faea10 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3aef15cb80 10 client.0 _ll_register_callbacks cb 0x7f3acc004d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fb9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fb9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44546/0 (socket says 172.21.15.17:44546) 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/2170420922 learned_addr learned my addr 172.21.15.17:0/2170420922 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:40.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad9d9c700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589faea10 0x562589fbe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/2170420922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589faea10 msgr2=0x562589fbe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589faea10 0x562589fbe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 msgr2=0x562589fb8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad8d9a700 1 -- 172.21.15.17:0/2170420922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad41a13f0 con 0x562589fadb70 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.349+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3ad8d9a700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fb9190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40046a0 tx=0x7f3ac4099820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894214727d92d8ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3abcff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3abcff9700 1 -- 172.21.15.17:0/2170420922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40993d0 con 0x562589fadb70 2023-10-05T15:34:40.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3abcff9700 1 -- 172.21.15.17:0/2170420922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3ac4099ce0 con 0x562589fadb70 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ad0015070 con 0x562589fadb70 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3abcff9700 1 -- 172.21.15.17:0/2170420922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ac4099f40 con 0x562589fadb70 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3aef15cb80 10 client.14820 fetch_fsmap learned FSMap version 17 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x562589d29260 con 0x562589fadb70 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3abcff9700 1 -- 172.21.15.17:0/2170420922 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ad0015070 con 0x562589fadb70 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.350+0000 7f3abcff9700 1 -- 172.21.15.17:0/2170420922 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 17) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f3ac4003b60 con 0x562589fadb70 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3aef15cb80 10 client.14820 fetch_fsmap finished waiting for FSMap version 17 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3aef15cb80 10 client.14820 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3aef15cb80 20 client.14820 populate_metadata read hostname 'smithi017' 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56258a01b430 0x56258a0178b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:40.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3aef15cb80 4 client.14820 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562589ef8ae0 con 0x56258a01b430 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.351+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56258a01b430 0x56258a0178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3ad959b700 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56258a01b430 0x56258a0178b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62cc8d06bb4cc4f7 server_cookie=bad65fceb5016bad in_seq=0 out_seq=0 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3abcff9700 10 client.14820 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3abcff9700 1 -- 172.21.15.17:0/2170420922 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x562589ef8ae0 con 0x56258a01b430 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3abcff9700 10 client.14820 handle_command_reply: tid=0 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 client.14820 shutdown 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 msgr2=0x562589fb9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fb9190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40046a0 tx=0x7f3ac4099820 comp rx=0 tx=0).stop 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 shutdown_connections 2023-10-05T15:34:40.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56258a01b430 0x56258a0178b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562589faea10 0x562589fbe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562589fad210 0x562589fb8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 --2- 172.21.15.17:0/2170420922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562589fadb70 0x562589fb9190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3abcff9700 0 client.14820 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 >> 172.21.15.17:0/2170420922 conn(0x562589f21210 msgr2=0x562589fa6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 shutdown_connections 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 1 -- 172.21.15.17:0/2170420922 wait complete. 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.352+0000 7f3aef15cb80 20 client.14820 trim_cache size 0 max 16384 2023-10-05T15:34:40.360 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24593, 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 7.7254237909999999, 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 17, 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 90, 2023-10-05T15:34:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:34:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 13.699290151 2023-10-05T15:34:40.362 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:34:40.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3ac00a1480 msgr2=0x7f3ac00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3ac00a1480 0x7f3ac00a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40752c0 tx=0x7f3acc0099e0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 msgr2=0x7f3ad40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 0x7f3ad40732a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400d980 tx=0x7f3ac400dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 shutdown_connections 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3ac00a1480 0x7f3ac00a3940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad4102a30 0x7f3ad40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ad4100e90 0x7f3ad4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 --2- 172.21.15.17:0/4179586477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ad4102070 0x7f3ad40732a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 >> 172.21.15.17:0/4179586477 conn(0x7f3ad40fc430 msgr2=0x7f3ad40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 shutdown_connections 2023-10-05T15:34:40.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:40.353+0000 7f3adb7ff700 1 -- 172.21.15.17:0/4179586477 wait complete. 2023-10-05T15:34:40.372 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-05T15:34:40.373 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:40.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-05T15:34:40.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:40 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2389474257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:40 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2389474257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:41.101 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:34:41.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:40 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2389474257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:41.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:41 smithi017 ceph-mon[129107]: pgmap v308: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 172 B/s wr, 3 op/s 2023-10-05T15:34:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:41 smithi167 ceph-mon[133366]: pgmap v308: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 172 B/s wr, 3 op/s 2023-10-05T15:34:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:41 smithi079 ceph-mon[132936]: pgmap v308: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 172 B/s wr, 3 op/s 2023-10-05T15:34:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.738+0000 7f2408088700 1 -- 172.21.15.17:0/1986425176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 msgr2=0x7f2400110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.738+0000 7f2408088700 1 --2- 172.21.15.17:0/1986425176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 0x7f2400110050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f23f800b0a0 tx=0x7f23f800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 -- 172.21.15.17:0/1986425176 shutdown_connections 2023-10-05T15:34:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 --2- 172.21.15.17:0/1986425176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 0x7f2400110050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 --2- 172.21.15.17:0/1986425176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24001033a0 0x7f2400103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:42.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 --2- 172.21.15.17:0/1986425176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2400103d50 0x7f2400107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 -- 172.21.15.17:0/1986425176 >> 172.21.15.17:0/1986425176 conn(0x7f24000fec10 msgr2=0x7f2400101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 -- 172.21.15.17:0/1986425176 shutdown_connections 2023-10-05T15:34:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.739+0000 7f2408088700 1 -- 172.21.15.17:0/1986425176 wait complete. 2023-10-05T15:34:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.740+0000 7f2408088700 1 Processor -- start 2023-10-05T15:34:42.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 -- start start 2023-10-05T15:34:42.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 0x7f2400199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:42.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2400103d50 0x7f2400199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 0x7f240019dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240019e2d0 con 0x7f2400108480 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240019e440 con 0x7f24001033a0 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.741+0000 7f2408088700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240019e600 con 0x7f2400103d50 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 0x7f2400199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 0x7f2400199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57364/0 (socket says 172.21.15.17:57364) 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 -- 172.21.15.17:0/1037368650 learned_addr learned my addr 172.21.15.17:0/1037368650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2406625700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 0x7f240019dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405623700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2400103d50 0x7f2400199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 -- 172.21.15.17:0/1037368650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2400103d50 msgr2=0x7f2400199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:42.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2400103d50 0x7f2400199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:42.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 -- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 msgr2=0x7f240019dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:42.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 0x7f240019dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:42.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 -- 172.21.15.17:0/1037368650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8009d00 con 0x7f24001033a0 2023-10-05T15:34:42.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f2405e24700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 0x7f2400199310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00d980 tx=0x7f23fc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.742+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc004220 con 0x7f24001033a0 2023-10-05T15:34:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.743+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23fc007640 con 0x7f24001033a0 2023-10-05T15:34:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.743+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240019e8e0 con 0x7f24001033a0 2023-10-05T15:34:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.743+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc005660 con 0x7f24001033a0 2023-10-05T15:34:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.743+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24001a6140 con 0x7f24001033a0 2023-10-05T15:34:42.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.744+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240004ebb0 con 0x7f24001033a0 2023-10-05T15:34:42.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.746+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f23fc004750 con 0x7f24001033a0 2023-10-05T15:34:42.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.747+0000 7f23f6ffd700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f23ec0a1480 0x7f23ec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:42.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.747+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f23fc0ccf00 con 0x7f24001033a0 2023-10-05T15:34:42.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.747+0000 7f2405623700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f23ec0a1480 0x7f23ec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:42.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.748+0000 7f2405623700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f23ec0a1480 0x7f23ec0a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f240019a930 tx=0x7f23f00091e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:42.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:42.749+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f23fc096310 con 0x7f24001033a0 2023-10-05T15:34:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.008+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f240019a670 con 0x7f24001033a0 2023-10-05T15:34:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.009+0000 7f23f6ffd700 1 -- 172.21.15.17:0/1037368650 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7f23fc016020 con 0x7f24001033a0 2023-10-05T15:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f23ec0a1480 msgr2=0x7f23ec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f23ec0a1480 0x7f23ec0a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f240019a930 tx=0x7f23f00091e0 comp rx=0 tx=0).stop 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 msgr2=0x7f2400199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 0x7f2400199310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00d980 tx=0x7f23fc00dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 shutdown_connections 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f23ec0a1480 0x7f23ec0a3940 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2400108480 0x7f240019dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24001033a0 0x7f2400199310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 --2- 172.21.15.17:0/1037368650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2400103d50 0x7f2400199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 >> 172.21.15.17:0/1037368650 conn(0x7f24000fec10 msgr2=0x7f24000ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 shutdown_connections 2023-10-05T15:34:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:43.011+0000 7f2408088700 1 -- 172.21.15.17:0/1037368650 wait complete. 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-05T15:34:43.482 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-05T15:34:43.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:43.485 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-10-05T15:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-05T15:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-05T15:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-05T15:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41533sec preferred_lft 41533sec 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-10-05T15:34:43.532 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-05T15:34:43.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:43.532 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:34:43.533 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:34:43.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2023-10-05T15:34:43.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2023-10-05T15:34:43.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2023-10-05T15:34:43.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-05T15:34:43.533 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:34:43.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:43 smithi017 ceph-mon[129107]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 147 B/s wr, 3 op/s 2023-10-05T15:34:43.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:43 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1037368650' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:34:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:43 smithi167 ceph-mon[133366]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 147 B/s wr, 3 op/s 2023-10-05T15:34:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:43 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1037368650' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:34:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:43 smithi079 ceph-mon[132936]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 147 B/s wr, 3 op/s 2023-10-05T15:34:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:43 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1037368650' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:34:44.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:44.130 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-05T15:34:44.202 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-10-05T15:34:44.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:44.205 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-10-05T15:34:44.264 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-10-05T15:34:44.264 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-05T15:34:44.264 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-05T15:34:44.264 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-05T15:34:44.264 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-05T15:34:44.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:44.265 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:34:44.266 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:34:44.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-05T15:34:44.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-05T15:34:44.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-05T15:34:44.266 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:34:45.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:45.086 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-05T15:34:45.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:45.131 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-10-05T15:34:45.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:45.214 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:34:45.214 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:34:45.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:45.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-05T15:34:45.215 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:34:45.400 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-05T15:34:45.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-05T15:34:45.401 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:34:45.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:45.767 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:34:45.767 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:34:45.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-10-05T15:34:45.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2023-10-05T15:34:45.768 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:34:45.877 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:45 smithi017 ceph-mon[129107]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 2 op/s 2023-10-05T15:34:45.944 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-05T15:34:45.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:34:45.944 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:45.987 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-05T15:34:45.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:34:45.987 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:46.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-05T15:34:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:45 smithi167 ceph-mon[133366]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 2 op/s 2023-10-05T15:34:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:45 smithi079 ceph-mon[132936]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 2 op/s 2023-10-05T15:34:46.181 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:34:46.225 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-05T15:34:46.225 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:34:46.226 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-05T15:34:46.227 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/844e2e1cf7cbbaadff459e8c490941f49791e984ab9d08c68fefadb92eb56fd5/merged 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f26d934ff165d2d8f08bc13a1bb380f64710008973b65cd20fd136d72d79941/merged 2023-10-05T15:34:46.228 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e0f2eed055c9895a521f82801cf2a667bff17bc656e138c3379d6ed468d78133/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9be3e5d6344e2e4a4cf3d94afe2d455f685263f059debc6b3aa60a8b03b95fbf/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1841cc43b5c02ed336004a285bc3b0a941ae60fc17f1f076bc200b683fd80e36/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/79af702143b594ecf321ba24f4f7a6f4196cc60e53ed84dee44474e932429553/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4d13a7fedd1588db55c7a8851b2a139134edbea1a2f5fa3a5d66dd8a3a524ecb/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d5a9a02959068cde6bb495591b6405f1e936ff1179479d8ec98147cdac325c72/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f031ec6604972aa69c006752d8c5a3c0b6ef564d927be013ae502379e546ecc/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/340d4b0b524319c56f65d01e28de1e6e20dd60a506598c7dfa05ab69641c71fe/merged 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:46.229 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:46.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:46.230 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-05T15:34:46.314 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-05T15:34:46.314 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-05T15:34:46.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-05T15:34:46.430 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:34:46.475 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-05T15:34:46.475 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-05T15:34:46.475 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-05T15:34:46.475 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-05T15:34:46.475 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-05T15:34:46.475 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:34:46.476 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-05T15:34:46.477 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/844e2e1cf7cbbaadff459e8c490941f49791e984ab9d08c68fefadb92eb56fd5/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f26d934ff165d2d8f08bc13a1bb380f64710008973b65cd20fd136d72d79941/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e0f2eed055c9895a521f82801cf2a667bff17bc656e138c3379d6ed468d78133/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9be3e5d6344e2e4a4cf3d94afe2d455f685263f059debc6b3aa60a8b03b95fbf/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1841cc43b5c02ed336004a285bc3b0a941ae60fc17f1f076bc200b683fd80e36/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/79af702143b594ecf321ba24f4f7a6f4196cc60e53ed84dee44474e932429553/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4d13a7fedd1588db55c7a8851b2a139134edbea1a2f5fa3a5d66dd8a3a524ecb/merged 2023-10-05T15:34:46.478 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d5a9a02959068cde6bb495591b6405f1e936ff1179479d8ec98147cdac325c72/merged 2023-10-05T15:34:46.479 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f031ec6604972aa69c006752d8c5a3c0b6ef564d927be013ae502379e546ecc/merged 2023-10-05T15:34:46.479 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/340d4b0b524319c56f65d01e28de1e6e20dd60a506598c7dfa05ab69641c71fe/merged 2023-10-05T15:34:46.479 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-05T15:34:46.479 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:46.479 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:46.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:46.480 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-05T15:34:46.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:2023-10-05T15:34:46.554+0000 7f9cfbe825c0 -1 init, newargv = 0x55f242393e40 newargc=15 2023-10-05T15:34:46.556 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[183585]: starting ceph client 2023-10-05T15:34:46.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[183585]: starting fuse 2023-10-05T15:34:47.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-05T15:34:47.705 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-05T15:34:47.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-05T15:34:47.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:34:47.753 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/844e2e1cf7cbbaadff459e8c490941f49791e984ab9d08c68fefadb92eb56fd5/merged 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f26d934ff165d2d8f08bc13a1bb380f64710008973b65cd20fd136d72d79941/merged 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e0f2eed055c9895a521f82801cf2a667bff17bc656e138c3379d6ed468d78133/merged 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9be3e5d6344e2e4a4cf3d94afe2d455f685263f059debc6b3aa60a8b03b95fbf/merged 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1841cc43b5c02ed336004a285bc3b0a941ae60fc17f1f076bc200b683fd80e36/merged 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/79af702143b594ecf321ba24f4f7a6f4196cc60e53ed84dee44474e932429553/merged 2023-10-05T15:34:47.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4d13a7fedd1588db55c7a8851b2a139134edbea1a2f5fa3a5d66dd8a3a524ecb/merged 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d5a9a02959068cde6bb495591b6405f1e936ff1179479d8ec98147cdac325c72/merged 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f031ec6604972aa69c006752d8c5a3c0b6ef564d927be013ae502379e546ecc/merged 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/340d4b0b524319c56f65d01e28de1e6e20dd60a506598c7dfa05ab69641c71fe/merged 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:34:47.755 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:47.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:47.756 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-05T15:34:47.800 INFO:teuthology.orchestra.run.smithi017.stdout:121 2023-10-05T15:34:47.801 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> import re 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-05T15:34:47.801 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2023-10-05T15:34:47.802 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2023-10-05T15:34:47.803 DEBUG:teuthology.orchestra.run.smithi017:> return f 2023-10-05T15:34:47.803 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-05T15:34:47.803 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:34:47.803 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.admin")) 2023-10-05T15:34:47.803 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-10-05T15:34:47.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:47 smithi017 ceph-mon[129107]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-05T15:34:47.984 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.admin.183585.asok 2023-10-05T15:34:47.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-05T15:34:47.997 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.183585.asok 2023-10-05T15:34:47.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:47.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.183585.asok status 2023-10-05T15:34:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:47 smithi167 ceph-mon[133366]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-05T15:34:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:47 smithi079 ceph-mon[132936]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "689b3d5ae1ed3e8efe9a65281cd9bd422749e95f", 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "admin", 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "183585", 2023-10-05T15:34:48.229 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24713, 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 24713 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-05T15:34:48.230 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1245831599 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1245831599 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.24713 172.21.15.17:0/1245831599", 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "172.21.15.17:0/1245831599", 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 17, 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 90, 2023-10-05T15:34:48.231 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2023-10-05T15:34:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2023-10-05T15:34:48.232 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2023-10-05T15:34:48.232 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:34:48.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:48.244 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2023-10-05T15:34:48.244 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:48.288 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2023-10-05T15:34:48.289 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:48.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:48.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:48.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:48.400 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-05T15:34:48.534 INFO:teuthology.orchestra.run.smithi017.stdout:# file: . 2023-10-05T15:34:48.534 INFO:teuthology.orchestra.run.smithi017.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-05T15:34:48.534 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:48.535 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:34:48.535 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:34:48.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:48.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 -- 172.21.15.17:0/2722379580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac074e90 msgr2=0x7fdeac0732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:48.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/2722379580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac074e90 0x7fdeac0732e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009990 tx=0x7fdea8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:48.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 -- 172.21.15.17:0/2722379580 shutdown_connections 2023-10-05T15:34:48.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/2722379580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 0x7fdeac10b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:48.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/2722379580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac074e90 0x7fdeac0732e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:48.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/2722379580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac0738b0 0x7fdeac073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:48.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 -- 172.21.15.17:0/2722379580 >> 172.21.15.17:0/2722379580 conn(0x7fdeac0fc460 msgr2=0x7fdeac0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:48.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 -- 172.21.15.17:0/2722379580 shutdown_connections 2023-10-05T15:34:48.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.824+0000 7fdeb3dff700 1 -- 172.21.15.17:0/2722379580 wait complete. 2023-10-05T15:34:48.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.825+0000 7fdeb3dff700 1 Processor -- start 2023-10-05T15:34:48.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.825+0000 7fdeb3dff700 1 -- start start 2023-10-05T15:34:48.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb3dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 0x7fdeac198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb3dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac074e90 0x7fdeac199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb3dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 0x7fdeac1a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb3dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac1a0850 con 0x7fdeac0738b0 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb3dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac1a09c0 con 0x7fdeac108de0 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb3dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac1a0b80 con 0x7fdeac074e90 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 0x7fdeac198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac074e90 0x7fdeac199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 0x7fdeac198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39166/0 (socket says 172.21.15.17:39166) 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac074e90 0x7fdeac199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:52274/0 (socket says 172.21.15.17:52274) 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb1b9b700 1 -- 172.21.15.17:0/893918563 learned_addr learned my addr 172.21.15.17:0/893918563 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.826+0000 7fdeb239c700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 0x7fdeac1a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:48.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb1b9b700 1 -- 172.21.15.17:0/893918563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac074e90 msgr2=0x7fdeac199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb1b9b700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac074e90 0x7fdeac199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb1b9b700 1 -- 172.21.15.17:0/893918563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 msgr2=0x7fdeac1a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb1b9b700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 0x7fdeac1a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb1b9b700 1 -- 172.21.15.17:0/893918563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80095f0 con 0x7fdeac0738b0 2023-10-05T15:34:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb239c700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 0x7fdeac1a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:48.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb1b9b700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 0x7fdeac198d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdea8000c00 tx=0x7fdea8003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:48.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea801d070 con 0x7fdeac0738b0 2023-10-05T15:34:48.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdea800bd70 con 0x7fdeac0738b0 2023-10-05T15:34:48.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8022c80 con 0x7fdeac0738b0 2023-10-05T15:34:48.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac1a0e00 con 0x7fdeac0738b0 2023-10-05T15:34:48.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.827+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac1a11d0 con 0x7fdeac0738b0 2023-10-05T15:34:48.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.828+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac1074e0 con 0x7fdeac0738b0 2023-10-05T15:34:48.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.830+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdea8022470 con 0x7fdeac0738b0 2023-10-05T15:34:48.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.832+0000 7fdea2ffd700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde980a14d0 0x7fde980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:48.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.832+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fdea80ce550 con 0x7fdeac0738b0 2023-10-05T15:34:48.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.832+0000 7fdeb139a700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde980a14d0 0x7fde980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:48.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.832+0000 7fdeb139a700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde980a14d0 0x7fde980a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde9c005950 tx=0x7fde9c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:48.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:48.836+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdea8097b10 con 0x7fdeac0738b0 2023-10-05T15:34:49.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.047+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeac02d1c0 con 0x7fdeac0738b0 2023-10-05T15:34:49.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.049+0000 7fdea2ffd700 1 -- 172.21.15.17:0/893918563 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7fdea8027020 con 0x7fdeac0738b0 2023-10-05T15:34:49.051 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:49.051 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde980a14d0 msgr2=0x7fde980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde980a14d0 0x7fde980a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde9c005950 tx=0x7fde9c00b410 comp rx=0 tx=0).stop 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 msgr2=0x7fdeac198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 0x7fdeac198d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdea8000c00 tx=0x7fdea8003a50 comp rx=0 tx=0).stop 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 shutdown_connections 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fde980a14d0 0x7fde980a3990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeac108de0 0x7fdeac1a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdeac0738b0 0x7fdeac198d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 --2- 172.21.15.17:0/893918563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeac074e90 0x7fdeac199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 >> 172.21.15.17:0/893918563 conn(0x7fdeac0fc460 msgr2=0x7fdeac0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:49.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 shutdown_connections 2023-10-05T15:34:49.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.051+0000 7fdeb3dff700 1 -- 172.21.15.17:0/893918563 wait complete. 2023-10-05T15:34:49.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:34:49.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:34:49.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2152775351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 msgr2=0x7f5c241012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2152775351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c241012c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c200098f0 tx=0x7f5c20009c00 comp rx=0 tx=0).stop 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2152775351 shutdown_connections 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2152775351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c24102a40 0x7f5c24109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2152775351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c241012c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2152775351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2152775351 >> 172.21.15.17:0/2152775351 conn(0x7f5c240fc460 msgr2=0x7f5c240fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2152775351 shutdown_connections 2023-10-05T15:34:49.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.276+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2152775351 wait complete. 2023-10-05T15:34:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.277+0000 7f5c2b5ff700 1 Processor -- start 2023-10-05T15:34:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.277+0000 7f5c2b5ff700 1 -- start start 2023-10-05T15:34:49.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2b5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c24198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2b5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2b5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c24102a40 0x7f5c241a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2b5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c241a0940 con 0x7f5c24102080 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2b5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c241a0a80 con 0x7f5c24100ea0 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2b5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c241a0c10 con 0x7f5c24102a40 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39188/0 (socket says 172.21.15.17:39188) 2023-10-05T15:34:49.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 -- 172.21.15.17:0/2565534521 learned_addr learned my addr 172.21.15.17:0/2565534521 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c2939b700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c24198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c29b9c700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c24102a40 0x7f5c241a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 -- 172.21.15.17:0/2565534521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c24102a40 msgr2=0x7f5c241a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c24102a40 0x7f5c241a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 -- 172.21.15.17:0/2565534521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 msgr2=0x7f5c24198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.278+0000 7f5c28b9a700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c24198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c28b9a700 1 -- 172.21.15.17:0/2565534521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20009520 con 0x7f5c24102080 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c2939b700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c24198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c28b9a700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24199300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400e9f0 tx=0x7f5c1400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:49.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14004220 con 0x7f5c24102080 2023-10-05T15:34:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c14004380 con 0x7f5c24102080 2023-10-05T15:34:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c241a0ef0 con 0x7f5c24102080 2023-10-05T15:34:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14003a80 con 0x7f5c24102080 2023-10-05T15:34:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.279+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c241a1370 con 0x7f5c24102080 2023-10-05T15:34:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.280+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2410c610 con 0x7f5c24102080 2023-10-05T15:34:49.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.282+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5c14003c20 con 0x7f5c24102080 2023-10-05T15:34:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.283+0000 7f5c1a7fc700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5c100a1480 0x7f5c100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.284+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5c14014070 con 0x7f5c24102080 2023-10-05T15:34:49.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.284+0000 7f5c2939b700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5c100a1480 0x7f5c100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.284+0000 7f5c2939b700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5c100a1480 0x7f5c100a3940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009fd0 tx=0x7f5c20019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:49.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.287+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c140964b0 con 0x7f5c24102080 2023-10-05T15:34:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.502+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c241a15c0 con 0x7f5c24102080 2023-10-05T15:34:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.503+0000 7f5c1a7fc700 1 -- 172.21.15.17:0/2565534521 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c14099ad0 con 0x7f5c24102080 2023-10-05T15:34:49.505 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:34:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5c100a1480 msgr2=0x7f5c100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5c100a1480 0x7f5c100a3940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009fd0 tx=0x7f5c20019040 comp rx=0 tx=0).stop 2023-10-05T15:34:49.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 msgr2=0x7f5c24199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24199300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400e9f0 tx=0x7f5c1400ed00 comp rx=0 tx=0).stop 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 shutdown_connections 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5c100a1480 0x7f5c100a3940 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5c24102a40 0x7f5c241a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c24100ea0 0x7f5c24198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 --2- 172.21.15.17:0/2565534521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c24102080 0x7f5c24199300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 >> 172.21.15.17:0/2565534521 conn(0x7f5c240fc460 msgr2=0x7f5c240fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 shutdown_connections 2023-10-05T15:34:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.505+0000 7f5c2b5ff700 1 -- 172.21.15.17:0/2565534521 wait complete. 2023-10-05T15:34:49.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:34:49.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 -- 172.21.15.17:0/1239625247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 msgr2=0x7f212c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 --2- 172.21.15.17:0/1239625247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c109350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f212400b0a0 tx=0x7f212400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 -- 172.21.15.17:0/1239625247 shutdown_connections 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 --2- 172.21.15.17:0/1239625247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c109350 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 --2- 172.21.15.17:0/1239625247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c100e90 0x7f212c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 --2- 172.21.15.17:0/1239625247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c102070 0x7f212c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 -- 172.21.15.17:0/1239625247 >> 172.21.15.17:0/1239625247 conn(0x7f212c0fc430 msgr2=0x7f212c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.730+0000 7f21323ff700 1 -- 172.21.15.17:0/1239625247 shutdown_connections 2023-10-05T15:34:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.731+0000 7f21323ff700 1 -- 172.21.15.17:0/1239625247 wait complete. 2023-10-05T15:34:49.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.731+0000 7f21323ff700 1 Processor -- start 2023-10-05T15:34:49.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 -- start start 2023-10-05T15:34:49.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c100e90 0x7f212c196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c102070 0x7f212c197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c19e770 con 0x7f212c102a30 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c19e8b0 con 0x7f212c100e90 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f21323ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c19ea40 con 0x7f212c102070 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f213099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f213099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c19e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39208/0 (socket says 172.21.15.17:39208) 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f213099c700 1 -- 172.21.15.17:0/3541892043 learned_addr learned my addr 172.21.15.17:0/3541892043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.732+0000 7f212bfff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c100e90 0x7f212c196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f212b7fe700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c102070 0x7f212c197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f213099c700 1 -- 172.21.15.17:0/3541892043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c102070 msgr2=0x7f212c197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f213099c700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c102070 0x7f212c197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f213099c700 1 -- 172.21.15.17:0/3541892043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c100e90 msgr2=0x7f212c196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f213099c700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c100e90 0x7f212c196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f213099c700 1 -- 172.21.15.17:0/3541892043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009d00 con 0x7f212c102a30 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f212bfff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c100e90 0x7f212c196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f213099c700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c19e1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f212400d010 tx=0x7f212400bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212400e040 con 0x7f212c102a30 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2124009480 con 0x7f212c102a30 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c19ecc0 con 0x7f212c102a30 2023-10-05T15:34:49.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.733+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240052a0 con 0x7f212c102a30 2023-10-05T15:34:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.734+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c19f140 con 0x7f212c102a30 2023-10-05T15:34:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.735+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c10c5b0 con 0x7f212c102a30 2023-10-05T15:34:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.737+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2124005400 con 0x7f212c102a30 2023-10-05T15:34:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.738+0000 7f21297fa700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21140a1500 0x7f21140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.738+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f21240cde90 con 0x7f212c102a30 2023-10-05T15:34:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.738+0000 7f212bfff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21140a1500 0x7f21140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.739+0000 7f212bfff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21140a1500 0x7f21140a39c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f212c101be0 tx=0x7f211c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.742+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2124097390 con 0x7f212c102a30 2023-10-05T15:34:49.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:49 smithi017 ceph-mon[129107]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-05T15:34:49.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:49 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/893918563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:49 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2565534521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.954+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f212c107e80 con 0x7f212c102a30 2023-10-05T15:34:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.955+0000 7f21297fa700 1 -- 172.21.15.17:0/3541892043 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f212409a9b0 con 0x7f212c102a30 2023-10-05T15:34:49.956 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:34:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21140a1500 msgr2=0x7f21140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21140a1500 0x7f21140a39c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f212c101be0 tx=0x7f211c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 msgr2=0x7f212c19e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c19e1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f212400d010 tx=0x7f212400bcc0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 shutdown_connections 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21140a1500 0x7f21140a39c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f212c102a30 0x7f212c19e1a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f212c100e90 0x7f212c196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 --2- 172.21.15.17:0/3541892043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f212c102070 0x7f212c197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.957+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 >> 172.21.15.17:0/3541892043 conn(0x7f212c0fc430 msgr2=0x7f212c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.958+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 shutdown_connections 2023-10-05T15:34:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:49.958+0000 7f21323ff700 1 -- 172.21.15.17:0/3541892043 wait complete. 2023-10-05T15:34:49.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:34:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:49 smithi167 ceph-mon[133366]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-05T15:34:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:49 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/893918563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:49 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2565534521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:49 smithi079 ceph-mon[132936]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-05T15:34:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/893918563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:49 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2565534521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:50.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 -- 172.21.15.17:0/4056217099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 msgr2=0x7fb83010b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 --2- 172.21.15.17:0/4056217099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb83010b240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb82800b0a0 tx=0x7fb82800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 -- 172.21.15.17:0/4056217099 shutdown_connections 2023-10-05T15:34:50.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 --2- 172.21.15.17:0/4056217099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb83010b240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 --2- 172.21.15.17:0/4056217099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb830074ef0 0x7fb830073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 --2- 172.21.15.17:0/4056217099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 0x7fb830073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 -- 172.21.15.17:0/4056217099 >> 172.21.15.17:0/4056217099 conn(0x7fb8300fc460 msgr2=0x7fb8300fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 -- 172.21.15.17:0/4056217099 shutdown_connections 2023-10-05T15:34:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.182+0000 7fb8375ff700 1 -- 172.21.15.17:0/4056217099 wait complete. 2023-10-05T15:34:50.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.183+0000 7fb8375ff700 1 Processor -- start 2023-10-05T15:34:50.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 -- start start 2023-10-05T15:34:50.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 0x7fb830198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb830074ef0 0x7fb830199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb8301a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301a0900 con 0x7fb830108db0 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301a0a70 con 0x7fb830073910 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb8375ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301a0c30 con 0x7fb830074ef0 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb835b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb8301a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb83539b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 0x7fb830198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb835b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb8301a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39216/0 (socket says 172.21.15.17:39216) 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb835b9c700 1 -- 172.21.15.17:0/1404363049 learned_addr learned my addr 172.21.15.17:0/1404363049 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.184+0000 7fb834b9a700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb830074ef0 0x7fb830199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb835b9c700 1 -- 172.21.15.17:0/1404363049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb830074ef0 msgr2=0x7fb830199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb835b9c700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb830074ef0 0x7fb830199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb835b9c700 1 -- 172.21.15.17:0/1404363049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 msgr2=0x7fb830198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb835b9c700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 0x7fb830198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb835b9c700 1 -- 172.21.15.17:0/1404363049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828009d00 con 0x7fb830108db0 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb83539b700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 0x7fb830198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb835b9c700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb8301a0330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb82800d010 tx=0x7fb82800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800e040 con 0x7fb830108db0 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb828009480 con 0x7fb830108db0 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8301a0eb0 con 0x7fb830108db0 2023-10-05T15:34:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280052a0 con 0x7fb830108db0 2023-10-05T15:34:50.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.185+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301a1270 con 0x7fb830108db0 2023-10-05T15:34:50.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.186+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb830107460 con 0x7fb830108db0 2023-10-05T15:34:50.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.188+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb828005400 con 0x7fb830108db0 2023-10-05T15:34:50.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.190+0000 7fb8267fc700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb81c0a1500 0x7fb81c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.191+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb8280cdf60 con 0x7fb830108db0 2023-10-05T15:34:50.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.191+0000 7fb83539b700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb81c0a1500 0x7fb81c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.191+0000 7fb83539b700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb81c0a1500 0x7fb81c0a39c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb83019a290 tx=0x7fb82c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:50.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.195+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb828097400 con 0x7fb830108db0 2023-10-05T15:34:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.404+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb83002cf70 con 0x7fb830108db0 2023-10-05T15:34:50.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.404+0000 7fb8267fc700 1 -- 172.21.15.17:0/1404363049 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb82809aa20 con 0x7fb830108db0 2023-10-05T15:34:50.406 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb81c0a1500 msgr2=0x7fb81c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb81c0a1500 0x7fb81c0a39c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb83019a290 tx=0x7fb82c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 msgr2=0x7fb8301a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb8301a0330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb82800d010 tx=0x7fb82800bcc0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 shutdown_connections 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb81c0a1500 0x7fb81c0a39c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb830108db0 0x7fb8301a0330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb830073910 0x7fb830198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 --2- 172.21.15.17:0/1404363049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb830074ef0 0x7fb830199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 >> 172.21.15.17:0/1404363049 conn(0x7fb8300fc460 msgr2=0x7fb8300fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 shutdown_connections 2023-10-05T15:34:50.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.407+0000 7fb8375ff700 1 -- 172.21.15.17:0/1404363049 wait complete. 2023-10-05T15:34:50.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:34:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 -- 172.21.15.17:0/2381728077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 msgr2=0x7f24c0101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 --2- 172.21.15.17:0/2381728077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c0101190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f24b00099c0 tx=0x7f24b0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 -- 172.21.15.17:0/2381728077 shutdown_connections 2023-10-05T15:34:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 --2- 172.21.15.17:0/2381728077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0102900 0x7f24c01091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 --2- 172.21.15.17:0/2381728077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c0101190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 --2- 172.21.15.17:0/2381728077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0101f60 0x7f24c01023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 -- 172.21.15.17:0/2381728077 >> 172.21.15.17:0/2381728077 conn(0x7f24c00fc2e0 msgr2=0x7f24c00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:50.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 -- 172.21.15.17:0/2381728077 shutdown_connections 2023-10-05T15:34:50.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.633+0000 7f24c539d700 1 -- 172.21.15.17:0/2381728077 wait complete. 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.634+0000 7f24c539d700 1 Processor -- start 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.634+0000 7f24c539d700 1 -- start start 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c539d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c01968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c539d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0101f60 0x7f24c0196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c539d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0102900 0x7f24c019de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c539d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c019e420 con 0x7f24c0100d70 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c539d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c019e560 con 0x7f24c0101f60 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c539d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c019e6f0 con 0x7f24c0102900 2023-10-05T15:34:50.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c01968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c01968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39236/0 (socket says 172.21.15.17:39236) 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 -- 172.21.15.17:0/3582995030 learned_addr learned my addr 172.21.15.17:0/3582995030 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c4b9c700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0102900 0x7f24c019de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 -- 172.21.15.17:0/3582995030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0102900 msgr2=0x7f24c019de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0102900 0x7f24c019de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bf7fe700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0101f60 0x7f24c0196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 -- 172.21.15.17:0/3582995030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0101f60 msgr2=0x7f24c0196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0101f60 0x7f24c0196de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bffff700 1 -- 172.21.15.17:0/3582995030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00095f0 con 0x7f24c0100d70 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24c4b9c700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0102900 0x7f24c019de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.635+0000 7f24bf7fe700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0101f60 0x7f24c0196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:34:50.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.636+0000 7f24bffff700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c01968a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24b0000c00 tx=0x7f24b000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:50.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.636+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b001d070 con 0x7f24c0100d70 2023-10-05T15:34:50.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.636+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24b000bcf0 con 0x7f24c0100d70 2023-10-05T15:34:50.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.636+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b00173f0 con 0x7f24c0100d70 2023-10-05T15:34:50.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.636+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00730e0 con 0x7f24c0100d70 2023-10-05T15:34:50.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.636+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c0073590 con 0x7f24c0100d70 2023-10-05T15:34:50.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.637+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c01082c0 con 0x7f24c0100d70 2023-10-05T15:34:50.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.639+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f24b0022470 con 0x7f24c0100d70 2023-10-05T15:34:50.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.640+0000 7f24bd7fa700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24a80a15a0 0x7f24a80a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:50.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.641+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f24b00ce0b0 con 0x7f24c0100d70 2023-10-05T15:34:50.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.641+0000 7f24bf7fe700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24a80a15a0 0x7f24a80a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:50.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.641+0000 7f24bf7fe700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24a80a15a0 0x7f24a80a3a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009be0 tx=0x7f24b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.644+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f24b0097550 con 0x7f24c0100d70 2023-10-05T15:34:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.863+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24c010c670 con 0x7f24c0100d70 2023-10-05T15:34:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.864+0000 7f24bd7fa700 1 -- 172.21.15.17:0/3582995030 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24b009ab70 con 0x7f24c0100d70 2023-10-05T15:34:50.865 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:34:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24a80a15a0 msgr2=0x7f24a80a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24a80a15a0 0x7f24a80a3a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009be0 tx=0x7f24b4009260 comp rx=0 tx=0).stop 2023-10-05T15:34:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 msgr2=0x7f24c01968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c01968a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f24b0000c00 tx=0x7f24b000fab0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 shutdown_connections 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24a80a15a0 0x7f24a80a3a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24c0102900 0x7f24c019de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24c0100d70 0x7f24c01968a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 --2- 172.21.15.17:0/3582995030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24c0101f60 0x7f24c0196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 >> 172.21.15.17:0/3582995030 conn(0x7f24c00fc2e0 msgr2=0x7f24c0105400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 shutdown_connections 2023-10-05T15:34:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:50.866+0000 7f24c539d700 1 -- 172.21.15.17:0/3582995030 wait complete. 2023-10-05T15:34:50.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:34:50.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3541892043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:34:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1404363049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:34:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:50 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3541892043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:34:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:50 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1404363049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:34:51.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.089+0000 7f2126dff700 1 -- 172.21.15.17:0/226811528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102070 msgr2=0x7f21201024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.089+0000 7f2126dff700 1 --2- 172.21.15.17:0/226811528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102070 0x7f21201024f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f210c009990 tx=0x7f210c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 -- 172.21.15.17:0/226811528 shutdown_connections 2023-10-05T15:34:51.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 --2- 172.21.15.17:0/226811528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2120102a30 0x7f2120109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 --2- 172.21.15.17:0/226811528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2120100e90 0x7f21201012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 --2- 172.21.15.17:0/226811528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102070 0x7f21201024f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 -- 172.21.15.17:0/226811528 >> 172.21.15.17:0/226811528 conn(0x7f21200fc430 msgr2=0x7f21200fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:51.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 -- 172.21.15.17:0/226811528 shutdown_connections 2023-10-05T15:34:51.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.090+0000 7f2126dff700 1 -- 172.21.15.17:0/226811528 wait complete. 2023-10-05T15:34:51.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.091+0000 7f2126dff700 1 Processor -- start 2023-10-05T15:34:51.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.091+0000 7f2126dff700 1 -- start start 2023-10-05T15:34:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2126dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2120100e90 0x7f2120196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2126dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2120102070 0x7f21201970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2126dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 0x7f212019e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2126dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019e6e0 con 0x7f2120102a30 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2126dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019e820 con 0x7f2120100e90 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2126dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019e9b0 con 0x7f2120102070 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f212539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 0x7f212019e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f212539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 0x7f212019e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39264/0 (socket says 172.21.15.17:39264) 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f212539c700 1 -- 172.21.15.17:0/2535699648 learned_addr learned my addr 172.21.15.17:0/2535699648 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f2124b9b700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2120100e90 0x7f2120196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.092+0000 7f211ffff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2120102070 0x7f21201970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f212539c700 1 -- 172.21.15.17:0/2535699648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2120102070 msgr2=0x7f21201970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f212539c700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2120102070 0x7f21201970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f212539c700 1 -- 172.21.15.17:0/2535699648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2120100e90 msgr2=0x7f2120196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f212539c700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2120100e90 0x7f2120196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f212539c700 1 -- 172.21.15.17:0/2535699648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0095f0 con 0x7f2120102a30 2023-10-05T15:34:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f212539c700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 0x7f212019e110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f211800ef30 tx=0x7f211800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118018070 con 0x7f2120102a30 2023-10-05T15:34:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f211800f040 con 0x7f2120102a30 2023-10-05T15:34:51.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212019ec30 con 0x7f2120102a30 2023-10-05T15:34:51.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211800cc70 con 0x7f2120102a30 2023-10-05T15:34:51.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.093+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212019f0f0 con 0x7f2120102a30 2023-10-05T15:34:51.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.094+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120107f80 con 0x7f2120102a30 2023-10-05T15:34:51.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.096+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2118007500 con 0x7f2120102a30 2023-10-05T15:34:51.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.098+0000 7f211dffb700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21100a1480 0x7f21100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.098+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f21180ccac0 con 0x7f2120102a30 2023-10-05T15:34:51.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.098+0000 7f2124b9b700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21100a1480 0x7f21100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.098+0000 7f2124b9b700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21100a1480 0x7f21100a3940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2120101be0 tx=0x7f2114009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:51.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.102+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2118095f60 con 0x7f2120102a30 2023-10-05T15:34:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:50 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3541892043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:34:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:50 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1404363049' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:34:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.329+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f212002d020 con 0x7f2120102a30 2023-10-05T15:34:51.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.329+0000 7f211dffb700 1 -- 172.21.15.17:0/2535699648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+592 (secure 0 0 0) 0x7f2118099580 con 0x7f2120102a30 2023-10-05T15:34:51.331 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2395163877 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:51.331 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2135774582 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3151379810 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2053167755 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360652288 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4090412968 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:51.332 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21100a1480 msgr2=0x7f21100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21100a1480 0x7f21100a3940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2120101be0 tx=0x7f2114009260 comp rx=0 tx=0).stop 2023-10-05T15:34:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 msgr2=0x7f212019e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 0x7f212019e110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f211800ef30 tx=0x7f211800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 shutdown_connections 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f21100a1480 0x7f21100a3940 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120102a30 0x7f212019e110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2120100e90 0x7f2120196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 --2- 172.21.15.17:0/2535699648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2120102070 0x7f21201970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 >> 172.21.15.17:0/2535699648 conn(0x7f21200fc430 msgr2=0x7f21200fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 shutdown_connections 2023-10-05T15:34:51.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.332+0000 7f2126dff700 1 -- 172.21.15.17:0/2535699648 wait complete. 2023-10-05T15:34:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2023-10-05T15:34:51.352 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:34:51.352 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:34:51.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:51.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.638+0000 7ff4227ff700 1 -- 172.21.15.17:0/3475395847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c100ea0 msgr2=0x7ff41c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.638+0000 7ff4227ff700 1 --2- 172.21.15.17:0/3475395847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c100ea0 0x7ff41c1012c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009990 tx=0x7ff40c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 -- 172.21.15.17:0/3475395847 shutdown_connections 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 --2- 172.21.15.17:0/3475395847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff41c102a40 0x7ff41c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 --2- 172.21.15.17:0/3475395847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c100ea0 0x7ff41c1012c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 --2- 172.21.15.17:0/3475395847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff41c102080 0x7ff41c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 -- 172.21.15.17:0/3475395847 >> 172.21.15.17:0/3475395847 conn(0x7ff41c0fc420 msgr2=0x7ff41c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 -- 172.21.15.17:0/3475395847 shutdown_connections 2023-10-05T15:34:51.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.639+0000 7ff4227ff700 1 -- 172.21.15.17:0/3475395847 wait complete. 2023-10-05T15:34:51.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 Processor -- start 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 -- start start 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff41c100ea0 0x7ff41c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 0x7ff41c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff41c102a40 0x7ff41c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1a08e0 con 0x7ff41c102080 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1a0a20 con 0x7ff41c100ea0 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff4227ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1a0bb0 con 0x7ff41c102a40 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff41b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 0x7ff41c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff41b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 0x7ff41c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39280/0 (socket says 172.21.15.17:39280) 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.640+0000 7ff41b7fe700 1 -- 172.21.15.17:0/1370159524 learned_addr learned my addr 172.21.15.17:0/1370159524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41bfff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff41c100ea0 0x7ff41c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff420d9c700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff41c102a40 0x7ff41c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41b7fe700 1 -- 172.21.15.17:0/1370159524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff41c102a40 msgr2=0x7ff41c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41b7fe700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff41c102a40 0x7ff41c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41b7fe700 1 -- 172.21.15.17:0/1370159524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff41c100ea0 msgr2=0x7ff41c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41b7fe700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff41c100ea0 0x7ff41c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41b7fe700 1 -- 172.21.15.17:0/1370159524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0095f0 con 0x7ff41c102080 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff41b7fe700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 0x7ff41c1992a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff41000d980 tx=0x7ff41000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000de60 con 0x7ff41c102080 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4100044b0 con 0x7ff41c102080 2023-10-05T15:34:51.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410003b40 con 0x7ff41c102080 2023-10-05T15:34:51.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c1a0e90 con 0x7ff41c102080 2023-10-05T15:34:51.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.641+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c1a1310 con 0x7ff41c102080 2023-10-05T15:34:51.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.642+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c193400 con 0x7ff41c102080 2023-10-05T15:34:51.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.644+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff410004870 con 0x7ff41c102080 2023-10-05T15:34:51.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.646+0000 7ff4197fa700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4040a1550 0x7ff4040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:51.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.646+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff4100cce80 con 0x7ff41c102080 2023-10-05T15:34:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.646+0000 7ff41bfff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4040a1550 0x7ff4040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:51.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.647+0000 7ff41bfff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4040a1550 0x7ff4040a3a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00b5c0 tx=0x7ff40c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:51.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.648+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff4100963c0 con 0x7ff41c102080 2023-10-05T15:34:51.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.865+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff41c10c660 con 0x7ff41c102080 2023-10-05T15:34:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.866+0000 7ff4197fa700 1 -- 172.21.15.17:0/1370159524 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7ff410017090 con 0x7ff41c102080 2023-10-05T15:34:51.868 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:51.869 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4040a1550 msgr2=0x7ff4040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4040a1550 0x7ff4040a3a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00b5c0 tx=0x7ff40c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 msgr2=0x7ff41c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 0x7ff41c1992a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff41000d980 tx=0x7ff41000dd40 comp rx=0 tx=0).stop 2023-10-05T15:34:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 shutdown_connections 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4040a1550 0x7ff4040a3a10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff41c102a40 0x7ff41c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff41c100ea0 0x7ff41c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 --2- 172.21.15.17:0/1370159524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff41c102080 0x7ff41c1992a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 >> 172.21.15.17:0/1370159524 conn(0x7ff41c0fc420 msgr2=0x7ff41c107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 shutdown_connections 2023-10-05T15:34:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:51.869+0000 7ff4227ff700 1 -- 172.21.15.17:0/1370159524 wait complete. 2023-10-05T15:34:51.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:34:51.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:34:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:51 smithi017 ceph-mon[129107]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:51.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:51 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3582995030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:34:51.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:51 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2535699648' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:34:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:51 smithi167 ceph-mon[133366]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3582995030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:34:52.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2535699648' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:34:52.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 -- 172.21.15.17:0/3217738200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88100e90 msgr2=0x7fea881012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/3217738200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88100e90 0x7fea881012b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fea84009990 tx=0x7fea84009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 -- 172.21.15.17:0/3217738200 shutdown_connections 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/3217738200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea88102a30 0x7fea88109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/3217738200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88100e90 0x7fea881012b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/3217738200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88102070 0x7fea881024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 -- 172.21.15.17:0/3217738200 >> 172.21.15.17:0/3217738200 conn(0x7fea880fc430 msgr2=0x7fea880fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 -- 172.21.15.17:0/3217738200 shutdown_connections 2023-10-05T15:34:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.095+0000 7fea8f7ff700 1 -- 172.21.15.17:0/3217738200 wait complete. 2023-10-05T15:34:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.096+0000 7fea8f7ff700 1 Processor -- start 2023-10-05T15:34:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.096+0000 7fea8f7ff700 1 -- start start 2023-10-05T15:34:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8f7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88100e90 0x7fea88198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8f7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea88102070 0x7fea88199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8f7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 0x7fea881a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8f7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea881a0880 con 0x7fea88102a30 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8f7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea881a09f0 con 0x7fea88100e90 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8f7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea881a0bb0 con 0x7fea88102070 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 0x7fea881a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 0x7fea881a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39304/0 (socket says 172.21.15.17:39304) 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 -- 172.21.15.17:0/2182243760 learned_addr learned my addr 172.21.15.17:0/2182243760 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8cd9a700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea88102070 0x7fea88199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8d59b700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88100e90 0x7fea88198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 -- 172.21.15.17:0/2182243760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea88102070 msgr2=0x7fea88199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea88102070 0x7fea88199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 -- 172.21.15.17:0/2182243760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88100e90 msgr2=0x7fea88198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88100e90 0x7fea88198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8dd9c700 1 -- 172.21.15.17:0/2182243760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea840095f0 con 0x7fea88102a30 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.097+0000 7fea8d59b700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88100e90 0x7fea88198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.098+0000 7fea8dd9c700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 0x7fea881a02b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea8000ef30 tx=0x7fea8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.098+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80018070 con 0x7fea88102a30 2023-10-05T15:34:52.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.098+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea8000f040 con 0x7fea88102a30 2023-10-05T15:34:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.098+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea881a0e30 con 0x7fea88102a30 2023-10-05T15:34:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.098+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8000cc70 con 0x7fea88102a30 2023-10-05T15:34:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.098+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea881a1200 con 0x7fea88102a30 2023-10-05T15:34:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.099+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea881933a0 con 0x7fea88102a30 2023-10-05T15:34:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.101+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fea80007500 con 0x7fea88102a30 2023-10-05T15:34:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.102+0000 7fea7e7fc700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fea740a1480 0x7fea740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.103+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fea800ccad0 con 0x7fea88102a30 2023-10-05T15:34:52.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.103+0000 7fea8d59b700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fea740a1480 0x7fea740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:51 smithi079 ceph-mon[132936]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:52.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:51 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3582995030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:34:52.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:51 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2535699648' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:34:52.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.103+0000 7fea8d59b700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fea740a1480 0x7fea740a3940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fea8819a210 tx=0x7fea8400b2a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:52.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.106+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fea80095f70 con 0x7fea88102a30 2023-10-05T15:34:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.322+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea8802cf70 con 0x7fea88102a30 2023-10-05T15:34:52.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.323+0000 7fea7e7fc700 1 -- 172.21.15.17:0/2182243760 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea80099590 con 0x7fea88102a30 2023-10-05T15:34:52.325 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:34:52.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.325+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fea740a1480 msgr2=0x7fea740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.325+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fea740a1480 0x7fea740a3940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fea8819a210 tx=0x7fea8400b2a0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.325+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 msgr2=0x7fea881a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.325+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 0x7fea881a02b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea8000ef30 tx=0x7fea8000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 shutdown_connections 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fea740a1480 0x7fea740a3940 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea88102a30 0x7fea881a02b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88100e90 0x7fea88198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 --2- 172.21.15.17:0/2182243760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea88102070 0x7fea88199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 >> 172.21.15.17:0/2182243760 conn(0x7fea880fc430 msgr2=0x7fea88107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 shutdown_connections 2023-10-05T15:34:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.326+0000 7fea8f7ff700 1 -- 172.21.15.17:0/2182243760 wait complete. 2023-10-05T15:34:52.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 -- 172.21.15.17:0/4267262728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204100e90 msgr2=0x7f12041012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 --2- 172.21.15.17:0/4267262728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204100e90 0x7f12041012b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1200009990 tx=0x7f1200009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 -- 172.21.15.17:0/4267262728 shutdown_connections 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 --2- 172.21.15.17:0/4267262728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1204102a30 0x7f1204109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 --2- 172.21.15.17:0/4267262728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204100e90 0x7f12041012b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 --2- 172.21.15.17:0/4267262728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1204102070 0x7f12041024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 -- 172.21.15.17:0/4267262728 >> 172.21.15.17:0/4267262728 conn(0x7f12040fc430 msgr2=0x7f12040fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:52.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 -- 172.21.15.17:0/4267262728 shutdown_connections 2023-10-05T15:34:52.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.550+0000 7f120c3ff700 1 -- 172.21.15.17:0/4267262728 wait complete. 2023-10-05T15:34:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 Processor -- start 2023-10-05T15:34:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 -- start start 2023-10-05T15:34:52.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1204100e90 0x7f1204198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1204102070 0x7f12041992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 0x7f12041a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041a08e0 con 0x7f1204102a30 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041a0a50 con 0x7f1204100e90 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.551+0000 7f120c3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041a0c10 con 0x7f1204102070 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 0x7f12041a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 0x7f12041a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39320/0 (socket says 172.21.15.17:39320) 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 -- 172.21.15.17:0/2988462485 learned_addr learned my addr 172.21.15.17:0/2988462485 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a19b700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1204100e90 0x7f1204198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120999a700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1204102070 0x7f12041992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 -- 172.21.15.17:0/2988462485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1204102070 msgr2=0x7f12041992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1204102070 0x7f12041992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 -- 172.21.15.17:0/2988462485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1204100e90 msgr2=0x7f1204198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1204100e90 0x7f1204198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 -- 172.21.15.17:0/2988462485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000095f0 con 0x7f1204102a30 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.552+0000 7f120a99c700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 0x7f12041a0310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00ef30 tx=0x7f11fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.553+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc018070 con 0x7f1204102a30 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.553+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11fc00f040 con 0x7f1204102a30 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.553+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12041a0e90 con 0x7f1204102a30 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.553+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00cc70 con 0x7f1204102a30 2023-10-05T15:34:52.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.553+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12041a1260 con 0x7f1204102a30 2023-10-05T15:34:52.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.554+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12041933f0 con 0x7f1204102a30 2023-10-05T15:34:52.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.556+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f11fc007500 con 0x7f1204102a30 2023-10-05T15:34:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.557+0000 7f11fb7fe700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11f00a1480 0x7f11f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.557+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f11fc0cca60 con 0x7f1204102a30 2023-10-05T15:34:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.558+0000 7f120a19b700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11f00a1480 0x7f11f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:52.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.558+0000 7f120a19b700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11f00a1480 0x7f11f00a3940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12000098e0 tx=0x7f120000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:52.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.561+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f11fc095f60 con 0x7f1204102a30 2023-10-05T15:34:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.781+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f120402cf70 con 0x7f1204102a30 2023-10-05T15:34:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.782+0000 7f11fb7fe700 1 -- 172.21.15.17:0/2988462485 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11fc099580 con 0x7f1204102a30 2023-10-05T15:34:52.784 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:34:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.784+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11f00a1480 msgr2=0x7f11f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.784+0000 7f120c3ff700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11f00a1480 0x7f11f00a3940 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12000098e0 tx=0x7f120000b260 comp rx=0 tx=0).stop 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.784+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 msgr2=0x7f12041a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.784+0000 7f120c3ff700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 0x7f12041a0310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00ef30 tx=0x7f11fc00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 shutdown_connections 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11f00a1480 0x7f11f00a3940 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1204102a30 0x7f12041a0310 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1204100e90 0x7f1204198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 --2- 172.21.15.17:0/2988462485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1204102070 0x7f12041992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 >> 172.21.15.17:0/2988462485 conn(0x7f12040fc430 msgr2=0x7f1204107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 shutdown_connections 2023-10-05T15:34:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:52.785+0000 7f120c3ff700 1 -- 172.21.15.17:0/2988462485 wait complete. 2023-10-05T15:34:52.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:34:53.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 -- 172.21.15.17:0/864904070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102070 msgr2=0x7fe9441024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/864904070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102070 0x7fe9441024f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe934009990 tx=0x7fe934009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 -- 172.21.15.17:0/864904070 shutdown_connections 2023-10-05T15:34:53.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/864904070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe944102a30 0x7fe944109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/864904070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 0x7fe9441012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/864904070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102070 0x7fe9441024f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 -- 172.21.15.17:0/864904070 >> 172.21.15.17:0/864904070 conn(0x7fe9440fc430 msgr2=0x7fe9440fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:53.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 -- 172.21.15.17:0/864904070 shutdown_connections 2023-10-05T15:34:53.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.009+0000 7fe94b7ff700 1 -- 172.21.15.17:0/864904070 wait complete. 2023-10-05T15:34:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.010+0000 7fe94b7ff700 1 Processor -- start 2023-10-05T15:34:53.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 -- start start 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 0x7fe944074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe944102070 0x7fe9440732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 0x7fe9440737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe944073f80 con 0x7fe944102a30 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440740f0 con 0x7fe944100e90 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe94b7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9441a0bb0 con 0x7fe944102070 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe949d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 0x7fe9440737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe949d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 0x7fe9440737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39338/0 (socket says 172.21.15.17:39338) 2023-10-05T15:34:53.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe949d9c700 1 -- 172.21.15.17:0/2080771914 learned_addr learned my addr 172.21.15.17:0/2080771914 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.011+0000 7fe948d9a700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe944102070 0x7fe9440732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe94959b700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 0x7fe944074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe949d9c700 1 -- 172.21.15.17:0/2080771914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe944102070 msgr2=0x7fe9440732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe949d9c700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe944102070 0x7fe9440732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe949d9c700 1 -- 172.21.15.17:0/2080771914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 msgr2=0x7fe944074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe949d9c700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 0x7fe944074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe949d9c700 1 -- 172.21.15.17:0/2080771914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340095f0 con 0x7fe944102a30 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe94959b700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 0x7fe944074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe949d9c700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 0x7fe9440737e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe93c007ee0 tx=0x7fe93c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:53.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c017070 con 0x7fe944102a30 2023-10-05T15:34:53.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe93c00f040 con 0x7fe944102a30 2023-10-05T15:34:53.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9441a0e90 con 0x7fe944102a30 2023-10-05T15:34:53.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c005710 con 0x7fe944102a30 2023-10-05T15:34:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.012+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9441a12c0 con 0x7fe944102a30 2023-10-05T15:34:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.013+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe944107f20 con 0x7fe944102a30 2023-10-05T15:34:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.015+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe93c005870 con 0x7fe944102a30 2023-10-05T15:34:53.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.017+0000 7fe93a7fc700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9300a1480 0x7fe9300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.017+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe93c0cc740 con 0x7fe944102a30 2023-10-05T15:34:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.017+0000 7fe94959b700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9300a1480 0x7fe9300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.018+0000 7fe94959b700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9300a1480 0x7fe9300a3940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe944101be0 tx=0x7fe940009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:53.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.021+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe93c095b50 con 0x7fe944102a30 2023-10-05T15:34:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:52 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1370159524' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:52 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2182243760' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:52 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1370159524' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:52 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2182243760' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:53.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:52 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1370159524' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:53.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:52 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2182243760' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:34:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.231+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe94402d270 con 0x7fe944102a30 2023-10-05T15:34:53.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.232+0000 7fe93a7fc700 1 -- 172.21.15.17:0/2080771914 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe93c099170 con 0x7fe944102a30 2023-10-05T15:34:53.234 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:34:53.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9300a1480 msgr2=0x7fe9300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9300a1480 0x7fe9300a3940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe944101be0 tx=0x7fe940009260 comp rx=0 tx=0).stop 2023-10-05T15:34:53.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 msgr2=0x7fe9440737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 0x7fe9440737e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe93c007ee0 tx=0x7fe93c00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 shutdown_connections 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9300a1480 0x7fe9300a3940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe944102a30 0x7fe9440737e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe944100e90 0x7fe944074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 --2- 172.21.15.17:0/2080771914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe944102070 0x7fe9440732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.234+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 >> 172.21.15.17:0/2080771914 conn(0x7fe9440fc430 msgr2=0x7fe9440fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.235+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 shutdown_connections 2023-10-05T15:34:53.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.235+0000 7fe94b7ff700 1 -- 172.21.15.17:0/2080771914 wait complete. 2023-10-05T15:34:53.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:34:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 -- 172.21.15.17:0/3994202173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102a40 msgr2=0x7facdc109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 --2- 172.21.15.17:0/3994202173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102a40 0x7facdc109360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facd400b0a0 tx=0x7facd400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 -- 172.21.15.17:0/3994202173 shutdown_connections 2023-10-05T15:34:53.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 --2- 172.21.15.17:0/3994202173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102a40 0x7facdc109360 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 --2- 172.21.15.17:0/3994202173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 0x7facdc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 --2- 172.21.15.17:0/3994202173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102080 0x7facdc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 -- 172.21.15.17:0/3994202173 >> 172.21.15.17:0/3994202173 conn(0x7facdc0fc460 msgr2=0x7facdc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:53.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 -- 172.21.15.17:0/3994202173 shutdown_connections 2023-10-05T15:34:53.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.459+0000 7face25ff700 1 -- 172.21.15.17:0/3994202173 wait complete. 2023-10-05T15:34:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.460+0000 7face25ff700 1 Processor -- start 2023-10-05T15:34:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.460+0000 7face25ff700 1 -- start start 2023-10-05T15:34:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face25ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 0x7facdc196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face25ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 0x7facdc197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face25ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102a40 0x7facdc19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face25ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc19e760 con 0x7facdc102080 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face25ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc19e8d0 con 0x7facdc102a40 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face25ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc19ea90 con 0x7facdc100ea0 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 0x7facdc197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 0x7facdc197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39348/0 (socket says 172.21.15.17:39348) 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdbfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 0x7facdc196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 -- 172.21.15.17:0/2413069517 learned_addr learned my addr 172.21.15.17:0/2413069517 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7face0b9c700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102a40 0x7facdc19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 -- 172.21.15.17:0/2413069517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 msgr2=0x7facdc196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 0x7facdc196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 -- 172.21.15.17:0/2413069517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102a40 msgr2=0x7facdc19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.461+0000 7facdb7fe700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102a40 0x7facdc19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7facdb7fe700 1 -- 172.21.15.17:0/2413069517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009d00 con 0x7facdc102080 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7face0b9c700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102a40 0x7facdc19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7facdbfff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 0x7facdc196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7facdb7fe700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 0x7facdc197160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7facd000e970 tx=0x7facd000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0009790 con 0x7facdc102080 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facd000eec0 con 0x7facdc102080 2023-10-05T15:34:53.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc19ed70 con 0x7facdc102080 2023-10-05T15:34:53.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0003c10 con 0x7facdc102080 2023-10-05T15:34:53.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.462+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc19f210 con 0x7facdc102080 2023-10-05T15:34:53.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.463+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc107ea0 con 0x7facdc102080 2023-10-05T15:34:53.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.465+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7facd0003db0 con 0x7facdc102080 2023-10-05T15:34:53.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.466+0000 7facd97fa700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7facc40a1500 0x7facc40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.467+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7facd0014070 con 0x7facdc102080 2023-10-05T15:34:53.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.467+0000 7facdbfff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7facc40a1500 0x7facc40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.467+0000 7facdbfff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7facc40a1500 0x7facc40a39c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7facdc1980f0 tx=0x7faccc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:53.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.470+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7facd0096560 con 0x7facdc102080 2023-10-05T15:34:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.682+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7facdc02d090 con 0x7facdc102080 2023-10-05T15:34:53.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.683+0000 7facd97fa700 1 -- 172.21.15.17:0/2413069517 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) v1 ==== 103+0+11 (secure 0 0 0) 0x7facd0099b80 con 0x7facdc102080 2023-10-05T15:34:53.685 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:34:53.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7facc40a1500 msgr2=0x7facc40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7facc40a1500 0x7facc40a39c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7facdc1980f0 tx=0x7faccc009260 comp rx=0 tx=0).stop 2023-10-05T15:34:53.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 msgr2=0x7facdc197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 0x7facdc197160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7facd000e970 tx=0x7facd000ec80 comp rx=0 tx=0).stop 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 shutdown_connections 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7facc40a1500 0x7facc40a39c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7facdc102a40 0x7facdc19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facdc100ea0 0x7facdc196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 --2- 172.21.15.17:0/2413069517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facdc102080 0x7facdc197160 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.685+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 >> 172.21.15.17:0/2413069517 conn(0x7facdc0fc460 msgr2=0x7facdc0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.686+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 shutdown_connections 2023-10-05T15:34:53.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.686+0000 7face25ff700 1 -- 172.21.15.17:0/2413069517 wait complete. 2023-10-05T15:34:53.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:34:53.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 -- 172.21.15.17:0/1514438731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0102a30 msgr2=0x7f03f0109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 --2- 172.21.15.17:0/1514438731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0102a30 0x7f03f0109350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b0a0 tx=0x7f03e800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 -- 172.21.15.17:0/1514438731 shutdown_connections 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 --2- 172.21.15.17:0/1514438731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0102a30 0x7f03f0109350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 --2- 172.21.15.17:0/1514438731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f0100e90 0x7f03f01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 --2- 172.21.15.17:0/1514438731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03f0102070 0x7f03f01024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 -- 172.21.15.17:0/1514438731 >> 172.21.15.17:0/1514438731 conn(0x7f03f00fc430 msgr2=0x7f03f00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.908+0000 7f03f4bff700 1 -- 172.21.15.17:0/1514438731 shutdown_connections 2023-10-05T15:34:53.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.909+0000 7f03f4bff700 1 -- 172.21.15.17:0/1514438731 wait complete. 2023-10-05T15:34:53.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.909+0000 7f03f4bff700 1 Processor -- start 2023-10-05T15:34:53.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 -- start start 2023-10-05T15:34:53.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 0x7f03f0196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03f0102070 0x7f03f01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f0102a30 0x7f03f019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f019e7a0 con 0x7f03f0100e90 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f019e910 con 0x7f03f0102070 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03f4bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f019ead0 con 0x7f03f0102a30 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03e659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 0x7f03f0196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03e659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 0x7f03f0196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44706/0 (socket says 172.21.15.17:44706) 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03e659c700 1 -- 172.21.15.17:0/3658061761 learned_addr learned my addr 172.21.15.17:0/3658061761 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03eed9d700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f0102a30 0x7f03f019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.910+0000 7f03ee59c700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03f0102070 0x7f03f01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e659c700 1 -- 172.21.15.17:0/3658061761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f0102a30 msgr2=0x7f03f019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e659c700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f0102a30 0x7f03f019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e659c700 1 -- 172.21.15.17:0/3658061761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03f0102070 msgr2=0x7f03f01971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:53.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e659c700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03f0102070 0x7f03f01971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e659c700 1 -- 172.21.15.17:0/3658061761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009d00 con 0x7f03f0100e90 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e659c700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 0x7f03f0196c60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f03e000d980 tx=0x7f03e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0004020 con 0x7f03f0100e90 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f019edb0 con 0x7f03f0100e90 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03e000f690 con 0x7f03f0100e90 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00039e0 con 0x7f03f0100e90 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.911+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f019f1d0 con 0x7f03f0100e90 2023-10-05T15:34:53.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.912+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f01084f0 con 0x7f03f0100e90 2023-10-05T15:34:53.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.914+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f03e000f800 con 0x7f03f0100e90 2023-10-05T15:34:53.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.916+0000 7f03e7fff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03dc0a1480 0x7f03dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:53.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.916+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f03e00ccae0 con 0x7f03f0100e90 2023-10-05T15:34:53.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.916+0000 7f03ee59c700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03dc0a1480 0x7f03dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:53.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.917+0000 7f03ee59c700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03dc0a1480 0x7f03dc0a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03f0100bb0 tx=0x7f03d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:53.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:53.920+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03e0095ef0 con 0x7f03f0100e90 2023-10-05T15:34:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:53 smithi167 ceph-mon[133366]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:53 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2988462485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:53 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2080771914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:53 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2413069517' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:53 smithi079 ceph-mon[132936]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:53 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2988462485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:53 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2080771914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:53 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2413069517' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.144+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03f010c600 con 0x7f03f0100e90 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.145+0000 7f03e7fff700 1 -- 172.21.15.17:0/3658061761 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) v1 ==== 81+0+592 (secure 0 0 0) 0x7f03e0099510 con 0x7f03f0100e90 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2395163877 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2135774582 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3151379810 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2053167755 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:54.147 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360652288 2023-10-06T15:27:04.477848+0000 2023-10-05T15:34:54.148 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4090412968 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:54.148 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:34:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.147+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03dc0a1480 msgr2=0x7f03dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.147+0000 7f03f4bff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03dc0a1480 0x7f03dc0a3940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03f0100bb0 tx=0x7f03d800b410 comp rx=0 tx=0).stop 2023-10-05T15:34:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.147+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 msgr2=0x7f03f0196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.147+0000 7f03f4bff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 0x7f03f0196c60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f03e000d980 tx=0x7f03e000dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.147+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 shutdown_connections 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.147+0000 7f03f4bff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03dc0a1480 0x7f03dc0a3940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.148+0000 7f03f4bff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03f0102a30 0x7f03f019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.148+0000 7f03f4bff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03f0100e90 0x7f03f0196c60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.148+0000 7f03f4bff700 1 --2- 172.21.15.17:0/3658061761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03f0102070 0x7f03f01971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.148+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 >> 172.21.15.17:0/3658061761 conn(0x7f03f00fc430 msgr2=0x7f03f0105630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.148+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 shutdown_connections 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.148+0000 7f03f4bff700 1 -- 172.21.15.17:0/3658061761 wait complete. 2023-10-05T15:34:54.150 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2023-10-05T15:34:54.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:53 smithi017 ceph-mon[129107]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:54.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:53 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2988462485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:53 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2080771914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.165 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:53 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2413069517' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:34:54.167 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2023-10-05T15:34:54.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:54.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-05T15:34:54.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[183585]: fuse finished with error 0 and tester_r 0 2023-10-05T15:34:54.240 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T15:34:54.338 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:34:54.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:34:54.338 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-05T15:34:54.394 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 -- 172.21.15.17:0/1414240358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 msgr2=0x7f24fc10b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 --2- 172.21.15.17:0/1414240358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc10b570 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24f400b0d0 tx=0x7f24f400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 -- 172.21.15.17:0/1414240358 shutdown_connections 2023-10-05T15:34:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 --2- 172.21.15.17:0/1414240358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc10b570 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 --2- 172.21.15.17:0/1414240358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24fc103130 0x7f24fc103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 --2- 172.21.15.17:0/1414240358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc104320 0x7f24fc104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 -- 172.21.15.17:0/1414240358 >> 172.21.15.17:0/1414240358 conn(0x7f24fc0fe6a0 msgr2=0x7f24fc100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:54.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 -- 172.21.15.17:0/1414240358 shutdown_connections 2023-10-05T15:34:54.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.595+0000 7f25021ff700 1 -- 172.21.15.17:0/1414240358 wait complete. 2023-10-05T15:34:54.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.596+0000 7f25021ff700 1 Processor -- start 2023-10-05T15:34:54.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.596+0000 7f25021ff700 1 -- start start 2023-10-05T15:34:54.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f25021ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc103130 0x7f24fc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:54.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f25021ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24fc104320 0x7f24fc1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:54.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f25021ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:54.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f25021ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1a08e0 con 0x7f24fc104cc0 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f25021ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1a0a20 con 0x7f24fc104320 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f25021ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1a0bb0 con 0x7f24fc103130 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44728/0 (socket says 172.21.15.17:44728) 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f24fb7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc103130 0x7f24fc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f24fbfff700 1 -- 172.21.15.17:0/3842566856 learned_addr learned my addr 172.21.15.17:0/3842566856 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.597+0000 7f24faffd700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24fc104320 0x7f24fc1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24fbfff700 1 -- 172.21.15.17:0/3842566856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc103130 msgr2=0x7f24fc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24fbfff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc103130 0x7f24fc198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24fbfff700 1 -- 172.21.15.17:0/3842566856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24fc104320 msgr2=0x7f24fc1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24fbfff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24fc104320 0x7f24fc1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24fbfff700 1 -- 172.21.15.17:0/3842566856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4009d00 con 0x7f24fc104cc0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24fbfff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc1a0310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009fd0 tx=0x7f24f400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400e040 con 0x7f24fc104cc0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24f4003c00 con 0x7f24fc104cc0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40052a0 con 0x7f24fc104cc0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc1a0e30 con 0x7f24fc104cc0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.598+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc1a1200 con 0x7f24fc104cc0 2023-10-05T15:34:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.599+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc10e800 con 0x7f24fc104cc0 2023-10-05T15:34:54.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.601+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f24f401b450 con 0x7f24fc104cc0 2023-10-05T15:34:54.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.604+0000 7f24f8ff9700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24e40a14d0 0x7f24e40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:54.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.604+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f24f40ce770 con 0x7f24fc104cc0 2023-10-05T15:34:54.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.604+0000 7f24fb7fe700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24e40a14d0 0x7f24e40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:54.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.605+0000 7f24fb7fe700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24e40a14d0 0x7f24e40a3990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24fc104180 tx=0x7f24ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:54.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.606+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f24f4097c10 con 0x7f24fc104cc0 2023-10-05T15:34:54.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.823+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24fc1a13f0 con 0x7f24fc104cc0 2023-10-05T15:34:54.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.824+0000 7f24f8ff9700 1 -- 172.21.15.17:0/3842566856 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7f24f4003d70 con 0x7f24fc104cc0 2023-10-05T15:34:54.827 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:54.827 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24e40a14d0 msgr2=0x7f24e40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24e40a14d0 0x7f24e40a3990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f24fc104180 tx=0x7f24ec009260 comp rx=0 tx=0).stop 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 msgr2=0x7f24fc1a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc1a0310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009fd0 tx=0x7f24f400cab0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 shutdown_connections 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f24e40a14d0 0x7f24e40a3990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24fc104cc0 0x7f24fc1a0310 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc103130 0x7f24fc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 --2- 172.21.15.17:0/3842566856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24fc104320 0x7f24fc1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:54.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 >> 172.21.15.17:0/3842566856 conn(0x7f24fc0fe6a0 msgr2=0x7f24fc1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:54.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 shutdown_connections 2023-10-05T15:34:54.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:54.827+0000 7f25021ff700 1 -- 172.21.15.17:0/3842566856 wait complete. 2023-10-05T15:34:54.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:34:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 -- 172.21.15.17:0/2948660583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 msgr2=0x7fb218109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 --2- 172.21.15.17:0/2948660583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 0x7fb218109360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb21000b0a0 tx=0x7fb21000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 -- 172.21.15.17:0/2948660583 shutdown_connections 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 --2- 172.21.15.17:0/2948660583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 0x7fb218109360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 --2- 172.21.15.17:0/2948660583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218100ea0 0x7fb2181012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 --2- 172.21.15.17:0/2948660583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb218102080 0x7fb218102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.049+0000 7fb21edff700 1 -- 172.21.15.17:0/2948660583 >> 172.21.15.17:0/2948660583 conn(0x7fb2180fc420 msgr2=0x7fb2180fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.050+0000 7fb21edff700 1 -- 172.21.15.17:0/2948660583 shutdown_connections 2023-10-05T15:34:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.050+0000 7fb21edff700 1 -- 172.21.15.17:0/2948660583 wait complete. 2023-10-05T15:34:55.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 Processor -- start 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 -- start start 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb218100ea0 0x7fb218074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 0x7fb2180732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 0x7fb2180737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb218073f80 con 0x7fb218102080 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2180740f0 con 0x7fb218102a40 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb21edff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2181a0c00 con 0x7fb218100ea0 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb217fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 0x7fb2180732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb217fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 0x7fb2180732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44744/0 (socket says 172.21.15.17:44744) 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.051+0000 7fb217fff700 1 -- 172.21.15.17:0/2803446056 learned_addr learned my addr 172.21.15.17:0/2803446056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb21cb9b700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb218100ea0 0x7fb218074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb21d39c700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 0x7fb2180737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb217fff700 1 -- 172.21.15.17:0/2803446056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb218100ea0 msgr2=0x7fb218074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb217fff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb218100ea0 0x7fb218074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb217fff700 1 -- 172.21.15.17:0/2803446056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 msgr2=0x7fb2180737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb217fff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 0x7fb2180737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb217fff700 1 -- 172.21.15.17:0/2803446056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009520 con 0x7fb218102080 2023-10-05T15:34:55.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb217fff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 0x7fb2180732a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb20400e970 tx=0x7fb20400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204009790 con 0x7fb218102080 2023-10-05T15:34:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb210009d00 con 0x7fb218102080 2023-10-05T15:34:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb20400eec0 con 0x7fb218102080 2023-10-05T15:34:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.052+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204003c10 con 0x7fb218102080 2023-10-05T15:34:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.053+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2181a1200 con 0x7fb218102080 2023-10-05T15:34:55.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.054+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21810c5c0 con 0x7fb218102080 2023-10-05T15:34:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.055+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb204003db0 con 0x7fb218102080 2023-10-05T15:34:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.057+0000 7fb215ffb700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2080a14d0 0x7fb2080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.057+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb204014070 con 0x7fb218102080 2023-10-05T15:34:55.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.057+0000 7fb21cb9b700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2080a14d0 0x7fb2080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.058+0000 7fb21cb9b700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2080a14d0 0x7fb2080a3990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb218101bf0 tx=0x7fb20c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:55.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.060+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2040965d0 con 0x7fb218102080 2023-10-05T15:34:55.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:54 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3658061761' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:34:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:54 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3658061761' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:34:55.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:54 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3658061761' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:34:55.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.276+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb218107df0 con 0x7fb218102080 2023-10-05T15:34:55.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.278+0000 7fb215ffb700 1 -- 172.21.15.17:0/2803446056 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7fb204099bf0 con 0x7fb218102080 2023-10-05T15:34:55.279 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:34:55.280 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2080a14d0 msgr2=0x7fb2080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2080a14d0 0x7fb2080a3990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb218101bf0 tx=0x7fb20c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 msgr2=0x7fb2180732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 0x7fb2180732a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb20400e970 tx=0x7fb20400ec80 comp rx=0 tx=0).stop 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 shutdown_connections 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2080a14d0 0x7fb2080a3990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb218102a40 0x7fb2180737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb218100ea0 0x7fb218074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 --2- 172.21.15.17:0/2803446056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb218102080 0x7fb2180732a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 >> 172.21.15.17:0/2803446056 conn(0x7fb2180fc420 msgr2=0x7fb2180fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:55.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 shutdown_connections 2023-10-05T15:34:55.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.280+0000 7fb21edff700 1 -- 172.21.15.17:0/2803446056 wait complete. 2023-10-05T15:34:55.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-05T15:34:55.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 -- 172.21.15.17:0/445908166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 msgr2=0x7f3898073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 --2- 172.21.15.17:0/445908166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898073340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3888009990 tx=0x7f3888009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 -- 172.21.15.17:0/445908166 shutdown_connections 2023-10-05T15:34:55.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 --2- 172.21.15.17:0/445908166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898108da0 0x7f389810b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 --2- 172.21.15.17:0/445908166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898073340 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 --2- 172.21.15.17:0/445908166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3898073910 0x7f3898073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 -- 172.21.15.17:0/445908166 >> 172.21.15.17:0/445908166 conn(0x7f38980fc430 msgr2=0x7f38980fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 -- 172.21.15.17:0/445908166 shutdown_connections 2023-10-05T15:34:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.505+0000 7f389cdff700 1 -- 172.21.15.17:0/445908166 wait complete. 2023-10-05T15:34:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.506+0000 7f389cdff700 1 Processor -- start 2023-10-05T15:34:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 -- start start 2023-10-05T15:34:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898073910 0x7f3898198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3898108da0 0x7f38981a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981a08c0 con 0x7f3898074ef0 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981a0a00 con 0x7f3898073910 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389cdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981a0b90 con 0x7f3898108da0 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f3895d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f3895d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44772/0 (socket says 172.21.15.17:44772) 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f3895d9b700 1 -- 172.21.15.17:0/3568687802 learned_addr learned my addr 172.21.15.17:0/3568687802 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.507+0000 7f389659c700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898073910 0x7f3898198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3896d9d700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3898108da0 0x7f38981a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3895d9b700 1 -- 172.21.15.17:0/3568687802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3898108da0 msgr2=0x7f38981a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3895d9b700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3898108da0 0x7f38981a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3895d9b700 1 -- 172.21.15.17:0/3568687802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898073910 msgr2=0x7f3898198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3895d9b700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898073910 0x7f3898198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3895d9b700 1 -- 172.21.15.17:0/3568687802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880095f0 con 0x7f3898074ef0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f389659c700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898073910 0x7f3898198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f3895d9b700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898199280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d980 tx=0x7f388c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.508+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00f890 con 0x7f3898074ef0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.509+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f388c00fe80 con 0x7f3898074ef0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.509+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38981a0e70 con 0x7f3898074ef0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.509+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c019360 con 0x7f3898074ef0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.509+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38981a12f0 con 0x7f3898074ef0 2023-10-05T15:34:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.510+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3898107450 con 0x7f3898074ef0 2023-10-05T15:34:55.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.512+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f388c00f9f0 con 0x7f3898074ef0 2023-10-05T15:34:55.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.513+0000 7f38877fe700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38800a1480 0x7f38800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:55.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.513+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f388c0cc900 con 0x7f3898074ef0 2023-10-05T15:34:55.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.513+0000 7f389659c700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38800a1480 0x7f38800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:55.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.514+0000 7f389659c700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38800a1480 0x7f38800a3940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f388800b5c0 tx=0x7f3888005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.517+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f388c095d10 con 0x7f3898074ef0 2023-10-05T15:34:55.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:55.780+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f389810e7d0 con 0x7f3898074ef0 2023-10-05T15:34:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:55 smithi167 ceph-mon[133366]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:55 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3842566856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:55 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2803446056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:55 smithi079 ceph-mon[132936]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:55 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3842566856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:55 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2803446056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:55 smithi017 ceph-mon[129107]: pgmap v315: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:55 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3842566856' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:55 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2803446056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:34:56.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.715+0000 7f38877fe700 1 -- 172.21.15.17:0/3568687802 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f388c099330 con 0x7f3898074ef0 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.719+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38800a1480 msgr2=0x7f38800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.719+0000 7f389cdff700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38800a1480 0x7f38800a3940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f388800b5c0 tx=0x7f3888005fb0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.719+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 msgr2=0x7f3898199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.719+0000 7f389cdff700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898199280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f388c00d980 tx=0x7f388c00dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 shutdown_connections 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38800a1480 0x7f38800a3940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3898108da0 0x7f38981a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3898073910 0x7f3898198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 --2- 172.21.15.17:0/3568687802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3898074ef0 0x7f3898199280 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 >> 172.21.15.17:0/3568687802 conn(0x7f38980fc430 msgr2=0x7f38980fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 shutdown_connections 2023-10-05T15:34:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.720+0000 7f389cdff700 1 -- 172.21.15.17:0/3568687802 wait complete. 2023-10-05T15:34:56.745 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-10-05T15:34:56.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 -- 172.21.15.17:0/1429804603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614102080 msgr2=0x7f0614102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 --2- 172.21.15.17:0/1429804603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614102080 0x7f0614102500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0608009990 tx=0x7f0608009ca0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 -- 172.21.15.17:0/1429804603 shutdown_connections 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 --2- 172.21.15.17:0/1429804603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0614102a40 0x7f0614109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 --2- 172.21.15.17:0/1429804603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0614100ea0 0x7f06141012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 --2- 172.21.15.17:0/1429804603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614102080 0x7f0614102500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 -- 172.21.15.17:0/1429804603 >> 172.21.15.17:0/1429804603 conn(0x7f06140fc460 msgr2=0x7f06140fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 -- 172.21.15.17:0/1429804603 shutdown_connections 2023-10-05T15:34:56.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.958+0000 7f06199ff700 1 -- 172.21.15.17:0/1429804603 wait complete. 2023-10-05T15:34:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 Processor -- start 2023-10-05T15:34:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 -- start start 2023-10-05T15:34:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 0x7f0614196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0614102080 0x7f0614197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:56.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0614102a40 0x7f061419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061419e6d0 con 0x7f0614100ea0 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061419e810 con 0x7f0614102080 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f06199ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061419e9a0 con 0x7f0614102a40 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.959+0000 7f0612ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 0x7f0614196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 0x7f0614196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44800/0 (socket says 172.21.15.17:44800) 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 -- 172.21.15.17:0/2083383958 learned_addr learned my addr 172.21.15.17:0/2083383958 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f06127fc700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0614102080 0x7f0614197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 -- 172.21.15.17:0/2083383958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0614102a40 msgr2=0x7f061419e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0614102a40 0x7f061419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 -- 172.21.15.17:0/2083383958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0614102080 msgr2=0x7f0614197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0614102080 0x7f0614197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:56.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 -- 172.21.15.17:0/2083383958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080095f0 con 0x7f0614100ea0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f0612ffd700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 0x7f0614196b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f060400d980 tx=0x7f060400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604004020 con 0x7f0614100ea0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0604009730 con 0x7f0614100ea0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061419ec80 con 0x7f0614100ea0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.960+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604003a00 con 0x7f0614100ea0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.961+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061419f190 con 0x7f0614100ea0 2023-10-05T15:34:56.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.961+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614107ed0 con 0x7f0614100ea0 2023-10-05T15:34:56.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.963+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f06040098a0 con 0x7f0614100ea0 2023-10-05T15:34:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.965+0000 7f06189fd700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05fc0a1500 0x7f05fc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.965+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f06040ccb90 con 0x7f0614100ea0 2023-10-05T15:34:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.965+0000 7f06127fc700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05fc0a1500 0x7f05fc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:56.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.966+0000 7f06127fc700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05fc0a1500 0x7f05fc0a39c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0608000c00 tx=0x7f060800b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:56.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:56.969+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0604095fa0 con 0x7f0614100ea0 2023-10-05T15:34:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:56 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3568687802' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-05T15:34:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:56 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3568687802' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-05T15:34:57.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:56 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3568687802' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-05T15:34:57.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.226+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f061402d020 con 0x7f0614100ea0 2023-10-05T15:34:57.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.716+0000 7f06189fd700 1 -- 172.21.15.17:0/2083383958 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f06040995c0 con 0x7f0614100ea0 2023-10-05T15:34:57.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05fc0a1500 msgr2=0x7f05fc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05fc0a1500 0x7f05fc0a39c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0608000c00 tx=0x7f060800b560 comp rx=0 tx=0).stop 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 msgr2=0x7f0614196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 0x7f0614196b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f060400d980 tx=0x7f060400dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 shutdown_connections 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05fc0a1500 0x7f05fc0a39c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0614102a40 0x7f061419e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0614100ea0 0x7f0614196b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 --2- 172.21.15.17:0/2083383958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0614102080 0x7f0614197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 >> 172.21.15.17:0/2083383958 conn(0x7f06140fc460 msgr2=0x7f06140fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:57.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 shutdown_connections 2023-10-05T15:34:57.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.721+0000 7f06199ff700 1 -- 172.21.15.17:0/2083383958 wait complete. 2023-10-05T15:34:57.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 -- 172.21.15.17:0/3417094714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c108da0 msgr2=0x7fec6c10b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 --2- 172.21.15.17:0/3417094714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c108da0 0x7fec6c10b230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fec6400b0a0 tx=0x7fec6400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 -- 172.21.15.17:0/3417094714 shutdown_connections 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 --2- 172.21.15.17:0/3417094714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c108da0 0x7fec6c10b230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 --2- 172.21.15.17:0/3417094714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6c074ef0 0x7fec6c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 --2- 172.21.15.17:0/3417094714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec6c073910 0x7fec6c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 -- 172.21.15.17:0/3417094714 >> 172.21.15.17:0/3417094714 conn(0x7fec6c0fc430 msgr2=0x7fec6c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:57.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 -- 172.21.15.17:0/3417094714 shutdown_connections 2023-10-05T15:34:57.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.960+0000 7fec73bff700 1 -- 172.21.15.17:0/3417094714 wait complete. 2023-10-05T15:34:57.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 Processor -- start 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 -- start start 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 0x7fec6c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6c074ef0 0x7fec6c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec6c108da0 0x7fec6c1a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1a0960 con 0x7fec6c073910 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1a0aa0 con 0x7fec6c108da0 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.961+0000 7fec73bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1a0c30 con 0x7fec6c074ef0 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 0x7fec6c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 0x7fec6c198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44826/0 (socket says 172.21.15.17:44826) 2023-10-05T15:34:57.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 -- 172.21.15.17:0/1336674431 learned_addr learned my addr 172.21.15.17:0/1336674431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7119a700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6c074ef0 0x7fec6c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 -- 172.21.15.17:0/1336674431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6c074ef0 msgr2=0x7fec6c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6c074ef0 0x7fec6c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 -- 172.21.15.17:0/1336674431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec6c108da0 msgr2=0x7fec6c1a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec6c108da0 0x7fec6c1a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 -- 172.21.15.17:0/1336674431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009d00 con 0x7fec6c073910 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.962+0000 7fec7199b700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 0x7fec6c198de0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fec6800e9a0 tx=0x7fec6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.963+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68009790 con 0x7fec6c073910 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.963+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec6800cbd0 con 0x7fec6c073910 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.963+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68018680 con 0x7fec6c073910 2023-10-05T15:34:57.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.963+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c1a0f10 con 0x7fec6c073910 2023-10-05T15:34:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.963+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c1a12e0 con 0x7fec6c073910 2023-10-05T15:34:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.964+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c107450 con 0x7fec6c073910 2023-10-05T15:34:57.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.966+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fec6800cd40 con 0x7fec6c073910 2023-10-05T15:34:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.967+0000 7fec62ffd700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec580a1500 0x7fec580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.967+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fec68014070 con 0x7fec6c073910 2023-10-05T15:34:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.967+0000 7fec7119a700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec580a1500 0x7fec580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:57.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.968+0000 7fec7119a700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec580a1500 0x7fec580a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec6c074c10 tx=0x7fec5c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:57.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:57.971+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fec68052100 con 0x7fec6c073910 2023-10-05T15:34:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:57 smithi167 ceph-mon[133366]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:57 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3568687802' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-05T15:34:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:57 smithi167 ceph-mon[133366]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:57 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2083383958' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-05T15:34:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:57 smithi079 ceph-mon[132936]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:57 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3568687802' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-05T15:34:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:57 smithi079 ceph-mon[132936]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:58.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:57 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2083383958' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-05T15:34:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:57 smithi017 ceph-mon[129107]: pgmap v316: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2023-10-05T15:34:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:57 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3568687802' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-05T15:34:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:57 smithi017 ceph-mon[129107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:58.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:57 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2083383958' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-05T15:34:58.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.228+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fec6c02d0c0 con 0x7fec6c073910 2023-10-05T15:34:58.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.730+0000 7fec62ffd700 1 -- 172.21.15.17:0/1336674431 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fec68096570 con 0x7fec6c073910 2023-10-05T15:34:58.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec580a1500 msgr2=0x7fec580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec580a1500 0x7fec580a39c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec6c074c10 tx=0x7fec5c009260 comp rx=0 tx=0).stop 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 msgr2=0x7fec6c198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 0x7fec6c198de0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fec6800e9a0 tx=0x7fec6800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 shutdown_connections 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fec580a1500 0x7fec580a39c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec6c108da0 0x7fec6c1a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec6c073910 0x7fec6c198de0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 --2- 172.21.15.17:0/1336674431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec6c074ef0 0x7fec6c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 >> 172.21.15.17:0/1336674431 conn(0x7fec6c0fc430 msgr2=0x7fec6c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 shutdown_connections 2023-10-05T15:34:58.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.734+0000 7fec73bff700 1 -- 172.21.15.17:0/1336674431 wait complete. 2023-10-05T15:34:58.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-05T15:34:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.972+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1512694967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102a30 msgr2=0x7f45a4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.972+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1512694967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102a30 0x7f45a4109350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f459c00b0a0 tx=0x7f459c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1512694967 shutdown_connections 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1512694967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102a30 0x7f45a4109350 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1512694967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a4100e90 0x7f45a41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1512694967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a4102070 0x7f45a41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1512694967 >> 172.21.15.17:0/1512694967 conn(0x7f45a40fc430 msgr2=0x7f45a40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1512694967 shutdown_connections 2023-10-05T15:34:58.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.973+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1512694967 wait complete. 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 Processor -- start 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 -- start start 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a4100e90 0x7f45a4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 0x7f45a40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a4102a30 0x7f45a40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4073f80 con 0x7f45a4102070 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40740f0 con 0x7f45a4100e90 2023-10-05T15:34:58.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45aa5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41a0c70 con 0x7f45a4102a30 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 0x7f45a40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45a3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 0x7f45a40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44840/0 (socket says 172.21.15.17:44840) 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f45a3fff700 1 -- 172.21.15.17:0/1360651873 learned_addr learned my addr 172.21.15.17:0/1360651873 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.974+0000 7f459bfff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a4100e90 0x7f45a4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a8b9c700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a4102a30 0x7f45a40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a3fff700 1 -- 172.21.15.17:0/1360651873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a4102a30 msgr2=0x7f45a40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a3fff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a4102a30 0x7f45a40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a3fff700 1 -- 172.21.15.17:0/1360651873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a4100e90 msgr2=0x7f45a4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a3fff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a4100e90 0x7f45a4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a3fff700 1 -- 172.21.15.17:0/1360651873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009d00 con 0x7f45a4102070 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a3fff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 0x7f45a40732a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f458c00d980 tx=0x7f458c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c004020 con 0x7f45a4102070 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a41a0f50 con 0x7f45a4102070 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f458c00f690 con 0x7f45a4102070 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0039e0 con 0x7f45a4102070 2023-10-05T15:34:58.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.975+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a41a13d0 con 0x7f45a4102070 2023-10-05T15:34:58.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.976+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a410c600 con 0x7f45a4102070 2023-10-05T15:34:58.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.978+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f458c00f800 con 0x7f45a4102070 2023-10-05T15:34:58.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.980+0000 7f45a1ffb700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45900a1480 0x7f45900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:58.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.980+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f458c0cce40 con 0x7f45a4102070 2023-10-05T15:34:58.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.980+0000 7f459bfff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45900a1480 0x7f45900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:58.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.981+0000 7f459bfff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45900a1480 0x7f45900a3940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45a4101be0 tx=0x7f459400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:58.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:58.982+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f458c096250 con 0x7f45a4102070 2023-10-05T15:34:59.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-05T15:34:59.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2083383958' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-05T15:34:59.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-05T15:34:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2023-10-05T15:34:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: daemon mds.g is now active in filesystem cephfs as rank 1 2023-10-05T15:34:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1336674431' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-05T15:34:59.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:58 smithi167 ceph-mon[133366]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 0 op/s 2023-10-05T15:34:59.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-05T15:34:59.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2083383958' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-05T15:34:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-05T15:34:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2023-10-05T15:34:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: daemon mds.g is now active in filesystem cephfs as rank 1 2023-10-05T15:34:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1336674431' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-05T15:34:59.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:58 smithi079 ceph-mon[132936]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 0 op/s 2023-10-05T15:34:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-05T15:34:59.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2083383958' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-05T15:34:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-05T15:34:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-05T15:34:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2023-10-05T15:34:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: daemon mds.g is now active in filesystem cephfs as rank 1 2023-10-05T15:34:59.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1336674431' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-05T15:34:59.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:58 smithi017 ceph-mon[129107]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 0 op/s 2023-10-05T15:34:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.245+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f45a410c890 con 0x7f45a4102070 2023-10-05T15:34:59.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.738+0000 7f45a1ffb700 1 -- 172.21.15.17:0/1360651873 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f45a410c890 con 0x7f45a4102070 2023-10-05T15:34:59.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45900a1480 msgr2=0x7f45900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45900a1480 0x7f45900a3940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f45a4101be0 tx=0x7f459400b410 comp rx=0 tx=0).stop 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 msgr2=0x7f45a40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 0x7f45a40732a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f458c00d980 tx=0x7f458c00dc90 comp rx=0 tx=0).stop 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 shutdown_connections 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45900a1480 0x7f45900a3940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a4102a30 0x7f45a40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45a4100e90 0x7f45a4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 --2- 172.21.15.17:0/1360651873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45a4102070 0x7f45a40732a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 >> 172.21.15.17:0/1360651873 conn(0x7f45a40fc430 msgr2=0x7f45a40fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 shutdown_connections 2023-10-05T15:34:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.742+0000 7f45aa5ff700 1 -- 172.21.15.17:0/1360651873 wait complete. 2023-10-05T15:34:59.771 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2023-10-05T15:34:59.771 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-05T15:34:59.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 -- 172.21.15.17:0/4265243492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308106ca0 msgr2=0x7fe308109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:59.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 --2- 172.21.15.17:0/4265243492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308106ca0 0x7fe308109090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe30000b0a0 tx=0x7fe30000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 -- 172.21.15.17:0/4265243492 shutdown_connections 2023-10-05T15:34:59.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 --2- 172.21.15.17:0/4265243492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308106ca0 0x7fe308109090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 --2- 172.21.15.17:0/4265243492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe308101a40 0x7fe308103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 --2- 172.21.15.17:0/4265243492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308104370 0x7fe308106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 -- 172.21.15.17:0/4265243492 >> 172.21.15.17:0/4265243492 conn(0x7fe3080fb370 msgr2=0x7fe3080fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:34:59.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 -- 172.21.15.17:0/4265243492 shutdown_connections 2023-10-05T15:34:59.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.981+0000 7fe30fbff700 1 -- 172.21.15.17:0/4265243492 wait complete. 2023-10-05T15:34:59.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.982+0000 7fe30fbff700 1 Processor -- start 2023-10-05T15:34:59.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.982+0000 7fe30fbff700 1 -- start start 2023-10-05T15:34:59.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30fbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 0x7fe308198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30fbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308104370 0x7fe308199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30fbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe308106ca0 0x7fe3081a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30fbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081a0940 con 0x7fe308104370 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30fbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081a0a80 con 0x7fe308106ca0 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30fbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081a0c10 con 0x7fe308101a40 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 0x7fe308198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 0x7fe308198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:45350/0 (socket says 172.21.15.17:45350) 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308104370 0x7fe308199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 -- 172.21.15.17:0/2078948963 learned_addr learned my addr 172.21.15.17:0/2078948963 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30e19c700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe308106ca0 0x7fe3081a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:59.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 -- 172.21.15.17:0/2078948963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe308106ca0 msgr2=0x7fe3081a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe308106ca0 0x7fe3081a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 -- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308104370 msgr2=0x7fe308199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.983+0000 7fe30d99b700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308104370 0x7fe308199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe30d99b700 1 -- 172.21.15.17:0/2078948963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009d00 con 0x7fe308101a40 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe30d19a700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308104370 0x7fe308199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe30d99b700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 0x7fe308198dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e9a0 tx=0x7fe30400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304009790 con 0x7fe308101a40 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe304010430 con 0x7fe308101a40 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3081a0ef0 con 0x7fe308101a40 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400cea0 con 0x7fe308101a40 2023-10-05T15:34:59.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.984+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3081a1310 con 0x7fe308101a40 2023-10-05T15:34:59.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.985+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308108820 con 0x7fe308101a40 2023-10-05T15:34:59.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.988+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe3040105a0 con 0x7fe308101a40 2023-10-05T15:34:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.989+0000 7fe2feffd700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2f40a1480 0x7fe2f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:34:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.989+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe304014070 con 0x7fe308101a40 2023-10-05T15:34:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.989+0000 7fe30d19a700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2f40a1480 0x7fe2f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:34:59.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.990+0000 7fe30d19a700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2f40a1480 0x7fe2f40a3940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8011490 tx=0x7fe2f8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:34:59.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:34:59.991+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe3040966b0 con 0x7fe308101a40 2023-10-05T15:35:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1336674431' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-05T15:35:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] up:active 2023-10-05T15:35:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-05T15:35:00.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2023-10-05T15:35:00.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2023-10-05T15:35:00.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-10-05T15:35:00.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:34:59 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1360651873' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-05T15:35:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1336674431' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-05T15:35:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] up:active 2023-10-05T15:35:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-05T15:35:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2023-10-05T15:35:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2023-10-05T15:35:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-10-05T15:35:00.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:34:59 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1360651873' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-05T15:35:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1336674431' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-05T15:35:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] up:active 2023-10-05T15:35:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-05T15:35:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2023-10-05T15:35:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2023-10-05T15:35:00.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-10-05T15:35:00.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:34:59 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1360651873' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-05T15:35:00.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.235+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fe30810c590 con 0x7fe2f40a1480 2023-10-05T15:35:00.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:35:00.241+0000 7f322538d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:35:00.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:35:00.241+0000 7f322538d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:35:00.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:35:00.241+0000 7f322538d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:35:00.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:35:00.241+0000 7f322538d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:35:00.697 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:35:00.241+0000 7f322538d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-05T15:35:00.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.795+0000 7fe2feffd700 1 -- 172.21.15.17:0/2078948963 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe30810c590 con 0x7fe2f40a1480 2023-10-05T15:35:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2f40a1480 msgr2=0x7fe2f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2f40a1480 0x7fe2f40a3940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8011490 tx=0x7fe2f8009260 comp rx=0 tx=0).stop 2023-10-05T15:35:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 msgr2=0x7fe308198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 0x7fe308198dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e9a0 tx=0x7fe30400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 shutdown_connections 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2f40a1480 0x7fe2f40a3940 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe308106ca0 0x7fe3081a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe308101a40 0x7fe308198dc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 --2- 172.21.15.17:0/2078948963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe308104370 0x7fe308199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 >> 172.21.15.17:0/2078948963 conn(0x7fe3080fb370 msgr2=0x7fe3081000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 shutdown_connections 2023-10-05T15:35:00.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:00.798+0000 7fe30fbff700 1 -- 172.21.15.17:0/2078948963 wait complete. 2023-10-05T15:35:00.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-05T15:35:01.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 -- 172.21.15.17:0/4142741206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102070 msgr2=0x7f0f5c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 --2- 172.21.15.17:0/4142741206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102070 0x7f0f5c1024f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009990 tx=0x7f0f4c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 -- 172.21.15.17:0/4142741206 shutdown_connections 2023-10-05T15:35:01.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 --2- 172.21.15.17:0/4142741206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102a30 0x7f0f5c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 --2- 172.21.15.17:0/4142741206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c100e90 0x7f0f5c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 --2- 172.21.15.17:0/4142741206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102070 0x7f0f5c1024f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.025+0000 7f0f635ff700 1 -- 172.21.15.17:0/4142741206 >> 172.21.15.17:0/4142741206 conn(0x7f0f5c0fc430 msgr2=0x7f0f5c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:01.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.026+0000 7f0f635ff700 1 -- 172.21.15.17:0/4142741206 shutdown_connections 2023-10-05T15:35:01.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.026+0000 7f0f635ff700 1 -- 172.21.15.17:0/4142741206 wait complete. 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 Processor -- start 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 -- start start 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c100e90 0x7f0f5c196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102070 0x7f0f5c197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 0x7f0f5c19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c19e6d0 con 0x7f0f5c102a30 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c19e810 con 0x7f0f5c100e90 2023-10-05T15:35:01.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f635ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c19e9a0 con 0x7f0f5c102070 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f61b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 0x7f0f5c19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f61b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 0x7f0f5c19e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44906/0 (socket says 172.21.15.17:44906) 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f61b9c700 1 -- 172.21.15.17:0/3142744731 learned_addr learned my addr 172.21.15.17:0/3142744731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f60b9a700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102070 0x7f0f5c197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.027+0000 7f0f6139b700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c100e90 0x7f0f5c196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f61b9c700 1 -- 172.21.15.17:0/3142744731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102070 msgr2=0x7f0f5c197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f61b9c700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102070 0x7f0f5c197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f61b9c700 1 -- 172.21.15.17:0/3142744731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c100e90 msgr2=0x7f0f5c196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f61b9c700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c100e90 0x7f0f5c196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f61b9c700 1 -- 172.21.15.17:0/3142744731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0095f0 con 0x7f0f5c102a30 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f61b9c700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 0x7f0f5c19e100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0f54007ee0 tx=0x7f0f5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54017070 con 0x7f0f5c102a30 2023-10-05T15:35:01.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f5400f040 con 0x7f0f5c102a30 2023-10-05T15:35:01.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c19ec80 con 0x7f0f5c102a30 2023-10-05T15:35:01.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54005570 con 0x7f0f5c102a30 2023-10-05T15:35:01.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.028+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c19f140 con 0x7f0f5c102a30 2023-10-05T15:35:01.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.029+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c107f20 con 0x7f0f5c102a30 2023-10-05T15:35:01.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.031+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0f5400db20 con 0x7f0f5c102a30 2023-10-05T15:35:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.033+0000 7f0f527fc700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0f480a1480 0x7f0f480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.033+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0f540cc660 con 0x7f0f5c102a30 2023-10-05T15:35:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.033+0000 7f0f6139b700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0f480a1480 0x7f0f480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.034+0000 7f0f6139b700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0f480a1480 0x7f0f480a3940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c101be0 tx=0x7f0f58007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:01.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.037+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0f54095a70 con 0x7f0f5c102a30 2023-10-05T15:35:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1360651873' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-05T15:35:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] up:active 2023-10-05T15:35:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-05T15:35:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2023-10-05T15:35:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2023-10-05T15:35:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: daemon mds.h is now active in filesystem cephfs as rank 3 2023-10-05T15:35:01.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: from='client.24808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:01.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:00 smithi167 ceph-mon[133366]: pgmap v318: 129 pgs: 129 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-10-05T15:35:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1360651873' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-05T15:35:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] up:active 2023-10-05T15:35:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-05T15:35:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2023-10-05T15:35:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2023-10-05T15:35:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: daemon mds.h is now active in filesystem cephfs as rank 3 2023-10-05T15:35:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: from='client.24808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:01.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:00 smithi079 ceph-mon[132936]: pgmap v318: 129 pgs: 129 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-10-05T15:35:01.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1360651873' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] up:active 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=h=up:creating} 8 up:standby 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: daemon mds.h is now active in filesystem cephfs as rank 3 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: from='client.24808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:00 smithi017 ceph-mon[129107]: pgmap v318: 129 pgs: 129 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2023-10-05T15:35:01.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.284+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f5c02d2e0 con 0x7f0f480a1480 2023-10-05T15:35:01.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.289+0000 7f0f527fc700 1 -- 172.21.15.17:0/3142744731 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f0f5c02d2e0 con 0x7f0f480a1480 2023-10-05T15:35:01.291 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/_nogroup/sv_0/bdad900e-df50-4874-b7b8-b1053796183f 2023-10-05T15:35:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0f480a1480 msgr2=0x7f0f480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0f480a1480 0x7f0f480a3940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c101be0 tx=0x7f0f58007400 comp rx=0 tx=0).stop 2023-10-05T15:35:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 msgr2=0x7f0f5c19e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 0x7f0f5c19e100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0f54007ee0 tx=0x7f0f5400d3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 shutdown_connections 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0f480a1480 0x7f0f480a3940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f5c102a30 0x7f0f5c19e100 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c100e90 0x7f0f5c196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 --2- 172.21.15.17:0/3142744731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102070 0x7f0f5c197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 >> 172.21.15.17:0/3142744731 conn(0x7f0f5c0fc430 msgr2=0x7f0f5c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 shutdown_connections 2023-10-05T15:35:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.291+0000 7f0f635ff700 1 -- 172.21.15.17:0/3142744731 wait complete. 2023-10-05T15:35:01.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-05T15:35:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3584161351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 msgr2=0x7fcb74073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3584161351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74073d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009990 tx=0x7fcb68009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3584161351 shutdown_connections 2023-10-05T15:35:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3584161351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb74108db0 0x7fcb7410b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3584161351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb74074ef0 0x7fcb74073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3584161351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74073d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3584161351 >> 172.21.15.17:0/3584161351 conn(0x7fcb740fc460 msgr2=0x7fcb740fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3584161351 shutdown_connections 2023-10-05T15:35:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.519+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3584161351 wait complete. 2023-10-05T15:35:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.520+0000 7fcb7a5ff700 1 Processor -- start 2023-10-05T15:35:01.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.520+0000 7fcb7a5ff700 1 -- start start 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb7a5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb7a5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb74074ef0 0x7fcb74199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb7a5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb74108db0 0x7fcb741a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb7a5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741a0830 con 0x7fcb74073910 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb7a5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741a09a0 con 0x7fcb74108db0 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb7a5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741a0b60 con 0x7fcb74074ef0 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb73fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb73fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44920/0 (socket says 172.21.15.17:44920) 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb73fff700 1 -- 172.21.15.17:0/3049919879 learned_addr learned my addr 172.21.15.17:0/3049919879 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb737fe700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb74074ef0 0x7fcb74199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.521+0000 7fcb78b9c700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb74108db0 0x7fcb741a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb73fff700 1 -- 172.21.15.17:0/3049919879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb74074ef0 msgr2=0x7fcb74199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb73fff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb74074ef0 0x7fcb74199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb73fff700 1 -- 172.21.15.17:0/3049919879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb74108db0 msgr2=0x7fcb741a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb73fff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb74108db0 0x7fcb741a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb73fff700 1 -- 172.21.15.17:0/3049919879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680095f0 con 0x7fcb74073910 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb73fff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74198cc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c9b0 tx=0x7fcb6400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64007b00 con 0x7fcb74073910 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb6400ce50 con 0x7fcb74073910 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64018420 con 0x7fcb74073910 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb741a0e40 con 0x7fcb74073910 2023-10-05T15:35:01.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.522+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb741a1260 con 0x7fcb74073910 2023-10-05T15:35:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.523+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb74107460 con 0x7fcb74073910 2023-10-05T15:35:01.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.525+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcb6400f450 con 0x7fcb74073910 2023-10-05T15:35:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.528+0000 7fcb717fa700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcb5c0a1500 0x7fcb5c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.528+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcb640ccdb0 con 0x7fcb74073910 2023-10-05T15:35:01.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.528+0000 7fcb737fe700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcb5c0a1500 0x7fcb5c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:01.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.528+0000 7fcb737fe700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcb5c0a1500 0x7fcb5c0a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb6800b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.532+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb64096220 con 0x7fcb74073910 2023-10-05T15:35:01.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.786+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb7402d320 con 0x7fcb5c0a1500 2023-10-05T15:35:01.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.811+0000 7fcb717fa700 1 -- 172.21.15.17:0/3049919879 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcb7402d320 con 0x7fcb5c0a1500 2023-10-05T15:35:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcb5c0a1500 msgr2=0x7fcb5c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcb5c0a1500 0x7fcb5c0a39c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb68000c00 tx=0x7fcb6800b560 comp rx=0 tx=0).stop 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 msgr2=0x7fcb74198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74198cc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c9b0 tx=0x7fcb6400ccc0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 shutdown_connections 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcb5c0a1500 0x7fcb5c0a39c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb74108db0 0x7fcb741a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb74073910 0x7fcb74198cc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 --2- 172.21.15.17:0/3049919879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb74074ef0 0x7fcb74199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 >> 172.21.15.17:0/3049919879 conn(0x7fcb740fc460 msgr2=0x7fcb740fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 shutdown_connections 2023-10-05T15:35:01.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:01.814+0000 7fcb7a5ff700 1 -- 172.21.15.17:0/3049919879 wait complete. 2023-10-05T15:35:01.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-05T15:35:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.038+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/3549739094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102a30 msgr2=0x7ffb84109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.038+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/3549739094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102a30 0x7ffb84109350 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00b0a0 tx=0x7ffb7c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/3549739094 shutdown_connections 2023-10-05T15:35:02.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/3549739094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102a30 0x7ffb84109350 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/3549739094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb84100e90 0x7ffb841012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/3549739094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb84102070 0x7ffb841024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/3549739094 >> 172.21.15.17:0/3549739094 conn(0x7ffb840fc430 msgr2=0x7ffb840fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:02.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/3549739094 shutdown_connections 2023-10-05T15:35:02.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.039+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/3549739094 wait complete. 2023-10-05T15:35:02.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 Processor -- start 2023-10-05T15:35:02.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 -- start start 2023-10-05T15:35:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb84100e90 0x7ffb84074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 0x7ffb840732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb84102a30 0x7ffb840737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84073f80 con 0x7ffb84102070 2023-10-05T15:35:02.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840740f0 con 0x7ffb84100e90 2023-10-05T15:35:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.040+0000 7ffb8b7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb841a0c50 con 0x7ffb84102a30 2023-10-05T15:35:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 0x7ffb840732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 0x7ffb840732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44938/0 (socket says 172.21.15.17:44938) 2023-10-05T15:35:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 -- 172.21.15.17:0/1209805053 learned_addr learned my addr 172.21.15.17:0/1209805053 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb8959b700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb84100e90 0x7ffb84074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 -- 172.21.15.17:0/1209805053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb84102a30 msgr2=0x7ffb840737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb84102a30 0x7ffb840737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 -- 172.21.15.17:0/1209805053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb84100e90 msgr2=0x7ffb84074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb84100e90 0x7ffb84074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 -- 172.21.15.17:0/1209805053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80009520 con 0x7ffb84102070 2023-10-05T15:35:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb88d9a700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 0x7ffb840732a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400e970 tx=0x7ffb7400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:02.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74009790 con 0x7ffb84102070 2023-10-05T15:35:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb7400eec0 con 0x7ffb84102070 2023-10-05T15:35:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c009d00 con 0x7ffb84102070 2023-10-05T15:35:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.041+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74003c10 con 0x7ffb84102070 2023-10-05T15:35:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.042+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb841a12d0 con 0x7ffb84102070 2023-10-05T15:35:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.043+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8410c5b0 con 0x7ffb84102070 2023-10-05T15:35:02.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.045+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ffb74003e50 con 0x7ffb84102070 2023-10-05T15:35:02.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.046+0000 7ffb7a7fc700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ffb700a1500 0x7ffb700a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.046+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ffb74014070 con 0x7ffb84102070 2023-10-05T15:35:02.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.046+0000 7ffb8959b700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ffb700a1500 0x7ffb700a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.047+0000 7ffb8959b700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ffb700a1500 0x7ffb700a39c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb84101be0 tx=0x7ffb80009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:02.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.050+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffb74096540 con 0x7ffb84102070 2023-10-05T15:35:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] up:active 2023-10-05T15:35:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-05T15:35:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-05T15:35:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: Cluster is now healthy 2023-10-05T15:35:02.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=h=up:active} 8 up:standby 2023-10-05T15:35:02.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-05T15:35:02.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: daemon mds.c is now active in filesystem cephfs as rank 4 2023-10-05T15:35:02.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:02.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: mds.? [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] up:active 2023-10-05T15:35:02.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:01 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:35:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] up:active 2023-10-05T15:35:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-05T15:35:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-05T15:35:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: Cluster is now healthy 2023-10-05T15:35:02.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=h=up:active} 8 up:standby 2023-10-05T15:35:02.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-05T15:35:02.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: daemon mds.c is now active in filesystem cephfs as rank 4 2023-10-05T15:35:02.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:02.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: mds.? [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] up:active 2023-10-05T15:35:02.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:01 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:35:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] up:active 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: Cluster is now healthy 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: fsmap cephfs:4 {0=b=up:active,1=g=up:active,2=i=up:active,3=h=up:active} 8 up:standby 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: daemon mds.c is now active in filesystem cephfs as rank 4 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: mds.? [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] up:active 2023-10-05T15:35:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:01 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:35:02.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.297+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb840612f0 con 0x7ffb700a1500 2023-10-05T15:35:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.301+0000 7ffb7a7fc700 1 -- 172.21.15.17:0/1209805053 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7ffb840612f0 con 0x7ffb700a1500 2023-10-05T15:35:02.303 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/_nogroup/sv_1/284215cb-bf42-4587-aa9c-fe962cc0844a 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ffb700a1500 msgr2=0x7ffb700a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ffb700a1500 0x7ffb700a39c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb84101be0 tx=0x7ffb80009260 comp rx=0 tx=0).stop 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 msgr2=0x7ffb840732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 0x7ffb840732a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400e970 tx=0x7ffb7400ec80 comp rx=0 tx=0).stop 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 shutdown_connections 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ffb700a1500 0x7ffb700a39c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb84102a30 0x7ffb840737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb84100e90 0x7ffb84074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 --2- 172.21.15.17:0/1209805053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb84102070 0x7ffb840732a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 >> 172.21.15.17:0/1209805053 conn(0x7ffb840fc430 msgr2=0x7ffb840fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 shutdown_connections 2023-10-05T15:35:02.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.304+0000 7ffb8b7ff700 1 -- 172.21.15.17:0/1209805053 wait complete. 2023-10-05T15:35:02.324 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 -- 172.21.15.17:0/549095240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 msgr2=0x7f8738073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 --2- 172.21.15.17:0/549095240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738073340 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8728009990 tx=0x7f8728009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 -- 172.21.15.17:0/549095240 shutdown_connections 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 --2- 172.21.15.17:0/549095240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8738108db0 0x7f873810b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 --2- 172.21.15.17:0/549095240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738073340 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 --2- 172.21.15.17:0/549095240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738073910 0x7f8738073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 -- 172.21.15.17:0/549095240 >> 172.21.15.17:0/549095240 conn(0x7f87380fc420 msgr2=0x7f87380fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:02.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 -- 172.21.15.17:0/549095240 shutdown_connections 2023-10-05T15:35:02.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.526+0000 7f873cdff700 1 -- 172.21.15.17:0/549095240 wait complete. 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 Processor -- start 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 -- start start 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8738073910 0x7f8738198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738108db0 0x7f87381a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381a0870 con 0x7f8738074ef0 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381a09e0 con 0x7f8738108db0 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.527+0000 7f873cdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381a0ba0 con 0x7f8738073910 2023-10-05T15:35:02.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44960/0 (socket says 172.21.15.17:44960) 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 -- 172.21.15.17:0/482643640 learned_addr learned my addr 172.21.15.17:0/482643640 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8736d9d700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738108db0 0x7f87381a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f873659c700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8738073910 0x7f8738198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 -- 172.21.15.17:0/482643640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8738073910 msgr2=0x7f8738198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8738073910 0x7f8738198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 -- 172.21.15.17:0/482643640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738108db0 msgr2=0x7f87381a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738108db0 0x7f87381a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 -- 172.21.15.17:0/482643640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280095f0 con 0x7f8738074ef0 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f8735d9b700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738199270 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f872c00d980 tx=0x7f872c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:02.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.528+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c004020 con 0x7f8738074ef0 2023-10-05T15:35:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.529+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f872c009730 con 0x7f8738074ef0 2023-10-05T15:35:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.529+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87381a0e80 con 0x7f8738074ef0 2023-10-05T15:35:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.529+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0039c0 con 0x7f8738074ef0 2023-10-05T15:35:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.529+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87381a12a0 con 0x7f8738074ef0 2023-10-05T15:35:02.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.530+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8738107460 con 0x7f8738074ef0 2023-10-05T15:35:02.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.532+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f872c0098a0 con 0x7f8738074ef0 2023-10-05T15:35:02.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.533+0000 7f87277fe700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87200a14d0 0x7f87200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:02.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.533+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f872c0ccc40 con 0x7f8738074ef0 2023-10-05T15:35:02.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.533+0000 7f873659c700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87200a14d0 0x7f87200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:02.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.534+0000 7f873659c700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87200a14d0 0x7f87200a3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f872800b5c0 tx=0x7f8728000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:02.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.537+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f872c096050 con 0x7f8738074ef0 2023-10-05T15:35:02.604 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:35:02.219+0000 7f8dddca6700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-05T15:35:02.604 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:35:02.219+0000 7f8dddca6700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-10-05T15:35:02.604 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:35:02.219+0000 7f8dddca6700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-05T15:35:02.604 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:35:02.219+0000 7f8dddca6700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-05T15:35:02.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.768+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f872c096420 con 0x7f8738074ef0 2023-10-05T15:35:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.802+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f873802d170 con 0x7f8738074ef0 2023-10-05T15:35:02.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.803+0000 7f87277fe700 1 -- 172.21.15.17:0/482643640 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f872c05f580 con 0x7f8738074ef0 2023-10-05T15:35:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:02.805 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:35:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87200a14d0 msgr2=0x7f87200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87200a14d0 0x7f87200a3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f872800b5c0 tx=0x7f8728000bc0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 msgr2=0x7f8738199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738199270 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f872c00d980 tx=0x7f872c00dc90 comp rx=0 tx=0).stop 2023-10-05T15:35:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 shutdown_connections 2023-10-05T15:35:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87200a14d0 0x7f87200a3990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8738108db0 0x7f87381a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8738073910 0x7f8738198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 --2- 172.21.15.17:0/482643640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8738074ef0 0x7f8738199270 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.805+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 >> 172.21.15.17:0/482643640 conn(0x7f87380fc420 msgr2=0x7f87380fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.806+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 shutdown_connections 2023-10-05T15:35:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:02.806+0000 7f873cdff700 1 -- 172.21.15.17:0/482643640 wait complete. 2023-10-05T15:35:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:35:02.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 -- 172.21.15.17:0/3069024802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102a30 msgr2=0x7fd030109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 --2- 172.21.15.17:0/3069024802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102a30 0x7fd030109350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd02800b0a0 tx=0x7fd02800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 -- 172.21.15.17:0/3069024802 shutdown_connections 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 --2- 172.21.15.17:0/3069024802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102a30 0x7fd030109350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 --2- 172.21.15.17:0/3069024802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030100e90 0x7fd0301012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 --2- 172.21.15.17:0/3069024802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd030102070 0x7fd0301024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 -- 172.21.15.17:0/3069024802 >> 172.21.15.17:0/3069024802 conn(0x7fd0300fc430 msgr2=0x7fd0300fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:03.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 -- 172.21.15.17:0/3069024802 shutdown_connections 2023-10-05T15:35:03.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.028+0000 7fd037bff700 1 -- 172.21.15.17:0/3069024802 wait complete. 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 Processor -- start 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 -- start start 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd030100e90 0x7fd030196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 0x7fd0301970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030102a30 0x7fd03019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03019e710 con 0x7fd030102070 2023-10-05T15:35:03.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03019e850 con 0x7fd030102a30 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.029+0000 7fd037bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03019e9e0 con 0x7fd030100e90 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 0x7fd0301970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 0x7fd0301970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44992/0 (socket says 172.21.15.17:44992) 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 -- 172.21.15.17:0/1530442720 learned_addr learned my addr 172.21.15.17:0/1530442720 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03599b700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd030100e90 0x7fd030196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03619c700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030102a30 0x7fd03019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 -- 172.21.15.17:0/1530442720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd030100e90 msgr2=0x7fd030196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd030100e90 0x7fd030196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 -- 172.21.15.17:0/1530442720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030102a30 msgr2=0x7fd03019e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030102a30 0x7fd03019e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 -- 172.21.15.17:0/1530442720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009d00 con 0x7fd030102070 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd03519a700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 0x7fd0301970d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e970 tx=0x7fd02000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.030+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020009790 con 0x7fd030102070 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.031+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0200044b0 con 0x7fd030102070 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.031+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03019ecc0 con 0x7fd030102070 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.031+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020003dd0 con 0x7fd030102070 2023-10-05T15:35:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.031+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03019f1d0 con 0x7fd030102070 2023-10-05T15:35:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.032+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03010c5b0 con 0x7fd030102070 2023-10-05T15:35:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.034+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd020004000 con 0x7fd030102070 2023-10-05T15:35:03.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.035+0000 7fd026ffd700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd01c0a15d0 0x7fd01c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.035+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd020014070 con 0x7fd030102070 2023-10-05T15:35:03.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.035+0000 7fd03599b700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd01c0a15d0 0x7fd01c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.036+0000 7fd03599b700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd01c0a15d0 0x7fd01c0a3a90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd030101be0 tx=0x7fd02c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:03.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.037+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd020096700 con 0x7fd030102070 2023-10-05T15:35:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:02 smithi167 ceph-mon[133366]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:02 smithi167 ceph-mon[133366]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:02 smithi167 ceph-mon[133366]: pgmap v319: 129 pgs: 129 active+clean; 584 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.1 KiB/s wr, 8 op/s 2023-10-05T15:35:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-mon[132936]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-mon[132936]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:03.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:02 smithi079 ceph-mon[132936]: pgmap v319: 129 pgs: 129 active+clean; 584 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.1 KiB/s wr, 8 op/s 2023-10-05T15:35:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:02 smithi017 ceph-mon[129107]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:02 smithi017 ceph-mon[129107]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:35:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:02 smithi017 ceph-mon[129107]: pgmap v319: 129 pgs: 129 active+clean; 584 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.1 KiB/s wr, 8 op/s 2023-10-05T15:35:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.254+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd03010c7a0 con 0x7fd030102070 2023-10-05T15:35:03.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.256+0000 7fd026ffd700 1 -- 172.21.15.17:0/1530442720 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+23914 (secure 0 0 0) 0x7fd020099d20 con 0x7fd030102070 2023-10-05T15:35:03.258 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:03.258 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":90,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:34:37.168626+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:35:03.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.258+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd01c0a15d0 msgr2=0x7fd01c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.258+0000 7fd037bff700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd01c0a15d0 0x7fd01c0a3a90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd030101be0 tx=0x7fd02c009260 comp rx=0 tx=0).stop 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.258+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 msgr2=0x7fd0301970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.258+0000 7fd037bff700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 0x7fd0301970d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e970 tx=0x7fd02000ed30 comp rx=0 tx=0).stop 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.258+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 shutdown_connections 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd01c0a15d0 0x7fd01c0a3a90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd030102a30 0x7fd03019e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd030100e90 0x7fd030196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 --2- 172.21.15.17:0/1530442720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd030102070 0x7fd0301970d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 >> 172.21.15.17:0/1530442720 conn(0x7fd0300fc430 msgr2=0x7fd0300fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 shutdown_connections 2023-10-05T15:35:03.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.259+0000 7fd037bff700 1 -- 172.21.15.17:0/1530442720 wait complete. 2023-10-05T15:35:03.279 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-05T15:35:03.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:35:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 -- 172.21.15.17:0/2190896572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930100ea0 msgr2=0x7f19301012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 --2- 172.21.15.17:0/2190896572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930100ea0 0x7f19301012c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1920009990 tx=0x7f1920009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 -- 172.21.15.17:0/2190896572 shutdown_connections 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 --2- 172.21.15.17:0/2190896572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1930102a40 0x7f1930109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 --2- 172.21.15.17:0/2190896572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930100ea0 0x7f19301012c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 --2- 172.21.15.17:0/2190896572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1930102080 0x7f1930102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 -- 172.21.15.17:0/2190896572 >> 172.21.15.17:0/2190896572 conn(0x7f19300fc420 msgr2=0x7f19300fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 -- 172.21.15.17:0/2190896572 shutdown_connections 2023-10-05T15:35:03.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.482+0000 7f19359ff700 1 -- 172.21.15.17:0/2190896572 wait complete. 2023-10-05T15:35:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 Processor -- start 2023-10-05T15:35:03.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 -- start start 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1930100ea0 0x7f1930196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1930102080 0x7f19301970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 0x7f193019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193019e710 con 0x7f1930102a40 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193019e850 con 0x7f1930100ea0 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.484+0000 7f19359ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193019e9e0 con 0x7f1930102080 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 0x7f193019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 0x7f193019e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45006/0 (socket says 172.21.15.17:45006) 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 -- 172.21.15.17:0/4016643257 learned_addr learned my addr 172.21.15.17:0/4016643257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192effd700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1930100ea0 0x7f1930196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192e7fc700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1930102080 0x7f19301970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 -- 172.21.15.17:0/4016643257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1930102080 msgr2=0x7f19301970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1930102080 0x7f19301970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 -- 172.21.15.17:0/4016643257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1930100ea0 msgr2=0x7f1930196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1930100ea0 0x7f1930196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 -- 172.21.15.17:0/4016643257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200095f0 con 0x7f1930102a40 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.485+0000 7f192f7fe700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 0x7f193019e140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1928007ee0 tx=0x7f192800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.486+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192800ddd0 con 0x7f1930102a40 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.486+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f192800f040 con 0x7f1930102a40 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.486+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280047d0 con 0x7f1930102a40 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.486+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193019ecc0 con 0x7f1930102a40 2023-10-05T15:35:03.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.486+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193019f180 con 0x7f1930102a40 2023-10-05T15:35:03.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.487+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19301085b0 con 0x7f1930102a40 2023-10-05T15:35:03.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.489+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1928003a00 con 0x7f1930102a40 2023-10-05T15:35:03.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.490+0000 7f19349fd700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f19180a15d0 0x7f19180a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.490+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f19280cc8d0 con 0x7f1930102a40 2023-10-05T15:35:03.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.490+0000 7f192effd700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f19180a15d0 0x7f19180a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.491+0000 7f192effd700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f19180a15d0 0x7f19180a3a90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19200098e0 tx=0x7f192000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:03.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.494+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f192804f100 con 0x7f1930102a40 2023-10-05T15:35:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.705+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f193002d2b0 con 0x7f19180a15d0 2023-10-05T15:35:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.721+0000 7f19349fd700 1 -- 172.21.15.17:0/4016643257 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422325 (secure 0 0 0) 0x7f193002d2b0 con 0x7f19180a15d0 2023-10-05T15:35:03.729 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:03.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f19180a15d0 msgr2=0x7f19180a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f19180a15d0 0x7f19180a3a90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19200098e0 tx=0x7f192000b260 comp rx=0 tx=0).stop 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 msgr2=0x7f193019e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 0x7f193019e140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1928007ee0 tx=0x7f192800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 shutdown_connections 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f19180a15d0 0x7f19180a3a90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1930102a40 0x7f193019e140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1930100ea0 0x7f1930196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 --2- 172.21.15.17:0/4016643257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1930102080 0x7f19301970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 >> 172.21.15.17:0/4016643257 conn(0x7f19300fc420 msgr2=0x7f19301056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 shutdown_connections 2023-10-05T15:35:03.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.726+0000 7f19359ff700 1 -- 172.21.15.17:0/4016643257 wait complete. 2023-10-05T15:35:03.734 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:35:03.746 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2023-10-05T15:35:02.584307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597870,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":134,"num_read_kb":117,"num_write":320,"num_write_kb":2981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335964,"kb_used_data":11764,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605860,"statfs":{"total":1151940427776,"available":1151596400640,"internally_reserved":0,"allocated":12046336,"data_stored":7548916,"data_compressed":249123,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3003,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":91,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003301"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651455+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:34:36.651455+0000","last_peered":"2023-10-05T15:34:36.651455+0000","last_clean":"2023-10-05T15:34:36.651455+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:34:36.651455+0000","last_undegraded":"2023-10-05T15:34:36.651455+0000","last_fullsized":"2023-10-05T15:34:36.651455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.657965+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:34:36.657965+0000","last_peered":"2023-10-05T15:34:36.657965+0000","last_clean":"2023-10-05T15:34:36.657965+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:34:36.657965+0000","last_undegraded":"2023-10-05T15:34:36.657965+0000","last_fullsized":"2023-10-05T15:34:36.657965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655970+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:34:36.655970+0000","last_peered":"2023-10-05T15:34:36.655970+0000","last_clean":"2023-10-05T15:34:36.655970+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:34:36.655970+0000","last_undegraded":"2023-10-05T15:34:36.655970+0000","last_fullsized":"2023-10-05T15:34:36.655970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.647524+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:34:36.647524+0000","last_peered":"2023-10-05T15:34:36.647524+0000","last_clean":"2023-10-05T15:34:36.647524+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:34:36.647524+0000","last_undegraded":"2023-10-05T15:34:36.647524+0000","last_fullsized":"2023-10-05T15:34:36.647524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.644731+0000","last_change":"2023-10-05T15:34:32.602982+0000","last_active":"2023-10-05T15:34:36.644731+0000","last_peered":"2023-10-05T15:34:36.644731+0000","last_clean":"2023-10-05T15:34:36.644731+0000","last_became_active":"2023-10-05T15:34:32.602604+0000","last_became_peered":"2023-10-05T15:34:32.602604+0000","last_unstale":"2023-10-05T15:34:36.644731+0000","last_undegraded":"2023-10-05T15:34:36.644731+0000","last_fullsized":"2023-10-05T15:34:36.644731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:07:45.111391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856093+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:34:36.856093+0000","last_peered":"2023-10-05T15:34:36.856093+0000","last_clean":"2023-10-05T15:34:36.856093+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:34:36.856093+0000","last_undegraded":"2023-10-05T15:34:36.856093+0000","last_fullsized":"2023-10-05T15:34:36.856093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651737+0000","last_change":"2023-10-05T15:34:32.610565+0000","last_active":"2023-10-05T15:34:36.651737+0000","last_peered":"2023-10-05T15:34:36.651737+0000","last_clean":"2023-10-05T15:34:36.651737+0000","last_became_active":"2023-10-05T15:34:32.610276+0000","last_became_peered":"2023-10-05T15:34:32.610276+0000","last_unstale":"2023-10-05T15:34:36.651737+0000","last_undegraded":"2023-10-05T15:34:36.651737+0000","last_fullsized":"2023-10-05T15:34:36.651737+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:19.372698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649650+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:34:36.649650+0000","last_peered":"2023-10-05T15:34:36.649650+0000","last_clean":"2023-10-05T15:34:36.649650+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:34:36.649650+0000","last_undegraded":"2023-10-05T15:34:36.649650+0000","last_fullsized":"2023-10-05T15:34:36.649650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.653400+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:34:36.653400+0000","last_peered":"2023-10-05T15:34:36.653400+0000","last_clean":"2023-10-05T15:34:36.653400+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:34:36.653400+0000","last_undegraded":"2023-10-05T15:34:36.653400+0000","last_fullsized":"2023-10-05T15:34:36.653400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856982+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:34:36.856982+0000","last_peered":"2023-10-05T15:34:36.856982+0000","last_clean":"2023-10-05T15:34:36.856982+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:34:36.856982+0000","last_undegraded":"2023-10-05T15:34:36.856982+0000","last_fullsized":"2023-10-05T15:34:36.856982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652116+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:34:36.652116+0000","last_peered":"2023-10-05T15:34:36.652116+0000","last_clean":"2023-10-05T15:34:36.652116+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:34:36.652116+0000","last_undegraded":"2023-10-05T15:34:36.652116+0000","last_fullsized":"2023-10-05T15:34:36.652116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.647401+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:34:36.647401+0000","last_peered":"2023-10-05T15:34:36.647401+0000","last_clean":"2023-10-05T15:34:36.647401+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:34:36.647401+0000","last_undegraded":"2023-10-05T15:34:36.647401+0000","last_fullsized":"2023-10-05T15:34:36.647401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.671393+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:34:36.671393+0000","last_peered":"2023-10-05T15:34:36.671393+0000","last_clean":"2023-10-05T15:34:36.671393+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:34:36.671393+0000","last_undegraded":"2023-10-05T15:34:36.671393+0000","last_fullsized":"2023-10-05T15:34:36.671393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655595+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:34:36.655595+0000","last_peered":"2023-10-05T15:34:36.655595+0000","last_clean":"2023-10-05T15:34:36.655595+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:34:36.655595+0000","last_undegraded":"2023-10-05T15:34:36.655595+0000","last_fullsized":"2023-10-05T15:34:36.655595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.654201+0000","last_change":"2023-10-05T15:34:32.603806+0000","last_active":"2023-10-05T15:34:36.654201+0000","last_peered":"2023-10-05T15:34:36.654201+0000","last_clean":"2023-10-05T15:34:36.654201+0000","last_became_active":"2023-10-05T15:34:32.603454+0000","last_became_peered":"2023-10-05T15:34:32.603454+0000","last_unstale":"2023-10-05T15:34:36.654201+0000","last_undegraded":"2023-10-05T15:34:36.654201+0000","last_fullsized":"2023-10-05T15:34:36.654201+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:51.728253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650879+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:34:36.650879+0000","last_peered":"2023-10-05T15:34:36.650879+0000","last_clean":"2023-10-05T15:34:36.650879+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:34:36.650879+0000","last_undegraded":"2023-10-05T15:34:36.650879+0000","last_fullsized":"2023-10-05T15:34:36.650879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651233+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:34:36.651233+0000","last_peered":"2023-10-05T15:34:36.651233+0000","last_clean":"2023-10-05T15:34:36.651233+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:34:36.651233+0000","last_undegraded":"2023-10-05T15:34:36.651233+0000","last_fullsized":"2023-10-05T15:34:36.651233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.665268+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:34:36.665268+0000","last_peered":"2023-10-05T15:34:36.665268+0000","last_clean":"2023-10-05T15:34:36.665268+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:34:36.665268+0000","last_undegraded":"2023-10-05T15:34:36.665268+0000","last_fullsized":"2023-10-05T15:34:36.665268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646818+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:34:36.646818+0000","last_peered":"2023-10-05T15:34:36.646818+0000","last_clean":"2023-10-05T15:34:36.646818+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:34:36.646818+0000","last_undegraded":"2023-10-05T15:34:36.646818+0000","last_fullsized":"2023-10-05T15:34:36.646818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869384+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:34:37.869384+0000","last_peered":"2023-10-05T15:34:37.869384+0000","last_clean":"2023-10-05T15:34:37.869384+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:34:37.869384+0000","last_undegraded":"2023-10-05T15:34:37.869384+0000","last_fullsized":"2023-10-05T15:34:37.869384+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.657545+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:34:36.657545+0000","last_peered":"2023-10-05T15:34:36.657545+0000","last_clean":"2023-10-05T15:34:36.657545+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:34:36.657545+0000","last_undegraded":"2023-10-05T15:34:36.657545+0000","last_fullsized":"2023-10-05T15:34:36.657545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650710+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:34:36.650710+0000","last_peered":"2023-10-05T15:34:36.650710+0000","last_clean":"2023-10-05T15:34:36.650710+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:34:36.650710+0000","last_undegraded":"2023-10-05T15:34:36.650710+0000","last_fullsized":"2023-10-05T15:34:36.650710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869743+0000","last_change":"2023-10-05T15:34:36.669884+0000","last_active":"2023-10-05T15:34:37.869743+0000","last_peered":"2023-10-05T15:34:37.869743+0000","last_clean":"2023-10-05T15:34:37.869743+0000","last_became_active":"2023-10-05T15:34:36.669519+0000","last_became_peered":"2023-10-05T15:34:36.669519+0000","last_unstale":"2023-10-05T15:34:37.869743+0000","last_undegraded":"2023-10-05T15:34:37.869743+0000","last_fullsized":"2023-10-05T15:34:37.869743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:54:03.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868809+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:34:37.868809+0000","last_peered":"2023-10-05T15:34:37.868809+0000","last_clean":"2023-10-05T15:34:37.868809+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:34:37.868809+0000","last_undegraded":"2023-10-05T15:34:37.868809+0000","last_fullsized":"2023-10-05T15:34:37.868809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655165+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:34:36.655165+0000","last_peered":"2023-10-05T15:34:36.655165+0000","last_clean":"2023-10-05T15:34:36.655165+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:34:36.655165+0000","last_undegraded":"2023-10-05T15:34:36.655165+0000","last_fullsized":"2023-10-05T15:34:36.655165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869991+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:34:37.869991+0000","last_peered":"2023-10-05T15:34:37.869991+0000","last_clean":"2023-10-05T15:34:37.869991+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:34:37.869991+0000","last_undegraded":"2023-10-05T15:34:37.869991+0000","last_fullsized":"2023-10-05T15:34:37.869991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.768293+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:35:00.768293+0000","last_peered":"2023-10-05T15:35:00.768293+0000","last_clean":"2023-10-05T15:35:00.768293+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:35:00.768293+0000","last_undegraded":"2023-10-05T15:35:00.768293+0000","last_fullsized":"2023-10-05T15:35:00.768293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651430+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:34:36.651430+0000","last_peered":"2023-10-05T15:34:36.651430+0000","last_clean":"2023-10-05T15:34:36.651430+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:34:36.651430+0000","last_undegraded":"2023-10-05T15:34:36.651430+0000","last_fullsized":"2023-10-05T15:34:36.651430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869340+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:34:37.869340+0000","last_peered":"2023-10-05T15:34:37.869340+0000","last_clean":"2023-10-05T15:34:37.869340+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:34:37.869340+0000","last_undegraded":"2023-10-05T15:34:37.869340+0000","last_fullsized":"2023-10-05T15:34:37.869340+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.767491+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:35:00.767491+0000","last_peered":"2023-10-05T15:35:00.767491+0000","last_clean":"2023-10-05T15:35:00.767491+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:35:00.767491+0000","last_undegraded":"2023-10-05T15:35:00.767491+0000","last_fullsized":"2023-10-05T15:35:00.767491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652567+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:34:36.652567+0000","last_peered":"2023-10-05T15:34:36.652567+0000","last_clean":"2023-10-05T15:34:36.652567+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:34:36.652567+0000","last_undegraded":"2023-10-05T15:34:36.652567+0000","last_fullsized":"2023-10-05T15:34:36.652567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869567+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:34:37.869567+0000","last_peered":"2023-10-05T15:34:37.869567+0000","last_clean":"2023-10-05T15:34:37.869567+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:34:37.869567+0000","last_undegraded":"2023-10-05T15:34:37.869567+0000","last_fullsized":"2023-10-05T15:34:37.869567+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.741383+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:34:57.741383+0000","last_peered":"2023-10-05T15:34:57.741383+0000","last_clean":"2023-10-05T15:34:57.741383+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:34:57.741383+0000","last_undegraded":"2023-10-05T15:34:57.741383+0000","last_fullsized":"2023-10-05T15:34:57.741383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.645147+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:34:36.645147+0000","last_peered":"2023-10-05T15:34:36.645147+0000","last_clean":"2023-10-05T15:34:36.645147+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:34:36.645147+0000","last_undegraded":"2023-10-05T15:34:36.645147+0000","last_fullsized":"2023-10-05T15:34:36.645147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869348+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:34:37.869348+0000","last_peered":"2023-10-05T15:34:37.869348+0000","last_clean":"2023-10-05T15:34:37.869348+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:34:37.869348+0000","last_undegraded":"2023-10-05T15:34:37.869348+0000","last_fullsized":"2023-10-05T15:34:37.869348+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.751246+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:34:58.751246+0000","last_peered":"2023-10-05T15:34:58.751246+0000","last_clean":"2023-10-05T15:34:58.751246+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:34:58.751246+0000","last_undegraded":"2023-10-05T15:34:58.751246+0000","last_fullsized":"2023-10-05T15:34:58.751246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650288+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:34:36.650288+0000","last_peered":"2023-10-05T15:34:36.650288+0000","last_clean":"2023-10-05T15:34:36.650288+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:34:36.650288+0000","last_undegraded":"2023-10-05T15:34:36.650288+0000","last_fullsized":"2023-10-05T15:34:36.650288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869054+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:34:37.869054+0000","last_peered":"2023-10-05T15:34:37.869054+0000","last_clean":"2023-10-05T15:34:37.869054+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:34:37.869054+0000","last_undegraded":"2023-10-05T15:34:37.869054+0000","last_fullsized":"2023-10-05T15:34:37.869054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.753279+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:34:58.753279+0000","last_peered":"2023-10-05T15:34:58.753279+0000","last_clean":"2023-10-05T15:34:58.753279+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:34:58.753279+0000","last_undegraded":"2023-10-05T15:34:58.753279+0000","last_fullsized":"2023-10-05T15:34:58.753279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649725+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:34:36.649725+0000","last_peered":"2023-10-05T15:34:36.649725+0000","last_clean":"2023-10-05T15:34:36.649725+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:34:36.649725+0000","last_undegraded":"2023-10-05T15:34:36.649725+0000","last_fullsized":"2023-10-05T15:34:36.649725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.867917+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:34:37.867917+0000","last_peered":"2023-10-05T15:34:37.867917+0000","last_clean":"2023-10-05T15:34:37.867917+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:34:37.867917+0000","last_undegraded":"2023-10-05T15:34:37.867917+0000","last_fullsized":"2023-10-05T15:34:37.867917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.663897+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:34:37.663897+0000","last_peered":"2023-10-05T15:34:37.663897+0000","last_clean":"2023-10-05T15:34:37.663897+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:34:37.663897+0000","last_undegraded":"2023-10-05T15:34:37.663897+0000","last_fullsized":"2023-10-05T15:34:37.663897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.653374+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:34:36.653374+0000","last_peered":"2023-10-05T15:34:36.653374+0000","last_clean":"2023-10-05T15:34:36.653374+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:34:36.653374+0000","last_undegraded":"2023-10-05T15:34:36.653374+0000","last_fullsized":"2023-10-05T15:34:36.653374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868266+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:34:37.868266+0000","last_peered":"2023-10-05T15:34:37.868266+0000","last_clean":"2023-10-05T15:34:37.868266+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:34:37.868266+0000","last_undegraded":"2023-10-05T15:34:37.868266+0000","last_fullsized":"2023-10-05T15:34:37.868266+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740145+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:34:57.740145+0000","last_peered":"2023-10-05T15:34:57.740145+0000","last_clean":"2023-10-05T15:34:57.740145+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:34:57.740145+0000","last_undegraded":"2023-10-05T15:34:57.740145+0000","last_fullsized":"2023-10-05T15:34:57.740145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652988+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:34:36.652988+0000","last_peered":"2023-10-05T15:34:36.652988+0000","last_clean":"2023-10-05T15:34:36.652988+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:34:36.652988+0000","last_undegraded":"2023-10-05T15:34:36.652988+0000","last_fullsized":"2023-10-05T15:34:36.652988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660290+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:34:37.660290+0000","last_peered":"2023-10-05T15:34:37.660290+0000","last_clean":"2023-10-05T15:34:37.660290+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:34:37.660290+0000","last_undegraded":"2023-10-05T15:34:37.660290+0000","last_fullsized":"2023-10-05T15:34:37.660290+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.738478+0000","last_change":"2023-10-05T15:34:31.611897+0000","last_active":"2023-10-05T15:34:57.738478+0000","last_peered":"2023-10-05T15:34:57.738478+0000","last_clean":"2023-10-05T15:34:57.738478+0000","last_became_active":"2023-10-05T15:34:31.611550+0000","last_became_peered":"2023-10-05T15:34:31.611550+0000","last_unstale":"2023-10-05T15:34:57.738478+0000","last_undegraded":"2023-10-05T15:34:57.738478+0000","last_fullsized":"2023-10-05T15:34:57.738478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:21:00.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655279+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:34:36.655279+0000","last_peered":"2023-10-05T15:34:36.655279+0000","last_clean":"2023-10-05T15:34:36.655279+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:34:36.655279+0000","last_undegraded":"2023-10-05T15:34:36.655279+0000","last_fullsized":"2023-10-05T15:34:36.655279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.870164+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:34:37.870164+0000","last_peered":"2023-10-05T15:34:37.870164+0000","last_clean":"2023-10-05T15:34:37.870164+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:34:37.870164+0000","last_undegraded":"2023-10-05T15:34:37.870164+0000","last_fullsized":"2023-10-05T15:34:37.870164+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.664203+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:34:37.664203+0000","last_peered":"2023-10-05T15:34:37.664203+0000","last_clean":"2023-10-05T15:34:37.664203+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:34:37.664203+0000","last_undegraded":"2023-10-05T15:34:37.664203+0000","last_fullsized":"2023-10-05T15:34:37.664203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651519+0000","last_change":"2023-10-05T15:34:32.604356+0000","last_active":"2023-10-05T15:34:36.651519+0000","last_peered":"2023-10-05T15:34:36.651519+0000","last_clean":"2023-10-05T15:34:36.651519+0000","last_became_active":"2023-10-05T15:34:32.604039+0000","last_became_peered":"2023-10-05T15:34:32.604039+0000","last_unstale":"2023-10-05T15:34:36.651519+0000","last_undegraded":"2023-10-05T15:34:36.651519+0000","last_fullsized":"2023-10-05T15:34:36.651519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:42:20.127943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660456+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:34:37.660456+0000","last_peered":"2023-10-05T15:34:37.660456+0000","last_clean":"2023-10-05T15:34:37.660456+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:34:37.660456+0000","last_undegraded":"2023-10-05T15:34:37.660456+0000","last_fullsized":"2023-10-05T15:34:37.660456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.741245+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:34:57.741245+0000","last_peered":"2023-10-05T15:34:57.741245+0000","last_clean":"2023-10-05T15:34:57.741245+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:34:57.741245+0000","last_undegraded":"2023-10-05T15:34:57.741245+0000","last_fullsized":"2023-10-05T15:34:57.741245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.644857+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:34:36.644857+0000","last_peered":"2023-10-05T15:34:36.644857+0000","last_clean":"2023-10-05T15:34:36.644857+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:34:36.644857+0000","last_undegraded":"2023-10-05T15:34:36.644857+0000","last_fullsized":"2023-10-05T15:34:36.644857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.664427+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:34:37.664427+0000","last_peered":"2023-10-05T15:34:37.664427+0000","last_clean":"2023-10-05T15:34:37.664427+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:34:37.664427+0000","last_undegraded":"2023-10-05T15:34:37.664427+0000","last_fullsized":"2023-10-05T15:34:37.664427+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.752296+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:34:58.752296+0000","last_peered":"2023-10-05T15:34:58.752296+0000","last_clean":"2023-10-05T15:34:58.752296+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:34:58.752296+0000","last_undegraded":"2023-10-05T15:34:58.752296+0000","last_fullsized":"2023-10-05T15:34:58.752296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.664541+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:34:36.664541+0000","last_peered":"2023-10-05T15:34:36.664541+0000","last_clean":"2023-10-05T15:34:36.664541+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:34:36.664541+0000","last_undegraded":"2023-10-05T15:34:36.664541+0000","last_fullsized":"2023-10-05T15:34:36.664541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868437+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:34:37.868437+0000","last_peered":"2023-10-05T15:34:37.868437+0000","last_clean":"2023-10-05T15:34:37.868437+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:34:37.868437+0000","last_undegraded":"2023-10-05T15:34:37.868437+0000","last_fullsized":"2023-10-05T15:34:37.868437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740522+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:34:57.740522+0000","last_peered":"2023-10-05T15:34:57.740522+0000","last_clean":"2023-10-05T15:34:57.740522+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:34:57.740522+0000","last_undegraded":"2023-10-05T15:34:57.740522+0000","last_fullsized":"2023-10-05T15:34:57.740522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652982+0000","last_change":"2023-10-05T15:34:32.617270+0000","last_active":"2023-10-05T15:34:36.652982+0000","last_peered":"2023-10-05T15:34:36.652982+0000","last_clean":"2023-10-05T15:34:36.652982+0000","last_became_active":"2023-10-05T15:34:32.616941+0000","last_became_peered":"2023-10-05T15:34:32.616941+0000","last_unstale":"2023-10-05T15:34:36.652982+0000","last_undegraded":"2023-10-05T15:34:36.652982+0000","last_fullsized":"2023-10-05T15:34:36.652982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:52.771420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660780+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:34:37.660780+0000","last_peered":"2023-10-05T15:34:37.660780+0000","last_clean":"2023-10-05T15:34:37.660780+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:34:37.660780+0000","last_undegraded":"2023-10-05T15:34:37.660780+0000","last_fullsized":"2023-10-05T15:34:37.660780+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646347+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:34:36.646347+0000","last_peered":"2023-10-05T15:34:36.646347+0000","last_clean":"2023-10-05T15:34:36.646347+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:34:36.646347+0000","last_undegraded":"2023-10-05T15:34:36.646347+0000","last_fullsized":"2023-10-05T15:34:36.646347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.653564+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:34:36.653564+0000","last_peered":"2023-10-05T15:34:36.653564+0000","last_clean":"2023-10-05T15:34:36.653564+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:34:36.653564+0000","last_undegraded":"2023-10-05T15:34:36.653564+0000","last_fullsized":"2023-10-05T15:34:36.653564+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.885104+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:34:37.885104+0000","last_peered":"2023-10-05T15:34:37.885104+0000","last_clean":"2023-10-05T15:34:37.885104+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:34:37.885104+0000","last_undegraded":"2023-10-05T15:34:37.885104+0000","last_fullsized":"2023-10-05T15:34:37.885104+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.765839+0000","last_change":"2023-10-05T15:34:31.609929+0000","last_active":"2023-10-05T15:35:00.765839+0000","last_peered":"2023-10-05T15:35:00.765839+0000","last_clean":"2023-10-05T15:35:00.765839+0000","last_became_active":"2023-10-05T15:34:31.609604+0000","last_became_peered":"2023-10-05T15:34:31.609604+0000","last_unstale":"2023-10-05T15:35:00.765839+0000","last_undegraded":"2023-10-05T15:35:00.765839+0000","last_fullsized":"2023-10-05T15:35:00.765839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:12:46.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650560+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:34:36.650560+0000","last_peered":"2023-10-05T15:34:36.650560+0000","last_clean":"2023-10-05T15:34:36.650560+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:34:36.650560+0000","last_undegraded":"2023-10-05T15:34:36.650560+0000","last_fullsized":"2023-10-05T15:34:36.650560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.663528+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:34:37.663528+0000","last_peered":"2023-10-05T15:34:37.663528+0000","last_clean":"2023-10-05T15:34:37.663528+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:34:37.663528+0000","last_undegraded":"2023-10-05T15:34:37.663528+0000","last_fullsized":"2023-10-05T15:34:37.663528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.662427+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:34:37.662427+0000","last_peered":"2023-10-05T15:34:37.662427+0000","last_clean":"2023-10-05T15:34:37.662427+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:34:37.662427+0000","last_undegraded":"2023-10-05T15:34:37.662427+0000","last_fullsized":"2023-10-05T15:34:37.662427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650476+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:34:36.650476+0000","last_peered":"2023-10-05T15:34:36.650476+0000","last_clean":"2023-10-05T15:34:36.650476+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:34:36.650476+0000","last_undegraded":"2023-10-05T15:34:36.650476+0000","last_fullsized":"2023-10-05T15:34:36.650476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.662309+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:34:37.662309+0000","last_peered":"2023-10-05T15:34:37.662309+0000","last_clean":"2023-10-05T15:34:37.662309+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:34:37.662309+0000","last_undegraded":"2023-10-05T15:34:37.662309+0000","last_fullsized":"2023-10-05T15:34:37.662309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655704+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:34:36.655704+0000","last_peered":"2023-10-05T15:34:36.655704+0000","last_clean":"2023-10-05T15:34:36.655704+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:34:36.655704+0000","last_undegraded":"2023-10-05T15:34:36.655704+0000","last_fullsized":"2023-10-05T15:34:36.655704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856528+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:34:36.856528+0000","last_peered":"2023-10-05T15:34:36.856528+0000","last_clean":"2023-10-05T15:34:36.856528+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:34:36.856528+0000","last_undegraded":"2023-10-05T15:34:36.856528+0000","last_fullsized":"2023-10-05T15:34:36.856528+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.884877+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:34:37.884877+0000","last_peered":"2023-10-05T15:34:37.884877+0000","last_clean":"2023-10-05T15:34:37.884877+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:34:37.884877+0000","last_undegraded":"2023-10-05T15:34:37.884877+0000","last_fullsized":"2023-10-05T15:34:37.884877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868980+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:34:37.868980+0000","last_peered":"2023-10-05T15:34:37.868980+0000","last_clean":"2023-10-05T15:34:37.868980+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:34:37.868980+0000","last_undegraded":"2023-10-05T15:34:37.868980+0000","last_fullsized":"2023-10-05T15:34:37.868980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856307+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:34:36.856307+0000","last_peered":"2023-10-05T15:34:36.856307+0000","last_clean":"2023-10-05T15:34:36.856307+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:34:36.856307+0000","last_undegraded":"2023-10-05T15:34:36.856307+0000","last_fullsized":"2023-10-05T15:34:36.856307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.885047+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:34:37.885047+0000","last_peered":"2023-10-05T15:34:37.885047+0000","last_clean":"2023-10-05T15:34:37.885047+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:34:37.885047+0000","last_undegraded":"2023-10-05T15:34:37.885047+0000","last_fullsized":"2023-10-05T15:34:37.885047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650157+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:34:36.650157+0000","last_peered":"2023-10-05T15:34:36.650157+0000","last_clean":"2023-10-05T15:34:36.650157+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:34:36.650157+0000","last_undegraded":"2023-10-05T15:34:36.650157+0000","last_fullsized":"2023-10-05T15:34:36.650157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.753072+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:34:58.753072+0000","last_peered":"2023-10-05T15:34:58.753072+0000","last_clean":"2023-10-05T15:34:58.753072+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:34:58.753072+0000","last_undegraded":"2023-10-05T15:34:58.753072+0000","last_fullsized":"2023-10-05T15:34:58.753072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869635+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:34:37.869635+0000","last_peered":"2023-10-05T15:34:37.869635+0000","last_clean":"2023-10-05T15:34:37.869635+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:34:37.869635+0000","last_undegraded":"2023-10-05T15:34:37.869635+0000","last_fullsized":"2023-10-05T15:34:37.869635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649958+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:34:36.649958+0000","last_peered":"2023-10-05T15:34:36.649958+0000","last_clean":"2023-10-05T15:34:36.649958+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:34:36.649958+0000","last_undegraded":"2023-10-05T15:34:36.649958+0000","last_fullsized":"2023-10-05T15:34:36.649958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740441+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:34:57.740441+0000","last_peered":"2023-10-05T15:34:57.740441+0000","last_clean":"2023-10-05T15:34:57.740441+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:34:57.740441+0000","last_undegraded":"2023-10-05T15:34:57.740441+0000","last_fullsized":"2023-10-05T15:34:57.740441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":314,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652629+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:34:36.652629+0000","last_peered":"2023-10-05T15:34:36.652629+0000","last_clean":"2023-10-05T15:34:36.652629+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:34:36.652629+0000","last_undegraded":"2023-10-05T15:34:36.652629+0000","last_fullsized":"2023-10-05T15:34:36.652629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.664151+0000","last_change":"2023-10-05T15:34:36.858457+0000","last_active":"2023-10-05T15:34:37.664151+0000","last_peered":"2023-10-05T15:34:37.664151+0000","last_clean":"2023-10-05T15:34:37.664151+0000","last_became_active":"2023-10-05T15:34:36.857998+0000","last_became_peered":"2023-10-05T15:34:36.857998+0000","last_unstale":"2023-10-05T15:34:37.664151+0000","last_undegraded":"2023-10-05T15:34:37.664151+0000","last_fullsized":"2023-10-05T15:34:37.664151+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:38:52.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.663968+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:34:36.663968+0000","last_peered":"2023-10-05T15:34:36.663968+0000","last_clean":"2023-10-05T15:34:36.663968+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:34:36.663968+0000","last_undegraded":"2023-10-05T15:34:36.663968+0000","last_fullsized":"2023-10-05T15:34:36.663968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.750232+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:34:58.750232+0000","last_peered":"2023-10-05T15:34:58.750232+0000","last_clean":"2023-10-05T15:34:58.750232+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:34:58.750232+0000","last_undegraded":"2023-10-05T15:34:58.750232+0000","last_fullsized":"2023-10-05T15:34:58.750232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868496+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:34:37.868496+0000","last_peered":"2023-10-05T15:34:37.868496+0000","last_clean":"2023-10-05T15:34:37.868496+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:34:37.868496+0000","last_undegraded":"2023-10-05T15:34:37.868496+0000","last_fullsized":"2023-10-05T15:34:37.868496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.766884+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:35:00.766884+0000","last_peered":"2023-10-05T15:35:00.766884+0000","last_clean":"2023-10-05T15:35:00.766884+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:35:00.766884+0000","last_undegraded":"2023-10-05T15:35:00.766884+0000","last_fullsized":"2023-10-05T15:35:00.766884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.672049+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:34:36.672049+0000","last_peered":"2023-10-05T15:34:36.672049+0000","last_clean":"2023-10-05T15:34:36.672049+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:34:36.672049+0000","last_undegraded":"2023-10-05T15:34:36.672049+0000","last_fullsized":"2023-10-05T15:34:36.672049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.867807+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:34:37.867807+0000","last_peered":"2023-10-05T15:34:37.867807+0000","last_clean":"2023-10-05T15:34:37.867807+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:34:37.867807+0000","last_undegraded":"2023-10-05T15:34:37.867807+0000","last_fullsized":"2023-10-05T15:34:37.867807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.675303+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:34:36.675303+0000","last_peered":"2023-10-05T15:34:36.675303+0000","last_clean":"2023-10-05T15:34:36.675303+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:34:36.675303+0000","last_undegraded":"2023-10-05T15:34:36.675303+0000","last_fullsized":"2023-10-05T15:34:36.675303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650492+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:34:36.650492+0000","last_peered":"2023-10-05T15:34:36.650492+0000","last_clean":"2023-10-05T15:34:36.650492+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:34:36.650492+0000","last_undegraded":"2023-10-05T15:34:36.650492+0000","last_fullsized":"2023-10-05T15:34:36.650492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868983+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:34:37.868983+0000","last_peered":"2023-10-05T15:34:37.868983+0000","last_clean":"2023-10-05T15:34:37.868983+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:34:37.868983+0000","last_undegraded":"2023-10-05T15:34:37.868983+0000","last_fullsized":"2023-10-05T15:34:37.868983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740010+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:34:57.740010+0000","last_peered":"2023-10-05T15:34:57.740010+0000","last_clean":"2023-10-05T15:34:57.740010+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:34:57.740010+0000","last_undegraded":"2023-10-05T15:34:57.740010+0000","last_fullsized":"2023-10-05T15:34:57.740010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.658066+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:34:36.658066+0000","last_peered":"2023-10-05T15:34:36.658066+0000","last_clean":"2023-10-05T15:34:36.658066+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:34:36.658066+0000","last_undegraded":"2023-10-05T15:34:36.658066+0000","last_fullsized":"2023-10-05T15:34:36.658066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869344+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:34:37.869344+0000","last_peered":"2023-10-05T15:34:37.869344+0000","last_clean":"2023-10-05T15:34:37.869344+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:34:37.869344+0000","last_undegraded":"2023-10-05T15:34:37.869344+0000","last_fullsized":"2023-10-05T15:34:37.869344+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740682+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:34:57.740682+0000","last_peered":"2023-10-05T15:34:57.740682+0000","last_clean":"2023-10-05T15:34:57.740682+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:34:57.740682+0000","last_undegraded":"2023-10-05T15:34:57.740682+0000","last_fullsized":"2023-10-05T15:34:57.740682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.644731+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:34:36.644731+0000","last_peered":"2023-10-05T15:34:36.644731+0000","last_clean":"2023-10-05T15:34:36.644731+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:34:36.644731+0000","last_undegraded":"2023-10-05T15:34:36.644731+0000","last_fullsized":"2023-10-05T15:34:36.644731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660903+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:34:37.660903+0000","last_peered":"2023-10-05T15:34:37.660903+0000","last_clean":"2023-10-05T15:34:37.660903+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:34:37.660903+0000","last_undegraded":"2023-10-05T15:34:37.660903+0000","last_fullsized":"2023-10-05T15:34:37.660903+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.766049+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:35:00.766049+0000","last_peered":"2023-10-05T15:35:00.766049+0000","last_clean":"2023-10-05T15:35:00.766049+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:35:00.766049+0000","last_undegraded":"2023-10-05T15:35:00.766049+0000","last_fullsized":"2023-10-05T15:35:00.766049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649465+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:34:36.649465+0000","last_peered":"2023-10-05T15:34:36.649465+0000","last_clean":"2023-10-05T15:34:36.649465+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:34:36.649465+0000","last_undegraded":"2023-10-05T15:34:36.649465+0000","last_fullsized":"2023-10-05T15:34:36.649465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869107+0000","last_change":"2023-10-05T15:34:36.660640+0000","last_active":"2023-10-05T15:34:37.869107+0000","last_peered":"2023-10-05T15:34:37.869107+0000","last_clean":"2023-10-05T15:34:37.869107+0000","last_became_active":"2023-10-05T15:34:36.660205+0000","last_became_peered":"2023-10-05T15:34:36.660205+0000","last_unstale":"2023-10-05T15:34:37.869107+0000","last_undegraded":"2023-10-05T15:34:37.869107+0000","last_fullsized":"2023-10-05T15:34:37.869107+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:47:57.422258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.645852+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:34:36.645852+0000","last_peered":"2023-10-05T15:34:36.645852+0000","last_clean":"2023-10-05T15:34:36.645852+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:34:36.645852+0000","last_undegraded":"2023-10-05T15:34:36.645852+0000","last_fullsized":"2023-10-05T15:34:36.645852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650963+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:34:36.650963+0000","last_peered":"2023-10-05T15:34:36.650963+0000","last_clean":"2023-10-05T15:34:36.650963+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:34:36.650963+0000","last_undegraded":"2023-10-05T15:34:36.650963+0000","last_fullsized":"2023-10-05T15:34:36.650963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869704+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:34:37.869704+0000","last_peered":"2023-10-05T15:34:37.869704+0000","last_clean":"2023-10-05T15:34:37.869704+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:34:37.869704+0000","last_undegraded":"2023-10-05T15:34:37.869704+0000","last_fullsized":"2023-10-05T15:34:37.869704+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740767+0000","last_change":"2023-10-05T15:34:31.604468+0000","last_active":"2023-10-05T15:34:57.740767+0000","last_peered":"2023-10-05T15:34:57.740767+0000","last_clean":"2023-10-05T15:34:57.740767+0000","last_became_active":"2023-10-05T15:34:31.604107+0000","last_became_peered":"2023-10-05T15:34:31.604107+0000","last_unstale":"2023-10-05T15:34:57.740767+0000","last_undegraded":"2023-10-05T15:34:57.740767+0000","last_fullsized":"2023-10-05T15:34:57.740767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:57:10.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651724+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:34:36.651724+0000","last_peered":"2023-10-05T15:34:36.651724+0000","last_clean":"2023-10-05T15:34:36.651724+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:34:36.651724+0000","last_undegraded":"2023-10-05T15:34:36.651724+0000","last_fullsized":"2023-10-05T15:34:36.651724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.870753+0000","last_change":"2023-10-05T15:34:36.668436+0000","last_active":"2023-10-05T15:34:37.870753+0000","last_peered":"2023-10-05T15:34:37.870753+0000","last_clean":"2023-10-05T15:34:37.870753+0000","last_became_active":"2023-10-05T15:34:36.668002+0000","last_became_peered":"2023-10-05T15:34:36.668002+0000","last_unstale":"2023-10-05T15:34:37.870753+0000","last_undegraded":"2023-10-05T15:34:37.870753+0000","last_fullsized":"2023-10-05T15:34:37.870753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:27:55.706225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.752897+0000","last_change":"2023-10-05T15:34:31.612135+0000","last_active":"2023-10-05T15:34:58.752897+0000","last_peered":"2023-10-05T15:34:58.752897+0000","last_clean":"2023-10-05T15:34:58.752897+0000","last_became_active":"2023-10-05T15:34:31.611686+0000","last_became_peered":"2023-10-05T15:34:31.611686+0000","last_unstale":"2023-10-05T15:34:58.752897+0000","last_undegraded":"2023-10-05T15:34:58.752897+0000","last_fullsized":"2023-10-05T15:34:58.752897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:38:43.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652315+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:34:36.652315+0000","last_peered":"2023-10-05T15:34:36.652315+0000","last_clean":"2023-10-05T15:34:36.652315+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:34:36.652315+0000","last_undegraded":"2023-10-05T15:34:36.652315+0000","last_fullsized":"2023-10-05T15:34:36.652315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868234+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:34:37.868234+0000","last_peered":"2023-10-05T15:34:37.868234+0000","last_clean":"2023-10-05T15:34:37.868234+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:34:37.868234+0000","last_undegraded":"2023-10-05T15:34:37.868234+0000","last_fullsized":"2023-10-05T15:34:37.868234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652678+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:34:36.652678+0000","last_peered":"2023-10-05T15:34:36.652678+0000","last_clean":"2023-10-05T15:34:36.652678+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:34:36.652678+0000","last_undegraded":"2023-10-05T15:34:36.652678+0000","last_fullsized":"2023-10-05T15:34:36.652678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652643+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:34:36.652643+0000","last_peered":"2023-10-05T15:34:36.652643+0000","last_clean":"2023-10-05T15:34:36.652643+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:34:36.652643+0000","last_undegraded":"2023-10-05T15:34:36.652643+0000","last_fullsized":"2023-10-05T15:34:36.652643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.663237+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:34:37.663237+0000","last_peered":"2023-10-05T15:34:37.663237+0000","last_clean":"2023-10-05T15:34:37.663237+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:34:37.663237+0000","last_undegraded":"2023-10-05T15:34:37.663237+0000","last_fullsized":"2023-10-05T15:34:37.663237+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.672225+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:34:36.672225+0000","last_peered":"2023-10-05T15:34:36.672225+0000","last_clean":"2023-10-05T15:34:36.672225+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:34:36.672225+0000","last_undegraded":"2023-10-05T15:34:36.672225+0000","last_fullsized":"2023-10-05T15:34:36.672225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651832+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:34:36.651832+0000","last_peered":"2023-10-05T15:34:36.651832+0000","last_clean":"2023-10-05T15:34:36.651832+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:34:36.651832+0000","last_undegraded":"2023-10-05T15:34:36.651832+0000","last_fullsized":"2023-10-05T15:34:36.651832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649556+0000","last_change":"2023-10-05T15:34:32.612359+0000","last_active":"2023-10-05T15:34:36.649556+0000","last_peered":"2023-10-05T15:34:36.649556+0000","last_clean":"2023-10-05T15:34:36.649556+0000","last_became_active":"2023-10-05T15:34:32.611989+0000","last_became_peered":"2023-10-05T15:34:32.611989+0000","last_unstale":"2023-10-05T15:34:36.649556+0000","last_undegraded":"2023-10-05T15:34:36.649556+0000","last_fullsized":"2023-10-05T15:34:36.649556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:44:17.562645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646657+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:34:36.646657+0000","last_peered":"2023-10-05T15:34:36.646657+0000","last_clean":"2023-10-05T15:34:36.646657+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:34:36.646657+0000","last_undegraded":"2023-10-05T15:34:36.646657+0000","last_fullsized":"2023-10-05T15:34:36.646657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.645752+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:34:36.645752+0000","last_peered":"2023-10-05T15:34:36.645752+0000","last_clean":"2023-10-05T15:34:36.645752+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:34:36.645752+0000","last_undegraded":"2023-10-05T15:34:36.645752+0000","last_fullsized":"2023-10-05T15:34:36.645752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.657167+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:34:36.657167+0000","last_peered":"2023-10-05T15:34:36.657167+0000","last_clean":"2023-10-05T15:34:36.657167+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:34:36.657167+0000","last_undegraded":"2023-10-05T15:34:36.657167+0000","last_fullsized":"2023-10-05T15:34:36.657167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.672147+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:34:36.672147+0000","last_peered":"2023-10-05T15:34:36.672147+0000","last_clean":"2023-10-05T15:34:36.672147+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:34:36.672147+0000","last_undegraded":"2023-10-05T15:34:36.672147+0000","last_fullsized":"2023-10-05T15:34:36.672147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650939+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:34:36.650939+0000","last_peered":"2023-10-05T15:34:36.650939+0000","last_clean":"2023-10-05T15:34:36.650939+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:34:36.650939+0000","last_undegraded":"2023-10-05T15:34:36.650939+0000","last_fullsized":"2023-10-05T15:34:36.650939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646205+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:34:36.646205+0000","last_peered":"2023-10-05T15:34:36.646205+0000","last_clean":"2023-10-05T15:34:36.646205+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:34:36.646205+0000","last_undegraded":"2023-10-05T15:34:36.646205+0000","last_fullsized":"2023-10-05T15:34:36.646205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650800+0000","last_change":"2023-10-05T15:34:32.601803+0000","last_active":"2023-10-05T15:34:36.650800+0000","last_peered":"2023-10-05T15:34:36.650800+0000","last_clean":"2023-10-05T15:34:36.650800+0000","last_became_active":"2023-10-05T15:34:32.601459+0000","last_became_peered":"2023-10-05T15:34:32.601459+0000","last_unstale":"2023-10-05T15:34:36.650800+0000","last_undegraded":"2023-10-05T15:34:36.650800+0000","last_fullsized":"2023-10-05T15:34:36.650800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:03:06.072594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650068+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:34:36.650068+0000","last_peered":"2023-10-05T15:34:36.650068+0000","last_clean":"2023-10-05T15:34:36.650068+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:34:36.650068+0000","last_undegraded":"2023-10-05T15:34:36.650068+0000","last_fullsized":"2023-10-05T15:34:36.650068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649603+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:34:36.649603+0000","last_peered":"2023-10-05T15:34:36.649603+0000","last_clean":"2023-10-05T15:34:36.649603+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:34:36.649603+0000","last_undegraded":"2023-10-05T15:34:36.649603+0000","last_fullsized":"2023-10-05T15:34:36.649603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651883+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:34:36.651883+0000","last_peered":"2023-10-05T15:34:36.651883+0000","last_clean":"2023-10-05T15:34:36.651883+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:34:36.651883+0000","last_undegraded":"2023-10-05T15:34:36.651883+0000","last_fullsized":"2023-10-05T15:34:36.651883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.671278+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:34:36.671278+0000","last_peered":"2023-10-05T15:34:36.671278+0000","last_clean":"2023-10-05T15:34:36.671278+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:34:36.671278+0000","last_undegraded":"2023-10-05T15:34:36.671278+0000","last_fullsized":"2023-10-05T15:34:36.671278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650302+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:34:36.650302+0000","last_peered":"2023-10-05T15:34:36.650302+0000","last_clean":"2023-10-05T15:34:36.650302+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:34:36.650302+0000","last_undegraded":"2023-10-05T15:34:36.650302+0000","last_fullsized":"2023-10-05T15:34:36.650302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7502,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":23496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480806,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.871}]},{"osd":5,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83499999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.1559999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.91500000000000004}]}]},{"osd":10,"up_from":73,"seq":313532612632,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":1075071,"data_compressed":47908,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.626}]},{"osd":2,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.87},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.92200000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.95799999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:34:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.88400000000000001}]}]},{"osd":9,"up_from":68,"seq":292057776157,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":480398,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.83799999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.75,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.133,"5min":1.343,"15min":1.343},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83599999999999997,"15min":0.83799999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.997,"5min":1.109,"15min":1.109},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69499999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.258,"15min":1.258},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.79500000000000004},"min":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1240000000000001,"5min":1.161,"15min":1.161},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.93500000000000005,"15min":0.93899999999999995},"min":{"1min":0.66300000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3049999999999999,"5min":1.391,"15min":1.391},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.004,"15min":1.02},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.371,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.65100000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.92400000000000004},"min":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0149999999999999,"5min":1.256,"15min":1.256},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.94799999999999995,"15min":0.95499999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.72699999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:34:12 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":8,"up_from":60,"seq":257698037794,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":481114,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96899999999999997,"5min":1.24,"15min":1.24},"last":0.753},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.51500000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98299999999999998,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84699999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.01,"5min":1.04,"15min":1.04},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.624}]},{"osd":4,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97099999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.90200000000000002,"15min":0.92000000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0469999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94999999999999996,"15min":0.95599999999999996},"min":{"1min":0.72799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2210000000000001,"5min":1.252,"15min":1.252},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96299999999999997,"15min":0.96699999999999997},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.1280000000000001,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.97999999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1359999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.90500000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2729999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.93300000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299431,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1072446,"data_compressed":47908,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.622,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5749999999999993,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.103,"5min":0.65500000000000003,"15min":0.57099999999999995},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.9950000000000001,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.76800000000000002,"15min":0.71799999999999997},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.5309999999999997,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.80800000000000005,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":8.2840000000000007,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.502}]},{"osd":3,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":8.5370000000000008,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.79500000000000004,"15min":0.75700000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.3289999999999997,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.626},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.127,"15min":1.127},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.2769999999999999,"5min":0.88700000000000001,"15min":0.80800000000000005},"min":{"1min":0.56599999999999995,"5min":0.5,"15min":0.5},"max":{"1min":8.609,"5min":8.609,"15min":8.609},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.4699999999999998,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1739999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.85499999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.90900000000000003,"15min":0.90000000000000002},"min":{"1min":0.73899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.89700000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.123,"5min":1.28,"15min":1.28},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.3400000000000001,"5min":0.96899999999999997,"15min":0.90700000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":8.3219999999999992,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":0.877}]},{"osd":10,"last update":"Thu Oct 5 15:34:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":479704,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44700000000000001,"15min":0.42499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69199999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.47399999999999998},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.58099999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.097,"15min":1.097},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":1.169,"15min":1.169},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.006,"15min":1.006},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.121,"15min":1.121},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:34:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.80800000000000005,"15min":0.78400000000000003},"min":{"1min":0.66400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.014,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.87}]},{"osd":8,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86699999999999999},"min":{"1min":0.63500000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.91000000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:34:46 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.89100000000000001},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.77200000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":483456,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.505},{"interface":"front","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":1.083,"15min":1.083},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.59899999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1499999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64500000000000002,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0660000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.68999999999999995,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Oct 5 15:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.754,"15min":0.72899999999999998},"min":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:34:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.534,"5min":1.538,"15min":1.538},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:34:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0600000000000001,"5min":1.51,"15min":1.51},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.046,"5min":1.381,"15min":1.381},"last":1.046}]},{"osd":8,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.60799999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0609999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.872},"min":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2130000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88300000000000001,"15min":0.88600000000000001},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0820000000000001,"5min":1.282,"15min":1.282},"last":1.091}]},{"osd":10,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.107},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480308,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.621,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0289999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.70099999999999996,"15min":0.65100000000000002},"min":{"1min":0.56399999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67000000000000004,"15min":0.61799999999999999},"min":{"1min":0.44800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.026},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.55500000000000005,"15min":0.51700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56299999999999994,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.88200000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0840000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71299999999999997,"15min":0.68300000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:34:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.83399999999999996},"min":{"1min":0.69899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77300000000000002,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0149999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.87,"15min":0.88200000000000001},"min":{"1min":0.64400000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.135},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85699999999999998,"15min":0.86499999999999999},"min":{"1min":0.60599999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.877}]},{"osd":9,"last update":"Thu Oct 5 15:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89700000000000002,"15min":0.89600000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.877,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1020000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.042}]},{"osd":11,"last update":"Thu Oct 5 15:34:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.054},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.90200000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":484806,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56399999999999995,"15min":0.54300000000000004},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":1.036,"15min":1.036},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66300000000000003,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.127,"15min":1.127},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.754}]},{"osd":3,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0289999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.61499999999999999},"min":{"1min":0.59199999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96499999999999997,"5min":1.734,"15min":1.734},"last":0.95299999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.499},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.876,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:34:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73199999999999998},"min":{"1min":0.61199999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91600000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.163,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.97399999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.044}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.88200000000000001,"15min":0.88500000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.075},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.0980000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":480044,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.438,"15min":0.40300000000000002},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.45100000000000001,"15min":0.42699999999999999},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.56699999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76900000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73099999999999998,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.032,"5min":1.109,"15min":1.109},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Oct 5 15:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.78800000000000003,"15min":0.76000000000000001},"min":{"1min":0.67200000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1759999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78300000000000003,"15min":0.75800000000000001},"min":{"1min":0.59599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.01,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":1.089,"15min":1.089},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85599999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.218,"5min":1.409,"15min":1.409},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2410000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.84899999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95199999999999996,"5min":1.105,"15min":1.105},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.621,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.93500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":479636,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Oct 5 15:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45800000000000002,"15min":0.433},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":1.526,"15min":1.526},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47599999999999998,"15min":0.44},"min":{"1min":0.35999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72999999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.57199999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66200000000000003,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.024,"5min":1.288,"15min":1.288},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65800000000000003,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77900000000000003,"15min":0.76900000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.878},{"interface":"front","average":{"1min":0.874,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:34:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.73699999999999999,"15min":0.70499999999999996},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0209999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.73299999999999998,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.627},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.74099999999999999,"15min":0.72099999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.80600000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.77500000000000002,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.97799999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0529999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0720000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.74199999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724593,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1071127,"data_compressed":47908,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":1.671,"15min":1.671},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63700000000000001,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.47699999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0049999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98399999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.54000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.53600000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76500000000000001,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.755},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.627,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.79600000000000004,"15min":0.77200000000000002},"min":{"1min":0.68500000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.72899999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.92000000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.95099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:35:03.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 -- 172.21.15.17:0/624951186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870102a40 msgr2=0x7f7870109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 --2- 172.21.15.17:0/624951186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870102a40 0x7f7870109360 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f786800b0a0 tx=0x7f786800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 -- 172.21.15.17:0/624951186 shutdown_connections 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 --2- 172.21.15.17:0/624951186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870102a40 0x7f7870109360 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 --2- 172.21.15.17:0/624951186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870100ea0 0x7f78701012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 --2- 172.21.15.17:0/624951186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7870102080 0x7f7870102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 -- 172.21.15.17:0/624951186 >> 172.21.15.17:0/624951186 conn(0x7f78700fc420 msgr2=0x7f78700fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 -- 172.21.15.17:0/624951186 shutdown_connections 2023-10-05T15:35:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.989+0000 7f78749ff700 1 -- 172.21.15.17:0/624951186 wait complete. 2023-10-05T15:35:03.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 Processor -- start 2023-10-05T15:35:03.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 -- start start 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 0x7f7870074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870102080 0x7f78700732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7870102a40 0x7f78700737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870073f80 con 0x7f7870100ea0 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700740f0 con 0x7f7870102a40 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.990+0000 7f78749ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78701a0c80 con 0x7f7870102080 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 0x7f7870074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 0x7f7870074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48856/0 (socket says 172.21.15.17:48856) 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 -- 172.21.15.17:0/2054507573 learned_addr learned my addr 172.21.15.17:0/2054507573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:03.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786dd9b700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870102080 0x7f78700732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786ed9d700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7870102a40 0x7f78700737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 -- 172.21.15.17:0/2054507573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870102080 msgr2=0x7f78700732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870102080 0x7f78700732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 -- 172.21.15.17:0/2054507573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7870102a40 msgr2=0x7f78700737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7870102a40 0x7f78700737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 -- 172.21.15.17:0/2054507573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009d00 con 0x7f7870100ea0 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786dd9b700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870102080 0x7f78700732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:35:03.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f786e59c700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 0x7f7870074c60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f786000d980 tx=0x7f786000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:03.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.991+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786000bb60 con 0x7f7870100ea0 2023-10-05T15:35:03.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.992+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7860007620 con 0x7f7870100ea0 2023-10-05T15:35:03.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.992+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78701a0f60 con 0x7f7870100ea0 2023-10-05T15:35:03.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.992+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786000f3c0 con 0x7f7870100ea0 2023-10-05T15:35:03.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.992+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78701a1380 con 0x7f7870100ea0 2023-10-05T15:35:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.993+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787010c680 con 0x7f7870100ea0 2023-10-05T15:35:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.995+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7860010460 con 0x7f7870100ea0 2023-10-05T15:35:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.996+0000 7f785f7fe700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78580a1550 0x7f78580a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.996+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f78600cd420 con 0x7f7870100ea0 2023-10-05T15:35:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.996+0000 7f786dd9b700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78580a1550 0x7f78580a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:03.997+0000 7f786dd9b700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78580a1550 0x7f78580a3a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7870100bc0 tx=0x7f786400b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.000+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f78600966d0 con 0x7f7870100ea0 2023-10-05T15:35:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:03 smithi167 ceph-mon[133366]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-10-05T15:35:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:03 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/482643640' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:35:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:03 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1530442720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:03 smithi167 ceph-mon[133366]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:03 smithi079 ceph-mon[132936]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-10-05T15:35:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:03 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/482643640' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:35:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:03 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1530442720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:03 smithi079 ceph-mon[132936]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:03 smithi017 ceph-mon[129107]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-10-05T15:35:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:03 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/482643640' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:35:04.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:03 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1530442720' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:04.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:03 smithi017 ceph-mon[129107]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:04.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.211+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78700612f0 con 0x7f78580a1550 2023-10-05T15:35:04.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.224+0000 7f785f7fe700 1 -- 172.21.15.17:0/2054507573 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422325 (secure 0 0 0) 0x7f78700612f0 con 0x7f78580a1550 2023-10-05T15:35:04.230 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:04.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78580a1550 msgr2=0x7f78580a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:04.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78580a1550 0x7f78580a3a10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7870100bc0 tx=0x7f786400b5f0 comp rx=0 tx=0).stop 2023-10-05T15:35:04.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 msgr2=0x7f7870074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:04.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 0x7f7870074c60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f786000d980 tx=0x7f786000dd40 comp rx=0 tx=0).stop 2023-10-05T15:35:04.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 shutdown_connections 2023-10-05T15:35:04.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78580a1550 0x7f78580a3a10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7870102a40 0x7f78700737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7870100ea0 0x7f7870074c60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 --2- 172.21.15.17:0/2054507573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7870102080 0x7f78700732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.229+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 >> 172.21.15.17:0/2054507573 conn(0x7f78700fc420 msgr2=0x7f78700fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.230+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 shutdown_connections 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:04.230+0000 7f78749ff700 1 -- 172.21.15.17:0/2054507573 wait complete. 2023-10-05T15:35:04.235 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:35:04.250 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2023-10-05T15:35:02.584307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597870,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":134,"num_read_kb":117,"num_write":320,"num_write_kb":2981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335964,"kb_used_data":11764,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605860,"statfs":{"total":1151940427776,"available":1151596400640,"internally_reserved":0,"allocated":12046336,"data_stored":7548916,"data_compressed":249123,"data_compressed_allocated":331776,"data_compressed_original":2162688,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3003,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":91,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003301"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651455+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:34:36.651455+0000","last_peered":"2023-10-05T15:34:36.651455+0000","last_clean":"2023-10-05T15:34:36.651455+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:34:36.651455+0000","last_undegraded":"2023-10-05T15:34:36.651455+0000","last_fullsized":"2023-10-05T15:34:36.651455+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.657965+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:34:36.657965+0000","last_peered":"2023-10-05T15:34:36.657965+0000","last_clean":"2023-10-05T15:34:36.657965+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:34:36.657965+0000","last_undegraded":"2023-10-05T15:34:36.657965+0000","last_fullsized":"2023-10-05T15:34:36.657965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655970+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:34:36.655970+0000","last_peered":"2023-10-05T15:34:36.655970+0000","last_clean":"2023-10-05T15:34:36.655970+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:34:36.655970+0000","last_undegraded":"2023-10-05T15:34:36.655970+0000","last_fullsized":"2023-10-05T15:34:36.655970+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.647524+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:34:36.647524+0000","last_peered":"2023-10-05T15:34:36.647524+0000","last_clean":"2023-10-05T15:34:36.647524+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:34:36.647524+0000","last_undegraded":"2023-10-05T15:34:36.647524+0000","last_fullsized":"2023-10-05T15:34:36.647524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.644731+0000","last_change":"2023-10-05T15:34:32.602982+0000","last_active":"2023-10-05T15:34:36.644731+0000","last_peered":"2023-10-05T15:34:36.644731+0000","last_clean":"2023-10-05T15:34:36.644731+0000","last_became_active":"2023-10-05T15:34:32.602604+0000","last_became_peered":"2023-10-05T15:34:32.602604+0000","last_unstale":"2023-10-05T15:34:36.644731+0000","last_undegraded":"2023-10-05T15:34:36.644731+0000","last_fullsized":"2023-10-05T15:34:36.644731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:07:45.111391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856093+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:34:36.856093+0000","last_peered":"2023-10-05T15:34:36.856093+0000","last_clean":"2023-10-05T15:34:36.856093+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:34:36.856093+0000","last_undegraded":"2023-10-05T15:34:36.856093+0000","last_fullsized":"2023-10-05T15:34:36.856093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651737+0000","last_change":"2023-10-05T15:34:32.610565+0000","last_active":"2023-10-05T15:34:36.651737+0000","last_peered":"2023-10-05T15:34:36.651737+0000","last_clean":"2023-10-05T15:34:36.651737+0000","last_became_active":"2023-10-05T15:34:32.610276+0000","last_became_peered":"2023-10-05T15:34:32.610276+0000","last_unstale":"2023-10-05T15:34:36.651737+0000","last_undegraded":"2023-10-05T15:34:36.651737+0000","last_fullsized":"2023-10-05T15:34:36.651737+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:30:19.372698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649650+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:34:36.649650+0000","last_peered":"2023-10-05T15:34:36.649650+0000","last_clean":"2023-10-05T15:34:36.649650+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:34:36.649650+0000","last_undegraded":"2023-10-05T15:34:36.649650+0000","last_fullsized":"2023-10-05T15:34:36.649650+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.653400+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:34:36.653400+0000","last_peered":"2023-10-05T15:34:36.653400+0000","last_clean":"2023-10-05T15:34:36.653400+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:34:36.653400+0000","last_undegraded":"2023-10-05T15:34:36.653400+0000","last_fullsized":"2023-10-05T15:34:36.653400+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856982+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:34:36.856982+0000","last_peered":"2023-10-05T15:34:36.856982+0000","last_clean":"2023-10-05T15:34:36.856982+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:34:36.856982+0000","last_undegraded":"2023-10-05T15:34:36.856982+0000","last_fullsized":"2023-10-05T15:34:36.856982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652116+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:34:36.652116+0000","last_peered":"2023-10-05T15:34:36.652116+0000","last_clean":"2023-10-05T15:34:36.652116+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:34:36.652116+0000","last_undegraded":"2023-10-05T15:34:36.652116+0000","last_fullsized":"2023-10-05T15:34:36.652116+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.647401+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:34:36.647401+0000","last_peered":"2023-10-05T15:34:36.647401+0000","last_clean":"2023-10-05T15:34:36.647401+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:34:36.647401+0000","last_undegraded":"2023-10-05T15:34:36.647401+0000","last_fullsized":"2023-10-05T15:34:36.647401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.671393+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:34:36.671393+0000","last_peered":"2023-10-05T15:34:36.671393+0000","last_clean":"2023-10-05T15:34:36.671393+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:34:36.671393+0000","last_undegraded":"2023-10-05T15:34:36.671393+0000","last_fullsized":"2023-10-05T15:34:36.671393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655595+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:34:36.655595+0000","last_peered":"2023-10-05T15:34:36.655595+0000","last_clean":"2023-10-05T15:34:36.655595+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:34:36.655595+0000","last_undegraded":"2023-10-05T15:34:36.655595+0000","last_fullsized":"2023-10-05T15:34:36.655595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.654201+0000","last_change":"2023-10-05T15:34:32.603806+0000","last_active":"2023-10-05T15:34:36.654201+0000","last_peered":"2023-10-05T15:34:36.654201+0000","last_clean":"2023-10-05T15:34:36.654201+0000","last_became_active":"2023-10-05T15:34:32.603454+0000","last_became_peered":"2023-10-05T15:34:32.603454+0000","last_unstale":"2023-10-05T15:34:36.654201+0000","last_undegraded":"2023-10-05T15:34:36.654201+0000","last_fullsized":"2023-10-05T15:34:36.654201+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:25:51.728253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650879+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:34:36.650879+0000","last_peered":"2023-10-05T15:34:36.650879+0000","last_clean":"2023-10-05T15:34:36.650879+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:34:36.650879+0000","last_undegraded":"2023-10-05T15:34:36.650879+0000","last_fullsized":"2023-10-05T15:34:36.650879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651233+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:34:36.651233+0000","last_peered":"2023-10-05T15:34:36.651233+0000","last_clean":"2023-10-05T15:34:36.651233+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:34:36.651233+0000","last_undegraded":"2023-10-05T15:34:36.651233+0000","last_fullsized":"2023-10-05T15:34:36.651233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.665268+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:34:36.665268+0000","last_peered":"2023-10-05T15:34:36.665268+0000","last_clean":"2023-10-05T15:34:36.665268+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:34:36.665268+0000","last_undegraded":"2023-10-05T15:34:36.665268+0000","last_fullsized":"2023-10-05T15:34:36.665268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646818+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:34:36.646818+0000","last_peered":"2023-10-05T15:34:36.646818+0000","last_clean":"2023-10-05T15:34:36.646818+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:34:36.646818+0000","last_undegraded":"2023-10-05T15:34:36.646818+0000","last_fullsized":"2023-10-05T15:34:36.646818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869384+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:34:37.869384+0000","last_peered":"2023-10-05T15:34:37.869384+0000","last_clean":"2023-10-05T15:34:37.869384+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:34:37.869384+0000","last_undegraded":"2023-10-05T15:34:37.869384+0000","last_fullsized":"2023-10-05T15:34:37.869384+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.657545+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:34:36.657545+0000","last_peered":"2023-10-05T15:34:36.657545+0000","last_clean":"2023-10-05T15:34:36.657545+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:34:36.657545+0000","last_undegraded":"2023-10-05T15:34:36.657545+0000","last_fullsized":"2023-10-05T15:34:36.657545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650710+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:34:36.650710+0000","last_peered":"2023-10-05T15:34:36.650710+0000","last_clean":"2023-10-05T15:34:36.650710+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:34:36.650710+0000","last_undegraded":"2023-10-05T15:34:36.650710+0000","last_fullsized":"2023-10-05T15:34:36.650710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869743+0000","last_change":"2023-10-05T15:34:36.669884+0000","last_active":"2023-10-05T15:34:37.869743+0000","last_peered":"2023-10-05T15:34:37.869743+0000","last_clean":"2023-10-05T15:34:37.869743+0000","last_became_active":"2023-10-05T15:34:36.669519+0000","last_became_peered":"2023-10-05T15:34:36.669519+0000","last_unstale":"2023-10-05T15:34:37.869743+0000","last_undegraded":"2023-10-05T15:34:37.869743+0000","last_fullsized":"2023-10-05T15:34:37.869743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:54:03.949163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868809+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:34:37.868809+0000","last_peered":"2023-10-05T15:34:37.868809+0000","last_clean":"2023-10-05T15:34:37.868809+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:34:37.868809+0000","last_undegraded":"2023-10-05T15:34:37.868809+0000","last_fullsized":"2023-10-05T15:34:37.868809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655165+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:34:36.655165+0000","last_peered":"2023-10-05T15:34:36.655165+0000","last_clean":"2023-10-05T15:34:36.655165+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:34:36.655165+0000","last_undegraded":"2023-10-05T15:34:36.655165+0000","last_fullsized":"2023-10-05T15:34:36.655165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869991+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:34:37.869991+0000","last_peered":"2023-10-05T15:34:37.869991+0000","last_clean":"2023-10-05T15:34:37.869991+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:34:37.869991+0000","last_undegraded":"2023-10-05T15:34:37.869991+0000","last_fullsized":"2023-10-05T15:34:37.869991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.768293+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:35:00.768293+0000","last_peered":"2023-10-05T15:35:00.768293+0000","last_clean":"2023-10-05T15:35:00.768293+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:35:00.768293+0000","last_undegraded":"2023-10-05T15:35:00.768293+0000","last_fullsized":"2023-10-05T15:35:00.768293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651430+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:34:36.651430+0000","last_peered":"2023-10-05T15:34:36.651430+0000","last_clean":"2023-10-05T15:34:36.651430+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:34:36.651430+0000","last_undegraded":"2023-10-05T15:34:36.651430+0000","last_fullsized":"2023-10-05T15:34:36.651430+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869340+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:34:37.869340+0000","last_peered":"2023-10-05T15:34:37.869340+0000","last_clean":"2023-10-05T15:34:37.869340+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:34:37.869340+0000","last_undegraded":"2023-10-05T15:34:37.869340+0000","last_fullsized":"2023-10-05T15:34:37.869340+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.767491+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:35:00.767491+0000","last_peered":"2023-10-05T15:35:00.767491+0000","last_clean":"2023-10-05T15:35:00.767491+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:35:00.767491+0000","last_undegraded":"2023-10-05T15:35:00.767491+0000","last_fullsized":"2023-10-05T15:35:00.767491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652567+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:34:36.652567+0000","last_peered":"2023-10-05T15:34:36.652567+0000","last_clean":"2023-10-05T15:34:36.652567+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:34:36.652567+0000","last_undegraded":"2023-10-05T15:34:36.652567+0000","last_fullsized":"2023-10-05T15:34:36.652567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869567+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:34:37.869567+0000","last_peered":"2023-10-05T15:34:37.869567+0000","last_clean":"2023-10-05T15:34:37.869567+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:34:37.869567+0000","last_undegraded":"2023-10-05T15:34:37.869567+0000","last_fullsized":"2023-10-05T15:34:37.869567+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.741383+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:34:57.741383+0000","last_peered":"2023-10-05T15:34:57.741383+0000","last_clean":"2023-10-05T15:34:57.741383+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:34:57.741383+0000","last_undegraded":"2023-10-05T15:34:57.741383+0000","last_fullsized":"2023-10-05T15:34:57.741383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.645147+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:34:36.645147+0000","last_peered":"2023-10-05T15:34:36.645147+0000","last_clean":"2023-10-05T15:34:36.645147+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:34:36.645147+0000","last_undegraded":"2023-10-05T15:34:36.645147+0000","last_fullsized":"2023-10-05T15:34:36.645147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869348+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:34:37.869348+0000","last_peered":"2023-10-05T15:34:37.869348+0000","last_clean":"2023-10-05T15:34:37.869348+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:34:37.869348+0000","last_undegraded":"2023-10-05T15:34:37.869348+0000","last_fullsized":"2023-10-05T15:34:37.869348+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.751246+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:34:58.751246+0000","last_peered":"2023-10-05T15:34:58.751246+0000","last_clean":"2023-10-05T15:34:58.751246+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:34:58.751246+0000","last_undegraded":"2023-10-05T15:34:58.751246+0000","last_fullsized":"2023-10-05T15:34:58.751246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650288+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:34:36.650288+0000","last_peered":"2023-10-05T15:34:36.650288+0000","last_clean":"2023-10-05T15:34:36.650288+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:34:36.650288+0000","last_undegraded":"2023-10-05T15:34:36.650288+0000","last_fullsized":"2023-10-05T15:34:36.650288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869054+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:34:37.869054+0000","last_peered":"2023-10-05T15:34:37.869054+0000","last_clean":"2023-10-05T15:34:37.869054+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:34:37.869054+0000","last_undegraded":"2023-10-05T15:34:37.869054+0000","last_fullsized":"2023-10-05T15:34:37.869054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.753279+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:34:58.753279+0000","last_peered":"2023-10-05T15:34:58.753279+0000","last_clean":"2023-10-05T15:34:58.753279+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:34:58.753279+0000","last_undegraded":"2023-10-05T15:34:58.753279+0000","last_fullsized":"2023-10-05T15:34:58.753279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649725+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:34:36.649725+0000","last_peered":"2023-10-05T15:34:36.649725+0000","last_clean":"2023-10-05T15:34:36.649725+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:34:36.649725+0000","last_undegraded":"2023-10-05T15:34:36.649725+0000","last_fullsized":"2023-10-05T15:34:36.649725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.867917+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:34:37.867917+0000","last_peered":"2023-10-05T15:34:37.867917+0000","last_clean":"2023-10-05T15:34:37.867917+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:34:37.867917+0000","last_undegraded":"2023-10-05T15:34:37.867917+0000","last_fullsized":"2023-10-05T15:34:37.867917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.663897+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:34:37.663897+0000","last_peered":"2023-10-05T15:34:37.663897+0000","last_clean":"2023-10-05T15:34:37.663897+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:34:37.663897+0000","last_undegraded":"2023-10-05T15:34:37.663897+0000","last_fullsized":"2023-10-05T15:34:37.663897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.653374+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:34:36.653374+0000","last_peered":"2023-10-05T15:34:36.653374+0000","last_clean":"2023-10-05T15:34:36.653374+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:34:36.653374+0000","last_undegraded":"2023-10-05T15:34:36.653374+0000","last_fullsized":"2023-10-05T15:34:36.653374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868266+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:34:37.868266+0000","last_peered":"2023-10-05T15:34:37.868266+0000","last_clean":"2023-10-05T15:34:37.868266+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:34:37.868266+0000","last_undegraded":"2023-10-05T15:34:37.868266+0000","last_fullsized":"2023-10-05T15:34:37.868266+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740145+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:34:57.740145+0000","last_peered":"2023-10-05T15:34:57.740145+0000","last_clean":"2023-10-05T15:34:57.740145+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:34:57.740145+0000","last_undegraded":"2023-10-05T15:34:57.740145+0000","last_fullsized":"2023-10-05T15:34:57.740145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652988+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:34:36.652988+0000","last_peered":"2023-10-05T15:34:36.652988+0000","last_clean":"2023-10-05T15:34:36.652988+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:34:36.652988+0000","last_undegraded":"2023-10-05T15:34:36.652988+0000","last_fullsized":"2023-10-05T15:34:36.652988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660290+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:34:37.660290+0000","last_peered":"2023-10-05T15:34:37.660290+0000","last_clean":"2023-10-05T15:34:37.660290+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:34:37.660290+0000","last_undegraded":"2023-10-05T15:34:37.660290+0000","last_fullsized":"2023-10-05T15:34:37.660290+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.738478+0000","last_change":"2023-10-05T15:34:31.611897+0000","last_active":"2023-10-05T15:34:57.738478+0000","last_peered":"2023-10-05T15:34:57.738478+0000","last_clean":"2023-10-05T15:34:57.738478+0000","last_became_active":"2023-10-05T15:34:31.611550+0000","last_became_peered":"2023-10-05T15:34:31.611550+0000","last_unstale":"2023-10-05T15:34:57.738478+0000","last_undegraded":"2023-10-05T15:34:57.738478+0000","last_fullsized":"2023-10-05T15:34:57.738478+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:21:00.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655279+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:34:36.655279+0000","last_peered":"2023-10-05T15:34:36.655279+0000","last_clean":"2023-10-05T15:34:36.655279+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:34:36.655279+0000","last_undegraded":"2023-10-05T15:34:36.655279+0000","last_fullsized":"2023-10-05T15:34:36.655279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.870164+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:34:37.870164+0000","last_peered":"2023-10-05T15:34:37.870164+0000","last_clean":"2023-10-05T15:34:37.870164+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:34:37.870164+0000","last_undegraded":"2023-10-05T15:34:37.870164+0000","last_fullsized":"2023-10-05T15:34:37.870164+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.664203+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:34:37.664203+0000","last_peered":"2023-10-05T15:34:37.664203+0000","last_clean":"2023-10-05T15:34:37.664203+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:34:37.664203+0000","last_undegraded":"2023-10-05T15:34:37.664203+0000","last_fullsized":"2023-10-05T15:34:37.664203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651519+0000","last_change":"2023-10-05T15:34:32.604356+0000","last_active":"2023-10-05T15:34:36.651519+0000","last_peered":"2023-10-05T15:34:36.651519+0000","last_clean":"2023-10-05T15:34:36.651519+0000","last_became_active":"2023-10-05T15:34:32.604039+0000","last_became_peered":"2023-10-05T15:34:32.604039+0000","last_unstale":"2023-10-05T15:34:36.651519+0000","last_undegraded":"2023-10-05T15:34:36.651519+0000","last_fullsized":"2023-10-05T15:34:36.651519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:42:20.127943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660456+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:34:37.660456+0000","last_peered":"2023-10-05T15:34:37.660456+0000","last_clean":"2023-10-05T15:34:37.660456+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:34:37.660456+0000","last_undegraded":"2023-10-05T15:34:37.660456+0000","last_fullsized":"2023-10-05T15:34:37.660456+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'12","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.741245+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:34:57.741245+0000","last_peered":"2023-10-05T15:34:57.741245+0000","last_clean":"2023-10-05T15:34:57.741245+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:34:57.741245+0000","last_undegraded":"2023-10-05T15:34:57.741245+0000","last_fullsized":"2023-10-05T15:34:57.741245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.644857+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:34:36.644857+0000","last_peered":"2023-10-05T15:34:36.644857+0000","last_clean":"2023-10-05T15:34:36.644857+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:34:36.644857+0000","last_undegraded":"2023-10-05T15:34:36.644857+0000","last_fullsized":"2023-10-05T15:34:36.644857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.664427+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:34:37.664427+0000","last_peered":"2023-10-05T15:34:37.664427+0000","last_clean":"2023-10-05T15:34:37.664427+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:34:37.664427+0000","last_undegraded":"2023-10-05T15:34:37.664427+0000","last_fullsized":"2023-10-05T15:34:37.664427+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.752296+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:34:58.752296+0000","last_peered":"2023-10-05T15:34:58.752296+0000","last_clean":"2023-10-05T15:34:58.752296+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:34:58.752296+0000","last_undegraded":"2023-10-05T15:34:58.752296+0000","last_fullsized":"2023-10-05T15:34:58.752296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.664541+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:34:36.664541+0000","last_peered":"2023-10-05T15:34:36.664541+0000","last_clean":"2023-10-05T15:34:36.664541+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:34:36.664541+0000","last_undegraded":"2023-10-05T15:34:36.664541+0000","last_fullsized":"2023-10-05T15:34:36.664541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868437+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:34:37.868437+0000","last_peered":"2023-10-05T15:34:37.868437+0000","last_clean":"2023-10-05T15:34:37.868437+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:34:37.868437+0000","last_undegraded":"2023-10-05T15:34:37.868437+0000","last_fullsized":"2023-10-05T15:34:37.868437+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740522+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:34:57.740522+0000","last_peered":"2023-10-05T15:34:57.740522+0000","last_clean":"2023-10-05T15:34:57.740522+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:34:57.740522+0000","last_undegraded":"2023-10-05T15:34:57.740522+0000","last_fullsized":"2023-10-05T15:34:57.740522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652982+0000","last_change":"2023-10-05T15:34:32.617270+0000","last_active":"2023-10-05T15:34:36.652982+0000","last_peered":"2023-10-05T15:34:36.652982+0000","last_clean":"2023-10-05T15:34:36.652982+0000","last_became_active":"2023-10-05T15:34:32.616941+0000","last_became_peered":"2023-10-05T15:34:32.616941+0000","last_unstale":"2023-10-05T15:34:36.652982+0000","last_undegraded":"2023-10-05T15:34:36.652982+0000","last_fullsized":"2023-10-05T15:34:36.652982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:33:52.771420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660780+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:34:37.660780+0000","last_peered":"2023-10-05T15:34:37.660780+0000","last_clean":"2023-10-05T15:34:37.660780+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:34:37.660780+0000","last_undegraded":"2023-10-05T15:34:37.660780+0000","last_fullsized":"2023-10-05T15:34:37.660780+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646347+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:34:36.646347+0000","last_peered":"2023-10-05T15:34:36.646347+0000","last_clean":"2023-10-05T15:34:36.646347+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:34:36.646347+0000","last_undegraded":"2023-10-05T15:34:36.646347+0000","last_fullsized":"2023-10-05T15:34:36.646347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.653564+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:34:36.653564+0000","last_peered":"2023-10-05T15:34:36.653564+0000","last_clean":"2023-10-05T15:34:36.653564+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:34:36.653564+0000","last_undegraded":"2023-10-05T15:34:36.653564+0000","last_fullsized":"2023-10-05T15:34:36.653564+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.885104+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:34:37.885104+0000","last_peered":"2023-10-05T15:34:37.885104+0000","last_clean":"2023-10-05T15:34:37.885104+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:34:37.885104+0000","last_undegraded":"2023-10-05T15:34:37.885104+0000","last_fullsized":"2023-10-05T15:34:37.885104+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.765839+0000","last_change":"2023-10-05T15:34:31.609929+0000","last_active":"2023-10-05T15:35:00.765839+0000","last_peered":"2023-10-05T15:35:00.765839+0000","last_clean":"2023-10-05T15:35:00.765839+0000","last_became_active":"2023-10-05T15:34:31.609604+0000","last_became_peered":"2023-10-05T15:34:31.609604+0000","last_unstale":"2023-10-05T15:35:00.765839+0000","last_undegraded":"2023-10-05T15:35:00.765839+0000","last_fullsized":"2023-10-05T15:35:00.765839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:12:46.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650560+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:34:36.650560+0000","last_peered":"2023-10-05T15:34:36.650560+0000","last_clean":"2023-10-05T15:34:36.650560+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:34:36.650560+0000","last_undegraded":"2023-10-05T15:34:36.650560+0000","last_fullsized":"2023-10-05T15:34:36.650560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.663528+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:34:37.663528+0000","last_peered":"2023-10-05T15:34:37.663528+0000","last_clean":"2023-10-05T15:34:37.663528+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:34:37.663528+0000","last_undegraded":"2023-10-05T15:34:37.663528+0000","last_fullsized":"2023-10-05T15:34:37.663528+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.662427+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:34:37.662427+0000","last_peered":"2023-10-05T15:34:37.662427+0000","last_clean":"2023-10-05T15:34:37.662427+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:34:37.662427+0000","last_undegraded":"2023-10-05T15:34:37.662427+0000","last_fullsized":"2023-10-05T15:34:37.662427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650476+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:34:36.650476+0000","last_peered":"2023-10-05T15:34:36.650476+0000","last_clean":"2023-10-05T15:34:36.650476+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:34:36.650476+0000","last_undegraded":"2023-10-05T15:34:36.650476+0000","last_fullsized":"2023-10-05T15:34:36.650476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.662309+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:34:37.662309+0000","last_peered":"2023-10-05T15:34:37.662309+0000","last_clean":"2023-10-05T15:34:37.662309+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:34:37.662309+0000","last_undegraded":"2023-10-05T15:34:37.662309+0000","last_fullsized":"2023-10-05T15:34:37.662309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.655704+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:34:36.655704+0000","last_peered":"2023-10-05T15:34:36.655704+0000","last_clean":"2023-10-05T15:34:36.655704+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:34:36.655704+0000","last_undegraded":"2023-10-05T15:34:36.655704+0000","last_fullsized":"2023-10-05T15:34:36.655704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856528+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:34:36.856528+0000","last_peered":"2023-10-05T15:34:36.856528+0000","last_clean":"2023-10-05T15:34:36.856528+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:34:36.856528+0000","last_undegraded":"2023-10-05T15:34:36.856528+0000","last_fullsized":"2023-10-05T15:34:36.856528+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.884877+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:34:37.884877+0000","last_peered":"2023-10-05T15:34:37.884877+0000","last_clean":"2023-10-05T15:34:37.884877+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:34:37.884877+0000","last_undegraded":"2023-10-05T15:34:37.884877+0000","last_fullsized":"2023-10-05T15:34:37.884877+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868980+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:34:37.868980+0000","last_peered":"2023-10-05T15:34:37.868980+0000","last_clean":"2023-10-05T15:34:37.868980+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:34:37.868980+0000","last_undegraded":"2023-10-05T15:34:37.868980+0000","last_fullsized":"2023-10-05T15:34:37.868980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.856307+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:34:36.856307+0000","last_peered":"2023-10-05T15:34:36.856307+0000","last_clean":"2023-10-05T15:34:36.856307+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:34:36.856307+0000","last_undegraded":"2023-10-05T15:34:36.856307+0000","last_fullsized":"2023-10-05T15:34:36.856307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.885047+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:34:37.885047+0000","last_peered":"2023-10-05T15:34:37.885047+0000","last_clean":"2023-10-05T15:34:37.885047+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:34:37.885047+0000","last_undegraded":"2023-10-05T15:34:37.885047+0000","last_fullsized":"2023-10-05T15:34:37.885047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650157+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:34:36.650157+0000","last_peered":"2023-10-05T15:34:36.650157+0000","last_clean":"2023-10-05T15:34:36.650157+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:34:36.650157+0000","last_undegraded":"2023-10-05T15:34:36.650157+0000","last_fullsized":"2023-10-05T15:34:36.650157+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.753072+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:34:58.753072+0000","last_peered":"2023-10-05T15:34:58.753072+0000","last_clean":"2023-10-05T15:34:58.753072+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:34:58.753072+0000","last_undegraded":"2023-10-05T15:34:58.753072+0000","last_fullsized":"2023-10-05T15:34:58.753072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869635+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:34:37.869635+0000","last_peered":"2023-10-05T15:34:37.869635+0000","last_clean":"2023-10-05T15:34:37.869635+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:34:37.869635+0000","last_undegraded":"2023-10-05T15:34:37.869635+0000","last_fullsized":"2023-10-05T15:34:37.869635+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649958+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:34:36.649958+0000","last_peered":"2023-10-05T15:34:36.649958+0000","last_clean":"2023-10-05T15:34:36.649958+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:34:36.649958+0000","last_undegraded":"2023-10-05T15:34:36.649958+0000","last_fullsized":"2023-10-05T15:34:36.649958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740441+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:34:57.740441+0000","last_peered":"2023-10-05T15:34:57.740441+0000","last_clean":"2023-10-05T15:34:57.740441+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:34:57.740441+0000","last_undegraded":"2023-10-05T15:34:57.740441+0000","last_fullsized":"2023-10-05T15:34:57.740441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":314,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652629+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:34:36.652629+0000","last_peered":"2023-10-05T15:34:36.652629+0000","last_clean":"2023-10-05T15:34:36.652629+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:34:36.652629+0000","last_undegraded":"2023-10-05T15:34:36.652629+0000","last_fullsized":"2023-10-05T15:34:36.652629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.664151+0000","last_change":"2023-10-05T15:34:36.858457+0000","last_active":"2023-10-05T15:34:37.664151+0000","last_peered":"2023-10-05T15:34:37.664151+0000","last_clean":"2023-10-05T15:34:37.664151+0000","last_became_active":"2023-10-05T15:34:36.857998+0000","last_became_peered":"2023-10-05T15:34:36.857998+0000","last_unstale":"2023-10-05T15:34:37.664151+0000","last_undegraded":"2023-10-05T15:34:37.664151+0000","last_fullsized":"2023-10-05T15:34:37.664151+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:38:52.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.663968+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:34:36.663968+0000","last_peered":"2023-10-05T15:34:36.663968+0000","last_clean":"2023-10-05T15:34:36.663968+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:34:36.663968+0000","last_undegraded":"2023-10-05T15:34:36.663968+0000","last_fullsized":"2023-10-05T15:34:36.663968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.750232+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:34:58.750232+0000","last_peered":"2023-10-05T15:34:58.750232+0000","last_clean":"2023-10-05T15:34:58.750232+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:34:58.750232+0000","last_undegraded":"2023-10-05T15:34:58.750232+0000","last_fullsized":"2023-10-05T15:34:58.750232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868496+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:34:37.868496+0000","last_peered":"2023-10-05T15:34:37.868496+0000","last_clean":"2023-10-05T15:34:37.868496+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:34:37.868496+0000","last_undegraded":"2023-10-05T15:34:37.868496+0000","last_fullsized":"2023-10-05T15:34:37.868496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.766884+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:35:00.766884+0000","last_peered":"2023-10-05T15:35:00.766884+0000","last_clean":"2023-10-05T15:35:00.766884+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:35:00.766884+0000","last_undegraded":"2023-10-05T15:35:00.766884+0000","last_fullsized":"2023-10-05T15:35:00.766884+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.672049+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:34:36.672049+0000","last_peered":"2023-10-05T15:34:36.672049+0000","last_clean":"2023-10-05T15:34:36.672049+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:34:36.672049+0000","last_undegraded":"2023-10-05T15:34:36.672049+0000","last_fullsized":"2023-10-05T15:34:36.672049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.867807+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:34:37.867807+0000","last_peered":"2023-10-05T15:34:37.867807+0000","last_clean":"2023-10-05T15:34:37.867807+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:34:37.867807+0000","last_undegraded":"2023-10-05T15:34:37.867807+0000","last_fullsized":"2023-10-05T15:34:37.867807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.675303+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:34:36.675303+0000","last_peered":"2023-10-05T15:34:36.675303+0000","last_clean":"2023-10-05T15:34:36.675303+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:34:36.675303+0000","last_undegraded":"2023-10-05T15:34:36.675303+0000","last_fullsized":"2023-10-05T15:34:36.675303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650492+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:34:36.650492+0000","last_peered":"2023-10-05T15:34:36.650492+0000","last_clean":"2023-10-05T15:34:36.650492+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:34:36.650492+0000","last_undegraded":"2023-10-05T15:34:36.650492+0000","last_fullsized":"2023-10-05T15:34:36.650492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868983+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:34:37.868983+0000","last_peered":"2023-10-05T15:34:37.868983+0000","last_clean":"2023-10-05T15:34:37.868983+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:34:37.868983+0000","last_undegraded":"2023-10-05T15:34:37.868983+0000","last_fullsized":"2023-10-05T15:34:37.868983+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740010+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:34:57.740010+0000","last_peered":"2023-10-05T15:34:57.740010+0000","last_clean":"2023-10-05T15:34:57.740010+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:34:57.740010+0000","last_undegraded":"2023-10-05T15:34:57.740010+0000","last_fullsized":"2023-10-05T15:34:57.740010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.658066+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:34:36.658066+0000","last_peered":"2023-10-05T15:34:36.658066+0000","last_clean":"2023-10-05T15:34:36.658066+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:34:36.658066+0000","last_undegraded":"2023-10-05T15:34:36.658066+0000","last_fullsized":"2023-10-05T15:34:36.658066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869344+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:34:37.869344+0000","last_peered":"2023-10-05T15:34:37.869344+0000","last_clean":"2023-10-05T15:34:37.869344+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:34:37.869344+0000","last_undegraded":"2023-10-05T15:34:37.869344+0000","last_fullsized":"2023-10-05T15:34:37.869344+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740682+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:34:57.740682+0000","last_peered":"2023-10-05T15:34:57.740682+0000","last_clean":"2023-10-05T15:34:57.740682+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:34:57.740682+0000","last_undegraded":"2023-10-05T15:34:57.740682+0000","last_fullsized":"2023-10-05T15:34:57.740682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.644731+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:34:36.644731+0000","last_peered":"2023-10-05T15:34:36.644731+0000","last_clean":"2023-10-05T15:34:36.644731+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:34:36.644731+0000","last_undegraded":"2023-10-05T15:34:36.644731+0000","last_fullsized":"2023-10-05T15:34:36.644731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.660903+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:34:37.660903+0000","last_peered":"2023-10-05T15:34:37.660903+0000","last_clean":"2023-10-05T15:34:37.660903+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:34:37.660903+0000","last_undegraded":"2023-10-05T15:34:37.660903+0000","last_fullsized":"2023-10-05T15:34:37.660903+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:35:00.766049+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:35:00.766049+0000","last_peered":"2023-10-05T15:35:00.766049+0000","last_clean":"2023-10-05T15:35:00.766049+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:35:00.766049+0000","last_undegraded":"2023-10-05T15:35:00.766049+0000","last_fullsized":"2023-10-05T15:35:00.766049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649465+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:34:36.649465+0000","last_peered":"2023-10-05T15:34:36.649465+0000","last_clean":"2023-10-05T15:34:36.649465+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:34:36.649465+0000","last_undegraded":"2023-10-05T15:34:36.649465+0000","last_fullsized":"2023-10-05T15:34:36.649465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869107+0000","last_change":"2023-10-05T15:34:36.660640+0000","last_active":"2023-10-05T15:34:37.869107+0000","last_peered":"2023-10-05T15:34:37.869107+0000","last_clean":"2023-10-05T15:34:37.869107+0000","last_became_active":"2023-10-05T15:34:36.660205+0000","last_became_peered":"2023-10-05T15:34:36.660205+0000","last_unstale":"2023-10-05T15:34:37.869107+0000","last_undegraded":"2023-10-05T15:34:37.869107+0000","last_fullsized":"2023-10-05T15:34:37.869107+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:47:57.422258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.645852+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:34:36.645852+0000","last_peered":"2023-10-05T15:34:36.645852+0000","last_clean":"2023-10-05T15:34:36.645852+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:34:36.645852+0000","last_undegraded":"2023-10-05T15:34:36.645852+0000","last_fullsized":"2023-10-05T15:34:36.645852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650963+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:34:36.650963+0000","last_peered":"2023-10-05T15:34:36.650963+0000","last_clean":"2023-10-05T15:34:36.650963+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:34:36.650963+0000","last_undegraded":"2023-10-05T15:34:36.650963+0000","last_fullsized":"2023-10-05T15:34:36.650963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.869704+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:34:37.869704+0000","last_peered":"2023-10-05T15:34:37.869704+0000","last_clean":"2023-10-05T15:34:37.869704+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:34:37.869704+0000","last_undegraded":"2023-10-05T15:34:37.869704+0000","last_fullsized":"2023-10-05T15:34:37.869704+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:57.740767+0000","last_change":"2023-10-05T15:34:31.604468+0000","last_active":"2023-10-05T15:34:57.740767+0000","last_peered":"2023-10-05T15:34:57.740767+0000","last_clean":"2023-10-05T15:34:57.740767+0000","last_became_active":"2023-10-05T15:34:31.604107+0000","last_became_peered":"2023-10-05T15:34:31.604107+0000","last_unstale":"2023-10-05T15:34:57.740767+0000","last_undegraded":"2023-10-05T15:34:57.740767+0000","last_fullsized":"2023-10-05T15:34:57.740767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:57:10.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651724+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:34:36.651724+0000","last_peered":"2023-10-05T15:34:36.651724+0000","last_clean":"2023-10-05T15:34:36.651724+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:34:36.651724+0000","last_undegraded":"2023-10-05T15:34:36.651724+0000","last_fullsized":"2023-10-05T15:34:36.651724+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.870753+0000","last_change":"2023-10-05T15:34:36.668436+0000","last_active":"2023-10-05T15:34:37.870753+0000","last_peered":"2023-10-05T15:34:37.870753+0000","last_clean":"2023-10-05T15:34:37.870753+0000","last_became_active":"2023-10-05T15:34:36.668002+0000","last_became_peered":"2023-10-05T15:34:36.668002+0000","last_unstale":"2023-10-05T15:34:37.870753+0000","last_undegraded":"2023-10-05T15:34:37.870753+0000","last_fullsized":"2023-10-05T15:34:37.870753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:27:55.706225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:58.752897+0000","last_change":"2023-10-05T15:34:31.612135+0000","last_active":"2023-10-05T15:34:58.752897+0000","last_peered":"2023-10-05T15:34:58.752897+0000","last_clean":"2023-10-05T15:34:58.752897+0000","last_became_active":"2023-10-05T15:34:31.611686+0000","last_became_peered":"2023-10-05T15:34:31.611686+0000","last_unstale":"2023-10-05T15:34:58.752897+0000","last_undegraded":"2023-10-05T15:34:58.752897+0000","last_fullsized":"2023-10-05T15:34:58.752897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:38:43.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652315+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:34:36.652315+0000","last_peered":"2023-10-05T15:34:36.652315+0000","last_clean":"2023-10-05T15:34:36.652315+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:34:36.652315+0000","last_undegraded":"2023-10-05T15:34:36.652315+0000","last_fullsized":"2023-10-05T15:34:36.652315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.868234+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:34:37.868234+0000","last_peered":"2023-10-05T15:34:37.868234+0000","last_clean":"2023-10-05T15:34:37.868234+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:34:37.868234+0000","last_undegraded":"2023-10-05T15:34:37.868234+0000","last_fullsized":"2023-10-05T15:34:37.868234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652678+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:34:36.652678+0000","last_peered":"2023-10-05T15:34:36.652678+0000","last_clean":"2023-10-05T15:34:36.652678+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:34:36.652678+0000","last_undegraded":"2023-10-05T15:34:36.652678+0000","last_fullsized":"2023-10-05T15:34:36.652678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.652643+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:34:36.652643+0000","last_peered":"2023-10-05T15:34:36.652643+0000","last_clean":"2023-10-05T15:34:36.652643+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:34:36.652643+0000","last_undegraded":"2023-10-05T15:34:36.652643+0000","last_fullsized":"2023-10-05T15:34:36.652643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-05T15:34:37.663237+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:34:37.663237+0000","last_peered":"2023-10-05T15:34:37.663237+0000","last_clean":"2023-10-05T15:34:37.663237+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:34:37.663237+0000","last_undegraded":"2023-10-05T15:34:37.663237+0000","last_fullsized":"2023-10-05T15:34:37.663237+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.672225+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:34:36.672225+0000","last_peered":"2023-10-05T15:34:36.672225+0000","last_clean":"2023-10-05T15:34:36.672225+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:34:36.672225+0000","last_undegraded":"2023-10-05T15:34:36.672225+0000","last_fullsized":"2023-10-05T15:34:36.672225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651832+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:34:36.651832+0000","last_peered":"2023-10-05T15:34:36.651832+0000","last_clean":"2023-10-05T15:34:36.651832+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:34:36.651832+0000","last_undegraded":"2023-10-05T15:34:36.651832+0000","last_fullsized":"2023-10-05T15:34:36.651832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649556+0000","last_change":"2023-10-05T15:34:32.612359+0000","last_active":"2023-10-05T15:34:36.649556+0000","last_peered":"2023-10-05T15:34:36.649556+0000","last_clean":"2023-10-05T15:34:36.649556+0000","last_became_active":"2023-10-05T15:34:32.611989+0000","last_became_peered":"2023-10-05T15:34:32.611989+0000","last_unstale":"2023-10-05T15:34:36.649556+0000","last_undegraded":"2023-10-05T15:34:36.649556+0000","last_fullsized":"2023-10-05T15:34:36.649556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:44:17.562645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646657+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:34:36.646657+0000","last_peered":"2023-10-05T15:34:36.646657+0000","last_clean":"2023-10-05T15:34:36.646657+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:34:36.646657+0000","last_undegraded":"2023-10-05T15:34:36.646657+0000","last_fullsized":"2023-10-05T15:34:36.646657+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.645752+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:34:36.645752+0000","last_peered":"2023-10-05T15:34:36.645752+0000","last_clean":"2023-10-05T15:34:36.645752+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:34:36.645752+0000","last_undegraded":"2023-10-05T15:34:36.645752+0000","last_fullsized":"2023-10-05T15:34:36.645752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.657167+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:34:36.657167+0000","last_peered":"2023-10-05T15:34:36.657167+0000","last_clean":"2023-10-05T15:34:36.657167+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:34:36.657167+0000","last_undegraded":"2023-10-05T15:34:36.657167+0000","last_fullsized":"2023-10-05T15:34:36.657167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.672147+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:34:36.672147+0000","last_peered":"2023-10-05T15:34:36.672147+0000","last_clean":"2023-10-05T15:34:36.672147+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:34:36.672147+0000","last_undegraded":"2023-10-05T15:34:36.672147+0000","last_fullsized":"2023-10-05T15:34:36.672147+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650939+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:34:36.650939+0000","last_peered":"2023-10-05T15:34:36.650939+0000","last_clean":"2023-10-05T15:34:36.650939+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:34:36.650939+0000","last_undegraded":"2023-10-05T15:34:36.650939+0000","last_fullsized":"2023-10-05T15:34:36.650939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.646205+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:34:36.646205+0000","last_peered":"2023-10-05T15:34:36.646205+0000","last_clean":"2023-10-05T15:34:36.646205+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:34:36.646205+0000","last_undegraded":"2023-10-05T15:34:36.646205+0000","last_fullsized":"2023-10-05T15:34:36.646205+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650800+0000","last_change":"2023-10-05T15:34:32.601803+0000","last_active":"2023-10-05T15:34:36.650800+0000","last_peered":"2023-10-05T15:34:36.650800+0000","last_clean":"2023-10-05T15:34:36.650800+0000","last_became_active":"2023-10-05T15:34:32.601459+0000","last_became_peered":"2023-10-05T15:34:32.601459+0000","last_unstale":"2023-10-05T15:34:36.650800+0000","last_undegraded":"2023-10-05T15:34:36.650800+0000","last_fullsized":"2023-10-05T15:34:36.650800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:03:06.072594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650068+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:34:36.650068+0000","last_peered":"2023-10-05T15:34:36.650068+0000","last_clean":"2023-10-05T15:34:36.650068+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:34:36.650068+0000","last_undegraded":"2023-10-05T15:34:36.650068+0000","last_fullsized":"2023-10-05T15:34:36.650068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.649603+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:34:36.649603+0000","last_peered":"2023-10-05T15:34:36.649603+0000","last_clean":"2023-10-05T15:34:36.649603+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:34:36.649603+0000","last_undegraded":"2023-10-05T15:34:36.649603+0000","last_fullsized":"2023-10-05T15:34:36.649603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.651883+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:34:36.651883+0000","last_peered":"2023-10-05T15:34:36.651883+0000","last_clean":"2023-10-05T15:34:36.651883+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:34:36.651883+0000","last_undegraded":"2023-10-05T15:34:36.651883+0000","last_fullsized":"2023-10-05T15:34:36.651883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.671278+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:34:36.671278+0000","last_peered":"2023-10-05T15:34:36.671278+0000","last_clean":"2023-10-05T15:34:36.671278+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:34:36.671278+0000","last_undegraded":"2023-10-05T15:34:36.671278+0000","last_fullsized":"2023-10-05T15:34:36.671278+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-05T15:34:36.650302+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:34:36.650302+0000","last_peered":"2023-10-05T15:34:36.650302+0000","last_clean":"2023-10-05T15:34:36.650302+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:34:36.650302+0000","last_undegraded":"2023-10-05T15:34:36.650302+0000","last_fullsized":"2023-10-05T15:34:36.650302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7502,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":23496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480806,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.871}]},{"osd":5,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83499999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.1559999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:34:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.91500000000000004}]}]},{"osd":10,"up_from":73,"seq":313532612632,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":1075071,"data_compressed":47908,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.626}]},{"osd":2,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.87},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.92200000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.95799999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:34:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.88400000000000001}]}]},{"osd":9,"up_from":68,"seq":292057776157,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":480398,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.83799999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.75,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.133,"5min":1.343,"15min":1.343},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83599999999999997,"15min":0.83799999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.997,"5min":1.109,"15min":1.109},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69499999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0349999999999999,"5min":1.258,"15min":1.258},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91800000000000004,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.79500000000000004},"min":{"1min":0.54600000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1240000000000001,"5min":1.161,"15min":1.161},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.93500000000000005,"15min":0.93899999999999995},"min":{"1min":0.66300000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3049999999999999,"5min":1.391,"15min":1.391},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.004,"15min":1.02},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.371,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.65100000000000002}]},{"osd":8,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91300000000000003,"15min":0.92400000000000004},"min":{"1min":0.66300000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0149999999999999,"5min":1.256,"15min":1.256},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.94799999999999995,"15min":0.95499999999999996},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.72699999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:34:12 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":8,"up_from":60,"seq":257698037794,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":481114,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73899999999999999,"15min":0.747},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96899999999999997,"5min":1.24,"15min":1.24},"last":0.753},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.51500000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91700000000000004,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98299999999999998,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84699999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.01,"5min":1.04,"15min":1.04},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.624}]},{"osd":4,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97099999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.90200000000000002,"15min":0.92000000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0469999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.94999999999999996,"15min":0.95599999999999996},"min":{"1min":0.72799999999999998,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2210000000000001,"5min":1.252,"15min":1.252},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.90500000000000003,"15min":0.89900000000000002},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96299999999999997,"15min":0.96699999999999997},"min":{"1min":0.60199999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.1280000000000001,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.96399999999999997,"15min":0.97999999999999998},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1359999999999999,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.90500000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2729999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.93300000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.98899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299431,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1072446,"data_compressed":47908,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.622,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5749999999999993,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.103,"5min":0.65500000000000003,"15min":0.57099999999999995},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.9950000000000001,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.76800000000000002,"15min":0.71799999999999997},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.5309999999999997,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.80800000000000005,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":8.2840000000000007,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.502}]},{"osd":3,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":8.5370000000000008,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.79500000000000004,"15min":0.75700000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.3289999999999997,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.626},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.127,"15min":1.127},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.2769999999999999,"5min":0.88700000000000001,"15min":0.80800000000000005},"min":{"1min":0.56599999999999995,"5min":0.5,"15min":0.5},"max":{"1min":8.609,"5min":8.609,"15min":8.609},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.4699999999999998,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1739999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.85499999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.90900000000000003,"15min":0.90000000000000002},"min":{"1min":0.73899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.89700000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.123,"5min":1.28,"15min":1.28},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.3400000000000001,"5min":0.96899999999999997,"15min":0.90700000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":8.3219999999999992,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":0.877}]},{"osd":10,"last update":"Thu Oct 5 15:34:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.83699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462957,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":479704,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.44700000000000001,"15min":0.42499999999999999},"min":{"1min":0.35299999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69199999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.47399999999999998},"min":{"1min":0.38600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92400000000000004,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.68799999999999994,"15min":0.66000000000000003},"min":{"1min":0.58099999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0649999999999999,"5min":1.097,"15min":1.097},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":1.169,"15min":1.169},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.57999999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.006,"15min":1.006},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.121,"15min":1.121},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Oct 5 15:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79800000000000004,"15min":0.79600000000000004},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:34:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.80800000000000005,"15min":0.78400000000000003},"min":{"1min":0.66400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.014,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.87}]},{"osd":8,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.86899999999999999,"15min":0.86699999999999999},"min":{"1min":0.63500000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.65900000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.91000000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:34:46 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.89100000000000001},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.77200000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":483456,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.505},{"interface":"front","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":1.083,"15min":1.083},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.59899999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1499999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64500000000000002,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0660000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65500000000000003,"15min":0.64000000000000001},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.68999999999999995,"15min":0.65100000000000002},"min":{"1min":0.505,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Oct 5 15:34:02 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.754,"15min":0.72899999999999998},"min":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:34:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.78600000000000003},"min":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.534,"5min":1.538,"15min":1.538},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:34:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0600000000000001,"5min":1.51,"15min":1.51},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.046,"5min":1.381,"15min":1.381},"last":1.046}]},{"osd":8,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.60799999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0609999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.872},"min":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2130000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88300000000000001,"15min":0.88600000000000001},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0820000000000001,"5min":1.282,"15min":1.282},"last":1.091}]},{"osd":10,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.107},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":480308,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.621,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0289999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.70099999999999996,"15min":0.65100000000000002},"min":{"1min":0.56399999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67000000000000004,"15min":0.61799999999999999},"min":{"1min":0.44800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.026},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Oct 5 15:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.55500000000000005,"15min":0.51700000000000002},"min":{"1min":0.42399999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56299999999999994,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.88200000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67400000000000004,"15min":0.68200000000000005},"min":{"1min":0.44400000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0840000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71299999999999997,"15min":0.68300000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96499999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:34:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.70099999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.83999999999999997,"15min":0.83399999999999996},"min":{"1min":0.69899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77300000000000002,"15min":0.76500000000000001},"min":{"1min":0.57499999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.0149999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:34:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.87,"15min":0.88200000000000001},"min":{"1min":0.64400000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0669999999999999,"5min":1.135,"15min":1.135},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.85699999999999998,"15min":0.86499999999999999},"min":{"1min":0.60599999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.877}]},{"osd":9,"last update":"Thu Oct 5 15:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89700000000000002,"15min":0.89600000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.877,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.1020000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.042}]},{"osd":11,"last update":"Thu Oct 5 15:34:36 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.054},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.90200000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":484806,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84099999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56399999999999995,"15min":0.54300000000000004},"min":{"1min":0.318,"5min":0.315,"15min":0.315},"max":{"1min":0.72199999999999998,"5min":1.036,"15min":1.036},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:34:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.66300000000000003,"15min":0.62},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88200000000000001,"5min":1.127,"15min":1.127},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.47699999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.754}]},{"osd":3,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.626,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0289999999999999,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.65400000000000003,"15min":0.61499999999999999},"min":{"1min":0.59199999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:33:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96499999999999997,"5min":1.734,"15min":1.734},"last":0.95299999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.499},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.876,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:34:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72699999999999998,"15min":0.71399999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.873},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73199999999999998},"min":{"1min":0.61199999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91600000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.163,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.97399999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.044}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.88200000000000001,"15min":0.88500000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.075},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.0980000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":480044,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.438,"15min":0.40300000000000002},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83199999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.45100000000000001,"15min":0.42699999999999999},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.54400000000000004,"5min":0.378,"15min":0.378},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.622},"min":{"1min":0.56699999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.76900000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73099999999999998,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.032,"5min":1.109,"15min":1.109},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Oct 5 15:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.78800000000000003,"15min":0.76000000000000001},"min":{"1min":0.67200000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1759999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78300000000000003,"15min":0.75800000000000001},"min":{"1min":0.59599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.01,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":1.089,"15min":1.089},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85599999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.218,"5min":1.409,"15min":1.409},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2410000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.84899999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95199999999999996,"5min":1.105,"15min":1.105},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.621,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.93500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":479636,"data_compressed":11711,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Oct 5 15:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.45800000000000002,"15min":0.433},"min":{"1min":0.313,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":1.526,"15min":1.526},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47599999999999998,"15min":0.44},"min":{"1min":0.35999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72999999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93500000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.57199999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66200000000000003,"15min":0.624},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.024,"5min":1.288,"15min":1.288},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65800000000000003,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90600000000000003,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.77900000000000003,"15min":0.76900000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.878},{"interface":"front","average":{"1min":0.874,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:34:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.73699999999999999,"15min":0.70499999999999996},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0209999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.73299999999999998,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.627},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.74099999999999999,"15min":0.72099999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.80600000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.77500000000000002,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.97799999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:46 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.96499999999999997,"15min":0.98299999999999998},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.0529999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0720000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.74199999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.86399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724593,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1071127,"data_compressed":47908,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83499999999999996,"5min":1.671,"15min":1.671},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63700000000000001,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90300000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.47099999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.50700000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.78700000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.46800000000000003},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.497,"15min":0.47699999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.0049999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98399999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.54000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91700000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.53600000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76500000000000001,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.755},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.627,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.79600000000000004,"15min":0.77200000000000002},"min":{"1min":0.68500000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:34:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.72899999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.86199999999999999,"15min":0.85299999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.92000000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:34:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.95099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:35:04.259 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-05T15:35:04.260 INFO:tasks.cephadm:Setting up client nodes... 2023-10-05T15:35:04.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-05T15:35:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-05T15:35:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2023-10-05T15:35:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-10-05T15:35:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2023-10-05T15:35:05.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:04 smithi167 ceph-mon[133366]: pgmap v320: 129 pgs: 129 active+clean; 620 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.8 KiB/s wr, 17 op/s 2023-10-05T15:35:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-05T15:35:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2023-10-05T15:35:05.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:04 smithi079 ceph-mon[132936]: pgmap v320: 129 pgs: 129 active+clean; 620 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.8 KiB/s wr, 17 op/s 2023-10-05T15:35:05.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2023-10-05T15:35:05.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:04 smithi017 ceph-mon[129107]: pgmap v320: 129 pgs: 129 active+clean; 620 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.8 KiB/s wr, 17 op/s 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2023-10-05T15:35:05.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2023-10-05T15:35:05.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-05T15:35:05.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2023-10-05T15:35:05.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:05 smithi017 ceph-mon[129107]: osdmap e91: 12 total, 12 up, 12 in 2023-10-05T15:35:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-05T15:35:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2023-10-05T15:35:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:05 smithi167 ceph-mon[133366]: osdmap e91: 12 total, 12 up, 12 in 2023-10-05T15:35:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2023-10-05T15:35:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:05 smithi079 ceph-mon[132936]: osdmap e91: 12 total, 12 up, 12 in 2023-10-05T15:35:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 -- 172.21.15.17:0/706187757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 msgr2=0x7f574c1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 --2- 172.21.15.17:0/706187757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c1013d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f573c0099c0 tx=0x7f573c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 -- 172.21.15.17:0/706187757 shutdown_connections 2023-10-05T15:35:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 --2- 172.21.15.17:0/706187757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f574c102b50 0x7f574c109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 --2- 172.21.15.17:0/706187757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c1013d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 --2- 172.21.15.17:0/706187757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f574c1021b0 0x7f574c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 -- 172.21.15.17:0/706187757 >> 172.21.15.17:0/706187757 conn(0x7f574c0fc570 msgr2=0x7f574c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:06.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.593+0000 7f5750fb6700 1 -- 172.21.15.17:0/706187757 shutdown_connections 2023-10-05T15:35:06.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.594+0000 7f5750fb6700 1 -- 172.21.15.17:0/706187757 wait complete. 2023-10-05T15:35:06.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.594+0000 7f5750fb6700 1 Processor -- start 2023-10-05T15:35:06.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 -- start start 2023-10-05T15:35:06.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:06.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f574c1021b0 0x7f574c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:06.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f574c102b50 0x7f574c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c1a08e0 con 0x7f574c100fb0 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c1a0a20 con 0x7f574c1021b0 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f5750fb6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c1a0bb0 con 0x7f574c102b50 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f574a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f574a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48882/0 (socket says 172.21.15.17:48882) 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.595+0000 7f574a59c700 1 -- 172.21.15.17:0/1841950279 learned_addr learned my addr 172.21.15.17:0/1841950279 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574ad9d700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f574c102b50 0x7f574c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f5749d9b700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f574c1021b0 0x7f574c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574a59c700 1 -- 172.21.15.17:0/1841950279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f574c102b50 msgr2=0x7f574c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574a59c700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f574c102b50 0x7f574c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574a59c700 1 -- 172.21.15.17:0/1841950279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f574c1021b0 msgr2=0x7f574c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574a59c700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f574c1021b0 0x7f574c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574a59c700 1 -- 172.21.15.17:0/1841950279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0095f0 con 0x7f574c100fb0 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f574a59c700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c198d50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f573c004730 tx=0x7f573c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c01d070 con 0x7f574c100fb0 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f573c004100 con 0x7f574c100fb0 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c005290 con 0x7f574c100fb0 2023-10-05T15:35:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.596+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c1a0e30 con 0x7f574c100fb0 2023-10-05T15:35:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.597+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c1a1190 con 0x7f574c100fb0 2023-10-05T15:35:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.598+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c1934a0 con 0x7f574c100fb0 2023-10-05T15:35:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.599+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f573c004980 con 0x7f574c100fb0 2023-10-05T15:35:06.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.601+0000 7f573b7fe700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f57340a1510 0x7f57340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.601+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f573c0ce220 con 0x7f574c100fb0 2023-10-05T15:35:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.601+0000 7f5749d9b700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f57340a1510 0x7f57340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.602+0000 7f5749d9b700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f57340a1510 0x7f57340a39d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5740005ea0 tx=0x7f5740005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:06.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.605+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f573c097440 con 0x7f574c100fb0 2023-10-05T15:35:06.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.901+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f574c02d090 con 0x7f574c100fb0 2023-10-05T15:35:06.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.904+0000 7f573b7fe700 1 -- 172.21.15.17:0/1841950279 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f573c09aa60 con 0x7f574c100fb0 2023-10-05T15:35:06.907 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-10-05T15:35:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQCq1x5liqvjNRAAKX7MzXuq3jZ/bpAexjVyKg== 2023-10-05T15:35:06.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f57340a1510 msgr2=0x7f57340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:06.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f57340a1510 0x7f57340a39d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5740005ea0 tx=0x7f5740005e30 comp rx=0 tx=0).stop 2023-10-05T15:35:06.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 msgr2=0x7f574c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c198d50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f573c004730 tx=0x7f573c009580 comp rx=0 tx=0).stop 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 shutdown_connections 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f57340a1510 0x7f57340a39d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f574c102b50 0x7f574c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f574c100fb0 0x7f574c198d50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 --2- 172.21.15.17:0/1841950279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f574c1021b0 0x7f574c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.906+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 >> 172.21.15.17:0/1841950279 conn(0x7f574c0fc570 msgr2=0x7f574c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.907+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 shutdown_connections 2023-10-05T15:35:06.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:06.907+0000 7f5750fb6700 1 -- 172.21.15.17:0/1841950279 wait complete. 2023-10-05T15:35:07.056 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:06 smithi017 ceph-mon[129107]: osdmap e92: 12 total, 12 up, 12 in 2023-10-05T15:35:07.057 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:06 smithi017 ceph-mon[129107]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 621 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 28 op/s 2023-10-05T15:35:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:06 smithi167 ceph-mon[133366]: osdmap e92: 12 total, 12 up, 12 in 2023-10-05T15:35:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:06 smithi167 ceph-mon[133366]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 621 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 28 op/s 2023-10-05T15:35:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:06 smithi079 ceph-mon[132936]: osdmap e92: 12 total, 12 up, 12 in 2023-10-05T15:35:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:06 smithi079 ceph-mon[132936]: pgmap v323: 129 pgs: 2 peering, 127 active+clean; 621 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 28 op/s 2023-10-05T15:35:07.430 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:35:07.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-05T15:35:07.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-05T15:35:07.531 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-05T15:35:07.532 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-05T15:35:07.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-05T15:35:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:07 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1841950279' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-05T15:35:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:07 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1841950279' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-05T15:35:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:07 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1841950279' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-05T15:35:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:07 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1841950279' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-05T15:35:08.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:07 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1841950279' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-05T15:35:08.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:07 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1841950279' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-05T15:35:08.303 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:08.930 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:08 smithi017 ceph-mon[129107]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 24 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:08 smithi167 ceph-mon[133366]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 24 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:09.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:08 smithi079 ceph-mon[132936]: pgmap v324: 129 pgs: 2 peering, 127 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 KiB/s wr, 24 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 -- 172.21.15.17:0/3014009607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848106f90 msgr2=0x7f0848107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 --2- 172.21.15.17:0/3014009607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848106f90 0x7f0848107370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f08380099c0 tx=0x7f0838009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 -- 172.21.15.17:0/3014009607 shutdown_connections 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 --2- 172.21.15.17:0/3014009607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0848101940 0x7f084810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 --2- 172.21.15.17:0/3014009607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848106f90 0x7f0848107370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 --2- 172.21.15.17:0/3014009607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0848100f80 0x7f0848101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 -- 172.21.15.17:0/3014009607 >> 172.21.15.17:0/3014009607 conn(0x7f08480780a0 msgr2=0x7f08480784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 -- 172.21.15.17:0/3014009607 shutdown_connections 2023-10-05T15:35:09.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.977+0000 7f084e45d700 1 -- 172.21.15.17:0/3014009607 wait complete. 2023-10-05T15:35:09.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.978+0000 7f084e45d700 1 Processor -- start 2023-10-05T15:35:09.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 -- start start 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 0x7f08481990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0848101940 0x7f0848199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0848106f90 0x7f084819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084819e090 con 0x7f0848100f80 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084819e200 con 0x7f0848101940 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f084e45d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084819e3c0 con 0x7f0848106f90 2023-10-05T15:35:09.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f0847fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 0x7f08481990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:09.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f0847fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 0x7f08481990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48894/0 (socket says 172.21.15.17:48894) 2023-10-05T15:35:09.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.979+0000 7f0847fff700 1 -- 172.21.15.17:0/276803360 learned_addr learned my addr 172.21.15.17:0/276803360 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f08477fe700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0848101940 0x7f0848199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f084c9fa700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0848106f90 0x7f084819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f0847fff700 1 -- 172.21.15.17:0/276803360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0848106f90 msgr2=0x7f084819da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f0847fff700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0848106f90 0x7f084819da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f0847fff700 1 -- 172.21.15.17:0/276803360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0848101940 msgr2=0x7f0848199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f0847fff700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0848101940 0x7f0848199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f0847fff700 1 -- 172.21.15.17:0/276803360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08380095f0 con 0x7f0848100f80 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f0847fff700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 0x7f08481990d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0838000c00 tx=0x7f0838005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083801d070 con 0x7f0848100f80 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.980+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084819e640 con 0x7f0848100f80 2023-10-05T15:35:09.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.981+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f083800fe70 con 0x7f0848100f80 2023-10-05T15:35:09.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.981+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380173f0 con 0x7f0848100f80 2023-10-05T15:35:09.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.981+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08481a5f00 con 0x7f0848100f80 2023-10-05T15:35:09.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.982+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084804ebb0 con 0x7f0848100f80 2023-10-05T15:35:09.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.984+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f083800f9e0 con 0x7f0848100f80 2023-10-05T15:35:09.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.985+0000 7f08457fa700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08300a1510 0x7f08300a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:09.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.985+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f08380ce2b0 con 0x7f0848100f80 2023-10-05T15:35:09.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.986+0000 7f08477fe700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08300a1510 0x7f08300a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:09.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.986+0000 7f08477fe700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08300a1510 0x7f08300a39d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f084819a6f0 tx=0x7f083c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:09.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:09.989+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08380974d0 con 0x7f0848100f80 2023-10-05T15:35:10.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.259+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0848110d50 con 0x7f0848100f80 2023-10-05T15:35:10.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.265+0000 7f08457fa700 1 -- 172.21.15.17:0/276803360 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260405 (secure 0 0 0) 0x7f083809aaf0 con 0x7f0848100f80 2023-10-05T15:35:10.271 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08300a1510 msgr2=0x7f08300a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08300a1510 0x7f08300a39d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f084819a6f0 tx=0x7f083c00b410 comp rx=0 tx=0).stop 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 msgr2=0x7f08481990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 0x7f08481990d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0838000c00 tx=0x7f0838005f10 comp rx=0 tx=0).stop 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 shutdown_connections 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08300a1510 0x7f08300a39d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0848106f90 0x7f084819da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0848100f80 0x7f08481990d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:10.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 --2- 172.21.15.17:0/276803360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0848101940 0x7f0848199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:10.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 >> 172.21.15.17:0/276803360 conn(0x7f08480780a0 msgr2=0x7f0848073230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:10.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 shutdown_connections 2023-10-05T15:35:10.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:10.269+0000 7f084e45d700 1 -- 172.21.15.17:0/276803360 wait complete. 2023-10-05T15:35:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:10 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/276803360' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-05T15:35:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:10 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/276803360' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-05T15:35:10.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:10 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/276803360' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-05T15:35:10.805 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":1244004544},{"type":"v1","addr":"172.21.15.17:6801","nonce":1244004544}]},"active_addr":"172.21.15.17:6801/1244004544","active_change":"2023-10-05T15:27:04.478008+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14211,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":587919469}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1092785870}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1297361438}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":216411331}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":647353750}]}]} 2023-10-05T15:35:10.811 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-05T15:35:10.811 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-05T15:35:10.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-05T15:35:11.550 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:11.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:11 smithi167 ceph-mon[133366]: pgmap v325: 129 pgs: 129 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 25 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:11.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:11 smithi079 ceph-mon[132936]: pgmap v325: 129 pgs: 129 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 25 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:11.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:11 smithi017 ceph-mon[129107]: pgmap v325: 129 pgs: 129 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 25 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:13.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 -- 172.21.15.17:0/210443255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc100f80 msgr2=0x7f43fc101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:13.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 --2- 172.21.15.17:0/210443255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc100f80 0x7f43fc101400 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f43f00099c0 tx=0x7f43f0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 -- 172.21.15.17:0/210443255 shutdown_connections 2023-10-05T15:35:13.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 --2- 172.21.15.17:0/210443255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc101940 0x7f43fc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 --2- 172.21.15.17:0/210443255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43fc106f90 0x7f43fc107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 --2- 172.21.15.17:0/210443255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc100f80 0x7f43fc101400 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 -- 172.21.15.17:0/210443255 >> 172.21.15.17:0/210443255 conn(0x7f43fc0780a0 msgr2=0x7f43fc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:13.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 -- 172.21.15.17:0/210443255 shutdown_connections 2023-10-05T15:35:13.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.334+0000 7f4401ab9700 1 -- 172.21.15.17:0/210443255 wait complete. 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.335+0000 7f4401ab9700 1 Processor -- start 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.335+0000 7f4401ab9700 1 -- start start 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.335+0000 7f4401ab9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc100f80 0x7f43fc196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f4401ab9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 0x7f43fc197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f4401ab9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43fc106f90 0x7f43fc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f4401ab9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc19bec0 con 0x7f43fc101940 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f4401ab9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc19c030 con 0x7f43fc100f80 2023-10-05T15:35:13.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f4401ab9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc19c1f0 con 0x7f43fc106f90 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 0x7f43fc197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 0x7f43fc197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48916/0 (socket says 172.21.15.17:48916) 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 -- 172.21.15.17:0/3741864023 learned_addr learned my addr 172.21.15.17:0/3741864023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43fbfff700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43fc106f90 0x7f43fc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43fb7fe700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc100f80 0x7f43fc196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 -- 172.21.15.17:0/3741864023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43fc106f90 msgr2=0x7f43fc19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43fc106f90 0x7f43fc19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 -- 172.21.15.17:0/3741864023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc100f80 msgr2=0x7f43fc196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc100f80 0x7f43fc196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43faffd700 1 -- 172.21.15.17:0/3741864023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00095f0 con 0x7f43fc101940 2023-10-05T15:35:13.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.336+0000 7f43fb7fe700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc100f80 0x7f43fc196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.337+0000 7f43faffd700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 0x7f43fc197440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43f0005910 tx=0x7f43f000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.337+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f001d070 con 0x7f43fc101940 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.337+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc19c470 con 0x7f43fc101940 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.337+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43f00054e0 con 0x7f43fc101940 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.337+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0004ab0 con 0x7f43fc101940 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.337+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc1a3d30 con 0x7f43fc101940 2023-10-05T15:35:13.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.338+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc04ebb0 con 0x7f43fc101940 2023-10-05T15:35:13.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.340+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f43f000fb80 con 0x7f43fc101940 2023-10-05T15:35:13.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.342+0000 7f43f8ff9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f43e40a1510 0x7f43e40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.342+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f43f00ce440 con 0x7f43fc101940 2023-10-05T15:35:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.342+0000 7f43fb7fe700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f43e40a1510 0x7f43e40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:13.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.343+0000 7f43fb7fe700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f43e40a1510 0x7f43e40a39d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009c90 tx=0x7f43ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:13.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.344+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f43f0097660 con 0x7f43fc101940 2023-10-05T15:35:13.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.553+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43fc110d00 con 0x7f43fc101940 2023-10-05T15:35:13.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.555+0000 7f43f8ff9700 1 -- 172.21.15.17:0/3741864023 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24386 (secure 0 0 0) 0x7f43f009ac80 con 0x7f43fc101940 2023-10-05T15:35:13.558 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:13.558 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":92,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:35:05.767531+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:35:13.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f43e40a1510 msgr2=0x7f43e40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f43e40a1510 0x7f43e40a39d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009c90 tx=0x7f43ec009260 comp rx=0 tx=0).stop 2023-10-05T15:35:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 msgr2=0x7f43fc197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 0x7f43fc197440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43f0005910 tx=0x7f43f000f690 comp rx=0 tx=0).stop 2023-10-05T15:35:13.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 shutdown_connections 2023-10-05T15:35:13.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f43e40a1510 0x7f43e40a39d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43fc106f90 0x7f43fc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43fc100f80 0x7f43fc196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 --2- 172.21.15.17:0/3741864023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43fc101940 0x7f43fc197440 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:13.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.557+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 >> 172.21.15.17:0/3741864023 conn(0x7f43fc0780a0 msgr2=0x7f43fc0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:13.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.558+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 shutdown_connections 2023-10-05T15:35:13.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:13.558+0000 7f4401ab9700 1 -- 172.21.15.17:0/3741864023 wait complete. 2023-10-05T15:35:13.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:13 smithi079 ceph-mon[132936]: pgmap v326: 129 pgs: 129 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:13.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:13 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3741864023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:13 smithi017 ceph-mon[129107]: pgmap v326: 129 pgs: 129 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:13.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:13 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3741864023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:13.953 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-05T15:35:13.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-05T15:35:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:13 smithi167 ceph-mon[133366]: pgmap v326: 129 pgs: 129 active+clean; 632 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-05T15:35:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:13 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3741864023' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:14.690 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:15.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:15 smithi079 ceph-mon[132936]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s; 12 B/s, 0 objects/s recovering 2023-10-05T15:35:15.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:15 smithi017 ceph-mon[129107]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s; 12 B/s, 0 objects/s recovering 2023-10-05T15:35:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:15 smithi167 ceph-mon[133366]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 12 op/s; 12 B/s, 0 objects/s recovering 2023-10-05T15:35:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 -- 172.21.15.17:0/177851082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8100f80 msgr2=0x7fbee8101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 --2- 172.21.15.17:0/177851082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8100f80 0x7fbee8101400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbed80099c0 tx=0x7fbed8009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 -- 172.21.15.17:0/177851082 shutdown_connections 2023-10-05T15:35:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 --2- 172.21.15.17:0/177851082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee8101940 0x7fbee810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 --2- 172.21.15.17:0/177851082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee8106f90 0x7fbee8107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 --2- 172.21.15.17:0/177851082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8100f80 0x7fbee8101400 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 -- 172.21.15.17:0/177851082 >> 172.21.15.17:0/177851082 conn(0x7fbee80780a0 msgr2=0x7fbee80784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:16.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 -- 172.21.15.17:0/177851082 shutdown_connections 2023-10-05T15:35:16.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.316+0000 7fbeefd88700 1 -- 172.21.15.17:0/177851082 wait complete. 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.317+0000 7fbeefd88700 1 Processor -- start 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.317+0000 7fbeefd88700 1 -- start start 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.317+0000 7fbeefd88700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee8100f80 0x7fbee8196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeefd88700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee8101940 0x7fbee81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeefd88700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 0x7fbee819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeefd88700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee819bf20 con 0x7fbee8106f90 2023-10-05T15:35:16.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeefd88700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee819c090 con 0x7fbee8100f80 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeefd88700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee819c250 con 0x7fbee8101940 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 0x7fbee819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 0x7fbee819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49298/0 (socket says 172.21.15.17:49298) 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 -- 172.21.15.17:0/1205365509 learned_addr learned my addr 172.21.15.17:0/1205365509 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeedb24700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee8100f80 0x7fbee8196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeed323700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee8101940 0x7fbee81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 -- 172.21.15.17:0/1205365509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee8101940 msgr2=0x7fbee81974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee8101940 0x7fbee81974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 -- 172.21.15.17:0/1205365509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee8100f80 msgr2=0x7fbee8196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee8100f80 0x7fbee8196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.318+0000 7fbeee325700 1 -- 172.21.15.17:0/1205365509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed80095f0 con 0x7fbee8106f90 2023-10-05T15:35:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.319+0000 7fbeee325700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 0x7fbee819b910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007f10 tx=0x7fbee000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.319+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0009ea0 con 0x7fbee8106f90 2023-10-05T15:35:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.319+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbee000f040 con 0x7fbee8106f90 2023-10-05T15:35:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.319+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee819c530 con 0x7fbee8106f90 2023-10-05T15:35:16.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.319+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0004640 con 0x7fbee8106f90 2023-10-05T15:35:16.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.319+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee81a3d90 con 0x7fbee8106f90 2023-10-05T15:35:16.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.320+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee804ebb0 con 0x7fbee8106f90 2023-10-05T15:35:16.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.322+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fbee00047a0 con 0x7fbee8106f90 2023-10-05T15:35:16.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.324+0000 7fbedeffd700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbed40a1510 0x7fbed40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:16.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.325+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fbee00cca20 con 0x7fbee8106f90 2023-10-05T15:35:16.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.325+0000 7fbeedb24700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbed40a1510 0x7fbed40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:16.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.325+0000 7fbeedb24700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbed40a1510 0x7fbed40a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbee4007b60 tx=0x7fbee40073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:16.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.329+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbee004f100 con 0x7fbee8106f90 2023-10-05T15:35:16.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.540+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbee8110d00 con 0x7fbee8106f90 2023-10-05T15:35:16.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.542+0000 7fbedeffd700 1 -- 172.21.15.17:0/1205365509 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24386 (secure 0 0 0) 0x7fbee0095bb0 con 0x7fbee8106f90 2023-10-05T15:35:16.545 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:16.546 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":92,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:35:05.767531+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbed40a1510 msgr2=0x7fbed40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbed40a1510 0x7fbed40a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbee4007b60 tx=0x7fbee40073d0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 msgr2=0x7fbee819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 0x7fbee819b910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007f10 tx=0x7fbee000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 shutdown_connections 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbed40a1510 0x7fbed40a39d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbee8106f90 0x7fbee819b910 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbee8100f80 0x7fbee8196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 --2- 172.21.15.17:0/1205365509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbee8101940 0x7fbee81974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 >> 172.21.15.17:0/1205365509 conn(0x7fbee80780a0 msgr2=0x7fbee80ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 shutdown_connections 2023-10-05T15:35:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:16.545+0000 7fbeefd88700 1 -- 172.21.15.17:0/1205365509 wait complete. 2023-10-05T15:35:16.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:16 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1205365509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:16.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:16 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1205365509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:17.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:16 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1205365509' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:35:17.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-05T15:35:17.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-05T15:35:17.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-05T15:35:17.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-05T15:35:17.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-05T15:35:17.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-05T15:35:17.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-05T15:35:17.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-05T15:35:17.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-05T15:35:17.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-05T15:35:17.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-05T15:35:17.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-05T15:35:17.622 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:17 smithi017 ceph-mon[129107]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2023-10-05T15:35:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:17 smithi167 ceph-mon[133366]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2023-10-05T15:35:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:17 smithi079 ceph-mon[132936]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2023-10-05T15:35:19.193 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:19.391 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:19.464 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:19.801 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:19 smithi017 ceph-mon[129107]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2023-10-05T15:35:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:19 smithi167 ceph-mon[133366]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2023-10-05T15:35:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:19 smithi079 ceph-mon[132936]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2023-10-05T15:35:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:20.110 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:21.635 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:21 smithi017 ceph-mon[129107]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-10-05T15:35:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:21 smithi167 ceph-mon[133366]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-10-05T15:35:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:21 smithi079 ceph-mon[132936]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 -- 172.21.15.17:0/2157469061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c101940 msgr2=0x7f4e9c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 --2- 172.21.15.17:0/2157469061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c101940 0x7f4e9c10ddb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400b0d0 tx=0x7f4e9400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 -- 172.21.15.17:0/2157469061 shutdown_connections 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 --2- 172.21.15.17:0/2157469061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c101940 0x7f4e9c10ddb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 --2- 172.21.15.17:0/2157469061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e9c106f90 0x7f4e9c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 --2- 172.21.15.17:0/2157469061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c100f80 0x7f4e9c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 -- 172.21.15.17:0/2157469061 >> 172.21.15.17:0/2157469061 conn(0x7f4e9c0780a0 msgr2=0x7f4e9c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 -- 172.21.15.17:0/2157469061 shutdown_connections 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.521+0000 7f4ea2105700 1 -- 172.21.15.17:0/2157469061 wait complete. 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.522+0000 7f4ea2105700 1 Processor -- start 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.522+0000 7f4ea2105700 1 -- start start 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.522+0000 7f4ea2105700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c100f80 0x7f4e9c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.522+0000 7f4ea2105700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c101940 0x7f4e9c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.522+0000 7f4ea2105700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e9c106f90 0x7f4e9c19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4ea2105700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19e120 con 0x7f4e9c100f80 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4ea2105700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19e290 con 0x7f4e9c101940 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4ea2105700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c19e450 con 0x7f4e9c106f90 2023-10-05T15:35:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c100f80 0x7f4e9c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c100f80 0x7f4e9c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49314/0 (socket says 172.21.15.17:49314) 2023-10-05T15:35:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 -- 172.21.15.17:0/3068944976 learned_addr learned my addr 172.21.15.17:0/3068944976 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9affd700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c101940 0x7f4e9c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9bfff700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e9c106f90 0x7f4e9c19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 -- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e9c106f90 msgr2=0x7f4e9c19db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e9c106f90 0x7f4e9c19db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 -- 172.21.15.17:0/3068944976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c101940 msgr2=0x7f4e9c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e9c101940 0x7f4e9c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9b7fe700 1 -- 172.21.15.17:0/3068944976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94009d00 con 0x7f4e9c100f80 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.523+0000 7f4e9bfff700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e9c106f90 0x7f4e9c19db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.524+0000 7f4e9b7fe700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c100f80 0x7f4e9c199160 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c9b0 tx=0x7f4e8c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.524+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c007b00 con 0x7f4e9c100f80 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.524+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c19e730 con 0x7f4e9c100f80 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.524+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e8c007c60 con 0x7f4e9c100f80 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.524+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c018660 con 0x7f4e9c100f80 2023-10-05T15:35:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.524+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c1a5f90 con 0x7f4e9c100f80 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.525+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e9c111010 con 0x7f4e9c100f80 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.527+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4e8c00f450 con 0x7f4e9c100f80 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.528+0000 7f4e98ff9700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e840a1510 0x7f4e840a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.528+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4e8c0cd580 con 0x7f4e9c100f80 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.529+0000 7f4e9affd700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e840a1510 0x7f4e840a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.529+0000 7f4e98ff9700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] conn(0x7f4e840ac530 0x7f4e840ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.529+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 --> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e840af0a0 con 0x7f4e840ac530 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.529+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e8c0cd8f0 con 0x7f4e9c100f80 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.529+0000 7f4e9bfff700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] conn(0x7f4e840ac530 0x7f4e840ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:22.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.529+0000 7f4e9affd700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e840a1510 0x7f4e840a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c19a780 tx=0x7f4e900073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.530+0000 7f4e9bfff700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] conn(0x7f4e840ac530 0x7f4e840ae9d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.531+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== osd.2 v2:172.21.15.167:6800/3358437232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4e840af0a0 con 0x7f4e840ac530 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.548+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 --> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e9c04ebb0 con 0x7f4e840ac530 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4e98ff9700 1 -- 172.21.15.17:0/3068944976 <== osd.2 v2:172.21.15.167:6800/3358437232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e9c04ebb0 con 0x7f4e840ac530 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] conn(0x7f4e840ac530 msgr2=0x7f4e840ae9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] conn(0x7f4e840ac530 0x7f4e840ae9d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e840a1510 msgr2=0x7f4e840a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e840a1510 0x7f4e840a39d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c19a780 tx=0x7f4e900073d0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c100f80 msgr2=0x7f4e9c199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 --2- 172.21.15.17:0/3068944976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e9c100f80 0x7f4e9c199160 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c9b0 tx=0x7f4e8c00ccc0 comp rx=0 tx=0).stop 2023-10-05T15:35:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4e9bfff700 1 -- 172.21.15.17:0/3068944976 reap_dead start 2023-10-05T15:35:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 shutdown_connections 2023-10-05T15:35:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.549+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 >> 172.21.15.17:0/3068944976 conn(0x7f4e9c0780a0 msgr2=0x7f4e9c10c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.550+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 shutdown_connections 2023-10-05T15:35:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:22.550+0000 7f4ea2105700 1 -- 172.21.15.17:0/3068944976 wait complete. 2023-10-05T15:35:23.094 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:23.188 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:23.726 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:23 smithi017 ceph-mon[129107]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-10-05T15:35:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:23 smithi167 ceph-mon[133366]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-10-05T15:35:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:23 smithi079 ceph-mon[132936]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2023-10-05T15:35:24.555 INFO:teuthology.orchestra.run.smithi017.stdout:77309411398 2023-10-05T15:35:24.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 -- 172.21.15.17:0/688199968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 msgr2=0x7fe7080730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 --2- 172.21.15.17:0/688199968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe7080730e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009990 tx=0x7fe6f8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 -- 172.21.15.17:0/688199968 shutdown_connections 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 --2- 172.21.15.17:0/688199968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe708111bc0 0x7fe708113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 --2- 172.21.15.17:0/688199968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe7080730e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 --2- 172.21.15.17:0/688199968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe708073620 0x7fe708073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 -- 172.21.15.17:0/688199968 >> 172.21.15.17:0/688199968 conn(0x7fe7080780a0 msgr2=0x7fe7080784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:25.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 -- 172.21.15.17:0/688199968 shutdown_connections 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.917+0000 7fe70e80d700 1 -- 172.21.15.17:0/688199968 wait complete. 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.918+0000 7fe70e80d700 1 Processor -- start 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.918+0000 7fe70e80d700 1 -- start start 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70e80d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe708073620 0x7fe70819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70e80d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe70819db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70e80d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe708111bc0 0x7fe7081a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70e80d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081a2580 con 0x7fe708074ef0 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70e80d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081a26f0 con 0x7fe708073620 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70e80d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7081a28b0 con 0x7fe708111bc0 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe7077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe70819db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe7077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe70819db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41578/0 (socket says 172.21.15.17:41578) 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe7077fe700 1 -- 172.21.15.17:0/2193911446 learned_addr learned my addr 172.21.15.17:0/2193911446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:25.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe70cdaa700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe708111bc0 0x7fe7081a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.919+0000 7fe707fff700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe708073620 0x7fe70819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7077fe700 1 -- 172.21.15.17:0/2193911446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe708111bc0 msgr2=0x7fe7081a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7077fe700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe708111bc0 0x7fe7081a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7077fe700 1 -- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe708073620 msgr2=0x7fe70819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7077fe700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe708073620 0x7fe70819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7077fe700 1 -- 172.21.15.17:0/2193911446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80095f0 con 0x7fe708074ef0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe707fff700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe708073620 0x7fe70819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7077fe700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe70819db00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00d950 tx=0x7fe6fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00f890 con 0x7fe708074ef0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6fc00fe80 con 0x7fe708074ef0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7081a2b90 con 0x7fe708074ef0 2023-10-05T15:35:25.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00e3b0 con 0x7fe708074ef0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.920+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7081aa3f0 con 0x7fe708074ef0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.921+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe708117660 con 0x7fe708074ef0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.924+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe6fc010460 con 0x7fe708074ef0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.925+0000 7fe7057fa700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe6f00a1590 0x7fe6f00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.925+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe6fc0cd470 con 0x7fe708074ef0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.925+0000 7fe707fff700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe6f00a1590 0x7fe6f00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.925+0000 7fe7057fa700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] conn(0x7fe6f00ac5b0 0x7fe6f00aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.925+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 --> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6f00af120 con 0x7fe6f00ac5b0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.925+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6fc0cd7e0 con 0x7fe708074ef0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.926+0000 7fe70cdaa700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] conn(0x7fe6f00ac5b0 0x7fe6f00aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.926+0000 7fe707fff700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe6f00a1590 0x7fe6f00a3a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8006010 tx=0x7fe6f800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.927+0000 7fe70cdaa700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] conn(0x7fe6f00ac5b0 0x7fe6f00aea50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.928+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== osd.4 v2:172.21.15.79:6808/1876046713 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe6f00af120 con 0x7fe6f00ac5b0 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.946+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 --> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe70804ebb0 con 0x7fe6f00ac5b0 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.947+0000 7fe7057fa700 1 -- 172.21.15.17:0/2193911446 <== osd.4 v2:172.21.15.79:6808/1876046713 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe70804ebb0 con 0x7fe6f00ac5b0 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] conn(0x7fe6f00ac5b0 msgr2=0x7fe6f00aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] conn(0x7fe6f00ac5b0 0x7fe6f00aea50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe6f00a1590 msgr2=0x7fe6f00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe6f00a1590 0x7fe6f00a3a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8006010 tx=0x7fe6f800b260 comp rx=0 tx=0).stop 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 msgr2=0x7fe70819db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 --2- 172.21.15.17:0/2193911446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe708074ef0 0x7fe70819db00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00d950 tx=0x7fe6fc00dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70cdaa700 1 -- 172.21.15.17:0/2193911446 reap_dead start 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 shutdown_connections 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 >> 172.21.15.17:0/2193911446 conn(0x7fe7080780a0 msgr2=0x7fe708110720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 shutdown_connections 2023-10-05T15:35:25.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:24.948+0000 7fe70e80d700 1 -- 172.21.15.17:0/2193911446 wait complete. 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 -- 172.21.15.17:0/3590099468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc0730e0 msgr2=0x7efebc0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 --2- 172.21.15.17:0/3590099468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc0730e0 0x7efebc0734c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efeb80098f0 tx=0x7efeb8009c00 comp rx=0 tx=0).stop 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 -- 172.21.15.17:0/3590099468 shutdown_connections 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 --2- 172.21.15.17:0/3590099468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc10d930 0x7efebc10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 --2- 172.21.15.17:0/3590099468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc0730e0 0x7efebc0734c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 --2- 172.21.15.17:0/3590099468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efebc073a00 0x7efebc10d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 -- 172.21.15.17:0/3590099468 >> 172.21.15.17:0/3590099468 conn(0x7efebc0780a0 msgr2=0x7efebc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 -- 172.21.15.17:0/3590099468 shutdown_connections 2023-10-05T15:35:25.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.101+0000 7efec3e41700 1 -- 172.21.15.17:0/3590099468 wait complete. 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.102+0000 7efec3e41700 1 Processor -- start 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.102+0000 7efec3e41700 1 -- start start 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec3e41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc0730e0 0x7efebc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec3e41700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc073a00 0x7efebc199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec3e41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efebc10d930 0x7efebc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec3e41700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc19e1b0 con 0x7efebc10d930 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec3e41700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc19e320 con 0x7efebc0730e0 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec3e41700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc19e4e0 con 0x7efebc073a00 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec1bdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc0730e0 0x7efebc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec23de700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efebc10d930 0x7efebc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec1bdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc0730e0 0x7efebc1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:33846/0 (socket says 172.21.15.17:33846) 2023-10-05T15:35:25.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec1bdd700 1 -- 172.21.15.17:0/1448057157 learned_addr learned my addr 172.21.15.17:0/1448057157 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.103+0000 7efec13dc700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc073a00 0x7efebc199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec1bdd700 1 -- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc073a00 msgr2=0x7efebc199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec1bdd700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc073a00 0x7efebc199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec1bdd700 1 -- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efebc10d930 msgr2=0x7efebc19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec1bdd700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efebc10d930 0x7efebc19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec1bdd700 1 -- 172.21.15.17:0/1448057157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8009520 con 0x7efebc0730e0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec1bdd700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc0730e0 0x7efebc1991f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009810 tx=0x7efeb800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb801c070 con 0x7efebc0730e0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc19e760 con 0x7efebc0730e0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efeb800bb70 con 0x7efebc0730e0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.104+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8004930 con 0x7efebc0730e0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.105+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc1a6020 con 0x7efebc0730e0 2023-10-05T15:35:25.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.106+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efebc113250 con 0x7efebc0730e0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.109+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7efeb8020070 con 0x7efebc0730e0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.111+0000 7efeb2ffd700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efea80a1590 0x7efea80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.111+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efeb80ce500 con 0x7efebc0730e0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.111+0000 7efec13dc700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efea80a1590 0x7efea80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.112+0000 7efeb2ffd700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] conn(0x7efea80ac5b0 0x7efea80aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.112+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 --> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efea80af120 con 0x7efea80ac5b0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.112+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7efeb80ce870 con 0x7efebc0730e0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.112+0000 7efec13dc700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efea80a1590 0x7efea80a3a50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efebc19a810 tx=0x7efeac009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.112+0000 7efec23de700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] conn(0x7efea80ac5b0 0x7efea80aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.113+0000 7efec23de700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] conn(0x7efea80ac5b0 0x7efea80aea50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.114+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== osd.8 v2:172.21.15.167:6816/3580182047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efea80af120 con 0x7efea80ac5b0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.134+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 --> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efebc04ebb0 con 0x7efea80ac5b0 2023-10-05T15:35:25.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.134+0000 7efeb2ffd700 1 -- 172.21.15.17:0/1448057157 <== osd.8 v2:172.21.15.167:6816/3580182047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efebc04ebb0 con 0x7efea80ac5b0 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] conn(0x7efea80ac5b0 msgr2=0x7efea80aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] conn(0x7efea80ac5b0 0x7efea80aea50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efea80a1590 msgr2=0x7efea80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efea80a1590 0x7efea80a3a50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efebc19a810 tx=0x7efeac009310 comp rx=0 tx=0).stop 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc0730e0 msgr2=0x7efebc1991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 --2- 172.21.15.17:0/1448057157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efebc0730e0 0x7efebc1991f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009810 tx=0x7efeb800fa00 comp rx=0 tx=0).stop 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec23de700 1 -- 172.21.15.17:0/1448057157 reap_dead start 2023-10-05T15:35:25.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 shutdown_connections 2023-10-05T15:35:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 >> 172.21.15.17:0/1448057157 conn(0x7efebc0780a0 msgr2=0x7efebc0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 shutdown_connections 2023-10-05T15:35:25.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.135+0000 7efec3e41700 1 -- 172.21.15.17:0/1448057157 wait complete. 2023-10-05T15:35:25.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:25 smithi017 ceph-mon[129107]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-05T15:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 -- 172.21.15.17:0/2439011215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9981029d0 msgr2=0x7ff99810aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 --2- 172.21.15.17:0/2439011215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9981029d0 0x7ff99810aec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff984009990 tx=0x7ff984009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 -- 172.21.15.17:0/2439011215 shutdown_connections 2023-10-05T15:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 --2- 172.21.15.17:0/2439011215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff99810b4e0 0x7ff99810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 --2- 172.21.15.17:0/2439011215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9981020b0 0x7ff998102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 --2- 172.21.15.17:0/2439011215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9981029d0 0x7ff99810aec0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 -- 172.21.15.17:0/2439011215 >> 172.21.15.17:0/2439011215 conn(0x7ff9980fb920 msgr2=0x7ff9980fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 -- 172.21.15.17:0/2439011215 shutdown_connections 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.185+0000 7ff99ef43700 1 -- 172.21.15.17:0/2439011215 wait complete. 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.186+0000 7ff99ef43700 1 Processor -- start 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.186+0000 7ff99ef43700 1 -- start start 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ef43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9981020b0 0x7ff9980ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ef43700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9981029d0 0x7ff998100250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ef43700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff99810b4e0 0x7ff9981007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ef43700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981a5440 con 0x7ff99810b4e0 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ef43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981a55b0 con 0x7ff9981020b0 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ef43700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981a5770 con 0x7ff9981029d0 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99d4e0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff99810b4e0 0x7ff9981007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99d4e0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff99810b4e0 0x7ff9981007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41608/0 (socket says 172.21.15.17:41608) 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99d4e0700 1 -- 172.21.15.17:0/3464523837 learned_addr learned my addr 172.21.15.17:0/3464523837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff99ccdf700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9981020b0 0x7ff9980ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.187+0000 7ff997fff700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9981029d0 0x7ff998100250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99d4e0700 1 -- 172.21.15.17:0/3464523837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9981029d0 msgr2=0x7ff998100250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99d4e0700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9981029d0 0x7ff998100250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99d4e0700 1 -- 172.21.15.17:0/3464523837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9981020b0 msgr2=0x7ff9980ffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99d4e0700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9981020b0 0x7ff9980ffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99d4e0700 1 -- 172.21.15.17:0/3464523837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840095f0 con 0x7ff99810b4e0 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99d4e0700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff99810b4e0 0x7ff9981007d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff990007ee0 tx=0x7ff99000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990017070 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff99000f040 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990005570 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9981a5a50 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.188+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9981a5ed0 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.189+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff998111000 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.191+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff99000db20 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff995ffb700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff9880a1590 0x7ff9880a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff9900ccf30 con 0x7ff99810b4e0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff99ccdf700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff9880a1590 0x7ff9880a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff995ffb700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] conn(0x7ff9880ac5b0 0x7ff9880aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 --> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9880af120 con 0x7ff9880ac5b0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9900cd2a0 con 0x7ff99810b4e0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.193+0000 7ff997fff700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] conn(0x7ff9880ac5b0 0x7ff9880aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.194+0000 7ff99ccdf700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff9880a1590 0x7ff9880a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff98c007be0 tx=0x7ff98c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.194+0000 7ff997fff700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] conn(0x7ff9880ac5b0 0x7ff9880aea50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.195+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== osd.0 v2:172.21.15.17:6802/867902841 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff9880af120 con 0x7ff9880ac5b0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.212+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 --> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff99804ebb0 con 0x7ff9880ac5b0 2023-10-05T15:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.212+0000 7ff995ffb700 1 -- 172.21.15.17:0/3464523837 <== osd.0 v2:172.21.15.17:6802/867902841 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff99804ebb0 con 0x7ff9880ac5b0 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] conn(0x7ff9880ac5b0 msgr2=0x7ff9880aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] conn(0x7ff9880ac5b0 0x7ff9880aea50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff9880a1590 msgr2=0x7ff9880a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff9880a1590 0x7ff9880a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff98c007be0 tx=0x7ff98c0073d0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff99810b4e0 msgr2=0x7ff9981007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 --2- 172.21.15.17:0/3464523837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff99810b4e0 0x7ff9981007d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff990007ee0 tx=0x7ff99000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99d4e0700 1 -- 172.21.15.17:0/3464523837 reap_dead start 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 shutdown_connections 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 >> 172.21.15.17:0/3464523837 conn(0x7ff9980fb920 msgr2=0x7ff9980fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 shutdown_connections 2023-10-05T15:35:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:25.213+0000 7ff99ef43700 1 -- 172.21.15.17:0/3464523837 wait complete. 2023-10-05T15:35:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:25 smithi167 ceph-mon[133366]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-05T15:35:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:25 smithi079 ceph-mon[132936]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 12 op/s 2023-10-05T15:35:26.823 INFO:teuthology.orchestra.run.smithi017.stdout:257698037799 2023-10-05T15:35:26.823 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-05T15:35:27.271 INFO:teuthology.orchestra.run.smithi017.stdout:146028888125 2023-10-05T15:35:27.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-05T15:35:27.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:27 smithi017 ceph-mon[129107]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:35:27.800 INFO:teuthology.orchestra.run.smithi017.stdout:34359738450 2023-10-05T15:35:27.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 -- 172.21.15.17:0/3398788042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 msgr2=0x7f0600068fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 --2- 172.21.15.17:0/3398788042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600068fe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009990 tx=0x7f05fc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 -- 172.21.15.17:0/3398788042 shutdown_connections 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 --2- 172.21.15.17:0/3398788042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001062b0 0x7f060010de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 --2- 172.21.15.17:0/3398788042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600068fe0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 --2- 172.21.15.17:0/3398788042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06000695b0 0x7f0600105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 -- 172.21.15.17:0/3398788042 >> 172.21.15.17:0/3398788042 conn(0x7f0600075e00 msgr2=0x7f0600076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.072+0000 7f0607fdd700 1 -- 172.21.15.17:0/3398788042 shutdown_connections 2023-10-05T15:35:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.073+0000 7f0607fdd700 1 -- 172.21.15.17:0/3398788042 wait complete. 2023-10-05T15:35:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.074+0000 7f0607fdd700 1 Processor -- start 2023-10-05T15:35:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.074+0000 7f0607fdd700 1 -- start start 2023-10-05T15:35:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0607fdd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0607fdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06000695b0 0x7f0600197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0607fdd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06001062b0 0x7f060019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0607fdd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060019bff0 con 0x7f0600068c00 2023-10-05T15:35:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0607fdd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060019c160 con 0x7f06000695b0 2023-10-05T15:35:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0607fdd700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060019c320 con 0x7f06001062b0 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0605d79700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0605d79700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41620/0 (socket says 172.21.15.17:41620) 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0605d79700 1 -- 172.21.15.17:0/555766346 learned_addr learned my addr 172.21.15.17:0/555766346 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f0605578700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06000695b0 0x7f0600197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.075+0000 7f060657a700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06001062b0 0x7f060019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605d79700 1 -- 172.21.15.17:0/555766346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06001062b0 msgr2=0x7f060019b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605d79700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06001062b0 0x7f060019b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605d79700 1 -- 172.21.15.17:0/555766346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06000695b0 msgr2=0x7f0600197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:28.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605d79700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06000695b0 0x7f0600197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605d79700 1 -- 172.21.15.17:0/555766346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0095f0 con 0x7f0600068c00 2023-10-05T15:35:28.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605578700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06000695b0 0x7f0600197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:35:28.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0605d79700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600197030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05fc005740 tx=0x7f05fc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:28.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc01d070 con 0x7f0600068c00 2023-10-05T15:35:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05fc00fbb0 con 0x7f0600068c00 2023-10-05T15:35:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0173f0 con 0x7f0600068c00 2023-10-05T15:35:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.076+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060019c5a0 con 0x7f0600068c00 2023-10-05T15:35:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.077+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06001a3e60 con 0x7f0600068c00 2023-10-05T15:35:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.078+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0600111030 con 0x7f0600068c00 2023-10-05T15:35:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.080+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f05fc00fd20 con 0x7f0600068c00 2023-10-05T15:35:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:27 smithi167 ceph-mon[133366]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:35:28.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.081+0000 7f05f6ffd700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05ec0a1590 0x7f05ec0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:28.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.081+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f05fc0ced70 con 0x7f0600068c00 2023-10-05T15:35:28.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.082+0000 7f0605578700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05ec0a1590 0x7f05ec0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:28.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.082+0000 7f05f6ffd700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] conn(0x7f05ec0ac5b0 0x7f05ec0aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.082+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 --> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05ec0af120 con 0x7f05ec0ac5b0 2023-10-05T15:35:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.082+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05fc0cf0e0 con 0x7f0600068c00 2023-10-05T15:35:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.082+0000 7f060657a700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] conn(0x7f05ec0ac5b0 0x7f05ec0aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.082+0000 7f0605578700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05ec0a1590 0x7f05ec0a3a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05f0005950 tx=0x7f05f00058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.083+0000 7f060657a700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] conn(0x7f05ec0ac5b0 0x7f05ec0aea50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:28.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.084+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== osd.6 v2:172.21.15.17:6818/4099404166 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f05ec0af120 con 0x7f05ec0ac5b0 2023-10-05T15:35:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:27 smithi079 ceph-mon[132936]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:35:28.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.102+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 --> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f060019c870 con 0x7f05ec0ac5b0 2023-10-05T15:35:28.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.102+0000 7f05f6ffd700 1 -- 172.21.15.17:0/555766346 <== osd.6 v2:172.21.15.17:6818/4099404166 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f05f800f040 con 0x7f05ec0ac5b0 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] conn(0x7f05ec0ac5b0 msgr2=0x7f05ec0aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] conn(0x7f05ec0ac5b0 0x7f05ec0aea50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05ec0a1590 msgr2=0x7f05ec0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f05ec0a1590 0x7f05ec0a3a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05f0005950 tx=0x7f05f00058e0 comp rx=0 tx=0).stop 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 msgr2=0x7f0600197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 --2- 172.21.15.17:0/555766346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0600068c00 0x7f0600197030 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05fc005740 tx=0x7f05fc005e80 comp rx=0 tx=0).stop 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f060657a700 1 -- 172.21.15.17:0/555766346 reap_dead start 2023-10-05T15:35:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 shutdown_connections 2023-10-05T15:35:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 >> 172.21.15.17:0/555766346 conn(0x7f0600075e00 msgr2=0x7f06000ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 shutdown_connections 2023-10-05T15:35:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:28.103+0000 7f0607fdd700 1 -- 172.21.15.17:0/555766346 wait complete. 2023-10-05T15:35:29.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 -- 172.21.15.17:0/2336885209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c111bc0 msgr2=0x7ff54c113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 --2- 172.21.15.17:0/2336885209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c111bc0 0x7ff54c113fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff54400b0a0 tx=0x7ff54400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 -- 172.21.15.17:0/2336885209 shutdown_connections 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 --2- 172.21.15.17:0/2336885209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c111bc0 0x7ff54c113fb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 --2- 172.21.15.17:0/2336885209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54c074ef0 0x7ff54c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 --2- 172.21.15.17:0/2336885209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c073620 0x7ff54c073a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 -- 172.21.15.17:0/2336885209 >> 172.21.15.17:0/2336885209 conn(0x7ff54c0780a0 msgr2=0x7ff54c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 -- 172.21.15.17:0/2336885209 shutdown_connections 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.222+0000 7ff551ae5700 1 -- 172.21.15.17:0/2336885209 wait complete. 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.223+0000 7ff551ae5700 1 Processor -- start 2023-10-05T15:35:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.223+0000 7ff551ae5700 1 -- start start 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff551ae5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c073620 0x7ff54c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff551ae5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c074ef0 0x7ff54c19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff551ae5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54c111bc0 0x7ff54c1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff551ae5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1a15e0 con 0x7ff54c073620 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff551ae5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1a1750 con 0x7ff54c111bc0 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff551ae5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1a1910 con 0x7ff54c074ef0 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff54b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c073620 0x7ff54c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff54b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c073620 0x7ff54c19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41656/0 (socket says 172.21.15.17:41656) 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff54b7fe700 1 -- 172.21.15.17:0/26707386 learned_addr learned my addr 172.21.15.17:0/26707386 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff54bfff700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54c111bc0 0x7ff54c1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.224+0000 7ff54affd700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c074ef0 0x7ff54c19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff54b7fe700 1 -- 172.21.15.17:0/26707386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c074ef0 msgr2=0x7ff54c19dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff54b7fe700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff54c074ef0 0x7ff54c19dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff54b7fe700 1 -- 172.21.15.17:0/26707386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54c111bc0 msgr2=0x7ff54c1a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff54b7fe700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff54c111bc0 0x7ff54c1a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff54b7fe700 1 -- 172.21.15.17:0/26707386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544009d00 con 0x7ff54c073620 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff54b7fe700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c073620 0x7ff54c19d6e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00d950 tx=0x7ff53c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00f890 con 0x7ff54c073620 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c1a1bf0 con 0x7ff54c073620 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.225+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c1aa540 con 0x7ff54c073620 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.226+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff53c00fe80 con 0x7ff54c073620 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.226+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00e3b0 con 0x7ff54c073620 2023-10-05T15:35:29.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.226+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff538000ff0 con 0x7ff54c073620 2023-10-05T15:35:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.228+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff53c00f9f0 con 0x7ff54c073620 2023-10-05T15:35:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.230+0000 7ff548ff9700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5340a1590 0x7ff5340a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.230+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff53c0cd1a0 con 0x7ff54c073620 2023-10-05T15:35:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.230+0000 7ff54affd700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5340a1590 0x7ff5340a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.230+0000 7ff548ff9700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] conn(0x7ff5340ac5b0 0x7ff5340aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.230+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 --> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5340af120 con 0x7ff5340ac5b0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.230+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff53c0cf780 con 0x7ff54c073620 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.231+0000 7ff54bfff700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] conn(0x7ff5340ac5b0 0x7ff5340aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.231+0000 7ff54affd700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5340a1590 0x7ff5340a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff54c19ed00 tx=0x7ff540009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.231+0000 7ff54bfff700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] conn(0x7ff5340ac5b0 0x7ff5340aea50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.232+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== osd.3 v2:172.21.15.17:6810/33404576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff5340af120 con 0x7ff5340ac5b0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.250+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 --> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff538002d70 con 0x7ff5340ac5b0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff548ff9700 1 -- 172.21.15.17:0/26707386 <== osd.3 v2:172.21.15.17:6810/33404576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff538002d70 con 0x7ff5340ac5b0 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] conn(0x7ff5340ac5b0 msgr2=0x7ff5340aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] conn(0x7ff5340ac5b0 0x7ff5340aea50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5340a1590 msgr2=0x7ff5340a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5340a1590 0x7ff5340a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff54c19ed00 tx=0x7ff540009260 comp rx=0 tx=0).stop 2023-10-05T15:35:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c073620 msgr2=0x7ff54c19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 --2- 172.21.15.17:0/26707386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff54c073620 0x7ff54c19d6e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00d950 tx=0x7ff53c00dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff54bfff700 1 -- 172.21.15.17:0/26707386 reap_dead start 2023-10-05T15:35:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 shutdown_connections 2023-10-05T15:35:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.251+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 >> 172.21.15.17:0/26707386 conn(0x7ff54c0780a0 msgr2=0x7ff54c110760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.252+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 shutdown_connections 2023-10-05T15:35:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.252+0000 7ff551ae5700 1 -- 172.21.15.17:0/26707386 wait complete. 2023-10-05T15:35:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 -- 172.21.15.17:0/2076819671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0101940 msgr2=0x7f82e010ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 --2- 172.21.15.17:0/2076819671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0101940 0x7f82e010ddb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82d800b0d0 tx=0x7f82d800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 -- 172.21.15.17:0/2076819671 shutdown_connections 2023-10-05T15:35:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 --2- 172.21.15.17:0/2076819671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0101940 0x7f82e010ddb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 --2- 172.21.15.17:0/2076819671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82e0106f90 0x7f82e0107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 --2- 172.21.15.17:0/2076819671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e0100f80 0x7f82e0101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 -- 172.21.15.17:0/2076819671 >> 172.21.15.17:0/2076819671 conn(0x7f82e00780a0 msgr2=0x7f82e00784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 -- 172.21.15.17:0/2076819671 shutdown_connections 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.025+0000 7f82e5022700 1 -- 172.21.15.17:0/2076819671 wait complete. 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.027+0000 7f82e5022700 1 Processor -- start 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.027+0000 7f82e5022700 1 -- start start 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82e5022700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0100f80 0x7f82e00731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82e5022700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e0101940 0x7f82e00736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82e5022700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82e0106f90 0x7f82e0073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82e5022700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01a5410 con 0x7f82e0100f80 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82e5022700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01a5580 con 0x7f82e0106f90 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82e5022700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01a5740 con 0x7f82e0101940 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0100f80 0x7f82e00731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0100f80 0x7f82e00731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41648/0 (socket says 172.21.15.17:41648) 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 -- 172.21.15.17:0/4278967496 learned_addr learned my addr 172.21.15.17:0/4278967496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82de59c700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e0101940 0x7f82e00736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82df59e700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82e0106f90 0x7f82e0073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 -- 172.21.15.17:0/4278967496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e0101940 msgr2=0x7f82e00736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82e0101940 0x7f82e00736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 -- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82e0106f90 msgr2=0x7f82e0073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82e0106f90 0x7f82e0073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82ded9d700 1 -- 172.21.15.17:0/4278967496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d8009d00 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.028+0000 7f82df59e700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82e0106f90 0x7f82e0073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.029+0000 7f82ded9d700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0100f80 0x7f82e00731b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82d000d950 tx=0x7f82d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.029+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0009940 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.029+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d0010460 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.029+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e01a5a20 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.029+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d000f620 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.029+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e01a5f70 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.030+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82e0111010 con 0x7f82e0100f80 2023-10-05T15:35:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.032+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f82d00105d0 con 0x7f82e0100f80 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.033+0000 7f82c7fff700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82c80a1590 0x7f82c80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.033+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f82d00cd4e0 con 0x7f82e0100f80 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.034+0000 7f82de59c700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82c80a1590 0x7f82c80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.034+0000 7f82c7fff700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] conn(0x7f82c80ac5b0 0x7f82c80aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.034+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 --> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82c80af120 con 0x7f82c80ac5b0 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.034+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82d00cd850 con 0x7f82e0100f80 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.034+0000 7f82de59c700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82c80a1590 0x7f82c80a3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82e00749a0 tx=0x7f82d400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.034+0000 7f82df59e700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] conn(0x7f82c80ac5b0 0x7f82c80aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.035+0000 7f82df59e700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] conn(0x7f82c80ac5b0 0x7f82c80aea50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.036+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== osd.1 v2:172.21.15.79:6800/1221166656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f82c80af120 con 0x7f82c80ac5b0 2023-10-05T15:35:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.053+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 --> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82e004ebb0 con 0x7f82c80ac5b0 2023-10-05T15:35:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82c7fff700 1 -- 172.21.15.17:0/4278967496 <== osd.1 v2:172.21.15.79:6800/1221166656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f82e004ebb0 con 0x7f82c80ac5b0 2023-10-05T15:35:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] conn(0x7f82c80ac5b0 msgr2=0x7f82c80aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] conn(0x7f82c80ac5b0 0x7f82c80aea50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82c80a1590 msgr2=0x7f82c80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f82c80a1590 0x7f82c80a3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82e00749a0 tx=0x7f82d400b410 comp rx=0 tx=0).stop 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0100f80 msgr2=0x7f82e00731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 --2- 172.21.15.17:0/4278967496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82e0100f80 0x7f82e00731b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f82d000d950 tx=0x7f82d000dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82df59e700 1 -- 172.21.15.17:0/4278967496 reap_dead start 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 shutdown_connections 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 >> 172.21.15.17:0/4278967496 conn(0x7f82e00780a0 msgr2=0x7f82e00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.054+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 shutdown_connections 2023-10-05T15:35:29.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.055+0000 7f82e5022700 1 -- 172.21.15.17:0/4278967496 wait complete. 2023-10-05T15:35:29.795 INFO:teuthology.orchestra.run.smithi017.stdout:201863462963 2023-10-05T15:35:29.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-05T15:35:29.860 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:29 smithi017 ceph-mon[129107]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 -- 172.21.15.17:0/3610776353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc106f90 msgr2=0x7f6adc107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 --2- 172.21.15.17:0/3610776353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc106f90 0x7f6adc107370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009990 tx=0x7f6acc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 -- 172.21.15.17:0/3610776353 shutdown_connections 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 --2- 172.21.15.17:0/3610776353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc101940 0x7f6adc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 --2- 172.21.15.17:0/3610776353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc106f90 0x7f6adc107370 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 --2- 172.21.15.17:0/3610776353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc100f80 0x7f6adc101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 -- 172.21.15.17:0/3610776353 >> 172.21.15.17:0/3610776353 conn(0x7f6adc0780a0 msgr2=0x7f6adc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:29.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 -- 172.21.15.17:0/3610776353 shutdown_connections 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.534+0000 7f6ae114f700 1 -- 172.21.15.17:0/3610776353 wait complete. 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.536+0000 7f6ae114f700 1 Processor -- start 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.536+0000 7f6ae114f700 1 -- start start 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6ae114f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc100f80 0x7f6adc196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6ae114f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc101940 0x7f6adc197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6ae114f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc106f90 0x7f6adc19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6ae114f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc19be60 con 0x7f6adc100f80 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6ae114f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc19bfd0 con 0x7f6adc106f90 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6ae114f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc19c190 con 0x7f6adc101940 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6adad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc100f80 0x7f6adc196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6adad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc100f80 0x7f6adc196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41670/0 (socket says 172.21.15.17:41670) 2023-10-05T15:35:29.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.537+0000 7f6adad9d700 1 -- 172.21.15.17:0/2729695429 learned_addr learned my addr 172.21.15.17:0/2729695429 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adb59e700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc106f90 0x7f6adc19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6ada59c700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc101940 0x7f6adc197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adad9d700 1 -- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc101940 msgr2=0x7f6adc197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adad9d700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc101940 0x7f6adc197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adad9d700 1 -- 172.21.15.17:0/2729695429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc106f90 msgr2=0x7f6adc19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adad9d700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6adc106f90 0x7f6adc19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adad9d700 1 -- 172.21.15.17:0/2729695429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0095f0 con 0x7f6adc100f80 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6adad9d700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc100f80 0x7f6adc196f10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6acc006010 tx=0x7f6acc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.538+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc01d070 con 0x7f6adc100f80 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.539+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc19c410 con 0x7f6adc100f80 2023-10-05T15:35:29.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.539+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6acc022470 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.539+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc017650 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.539+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc1a3cd0 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.540+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6adc04ebb0 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.543+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f6acc0225e0 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.545+0000 7f6ac3fff700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6ac40a1590 0x7f6ac40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.545+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6acc0ce680 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.545+0000 7f6ada59c700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6ac40a1590 0x7f6ac40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.545+0000 7f6ac3fff700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] conn(0x7f6ac40ac5b0 0x7f6ac40aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.545+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 --> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ac40af120 con 0x7f6ac40ac5b0 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.545+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6acc0cea90 con 0x7f6adc100f80 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.546+0000 7f6adb59e700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] conn(0x7f6ac40ac5b0 0x7f6ac40aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.546+0000 7f6ada59c700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6ac40a1590 0x7f6ac40a3a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6adc1984c0 tx=0x7f6ad0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.546+0000 7f6adb59e700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] conn(0x7f6ac40ac5b0 0x7f6ac40aea50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.548+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== osd.5 v2:172.21.15.167:6808/4076480812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6ac40af120 con 0x7f6ac40ac5b0 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.566+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 --> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6adc111000 con 0x7f6ac40ac5b0 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ac3fff700 1 -- 172.21.15.17:0/2729695429 <== osd.5 v2:172.21.15.167:6808/4076480812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6ad400f040 con 0x7f6ac40ac5b0 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] conn(0x7f6ac40ac5b0 msgr2=0x7f6ac40aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ae114f700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] conn(0x7f6ac40ac5b0 0x7f6ac40aea50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6ac40a1590 msgr2=0x7f6ac40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ae114f700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6ac40a1590 0x7f6ac40a3a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6adc1984c0 tx=0x7f6ad0009260 comp rx=0 tx=0).stop 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc100f80 msgr2=0x7f6adc196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6ae114f700 1 --2- 172.21.15.17:0/2729695429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6adc100f80 0x7f6adc196f10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6acc006010 tx=0x7f6acc004730 comp rx=0 tx=0).stop 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.567+0000 7f6adb59e700 1 -- 172.21.15.17:0/2729695429 reap_dead start 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.568+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 shutdown_connections 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.568+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 >> 172.21.15.17:0/2729695429 conn(0x7f6adc0780a0 msgr2=0x7f6adc0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.568+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 shutdown_connections 2023-10-05T15:35:29.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:29.568+0000 7f6ae114f700 1 -- 172.21.15.17:0/2729695429 wait complete. 2023-10-05T15:35:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:29 smithi167 ceph-mon[133366]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:35:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:29 smithi079 ceph-mon[132936]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-05T15:35:30.510 INFO:teuthology.orchestra.run.smithi017.stdout:111669149762 2023-10-05T15:35:30.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-05T15:35:30.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 -- 172.21.15.17:0/484568309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8101b30 msgr2=0x7f36a8105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 --2- 172.21.15.17:0/484568309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8101b30 0x7f36a8105b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f369c009990 tx=0x7f369c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 -- 172.21.15.17:0/484568309 shutdown_connections 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 --2- 172.21.15.17:0/484568309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8106260 0x7f36a810de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 --2- 172.21.15.17:0/484568309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a8101180 0x7f36a8101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 --2- 172.21.15.17:0/484568309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8101b30 0x7f36a8105b80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 -- 172.21.15.17:0/484568309 >> 172.21.15.17:0/484568309 conn(0x7f36a80fc9d0 msgr2=0x7f36a80fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.563+0000 7f36ae115700 1 -- 172.21.15.17:0/484568309 shutdown_connections 2023-10-05T15:35:30.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.564+0000 7f36ae115700 1 -- 172.21.15.17:0/484568309 wait complete. 2023-10-05T15:35:30.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.565+0000 7f36ae115700 1 Processor -- start 2023-10-05T15:35:30.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.565+0000 7f36ae115700 1 -- start start 2023-10-05T15:35:30.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36ae115700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a8101180 0x7f36a81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36ae115700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101b30 0x7f36a81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36ae115700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8106260 0x7f36a819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36ae115700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819e170 con 0x7f36a8101b30 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36ae115700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819e2e0 con 0x7f36a8106260 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36ae115700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819e4a0 con 0x7f36a8101180 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101b30 0x7f36a81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101b30 0x7f36a81996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41690/0 (socket says 172.21.15.17:41690) 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.566+0000 7f36a6ffd700 1 -- 172.21.15.17:0/1484757746 learned_addr learned my addr 172.21.15.17:0/1484757746 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a77fe700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a8101180 0x7f36a81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a7fff700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8106260 0x7f36a819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a6ffd700 1 -- 172.21.15.17:0/1484757746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a8101180 msgr2=0x7f36a81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a6ffd700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36a8101180 0x7f36a81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a6ffd700 1 -- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8106260 msgr2=0x7f36a819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a6ffd700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8106260 0x7f36a819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a6ffd700 1 -- 172.21.15.17:0/1484757746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0095f0 con 0x7f36a8101b30 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a7fff700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36a8106260 0x7f36a819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.567+0000 7f36a6ffd700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101b30 0x7f36a81996f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f369c0038b0 tx=0x7f369c0038e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.568+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c01d070 con 0x7f36a8101b30 2023-10-05T15:35:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.568+0000 7f36ae115700 1 -- 172.21.15.17:0/1484757746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a819e720 con 0x7f36a8101b30 2023-10-05T15:35:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.568+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f369c003e20 con 0x7f36a8101b30 2023-10-05T15:35:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.568+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c022cd0 con 0x7f36a8101b30 2023-10-05T15:35:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.569+0000 7f36ae115700 1 -- 172.21.15.17:0/1484757746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81a5fe0 con 0x7f36a8101b30 2023-10-05T15:35:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.570+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3688000fc0 con 0x7f36a8101b30 2023-10-05T15:35:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.574+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f369c022470 con 0x7f36a8101b30 2023-10-05T15:35:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.576+0000 7f36a4ff9700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36900a1610 0x7f36900a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.576+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f369c0cf130 con 0x7f36a8101b30 2023-10-05T15:35:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.576+0000 7f36a77fe700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36900a1610 0x7f36900a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.576+0000 7f36a4ff9700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] conn(0x7f36900ac630 0x7f36900aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.576+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 --> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36900af1a0 con 0x7f36900ac630 2023-10-05T15:35:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.576+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f369c0cf4e0 con 0x7f36a8101b30 2023-10-05T15:35:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.577+0000 7f36a7fff700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] conn(0x7f36900ac630 0x7f36900aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.577+0000 7f36a77fe700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36900a1610 0x7f36900a3ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3698007be0 tx=0x7f36980073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.577+0000 7f36a7fff700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] conn(0x7f36900ac630 0x7f36900aead0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:30.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.578+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== osd.10 v2:172.21.15.79:6824/1370861812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f36900af1a0 con 0x7f36900ac630 2023-10-05T15:35:30.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.598+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 --> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3688002d40 con 0x7f36900ac630 2023-10-05T15:35:30.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f36a4ff9700 1 -- 172.21.15.17:0/1484757746 <== osd.10 v2:172.21.15.79:6824/1370861812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3688002d40 con 0x7f36900ac630 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] conn(0x7f36900ac630 msgr2=0x7f36900aead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] conn(0x7f36900ac630 0x7f36900aead0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36900a1610 msgr2=0x7f36900a3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36900a1610 0x7f36900a3ad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3698007be0 tx=0x7f36980073d0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101b30 msgr2=0x7f36a81996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 --2- 172.21.15.17:0/1484757746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101b30 0x7f36a81996f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f369c0038b0 tx=0x7f369c0038e0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f36a7fff700 1 -- 172.21.15.17:0/1484757746 reap_dead start 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 shutdown_connections 2023-10-05T15:35:30.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.599+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 >> 172.21.15.17:0/1484757746 conn(0x7f36a80fc9d0 msgr2=0x7f36a80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.600+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 shutdown_connections 2023-10-05T15:35:30.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.600+0000 7f368e7fc700 1 -- 172.21.15.17:0/1484757746 wait complete. 2023-10-05T15:35:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/94819212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8106f90 msgr2=0x7fe1b8107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/94819212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8106f90 0x7fe1b8107370 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0099c0 tx=0x7fe1ac009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/94819212 shutdown_connections 2023-10-05T15:35:30.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/94819212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b8101940 0x7fe1b810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/94819212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8106f90 0x7fe1b8107370 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/94819212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b8100f80 0x7fe1b8101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/94819212 >> 172.21.15.17:0/94819212 conn(0x7fe1b80780a0 msgr2=0x7fe1b80784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/94819212 shutdown_connections 2023-10-05T15:35:30.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.976+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/94819212 wait complete. 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.977+0000 7fe1bf1bb700 1 Processor -- start 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.977+0000 7fe1bf1bb700 1 -- start start 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bf1bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b8100f80 0x7fe1b80731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bf1bb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8101940 0x7fe1b80736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bf1bb700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b8106f90 0x7fe1b8073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bf1bb700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81a5360 con 0x7fe1b8101940 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bf1bb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81a54d0 con 0x7fe1b8100f80 2023-10-05T15:35:30.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bf1bb700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b81a5690 con 0x7fe1b8106f90 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8101940 0x7fe1b80736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8101940 0x7fe1b80736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41708/0 (socket says 172.21.15.17:41708) 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 -- 172.21.15.17:0/1454889977 learned_addr learned my addr 172.21.15.17:0/1454889977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bcf57700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b8100f80 0x7fe1b80731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1bd758700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b8106f90 0x7fe1b8073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 -- 172.21.15.17:0/1454889977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b8106f90 msgr2=0x7fe1b8073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b8106f90 0x7fe1b8073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 -- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b8100f80 msgr2=0x7fe1b80731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b8100f80 0x7fe1b80731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:30.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.978+0000 7fe1b7fff700 1 -- 172.21.15.17:0/1454889977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0095f0 con 0x7fe1b8101940 2023-10-05T15:35:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.979+0000 7fe1b7fff700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8101940 0x7fe1b80736f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400e9a0 tx=0x7fe1a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.979+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4009790 con 0x7fe1b8101940 2023-10-05T15:35:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.979+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1a400cbd0 con 0x7fe1b8101940 2023-10-05T15:35:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.979+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b81a5970 con 0x7fe1b8101940 2023-10-05T15:35:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.979+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4018680 con 0x7fe1b8101940 2023-10-05T15:35:30.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.979+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b81a5ec0 con 0x7fe1b8101940 2023-10-05T15:35:30.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.980+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1b8111050 con 0x7fe1b8101940 2023-10-05T15:35:30.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.982+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe1a400cd40 con 0x7fe1b8101940 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1b5ffb700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a80a1590 0x7fe1a80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe1a4014070 con 0x7fe1b8101940 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1bcf57700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a80a1590 0x7fe1a80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1b5ffb700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] conn(0x7fe1a80ac5b0 0x7fe1a80aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 --> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1a80af120 con 0x7fe1a80ac5b0 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1a40cdbd0 con 0x7fe1b8101940 2023-10-05T15:35:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.985+0000 7fe1bcf57700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a80a1590 0x7fe1a80a3a50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009990 tx=0x7fe1ac005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.984+0000 7fe1bd758700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] conn(0x7fe1a80ac5b0 0x7fe1a80aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.985+0000 7fe1bd758700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] conn(0x7fe1a80ac5b0 0x7fe1a80aea50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:30.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:30.987+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== osd.7 v2:172.21.15.79:6816/2170841881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe1a80af120 con 0x7fe1a80ac5b0 2023-10-05T15:35:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.005+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 --> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1b804ebb0 con 0x7fe1a80ac5b0 2023-10-05T15:35:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1b5ffb700 1 -- 172.21.15.17:0/1454889977 <== osd.7 v2:172.21.15.79:6816/2170841881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe1b804ebb0 con 0x7fe1a80ac5b0 2023-10-05T15:35:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] conn(0x7fe1a80ac5b0 msgr2=0x7fe1a80aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] conn(0x7fe1a80ac5b0 0x7fe1a80aea50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a80a1590 msgr2=0x7fe1a80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a80a1590 0x7fe1a80a3a50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009990 tx=0x7fe1ac005c00 comp rx=0 tx=0).stop 2023-10-05T15:35:31.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8101940 msgr2=0x7fe1b80736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 --2- 172.21.15.17:0/1454889977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b8101940 0x7fe1b80736f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400e9a0 tx=0x7fe1a400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:35:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bd758700 1 -- 172.21.15.17:0/1454889977 reap_dead start 2023-10-05T15:35:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 shutdown_connections 2023-10-05T15:35:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 >> 172.21.15.17:0/1454889977 conn(0x7fe1b80780a0 msgr2=0x7fe1b80ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.006+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 shutdown_connections 2023-10-05T15:35:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:31.007+0000 7fe1bf1bb700 1 -- 172.21.15.17:0/1454889977 wait complete. 2023-10-05T15:35:31.071 INFO:teuthology.orchestra.run.smithi017.stdout:55834574925 2023-10-05T15:35:31.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-05T15:35:31.677 INFO:teuthology.orchestra.run.smithi017.stdout:313532612639 2023-10-05T15:35:31.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-05T15:35:31.808 INFO:teuthology.orchestra.run.smithi017.stdout:223338299438 2023-10-05T15:35:31.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-05T15:35:31.896 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:31 smithi017 ceph-mon[129107]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-10-05T15:35:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:31 smithi167 ceph-mon[133366]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-10-05T15:35:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:31 smithi079 ceph-mon[132936]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2023-10-05T15:35:32.441 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:32.472 INFO:teuthology.orchestra.run.smithi017.stdout:167503724600 2023-10-05T15:35:32.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-05T15:35:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 -- 172.21.15.17:0/611158343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 msgr2=0x7f935c10d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 --2- 172.21.15.17:0/611158343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 0x7f935c10d210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9350009990 tx=0x7f9350009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 -- 172.21.15.17:0/611158343 shutdown_connections 2023-10-05T15:35:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 --2- 172.21.15.17:0/611158343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c10d750 0x7f935c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 --2- 172.21.15.17:0/611158343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f935c0732e0 0x7f935c0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 --2- 172.21.15.17:0/611158343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 0x7f935c10d210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 -- 172.21.15.17:0/611158343 >> 172.21.15.17:0/611158343 conn(0x7f935c0fca20 msgr2=0x7f935c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 -- 172.21.15.17:0/611158343 shutdown_connections 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.672+0000 7f9360b0e700 1 -- 172.21.15.17:0/611158343 wait complete. 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 Processor -- start 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 -- start start 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c0732e0 0x7f935c106460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 0x7f935c1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f935c10d750 0x7f935c101510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c101ce0 con 0x7f935c10d750 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c101e50 con 0x7f935c073c00 2023-10-05T15:35:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.674+0000 7f9360b0e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c102010 con 0x7f935c0732e0 2023-10-05T15:35:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.675+0000 7f9359d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 0x7f935c1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.675+0000 7f9359d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 0x7f935c1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:33974/0 (socket says 172.21.15.17:33974) 2023-10-05T15:35:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.675+0000 7f9359d9b700 1 -- 172.21.15.17:0/254786932 learned_addr learned my addr 172.21.15.17:0/254786932 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.675+0000 7f935a59c700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c0732e0 0x7f935c106460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.675+0000 7f935ad9d700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f935c10d750 0x7f935c101510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935a59c700 1 -- 172.21.15.17:0/254786932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 msgr2=0x7f935c1069c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935a59c700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935c073c00 0x7f935c1069c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935a59c700 1 -- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f935c10d750 msgr2=0x7f935c101510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935a59c700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f935c10d750 0x7f935c101510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935a59c700 1 -- 172.21.15.17:0/254786932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500095f0 con 0x7f935c0732e0 2023-10-05T15:35:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935ad9d700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f935c10d750 0x7f935c101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:35:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.676+0000 7f935a59c700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c0732e0 0x7f935c106460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f934c00b450 tx=0x7f934c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.677+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c011830 con 0x7f935c0732e0 2023-10-05T15:35:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.677+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f934c011e20 con 0x7f935c0732e0 2023-10-05T15:35:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.677+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c010dd0 con 0x7f935c0732e0 2023-10-05T15:35:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.677+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c1022f0 con 0x7f935c0732e0 2023-10-05T15:35:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.677+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c10c480 con 0x7f935c0732e0 2023-10-05T15:35:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.678+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f935c113250 con 0x7f935c0732e0 2023-10-05T15:35:32.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.681+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f934c011990 con 0x7f935c0732e0 2023-10-05T15:35:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.684+0000 7f934b7fe700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93440a1660 0x7f93440a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.684+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f934c0ccfe0 con 0x7f935c0732e0 2023-10-05T15:35:32.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.684+0000 7f934b7fe700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] conn(0x7f93440ac680 0x7f93440aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:32.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.684+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 --> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93440af1f0 con 0x7f93440ac680 2023-10-05T15:35:32.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.684+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f934c0cd350 con 0x7f935c0732e0 2023-10-05T15:35:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.685+0000 7f935ad9d700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] conn(0x7f93440ac680 0x7f93440aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.685+0000 7f9359d9b700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93440a1660 0x7f93440a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.686+0000 7f935ad9d700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] conn(0x7f93440ac680 0x7f93440aeb20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.686+0000 7f9359d9b700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93440a1660 0x7f93440a3b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9350005f50 tx=0x7f9350005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:32.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.687+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== osd.11 v2:172.21.15.167:6824/1885248558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f93440af1f0 con 0x7f93440ac680 2023-10-05T15:35:32.723 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:32.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.718+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 --> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f935c04ebb0 con 0x7f93440ac680 2023-10-05T15:35:32.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.722+0000 7f934b7fe700 1 -- 172.21.15.17:0/254786932 <== osd.11 v2:172.21.15.167:6824/1885248558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f935c04ebb0 con 0x7f93440ac680 2023-10-05T15:35:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] conn(0x7f93440ac680 msgr2=0x7f93440aeb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f9360b0e700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] conn(0x7f93440ac680 0x7f93440aeb20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:32.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93440a1660 msgr2=0x7f93440a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f9360b0e700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93440a1660 0x7f93440a3b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9350005f50 tx=0x7f9350005e40 comp rx=0 tx=0).stop 2023-10-05T15:35:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c0732e0 msgr2=0x7f935c106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f9360b0e700 1 --2- 172.21.15.17:0/254786932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c0732e0 0x7f935c106460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f934c00b450 tx=0x7f934c00b810 comp rx=0 tx=0).stop 2023-10-05T15:35:32.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.724+0000 7f935ad9d700 1 -- 172.21.15.17:0/254786932 reap_dead start 2023-10-05T15:35:32.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.725+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 shutdown_connections 2023-10-05T15:35:32.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.725+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 >> 172.21.15.17:0/254786932 conn(0x7f935c0fca20 msgr2=0x7f935c10f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:32.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.725+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 shutdown_connections 2023-10-05T15:35:32.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:32.726+0000 7f9360b0e700 1 -- 172.21.15.17:0/254786932 wait complete. 2023-10-05T15:35:32.762 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:33.315 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:33.398 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:33.889 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:33 smithi017 ceph-mon[129107]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-05T15:35:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:33 smithi167 ceph-mon[133366]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-05T15:35:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:33 smithi079 ceph-mon[132936]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2023-10-05T15:35:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 -- 172.21.15.17:0/3005219178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038106f90 msgr2=0x7f1038107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 --2- 172.21.15.17:0/3005219178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038106f90 0x7f1038107370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f102c0099c0 tx=0x7f102c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 -- 172.21.15.17:0/3005219178 shutdown_connections 2023-10-05T15:35:34.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 --2- 172.21.15.17:0/3005219178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1038101940 0x7f103810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 --2- 172.21.15.17:0/3005219178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038106f90 0x7f1038107370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 --2- 172.21.15.17:0/3005219178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038100f80 0x7f1038101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 -- 172.21.15.17:0/3005219178 >> 172.21.15.17:0/3005219178 conn(0x7f10380780a0 msgr2=0x7f10380784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 -- 172.21.15.17:0/3005219178 shutdown_connections 2023-10-05T15:35:34.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.200+0000 7f103ebfd700 1 -- 172.21.15.17:0/3005219178 wait complete. 2023-10-05T15:35:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.201+0000 7f103ebfd700 1 Processor -- start 2023-10-05T15:35:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.201+0000 7f103ebfd700 1 -- start start 2023-10-05T15:35:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103ebfd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038100f80 0x7f10381990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:34.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103ebfd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1038101940 0x7f1038199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103ebfd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038106f90 0x7f103819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103ebfd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103819e0b0 con 0x7f1038101940 2023-10-05T15:35:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103ebfd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103819e220 con 0x7f1038100f80 2023-10-05T15:35:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103ebfd700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103819e3e0 con 0x7f1038106f90 2023-10-05T15:35:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103c999700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038100f80 0x7f10381990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:34.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f1037fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1038101940 0x7f1038199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103c999700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038100f80 0x7f10381990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51530/0 (socket says 172.21.15.17:51530) 2023-10-05T15:35:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.202+0000 7f103c999700 1 -- 172.21.15.17:0/4279004939 learned_addr learned my addr 172.21.15.17:0/4279004939 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:34.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103d19a700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038106f90 0x7f103819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103c999700 1 -- 172.21.15.17:0/4279004939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038106f90 msgr2=0x7f103819daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103c999700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038106f90 0x7f103819daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103c999700 1 -- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1038101940 msgr2=0x7f1038199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103c999700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1038101940 0x7f1038199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103c999700 1 -- 172.21.15.17:0/4279004939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0095f0 con 0x7f1038100f80 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.203+0000 7f103c999700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038100f80 0x7f10381990f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f102c000c00 tx=0x7f102c005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.204+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c01d070 con 0x7f1038100f80 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.204+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f102c00fe70 con 0x7f1038100f80 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.204+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103819e660 con 0x7f1038100f80 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.204+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0173f0 con 0x7f1038100f80 2023-10-05T15:35:34.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.204+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10381a5f20 con 0x7f1038100f80 2023-10-05T15:35:34.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.205+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1038111050 con 0x7f1038100f80 2023-10-05T15:35:34.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.207+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f102c00f9e0 con 0x7f1038100f80 2023-10-05T15:35:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.209+0000 7f1035ffb700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10280a1590 0x7f10280a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.209+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f102c0ce630 con 0x7f1038100f80 2023-10-05T15:35:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.209+0000 7f1035ffb700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] conn(0x7f10280ac5b0 0x7f10280aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.209+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 --> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10280af120 con 0x7f10280ac5b0 2023-10-05T15:35:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.209+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f102c0ce9a0 con 0x7f1038100f80 2023-10-05T15:35:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.209+0000 7f1037fff700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10280a1590 0x7f10280a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.210+0000 7f103d19a700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] conn(0x7f10280ac5b0 0x7f10280aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.210+0000 7f1037fff700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10280a1590 0x7f10280a3a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f103819a710 tx=0x7f1024009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.212+0000 7f103d19a700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] conn(0x7f10280ac5b0 0x7f10280aea50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.213+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== osd.9 v2:172.21.15.17:6826/1313927132 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f10280af120 con 0x7f10280ac5b0 2023-10-05T15:35:34.224 INFO:teuthology.orchestra.run.smithi017.stdout:347892351002 2023-10-05T15:35:34.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-05T15:35:34.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.236+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 --> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f103804ebb0 con 0x7f10280ac5b0 2023-10-05T15:35:34.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.236+0000 7f1035ffb700 1 -- 172.21.15.17:0/4279004939 <== osd.9 v2:172.21.15.17:6826/1313927132 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f103804ebb0 con 0x7f10280ac5b0 2023-10-05T15:35:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] conn(0x7f10280ac5b0 msgr2=0x7f10280aea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] conn(0x7f10280ac5b0 0x7f10280aea50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:34.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10280a1590 msgr2=0x7f10280a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10280a1590 0x7f10280a3a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f103819a710 tx=0x7f1024009260 comp rx=0 tx=0).stop 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038100f80 msgr2=0x7f10381990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 --2- 172.21.15.17:0/4279004939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1038100f80 0x7f10381990f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f102c000c00 tx=0x7f102c005f10 comp rx=0 tx=0).stop 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103d19a700 1 -- 172.21.15.17:0/4279004939 reap_dead start 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 shutdown_connections 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.237+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 >> 172.21.15.17:0/4279004939 conn(0x7f10380780a0 msgr2=0x7f10380ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.238+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 shutdown_connections 2023-10-05T15:35:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:34.238+0000 7f103ebfd700 1 -- 172.21.15.17:0/4279004939 wait complete. 2023-10-05T15:35:35.455 INFO:teuthology.orchestra.run.smithi017.stdout:292057776165 2023-10-05T15:35:35.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-05T15:35:35.559 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:35.796 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:35 smithi017 ceph-mon[129107]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:35:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:35 smithi167 ceph-mon[133366]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:35:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:35 smithi079 ceph-mon[132936]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:35:36.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:36 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:35:37.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:36 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:35:37.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:36 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:35:37.460 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:37.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:37 smithi017 ceph-mon[129107]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:37.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 -- 172.21.15.17:0/1998968604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c100f80 msgr2=0x7fcc1c101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/1998968604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c100f80 0x7fcc1c101400 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c0099c0 tx=0x7fcc0c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 -- 172.21.15.17:0/1998968604 shutdown_connections 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/1998968604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/1998968604 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c106f90 0x7fcc1c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/1998968604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c100f80 0x7fcc1c101400 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.826+0000 7fcc23ca9700 1 -- 172.21.15.17:0/1998968604 >> 172.21.15.17:0/1998968604 conn(0x7fcc1c0780a0 msgr2=0x7fcc1c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.827+0000 7fcc23ca9700 1 -- 172.21.15.17:0/1998968604 shutdown_connections 2023-10-05T15:35:37.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.827+0000 7fcc23ca9700 1 -- 172.21.15.17:0/1998968604 wait complete. 2023-10-05T15:35:37.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.828+0000 7fcc23ca9700 1 Processor -- start 2023-10-05T15:35:37.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.828+0000 7fcc23ca9700 1 -- start start 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc23ca9700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c100f80 0x7fcc1c10a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc23ca9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc23ca9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c106f90 0x7fcc1c1a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc23ca9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a9810 con 0x7fcc1c106f90 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc23ca9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a9950 con 0x7fcc1c101940 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc23ca9700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c1a9a90 con 0x7fcc1c100f80 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc21244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:37.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc21a45700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c100f80 0x7fcc1c10a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc21244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51550/0 (socket says 172.21.15.17:51550) 2023-10-05T15:35:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc21a45700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c100f80 0x7fcc1c10a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54378/0 (socket says 172.21.15.17:54378) 2023-10-05T15:35:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc21244700 1 -- 172.21.15.17:0/3852453665 learned_addr learned my addr 172.21.15.17:0/3852453665 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:37.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.829+0000 7fcc22246700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c106f90 0x7fcc1c1a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc21244700 1 -- 172.21.15.17:0/3852453665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c100f80 msgr2=0x7fcc1c10a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc21244700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c100f80 0x7fcc1c10a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc21244700 1 -- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c106f90 msgr2=0x7fcc1c1a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc21244700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c106f90 0x7fcc1c1a92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc21244700 1 -- 172.21.15.17:0/3852453665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0095f0 con 0x7fcc1c101940 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc21244700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10aa90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c005910 tx=0x7fcc0c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:37.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c01d070 con 0x7fcc1c101940 2023-10-05T15:35:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc0c005050 con 0x7fcc1c101940 2023-10-05T15:35:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c1a9d10 con 0x7fcc1c101940 2023-10-05T15:35:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.830+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c004a00 con 0x7fcc1c101940 2023-10-05T15:35:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.831+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c1aa120 con 0x7fcc1c101940 2023-10-05T15:35:37.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.832+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c04ebb0 con 0x7fcc1c101940 2023-10-05T15:35:37.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.834+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fcc0c0051c0 con 0x7fcc1c101940 2023-10-05T15:35:37.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.835+0000 7fcc12ffd700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcc080a1510 0x7fcc080a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:37.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.835+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcc0c0cdf20 con 0x7fcc1c101940 2023-10-05T15:35:37.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.836+0000 7fcc21a45700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcc080a1510 0x7fcc080a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:37.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.836+0000 7fcc21a45700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcc080a1510 0x7fcc080a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc18005950 tx=0x7fcc1800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:37.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:37.838+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcc0c097140 con 0x7fcc1c101940 2023-10-05T15:35:38.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.065+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcc1c0745d0 con 0x7fcc1c101940 2023-10-05T15:35:38.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.065+0000 7fcc12ffd700 1 -- 172.21.15.17:0/3852453665 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcc0c09a760 con 0x7fcc1c101940 2023-10-05T15:35:38.067 INFO:teuthology.orchestra.run.smithi017.stdout:201863462965 2023-10-05T15:35:38.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcc080a1510 msgr2=0x7fcc080a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcc080a1510 0x7fcc080a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc18005950 tx=0x7fcc1800b410 comp rx=0 tx=0).stop 2023-10-05T15:35:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 msgr2=0x7fcc1c10aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10aa90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c005910 tx=0x7fcc0c00f690 comp rx=0 tx=0).stop 2023-10-05T15:35:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 shutdown_connections 2023-10-05T15:35:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcc080a1510 0x7fcc080a39d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc1c106f90 0x7fcc1c1a92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc1c100f80 0x7fcc1c10a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 --2- 172.21.15.17:0/3852453665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc1c101940 0x7fcc1c10aa90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 >> 172.21.15.17:0/3852453665 conn(0x7fcc1c0780a0 msgr2=0x7fcc1c104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:38.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 shutdown_connections 2023-10-05T15:35:38.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.068+0000 7fcc23ca9700 1 -- 172.21.15.17:0/3852453665 wait complete. 2023-10-05T15:35:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:37 smithi167 ceph-mon[133366]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:37 smithi079 ceph-mon[132936]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 -- 172.21.15.17:0/3983355375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c073a00 msgr2=0x7f485c10d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 --2- 172.21.15.17:0/3983355375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c073a00 0x7f485c10d3f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4850009990 tx=0x7f4850009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 -- 172.21.15.17:0/3983355375 shutdown_connections 2023-10-05T15:35:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 --2- 172.21.15.17:0/3983355375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f485c10d930 0x7f485c10fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 --2- 172.21.15.17:0/3983355375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c0734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 --2- 172.21.15.17:0/3983355375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c073a00 0x7f485c10d3f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.358+0000 7f48622c6700 1 -- 172.21.15.17:0/3983355375 >> 172.21.15.17:0/3983355375 conn(0x7f485c0780a0 msgr2=0x7f485c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.359+0000 7f48622c6700 1 -- 172.21.15.17:0/3983355375 shutdown_connections 2023-10-05T15:35:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.359+0000 7f48622c6700 1 -- 172.21.15.17:0/3983355375 wait complete. 2023-10-05T15:35:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 Processor -- start 2023-10-05T15:35:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 -- start start 2023-10-05T15:35:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:38.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f485c073a00 0x7f485c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:38.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c10d930 0x7f485c19daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:38.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c19e100 con 0x7f485c10d930 2023-10-05T15:35:38.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c19e270 con 0x7f485c073a00 2023-10-05T15:35:38.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.360+0000 7f48622c6700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c19e430 con 0x7f485c0730e0 2023-10-05T15:35:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54398/0 (socket says 172.21.15.17:54398) 2023-10-05T15:35:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 -- 172.21.15.17:0/451213324 learned_addr learned my addr 172.21.15.17:0/451213324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485b7fe700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f485c073a00 0x7f485c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f4860863700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c10d930 0x7f485c19daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 -- 172.21.15.17:0/451213324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f485c073a00 msgr2=0x7f485c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f485c073a00 0x7f485c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 -- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c10d930 msgr2=0x7f485c19daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c10d930 0x7f485c19daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 -- 172.21.15.17:0/451213324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c009520 con 0x7f485c0730e0 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.361+0000 7f485bfff700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c199140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f484c00eb30 tx=0x7f484c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.362+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c009880 con 0x7f485c0730e0 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.362+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4854009c40 con 0x7f485c0730e0 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.362+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f484c0044b0 con 0x7f485c0730e0 2023-10-05T15:35:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.362+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c003ce0 con 0x7f485c0730e0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.362+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48500095f0 con 0x7f485c0730e0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.363+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c04ebb0 con 0x7f485c0730e0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.365+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f484c003ea0 con 0x7f485c0730e0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.366+0000 7f48597fa700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f48440a1510 0x7f48440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.366+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f484c014070 con 0x7f485c0730e0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.366+0000 7f485b7fe700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f48440a1510 0x7f48440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.367+0000 7f485b7fe700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f48440a1510 0x7f48440a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48500059d0 tx=0x7f4850005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.370+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f484c096850 con 0x7f485c0730e0 2023-10-05T15:35:38.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.590+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f485c113030 con 0x7f485c0730e0 2023-10-05T15:35:38.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.591+0000 7f48597fa700 1 -- 172.21.15.17:0/451213324 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f484c099e70 con 0x7f485c0730e0 2023-10-05T15:35:38.593 INFO:teuthology.orchestra.run.smithi017.stdout:146028888127 2023-10-05T15:35:38.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.593+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f48440a1510 msgr2=0x7f48440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.593+0000 7f48622c6700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f48440a1510 0x7f48440a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48500059d0 tx=0x7f4850005960 comp rx=0 tx=0).stop 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.593+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 msgr2=0x7f485c199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.593+0000 7f48622c6700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c199140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f484c00eb30 tx=0x7f484c00ee40 comp rx=0 tx=0).stop 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 shutdown_connections 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f48440a1510 0x7f48440a39d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c10d930 0x7f485c19daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c0730e0 0x7f485c199140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 --2- 172.21.15.17:0/451213324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f485c073a00 0x7f485c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 >> 172.21.15.17:0/451213324 conn(0x7f485c0780a0 msgr2=0x7f485c0ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 shutdown_connections 2023-10-05T15:35:38.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:38.594+0000 7f48622c6700 1 -- 172.21.15.17:0/451213324 wait complete. 2023-10-05T15:35:38.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:38 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3852453665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-05T15:35:38.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:38 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/451213324' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-05T15:35:39.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:38 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3852453665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-05T15:35:39.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:38 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/451213324' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-05T15:35:39.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:38 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3852453665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-05T15:35:39.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:38 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/451213324' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-05T15:35:39.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.554+0000 7f7ff064f700 1 -- 172.21.15.17:0/3640467683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 msgr2=0x7f7fe810de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.554+0000 7f7ff064f700 1 --2- 172.21.15.17:0/3640467683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe810de30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000b0a0 tx=0x7f7fe000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 -- 172.21.15.17:0/3640467683 shutdown_connections 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 --2- 172.21.15.17:0/3640467683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe810de30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 --2- 172.21.15.17:0/3640467683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe8101180 0x7f7fe8101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 --2- 172.21.15.17:0/3640467683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 0x7f7fe8105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 -- 172.21.15.17:0/3640467683 >> 172.21.15.17:0/3640467683 conn(0x7f7fe80fc9d0 msgr2=0x7f7fe80fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 -- 172.21.15.17:0/3640467683 shutdown_connections 2023-10-05T15:35:39.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.555+0000 7f7ff064f700 1 -- 172.21.15.17:0/3640467683 wait complete. 2023-10-05T15:35:39.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 Processor -- start 2023-10-05T15:35:39.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 -- start start 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe8101180 0x7f7fe8197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 0x7f7fe8197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe819c000 con 0x7f7fe8106260 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe819c170 con 0x7f7fe8101180 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.556+0000 7f7ff064f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe819c330 con 0x7f7fe8101b30 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33722/0 (socket says 172.21.15.17:33722) 2023-10-05T15:35:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 -- 172.21.15.17:0/2763822457 learned_addr learned my addr 172.21.15.17:0/2763822457 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:39.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7fee3eb700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe8101180 0x7f7fe8197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7fedbea700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 0x7f7fe8197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 -- 172.21.15.17:0/2763822457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 msgr2=0x7f7fe8197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 0x7f7fe8197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 -- 172.21.15.17:0/2763822457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe8101180 msgr2=0x7f7fe8197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe8101180 0x7f7fe8197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7feebec700 1 -- 172.21.15.17:0/2763822457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009d00 con 0x7f7fe8106260 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.557+0000 7f7fedbea700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 0x7f7fe8197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.558+0000 7f7feebec700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe819b9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000b070 tx=0x7f7fe000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.558+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000e040 con 0x7f7fe8106260 2023-10-05T15:35:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.558+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7fe0003e10 con 0x7f7fe8106260 2023-10-05T15:35:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.558+0000 7f7ff064f700 1 -- 172.21.15.17:0/2763822457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe819c5b0 con 0x7f7fe8106260 2023-10-05T15:35:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.558+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe001dea0 con 0x7f7fe8106260 2023-10-05T15:35:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.558+0000 7f7ff064f700 1 -- 172.21.15.17:0/2763822457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81a3ca0 con 0x7f7fe8106260 2023-10-05T15:35:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.559+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd00052f0 con 0x7f7fe8106260 2023-10-05T15:35:39.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.564+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f7fe001d480 con 0x7f7fe8106260 2023-10-05T15:35:39.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.565+0000 7f7fdf7fe700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7fd40a1510 0x7f7fd40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.565+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7fe00ce790 con 0x7f7fe8106260 2023-10-05T15:35:39.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.565+0000 7f7fee3eb700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7fd40a1510 0x7f7fd40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.566+0000 7f7fee3eb700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7fd40a1510 0x7f7fd40a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4005950 tx=0x7f7fe400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:39.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.566+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7fe009b440 con 0x7f7fe8106260 2023-10-05T15:35:39.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 -- 172.21.15.17:0/3503082539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 msgr2=0x7f4250101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 --2- 172.21.15.17:0/3503082539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 0x7f4250101400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42440099c0 tx=0x7f4244009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 -- 172.21.15.17:0/3503082539 shutdown_connections 2023-10-05T15:35:39.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 --2- 172.21.15.17:0/3503082539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4250101940 0x7f425010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 --2- 172.21.15.17:0/3503082539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250106f90 0x7f4250107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 --2- 172.21.15.17:0/3503082539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 0x7f4250101400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 -- 172.21.15.17:0/3503082539 >> 172.21.15.17:0/3503082539 conn(0x7f42500780a0 msgr2=0x7f42500784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 -- 172.21.15.17:0/3503082539 shutdown_connections 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.480+0000 7f42564e7700 1 -- 172.21.15.17:0/3503082539 wait complete. 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.481+0000 7f42564e7700 1 Processor -- start 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.481+0000 7f42564e7700 1 -- start start 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.481+0000 7f42564e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 0x7f4250199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.481+0000 7f42564e7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 0x7f42501996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f42564e7700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4250106f90 0x7f425019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f42564e7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425019e150 con 0x7f4250101940 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f42564e7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425019e2c0 con 0x7f4250100f80 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f42564e7700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425019e480 con 0x7f4250106f90 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 0x7f42501996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 0x7f4250199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 0x7f42501996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33692/0 (socket says 172.21.15.17:33692) 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 -- 172.21.15.17:0/2245579428 learned_addr learned my addr 172.21.15.17:0/2245579428 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f4254a84700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4250106f90 0x7f425019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 -- 172.21.15.17:0/2245579428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4250106f90 msgr2=0x7f425019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4250106f90 0x7f425019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 -- 172.21.15.17:0/2245579428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 msgr2=0x7f4250199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 0x7f4250199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.482+0000 7f424f7fe700 1 -- 172.21.15.17:0/2245579428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009520 con 0x7f4250101940 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.483+0000 7f424f7fe700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 0x7f42501996d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4244005910 tx=0x7f4244009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.483+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424401d070 con 0x7f4250101940 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.483+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42440095f0 con 0x7f4250101940 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.483+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4244022470 con 0x7f4250101940 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.483+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244017650 con 0x7f4250101940 2023-10-05T15:35:39.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.483+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42501a5df0 con 0x7f4250101940 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.484+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425004ebb0 con 0x7f4250101940 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.486+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f42440225e0 con 0x7f4250101940 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.487+0000 7f424d7fa700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f42380a1510 0x7f42380a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.487+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f42440ce140 con 0x7f4250101940 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.488+0000 7f424ffff700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f42380a1510 0x7f42380a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.488+0000 7f424ffff700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f42380a1510 0x7f42380a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4240009d70 tx=0x7f4240009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:39.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.492+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4244097360 con 0x7f4250101940 2023-10-05T15:35:39.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.745+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4250110d00 con 0x7f4250101940 2023-10-05T15:35:39.749 INFO:teuthology.orchestra.run.smithi017.stdout:111669149764 2023-10-05T15:35:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.746+0000 7f424d7fa700 1 -- 172.21.15.17:0/2245579428 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f424409a980 con 0x7f4250101940 2023-10-05T15:35:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.748+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f42380a1510 msgr2=0x7f42380a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.748+0000 7f42564e7700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f42380a1510 0x7f42380a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4240009d70 tx=0x7f4240009260 comp rx=0 tx=0).stop 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.748+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 msgr2=0x7f42501996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.748+0000 7f42564e7700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 0x7f42501996d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4244005910 tx=0x7f4244009580 comp rx=0 tx=0).stop 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.749+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 shutdown_connections 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.749+0000 7f42564e7700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f42380a1510 0x7f42380a39d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.749+0000 7f42564e7700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4250106f90 0x7f425019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.749+0000 7f42564e7700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4250100f80 0x7f4250199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.749+0000 7f42564e7700 1 --2- 172.21.15.17:0/2245579428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4250101940 0x7f42501996d0 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4244005910 tx=0x7f4244009580 comp rx=0 tx=0).stop 2023-10-05T15:35:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.749+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 >> 172.21.15.17:0/2245579428 conn(0x7f42500780a0 msgr2=0x7f425010c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.750+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 shutdown_connections 2023-10-05T15:35:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.750+0000 7f42564e7700 1 -- 172.21.15.17:0/2245579428 wait complete. 2023-10-05T15:35:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.842+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f7fd0005870 con 0x7f7fe8106260 2023-10-05T15:35:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.843+0000 7f7fdf7fe700 1 -- 172.21.15.17:0/2763822457 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fe009afd0 con 0x7f7fe8106260 2023-10-05T15:35:39.845 INFO:teuthology.orchestra.run.smithi017.stdout:257698037802 2023-10-05T15:35:39.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7fd40a1510 msgr2=0x7f7fd40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7fd40a1510 0x7f7fd40a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4005950 tx=0x7f7fe400b410 comp rx=0 tx=0).stop 2023-10-05T15:35:39.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 msgr2=0x7f7fe819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:39.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe819b9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000b070 tx=0x7f7fe000bce0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 shutdown_connections 2023-10-05T15:35:39.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7fd40a1510 0x7f7fd40a39d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fe8106260 0x7f7fe819b9f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe8101180 0x7f7fe8197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 --2- 172.21.15.17:0/2763822457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fe8101b30 0x7f7fe8197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 >> 172.21.15.17:0/2763822457 conn(0x7f7fe80fc9d0 msgr2=0x7f7fe80fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 shutdown_connections 2023-10-05T15:35:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:39.846+0000 7f7fdd7fa700 1 -- 172.21.15.17:0/2763822457 wait complete. 2023-10-05T15:35:39.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:39 smithi017 ceph-mon[129107]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 -- 172.21.15.17:0/2153118286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878100f80 msgr2=0x7f8878101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 --2- 172.21.15.17:0/2153118286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878100f80 0x7f8878101400 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88680099c0 tx=0x7f8868009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 -- 172.21.15.17:0/2153118286 shutdown_connections 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 --2- 172.21.15.17:0/2153118286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878101940 0x7f887810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 --2- 172.21.15.17:0/2153118286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8878106f90 0x7f8878107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 --2- 172.21.15.17:0/2153118286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878100f80 0x7f8878101400 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.073+0000 7f8880288700 1 -- 172.21.15.17:0/2153118286 >> 172.21.15.17:0/2153118286 conn(0x7f88780780a0 msgr2=0x7f88780784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.074+0000 7f8880288700 1 -- 172.21.15.17:0/2153118286 shutdown_connections 2023-10-05T15:35:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.074+0000 7f8880288700 1 -- 172.21.15.17:0/2153118286 wait complete. 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 Processor -- start 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 -- start start 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878100f80 0x7f88780731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8878101940 0x7f88780736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878106f90 0x7f8878073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88781a5340 con 0x7f8878106f90 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88781a54b0 con 0x7f8878100f80 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.075+0000 7f8880288700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88781a5670 con 0x7f8878101940 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878106f90 0x7f8878073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e024700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878100f80 0x7f88780731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e024700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878100f80 0x7f88780731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51602/0 (socket says 172.21.15.17:51602) 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e024700 1 -- 172.21.15.17:0/696803062 learned_addr learned my addr 172.21.15.17:0/696803062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887d823700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8878101940 0x7f88780736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 -- 172.21.15.17:0/696803062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8878101940 msgr2=0x7f88780736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8878101940 0x7f88780736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 -- 172.21.15.17:0/696803062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878100f80 msgr2=0x7f88780731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878100f80 0x7f88780731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 -- 172.21.15.17:0/696803062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88680095f0 con 0x7f8878106f90 2023-10-05T15:35:40.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f887e825700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878106f90 0x7f8878073c70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f887000efc0 tx=0x7f887000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.076+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870018070 con 0x7f8878106f90 2023-10-05T15:35:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.077+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f887000f040 con 0x7f8878106f90 2023-10-05T15:35:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.077+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000cb20 con 0x7f8878106f90 2023-10-05T15:35:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.077+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88781a58f0 con 0x7f8878106f90 2023-10-05T15:35:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.077+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88781a5d70 con 0x7f8878106f90 2023-10-05T15:35:40.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.078+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887804ebb0 con 0x7f8878106f90 2023-10-05T15:35:40.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.080+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f887000cd00 con 0x7f8878106f90 2023-10-05T15:35:40.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.081+0000 7f886f7fe700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88640a1590 0x7f88640a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.081+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f88700ccbc0 con 0x7f8878106f90 2023-10-05T15:35:40.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.081+0000 7f887e024700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88640a1590 0x7f88640a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:39 smithi167 ceph-mon[133366]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.082+0000 7f887e024700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88640a1590 0x7f88640a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8874005950 tx=0x7f887400b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:40.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.085+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8870095de0 con 0x7f8878106f90 2023-10-05T15:35:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:39 smithi079 ceph-mon[132936]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.347+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8878110f10 con 0x7f8878106f90 2023-10-05T15:35:40.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.347+0000 7f886f7fe700 1 -- 172.21.15.17:0/696803062 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8870099400 con 0x7f8878106f90 2023-10-05T15:35:40.350 INFO:teuthology.orchestra.run.smithi017.stdout:77309411401 2023-10-05T15:35:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88640a1590 msgr2=0x7f88640a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88640a1590 0x7f88640a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8874005950 tx=0x7f887400b500 comp rx=0 tx=0).stop 2023-10-05T15:35:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878106f90 msgr2=0x7f8878073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878106f90 0x7f8878073c70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f887000efc0 tx=0x7f887000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 shutdown_connections 2023-10-05T15:35:40.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f88640a1590 0x7f88640a3a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8878106f90 0x7f8878073c70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8878100f80 0x7f88780731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 --2- 172.21.15.17:0/696803062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8878101940 0x7f88780736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 >> 172.21.15.17:0/696803062 conn(0x7f88780780a0 msgr2=0x7f88780ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 shutdown_connections 2023-10-05T15:35:40.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.350+0000 7f8880288700 1 -- 172.21.15.17:0/696803062 wait complete. 2023-10-05T15:35:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 -- 172.21.15.17:0/2705776015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 msgr2=0x7ff9081059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 --2- 172.21.15.17:0/2705776015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff9081059d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009990 tx=0x7ff8fc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 -- 172.21.15.17:0/2705776015 shutdown_connections 2023-10-05T15:35:40.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 --2- 172.21.15.17:0/2705776015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9081060b0 0x7ff90810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 --2- 172.21.15.17:0/2705776015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff9081013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 --2- 172.21.15.17:0/2705776015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff9081059d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.357+0000 7ff90759e700 1 -- 172.21.15.17:0/2705776015 >> 172.21.15.17:0/2705776015 conn(0x7ff9080fc860 msgr2=0x7ff9080fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.358+0000 7ff90759e700 1 -- 172.21.15.17:0/2705776015 shutdown_connections 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.358+0000 7ff90759e700 1 -- 172.21.15.17:0/2705776015 wait complete. 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.359+0000 7ff90759e700 1 Processor -- start 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.359+0000 7ff90759e700 1 -- start start 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.359+0000 7ff90759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff908198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.359+0000 7ff90759e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff908199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9081060b0 0x7ff90819d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90759e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819df10 con 0x7ff908100fd0 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819e080 con 0x7ff9081060b0 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90759e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90819e240 con 0x7ff908101980 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff908198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff908198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33762/0 (socket says 172.21.15.17:33762) 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 -- 172.21.15.17:0/2341739475 learned_addr learned my addr 172.21.15.17:0/2341739475 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff905d9b700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff908199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff906d9d700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9081060b0 0x7ff90819d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 -- 172.21.15.17:0/2341739475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 msgr2=0x7ff908199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff908199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 -- 172.21.15.17:0/2341739475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9081060b0 msgr2=0x7ff90819d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9081060b0 0x7ff90819d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.360+0000 7ff90659c700 1 -- 172.21.15.17:0/2341739475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc0095f0 con 0x7ff908100fd0 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff905d9b700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff908199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff90659c700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff908198f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e9a0 tx=0x7ff8f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8009790 con 0x7ff908100fd0 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90819e520 con 0x7ff908100fd0 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8f8010430 con 0x7ff908100fd0 2023-10-05T15:35:40.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800cea0 con 0x7ff908100fd0 2023-10-05T15:35:40.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.361+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9081a5d80 con 0x7ff908100fd0 2023-10-05T15:35:40.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.363+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90804f400 con 0x7ff908100fd0 2023-10-05T15:35:40.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.368+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff8f80105a0 con 0x7ff908100fd0 2023-10-05T15:35:40.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.370+0000 7ff8f77fe700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8f00a1510 0x7ff8f00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:40.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.371+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff8f8014070 con 0x7ff908100fd0 2023-10-05T15:35:40.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.371+0000 7ff905d9b700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8f00a1510 0x7ff8f00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:40.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.373+0000 7ff905d9b700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8f00a1510 0x7ff8f00a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005910 tx=0x7ff8fc005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:40.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.380+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff8f8052100 con 0x7ff908100fd0 2023-10-05T15:35:40.410 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888125 got 146028888127 for osd.4 2023-10-05T15:35:40.410 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:40.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.619+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff908110c80 con 0x7ff908100fd0 2023-10-05T15:35:40.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.620+0000 7ff8f77fe700 1 -- 172.21.15.17:0/2341739475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8f8096550 con 0x7ff908100fd0 2023-10-05T15:35:40.622 INFO:teuthology.orchestra.run.smithi017.stdout:55834574927 2023-10-05T15:35:40.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8f00a1510 msgr2=0x7ff8f00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8f00a1510 0x7ff8f00a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005910 tx=0x7ff8fc005960 comp rx=0 tx=0).stop 2023-10-05T15:35:40.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 msgr2=0x7ff908198f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:40.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff908198f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e9a0 tx=0x7ff8f800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 shutdown_connections 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8f00a1510 0x7ff8f00a39d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9081060b0 0x7ff90819d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff908100fd0 0x7ff908198f50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 --2- 172.21.15.17:0/2341739475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff908101980 0x7ff908199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 >> 172.21.15.17:0/2341739475 conn(0x7ff9080fc860 msgr2=0x7ff9080fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.622+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 shutdown_connections 2023-10-05T15:35:40.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.623+0000 7ff90759e700 1 -- 172.21.15.17:0/2341739475 wait complete. 2023-10-05T15:35:40.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:40 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2245579428' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-05T15:35:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:40 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2763822457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-05T15:35:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:40 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/696803062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-05T15:35:40.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:40 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2341739475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-05T15:35:40.958 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462963 got 201863462965 for osd.6 2023-10-05T15:35:40.959 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:40.963 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:40.983 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.983 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:40.983 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:40 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2245579428' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-05T15:35:40.983 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:40 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2763822457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-05T15:35:40.984 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:40 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/696803062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-05T15:35:40.984 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:40 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2341739475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-05T15:35:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:40 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2245579428' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-05T15:35:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:40 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2763822457' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-05T15:35:41.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:40 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/696803062' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-05T15:35:41.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:40 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2341739475' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-05T15:35:41.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 -- 172.21.15.17:0/2954362393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158100a00 msgr2=0x7f4158104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 --2- 172.21.15.17:0/2954362393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158100a00 0x7f4158104a50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4148009990 tx=0x7f4148009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 -- 172.21.15.17:0/2954362393 shutdown_connections 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 --2- 172.21.15.17:0/2954362393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158105130 0x7f415810cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 --2- 172.21.15.17:0/2954362393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4158100050 0x7f4158100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 --2- 172.21.15.17:0/2954362393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158100a00 0x7f4158104a50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 -- 172.21.15.17:0/2954362393 >> 172.21.15.17:0/2954362393 conn(0x7f41580fb920 msgr2=0x7f41580fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 -- 172.21.15.17:0/2954362393 shutdown_connections 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.950+0000 7f415fbfc700 1 -- 172.21.15.17:0/2954362393 wait complete. 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.952+0000 7f415fbfc700 1 Processor -- start 2023-10-05T15:35:41.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.952+0000 7f415fbfc700 1 -- start start 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.952+0000 7f415fbfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 0x7f4158199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415fbfc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4158100a00 0x7f4158199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415fbfc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158105130 0x7f415819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415fbfc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415819e0e0 con 0x7f4158105130 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415fbfc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415819e250 con 0x7f4158100050 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415fbfc700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415819e410 con 0x7f4158100a00 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 0x7f4158199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 0x7f4158199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51630/0 (socket says 172.21.15.17:51630) 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 -- 172.21.15.17:0/1142452367 learned_addr learned my addr 172.21.15.17:0/1142452367 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415e199700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158105130 0x7f415819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d197700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4158100a00 0x7f4158199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 -- 172.21.15.17:0/1142452367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4158100a00 msgr2=0x7f4158199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4158100a00 0x7f4158199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 -- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158105130 msgr2=0x7f415819dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158105130 0x7f415819dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415d998700 1 -- 172.21.15.17:0/1142452367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480095f0 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.953+0000 7f415e199700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158105130 0x7f415819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.954+0000 7f415d998700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 0x7f4158199120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f415400d950 tx=0x7f415400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.954+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400f890 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.954+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f415400fe80 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.954+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415819e6f0 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.954+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400e3b0 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.954+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581a5f50 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.956+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41581031c0 con 0x7f4158100050 2023-10-05T15:35:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.958+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f4154010460 con 0x7f4158100050 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.960+0000 7f414effd700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41440a1510 0x7f41440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.960+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f41540ccf90 con 0x7f4158100050 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.960+0000 7f415d197700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41440a1510 0x7f41440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.961+0000 7f415d197700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41440a1510 0x7f41440a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f414800b5c0 tx=0x7f4148005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:40.964+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4154096120 con 0x7f4158100050 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.198+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f415804ebb0 con 0x7f4158100050 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.199+0000 7f414effd700 1 -- 172.21.15.17:0/1142452367 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4154016090 con 0x7f4158100050 2023-10-05T15:35:41.686 INFO:teuthology.orchestra.run.smithi017.stdout:34359738453 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41440a1510 msgr2=0x7f41440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41440a1510 0x7f41440a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f414800b5c0 tx=0x7f4148005fb0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 msgr2=0x7f4158199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 0x7f4158199120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f415400d950 tx=0x7f415400dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 shutdown_connections 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41440a1510 0x7f41440a39d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4158105130 0x7f415819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4158100050 0x7f4158199120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 --2- 172.21.15.17:0/1142452367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4158100a00 0x7f4158199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 >> 172.21.15.17:0/1142452367 conn(0x7f41580fb920 msgr2=0x7f41580fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 shutdown_connections 2023-10-05T15:35:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:41.201+0000 7f415fbfc700 1 -- 172.21.15.17:0/1142452367 wait complete. 2023-10-05T15:35:41.802 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574927 for osd.1 2023-10-05T15:35:41.802 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:41.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:41 smithi079 ceph-mon[132936]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-10-05T15:35:41.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:41 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1142452367' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-05T15:35:41.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:41 smithi017 ceph-mon[129107]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-10-05T15:35:41.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:41 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1142452367' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-05T15:35:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:41 smithi167 ceph-mon[133366]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2023-10-05T15:35:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:41 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1142452367' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-05T15:35:42.327 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411398 got 77309411401 for osd.2 2023-10-05T15:35:42.327 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:42.592 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:42.619 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037799 got 257698037802 for osd.8 2023-10-05T15:35:42.619 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:42.737 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149762 got 111669149764 for osd.3 2023-10-05T15:35:42.737 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:43.222 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738450 got 34359738453 for osd.0 2023-10-05T15:35:43.222 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:43.721 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:43.895 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:43 smithi017 ceph-mon[129107]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:44.042 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:43 smithi079 ceph-mon[132936]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:43 smithi167 ceph-mon[133366]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 -- 172.21.15.17:0/3376144282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68100f80 msgr2=0x7f5a68101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 --2- 172.21.15.17:0/3376144282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68100f80 0x7f5a68101400 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0099c0 tx=0x7f5a5c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 -- 172.21.15.17:0/3376144282 shutdown_connections 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 --2- 172.21.15.17:0/3376144282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68101940 0x7f5a6810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 --2- 172.21.15.17:0/3376144282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a68106f90 0x7f5a68107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 --2- 172.21.15.17:0/3376144282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68100f80 0x7f5a68101400 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 -- 172.21.15.17:0/3376144282 >> 172.21.15.17:0/3376144282 conn(0x7f5a680780a0 msgr2=0x7f5a680784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 -- 172.21.15.17:0/3376144282 shutdown_connections 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.660+0000 7f5a6e575700 1 -- 172.21.15.17:0/3376144282 wait complete. 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.661+0000 7f5a6e575700 1 Processor -- start 2023-10-05T15:35:44.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 -- start start 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 0x7f5a68070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a68101940 0x7f5a680706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68106f90 0x7f5a6806b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6806ba00 con 0x7f5a68106f90 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6806bb70 con 0x7f5a68100f80 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.662+0000 7f5a6e575700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6806bd30 con 0x7f5a68101940 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a6cb12700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68106f90 0x7f5a6806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 0x7f5a68070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 0x7f5a68070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50172/0 (socket says 172.21.15.17:50172) 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 -- 172.21.15.17:0/1526244878 learned_addr learned my addr 172.21.15.17:0/1526244878 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:44.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a6cb12700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68106f90 0x7f5a6806b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50048/0 (socket says 172.21.15.17:50048) 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 -- 172.21.15.17:0/1526244878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a68101940 msgr2=0x7f5a680706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a68101940 0x7f5a680706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 -- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68106f90 msgr2=0x7f5a6806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68106f90 0x7f5a6806b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 -- 172.21.15.17:0/1526244878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0095f0 con 0x7f5a68100f80 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.663+0000 7f5a67fff700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 0x7f5a68070180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800e9a0 tx=0x7f5a5800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.664+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58009790 con 0x7f5a68100f80 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.664+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a5800cbd0 con 0x7f5a68100f80 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.664+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58018680 con 0x7f5a68100f80 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.664+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6806c010 con 0x7f5a68100f80 2023-10-05T15:35:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.664+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a68074190 con 0x7f5a68100f80 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.665+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6804ebb0 con 0x7f5a68100f80 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.667+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f5a5800cd40 con 0x7f5a68100f80 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.669+0000 7f5a657fa700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a500a1510 0x7f5a500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.669+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5a58014070 con 0x7f5a68100f80 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.669+0000 7f5a677fe700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a500a1510 0x7f5a500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.670+0000 7f5a677fe700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a500a1510 0x7f5a500a39d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009fd0 tx=0x7f5a5c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:44.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.670+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5a580966e0 con 0x7f5a68100f80 2023-10-05T15:35:44.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.906+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5a6806c760 con 0x7f5a68100f80 2023-10-05T15:35:44.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.907+0000 7f5a657fa700 1 -- 172.21.15.17:0/1526244878 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a58099d00 con 0x7f5a68100f80 2023-10-05T15:35:44.909 INFO:teuthology.orchestra.run.smithi017.stdout:223338299440 2023-10-05T15:35:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.909+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a500a1510 msgr2=0x7f5a500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:44.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.909+0000 7f5a6e575700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a500a1510 0x7f5a500a39d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009fd0 tx=0x7f5a5c000bc0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.909+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 msgr2=0x7f5a68070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.909+0000 7f5a6e575700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 0x7f5a68070180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800e9a0 tx=0x7f5a5800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 shutdown_connections 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a500a1510 0x7f5a500a39d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a68106f90 0x7f5a6806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a68100f80 0x7f5a68070180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 --2- 172.21.15.17:0/1526244878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a68101940 0x7f5a680706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 >> 172.21.15.17:0/1526244878 conn(0x7f5a680780a0 msgr2=0x7f5a680ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 shutdown_connections 2023-10-05T15:35:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.910+0000 7f5a6e575700 1 -- 172.21.15.17:0/1526244878 wait complete. 2023-10-05T15:35:45.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 -- 172.21.15.17:0/4291587211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728101940 msgr2=0x7f972810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 --2- 172.21.15.17:0/4291587211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728101940 0x7f972810ddb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f972000b0d0 tx=0x7f972000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 -- 172.21.15.17:0/4291587211 shutdown_connections 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 --2- 172.21.15.17:0/4291587211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728101940 0x7f972810ddb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 --2- 172.21.15.17:0/4291587211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9728106f90 0x7f9728107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 --2- 172.21.15.17:0/4291587211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728100f80 0x7f9728101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 -- 172.21.15.17:0/4291587211 >> 172.21.15.17:0/4291587211 conn(0x7f97280780a0 msgr2=0x7f97280784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 -- 172.21.15.17:0/4291587211 shutdown_connections 2023-10-05T15:35:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.784+0000 7f972e4f2700 1 -- 172.21.15.17:0/4291587211 wait complete. 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.785+0000 7f972e4f2700 1 Processor -- start 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 -- start start 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728100f80 0x7f9728199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 0x7f97281996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9728106f90 0x7f972819db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972819e130 con 0x7f9728100f80 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972819e2a0 con 0x7f9728101940 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f972e4f2700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972819e460 con 0x7f9728106f90 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f9727fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728100f80 0x7f9728199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f971ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 0x7f97281996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f971ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 0x7f97281996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50182/0 (socket says 172.21.15.17:50182) 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.786+0000 7f971ffff700 1 -- 172.21.15.17:0/13962493 learned_addr learned my addr 172.21.15.17:0/13962493 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f972ca8f700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9728106f90 0x7f972819db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f971ffff700 1 -- 172.21.15.17:0/13962493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9728106f90 msgr2=0x7f972819db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f971ffff700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9728106f90 0x7f972819db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f971ffff700 1 -- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728100f80 msgr2=0x7f9728199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f971ffff700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728100f80 0x7f9728199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f971ffff700 1 -- 172.21.15.17:0/13962493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720009d00 con 0x7f9728101940 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f9727fff700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728100f80 0x7f9728199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f971ffff700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 0x7f97281996b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f971000e9a0 tx=0x7f971000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.787+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710009790 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.788+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972819e740 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.788+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9710010430 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.788+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971000cea0 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.788+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97281a5fa0 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.789+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972804ebb0 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.791+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f97100105a0 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.792+0000 7f9725ffb700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f97140a1510 0x7f97140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.792+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9710014070 con 0x7f9728101940 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.792+0000 7f9727fff700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f97140a1510 0x7f97140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.793+0000 7f9727fff700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f97140a1510 0x7f97140a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9718011490 tx=0x7f9718009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:44.794+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9710096730 con 0x7f9728101940 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.015+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f972819a4d0 con 0x7f9728101940 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.016+0000 7f9725ffb700 1 -- 172.21.15.17:0/13962493 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f9710099d50 con 0x7f9728101940 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f97140a1510 msgr2=0x7f97140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f97140a1510 0x7f97140a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9718011490 tx=0x7f9718009260 comp rx=0 tx=0).stop 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 msgr2=0x7f97281996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 0x7f97281996b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f971000e9a0 tx=0x7f971000ecb0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 shutdown_connections 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f97140a1510 0x7f97140a39d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9728106f90 0x7f972819db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9728100f80 0x7f9728199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 --2- 172.21.15.17:0/13962493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9728101940 0x7f97281996b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 >> 172.21.15.17:0/13962493 conn(0x7f97280780a0 msgr2=0x7f97280ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 shutdown_connections 2023-10-05T15:35:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:45.019+0000 7f972e4f2700 1 -- 172.21.15.17:0/13962493 wait complete. 2023-10-05T15:35:45.063 INFO:teuthology.orchestra.run.smithi017.stdout:313532612642 2023-10-05T15:35:45.878 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:45 smithi017 ceph-mon[129107]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-10-05T15:35:45.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1526244878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-05T15:35:45.879 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/13962493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-05T15:35:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:45 smithi167 ceph-mon[133366]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-10-05T15:35:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1526244878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-05T15:35:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/13962493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-05T15:35:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:45 smithi079 ceph-mon[132936]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2023-10-05T15:35:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1526244878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-05T15:35:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/13962493' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-05T15:35:46.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299438 got 223338299440 for osd.7 2023-10-05T15:35:46.631 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:46.651 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612639 got 313532612642 for osd.10 2023-10-05T15:35:46.651 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.038+0000 7f0aa3299700 1 -- 172.21.15.17:0/1190902195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c108490 msgr2=0x7f0a9c110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.038+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1190902195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c108490 0x7f0a9c110060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400b0a0 tx=0x7f0a9400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 -- 172.21.15.17:0/1190902195 shutdown_connections 2023-10-05T15:35:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1190902195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c108490 0x7f0a9c110060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1190902195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1190902195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a9c103d60 0x7f0a9c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 -- 172.21.15.17:0/1190902195 >> 172.21.15.17:0/1190902195 conn(0x7f0a9c0fec20 msgr2=0x7f0a9c101040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 -- 172.21.15.17:0/1190902195 shutdown_connections 2023-10-05T15:35:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.039+0000 7f0aa3299700 1 -- 172.21.15.17:0/1190902195 wait complete. 2023-10-05T15:35:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.040+0000 7f0aa3299700 1 Processor -- start 2023-10-05T15:35:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.040+0000 7f0aa3299700 1 -- start start 2023-10-05T15:35:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa3299700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa3299700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a9c103d60 0x7f0a9c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa3299700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a9c108490 0x7f0a9c19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa3299700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c19e120 con 0x7f0a9c108490 2023-10-05T15:35:47.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa3299700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c19e290 con 0x7f0a9c103d60 2023-10-05T15:35:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa3299700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c19e450 con 0x7f0a9c1033b0 2023-10-05T15:35:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa1035700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa1035700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42460/0 (socket says 172.21.15.17:42460) 2023-10-05T15:35:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa1035700 1 -- 172.21.15.17:0/1846700077 learned_addr learned my addr 172.21.15.17:0/1846700077 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa0834700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a9c103d60 0x7f0a9c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.041+0000 7f0aa1836700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a9c108490 0x7f0a9c19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.042+0000 7f0aa1035700 1 -- 172.21.15.17:0/1846700077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a9c103d60 msgr2=0x7f0a9c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.042+0000 7f0aa1035700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a9c103d60 0x7f0a9c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.042+0000 7f0aa1035700 1 -- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a9c108490 msgr2=0x7f0a9c19db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.042+0000 7f0aa1035700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a9c108490 0x7f0a9c19db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.042+0000 7f0aa1035700 1 -- 172.21.15.17:0/1846700077 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94009d00 con 0x7f0a9c1033b0 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.042+0000 7f0aa1035700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c199160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800d950 tx=0x7f0a9800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.043+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800f890 con 0x7f0a9c1033b0 2023-10-05T15:35:47.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.043+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a9800fe80 con 0x7f0a9c1033b0 2023-10-05T15:35:47.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.043+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c19e730 con 0x7f0a9c1033b0 2023-10-05T15:35:47.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.043+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800e3b0 con 0x7f0a9c1033b0 2023-10-05T15:35:47.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.043+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c06aaa0 con 0x7f0a9c1033b0 2023-10-05T15:35:47.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.044+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c04ebb0 con 0x7f0a9c1033b0 2023-10-05T15:35:47.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.047+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f0a98010460 con 0x7f0a9c1033b0 2023-10-05T15:35:47.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.049+0000 7f0a927fc700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a880a1510 0x7f0a880a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.049+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f0a980cd360 con 0x7f0a9c1033b0 2023-10-05T15:35:47.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.049+0000 7f0aa0834700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a880a1510 0x7f0a880a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.050+0000 7f0aa0834700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a880a1510 0x7f0a880a39d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c19a780 tx=0x7f0a8c009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:47.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.054+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a980964f0 con 0x7f0a9c1033b0 2023-10-05T15:35:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.283+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f0a9c113120 con 0x7f0a9c1033b0 2023-10-05T15:35:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.284+0000 7f0a927fc700 1 -- 172.21.15.17:0/1846700077 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f0a98099b10 con 0x7f0a9c1033b0 2023-10-05T15:35:47.286 INFO:teuthology.orchestra.run.smithi017.stdout:347892351005 2023-10-05T15:35:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a880a1510 msgr2=0x7f0a880a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a880a1510 0x7f0a880a39d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c19a780 tx=0x7f0a8c009190 comp rx=0 tx=0).stop 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 msgr2=0x7f0a9c199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c199160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800d950 tx=0x7f0a9800dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 shutdown_connections 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a880a1510 0x7f0a880a39d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a9c108490 0x7f0a9c19db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9c1033b0 0x7f0a9c199160 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 --2- 172.21.15.17:0/1846700077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a9c103d60 0x7f0a9c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 >> 172.21.15.17:0/1846700077 conn(0x7f0a9c0fec20 msgr2=0x7f0a9c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 shutdown_connections 2023-10-05T15:35:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.287+0000 7f0aa3299700 1 -- 172.21.15.17:0/1846700077 wait complete. 2023-10-05T15:35:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 -- 172.21.15.17:0/2952343004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4073620 msgr2=0x7faef4073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 --2- 172.21.15.17:0/2952343004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4073620 0x7faef4073a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faee40098f0 tx=0x7faee4009c00 comp rx=0 tx=0).stop 2023-10-05T15:35:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 -- 172.21.15.17:0/2952343004 shutdown_connections 2023-10-05T15:35:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 --2- 172.21.15.17:0/2952343004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4111bc0 0x7faef4113fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 --2- 172.21.15.17:0/2952343004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4074ef0 0x7faef40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 --2- 172.21.15.17:0/2952343004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4073620 0x7faef4073a80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 -- 172.21.15.17:0/2952343004 >> 172.21.15.17:0/2952343004 conn(0x7faef40780a0 msgr2=0x7faef40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 -- 172.21.15.17:0/2952343004 shutdown_connections 2023-10-05T15:35:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.396+0000 7faefa7b8700 1 -- 172.21.15.17:0/2952343004 wait complete. 2023-10-05T15:35:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.397+0000 7faefa7b8700 1 Processor -- start 2023-10-05T15:35:47.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 -- start start 2023-10-05T15:35:47.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4073620 0x7faef41a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4074ef0 0x7faef41a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4111bc0 0x7faef419d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef419db70 con 0x7faef4074ef0 2023-10-05T15:35:47.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef419dcb0 con 0x7faef4111bc0 2023-10-05T15:35:47.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.398+0000 7faefa7b8700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef419de70 con 0x7faef4073620 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4073620 0x7faef41a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4073620 0x7faef41a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42482/0 (socket says 172.21.15.17:42482) 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef3fff700 1 -- 172.21.15.17:0/4161010365 learned_addr learned my addr 172.21.15.17:0/4161010365 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef8d55700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4111bc0 0x7faef419d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef37fe700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4074ef0 0x7faef41a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef8d55700 1 -- 172.21.15.17:0/4161010365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4073620 msgr2=0x7faef41a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef8d55700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4073620 0x7faef41a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef8d55700 1 -- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4074ef0 msgr2=0x7faef41a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef8d55700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4074ef0 0x7faef41a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef8d55700 1 -- 172.21.15.17:0/4161010365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009520 con 0x7faef4111bc0 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.399+0000 7faef37fe700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4074ef0 0x7faef41a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.400+0000 7faef8d55700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4111bc0 0x7faef419d510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faef4105360 tx=0x7faeec009e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.400+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec00cb30 con 0x7faef4111bc0 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.400+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeec00cc90 con 0x7faef4111bc0 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.400+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec0125a0 con 0x7faef4111bc0 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.400+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef419e150 con 0x7faef4111bc0 2023-10-05T15:35:47.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.400+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef41aa4d0 con 0x7faef4111bc0 2023-10-05T15:35:47.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.402+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef404ebb0 con 0x7faef4111bc0 2023-10-05T15:35:47.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.403+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7faeec014440 con 0x7faef4111bc0 2023-10-05T15:35:47.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.405+0000 7faef17fa700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faee00a1590 0x7faee00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:47.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.405+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7faeec006e40 con 0x7faef4111bc0 2023-10-05T15:35:47.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.406+0000 7faef3fff700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faee00a1590 0x7faee00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:47.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.406+0000 7faef3fff700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faee00a1590 0x7faee00a3a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faedc005950 tx=0x7faedc009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:47.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.409+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faeec04f100 con 0x7faef4111bc0 2023-10-05T15:35:47.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.672+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7faef419ea40 con 0x7faef4111bc0 2023-10-05T15:35:47.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.672+0000 7faef17fa700 1 -- 172.21.15.17:0/4161010365 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeec095b60 con 0x7faef4111bc0 2023-10-05T15:35:47.674 INFO:teuthology.orchestra.run.smithi017.stdout:292057776167 2023-10-05T15:35:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faee00a1590 msgr2=0x7faee00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faee00a1590 0x7faee00a3a50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faedc005950 tx=0x7faedc009310 comp rx=0 tx=0).stop 2023-10-05T15:35:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4111bc0 msgr2=0x7faef419d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4111bc0 0x7faef419d510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faef4105360 tx=0x7faeec009e20 comp rx=0 tx=0).stop 2023-10-05T15:35:47.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 shutdown_connections 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faee00a1590 0x7faee00a3a50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faef4111bc0 0x7faef419d510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faef4073620 0x7faef41a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 --2- 172.21.15.17:0/4161010365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faef4074ef0 0x7faef41a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 >> 172.21.15.17:0/4161010365 conn(0x7faef40780a0 msgr2=0x7faef4110440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 shutdown_connections 2023-10-05T15:35:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:47.675+0000 7faefa7b8700 1 -- 172.21.15.17:0/4161010365 wait complete. 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 -- 172.21.15.17:0/3251323260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268106f90 msgr2=0x7fb268107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/3251323260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268106f90 0x7fb268107370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb2640099c0 tx=0x7fb264009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 -- 172.21.15.17:0/3251323260 shutdown_connections 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/3251323260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268101940 0x7fb26810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/3251323260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268106f90 0x7fb268107370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/3251323260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb268100f80 0x7fb268101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 -- 172.21.15.17:0/3251323260 >> 172.21.15.17:0/3251323260 conn(0x7fb2680780a0 msgr2=0x7fb2680784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:48.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 -- 172.21.15.17:0/3251323260 shutdown_connections 2023-10-05T15:35:48.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.039+0000 7fb26f8fa700 1 -- 172.21.15.17:0/3251323260 wait complete. 2023-10-05T15:35:48.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.040+0000 7fb26f8fa700 1 Processor -- start 2023-10-05T15:35:48.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 -- start start 2023-10-05T15:35:48.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb268100f80 0x7fb268196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:48.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268101940 0x7fb2681974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:48.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268106f90 0x7fb26819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26819bf20 con 0x7fb268106f90 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26819c090 con 0x7fb268101940 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26f8fa700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26819c250 con 0x7fb268100f80 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26ce95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268101940 0x7fb2681974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26de97700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268106f90 0x7fb26819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26ce95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268101940 0x7fb2681974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50246/0 (socket says 172.21.15.17:50246) 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26ce95700 1 -- 172.21.15.17:0/2503299843 learned_addr learned my addr 172.21.15.17:0/2503299843 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.041+0000 7fb26d696700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb268100f80 0x7fb268196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26de97700 1 -- 172.21.15.17:0/2503299843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb268100f80 msgr2=0x7fb268196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26de97700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb268100f80 0x7fb268196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26de97700 1 -- 172.21.15.17:0/2503299843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268101940 msgr2=0x7fb2681974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26de97700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268101940 0x7fb2681974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26de97700 1 -- 172.21.15.17:0/2503299843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260009c40 con 0x7fb268106f90 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26de97700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268106f90 0x7fb26819b910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb26000efc0 tx=0x7fb26000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260018070 con 0x7fb268106f90 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2640095f0 con 0x7fb268106f90 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb26000f040 con 0x7fb268106f90 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.042+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb260004020 con 0x7fb268106f90 2023-10-05T15:35:48.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.043+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2681a3bc0 con 0x7fb268106f90 2023-10-05T15:35:48.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.043+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26804ebb0 con 0x7fb268106f90 2023-10-05T15:35:48.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.046+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fb260003a00 con 0x7fb268106f90 2023-10-05T15:35:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.047+0000 7fb25e7fc700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2540a1510 0x7fb2540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.047+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb2600ccd60 con 0x7fb268106f90 2023-10-05T15:35:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.047+0000 7fb26d696700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2540a1510 0x7fb2540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:48.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.048+0000 7fb26d696700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2540a1510 0x7fb2540a39d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb264009990 tx=0x7fb264005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:48.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.051+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb260095f80 con 0x7fb268106f90 2023-10-05T15:35:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:47 smithi167 ceph-mon[133366]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:47 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1846700077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-05T15:35:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:47 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4161010365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-05T15:35:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:47 smithi079 ceph-mon[132936]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:48.155 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:47 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1846700077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-05T15:35:48.155 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:47 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4161010365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-05T15:35:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:47 smithi017 ceph-mon[129107]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:47 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1846700077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-05T15:35:48.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:47 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4161010365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-05T15:35:48.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.266+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb268110f30 con 0x7fb268106f90 2023-10-05T15:35:48.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.269+0000 7fb25e7fc700 1 -- 172.21.15.17:0/2503299843 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2600995a0 con 0x7fb268106f90 2023-10-05T15:35:48.271 INFO:teuthology.orchestra.run.smithi017.stdout:167503724603 2023-10-05T15:35:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.271+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2540a1510 msgr2=0x7fb2540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.271+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2540a1510 0x7fb2540a39d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb264009990 tx=0x7fb264005c00 comp rx=0 tx=0).stop 2023-10-05T15:35:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.271+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268106f90 msgr2=0x7fb26819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.271+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268106f90 0x7fb26819b910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb26000efc0 tx=0x7fb26000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 shutdown_connections 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2540a1510 0x7fb2540a39d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb268106f90 0x7fb26819b910 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb268100f80 0x7fb268196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 --2- 172.21.15.17:0/2503299843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb268101940 0x7fb2681974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 >> 172.21.15.17:0/2503299843 conn(0x7fb2680780a0 msgr2=0x7fb2680ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 shutdown_connections 2023-10-05T15:35:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:48.272+0000 7fb26f8fa700 1 -- 172.21.15.17:0/2503299843 wait complete. 2023-10-05T15:35:48.277 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351002 got 347892351005 for osd.11 2023-10-05T15:35:48.278 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:48.303 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776165 got 292057776167 for osd.9 2023-10-05T15:35:48.303 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:48.846 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724600 got 167503724603 for osd.5 2023-10-05T15:35:48.846 DEBUG:teuthology.parallel:result is None 2023-10-05T15:35:48.847 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-05T15:35:48.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-05T15:35:49.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:48 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2503299843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-05T15:35:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:48 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2503299843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-05T15:35:49.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:48 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2503299843' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-05T15:35:49.602 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:49.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:49 smithi017 ceph-mon[129107]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:49.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:49.991 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:49 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:50.048 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:49 smithi079 ceph-mon[132936]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:50.048 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:50.048 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:49 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:49 smithi167 ceph-mon[133366]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:49 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:50.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:35:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:35:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:35:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:35:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:35:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:35:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:35:51.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.372+0000 7f38ff204700 1 -- 172.21.15.17:0/266955731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 msgr2=0x7f38f810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.372+0000 7f38ff204700 1 --2- 172.21.15.17:0/266955731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f810ddb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38f000b0d0 tx=0x7f38f000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.372+0000 7f38ff204700 1 -- 172.21.15.17:0/266955731 shutdown_connections 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.373+0000 7f38ff204700 1 --2- 172.21.15.17:0/266955731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f810ddb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.373+0000 7f38ff204700 1 --2- 172.21.15.17:0/266955731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8106f90 0x7f38f8107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.373+0000 7f38ff204700 1 --2- 172.21.15.17:0/266955731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f8100f80 0x7f38f8101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.373+0000 7f38ff204700 1 -- 172.21.15.17:0/266955731 >> 172.21.15.17:0/266955731 conn(0x7f38f80780a0 msgr2=0x7f38f80784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.373+0000 7f38ff204700 1 -- 172.21.15.17:0/266955731 shutdown_connections 2023-10-05T15:35:51.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.373+0000 7f38ff204700 1 -- 172.21.15.17:0/266955731 wait complete. 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 Processor -- start 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 -- start start 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8100f80 0x7f38f80731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f80736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f8106f90 0x7f38f8073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81a53f0 con 0x7f38f8101940 2023-10-05T15:35:51.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81a5560 con 0x7f38f8100f80 2023-10-05T15:35:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.374+0000 7f38ff204700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81a5720 con 0x7f38f8106f90 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f80736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f80736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50120/0 (socket says 172.21.15.17:50120) 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 -- 172.21.15.17:0/3388755830 learned_addr learned my addr 172.21.15.17:0/3388755830 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38fcfa0700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8100f80 0x7f38f80731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 -- 172.21.15.17:0/3388755830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f8106f90 msgr2=0x7f38f8073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f8106f90 0x7f38f8073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 -- 172.21.15.17:0/3388755830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8100f80 msgr2=0x7f38f80731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8100f80 0x7f38f80731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38f7fff700 1 -- 172.21.15.17:0/3388755830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0009d00 con 0x7f38f8101940 2023-10-05T15:35:51.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.375+0000 7f38fcfa0700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8100f80 0x7f38f80731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.376+0000 7f38f7fff700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f80736f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38e400d950 tx=0x7f38e400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.376+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4009940 con 0x7f38f8101940 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.376+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38e4010460 con 0x7f38f8101940 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.376+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e400f620 con 0x7f38f8101940 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.376+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f81a5a00 con 0x7f38f8101940 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.376+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f81a5eb0 con 0x7f38f8101940 2023-10-05T15:35:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.377+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f804ebb0 con 0x7f38f8101940 2023-10-05T15:35:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.379+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f38e40105d0 con 0x7f38f8101940 2023-10-05T15:35:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.380+0000 7f38f5ffb700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38e80a1590 0x7f38e80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.380+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f38e40ccfc0 con 0x7f38f8101940 2023-10-05T15:35:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.380+0000 7f38fcfa0700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38e80a1590 0x7f38e80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.381+0000 7f38fcfa0700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38e80a1590 0x7f38e80a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f38ec011490 tx=0x7f38ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:51.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.384+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38e4096150 con 0x7f38f8101940 2023-10-05T15:35:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.592+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38f8111000 con 0x7f38e80a1590 2023-10-05T15:35:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.609+0000 7f38f5ffb700 1 -- 172.21.15.17:0/3388755830 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426722 (secure 0 0 0) 0x7f38ec004030 con 0x7f38e80a1590 2023-10-05T15:35:51.617 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.615+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38e80a1590 msgr2=0x7f38e80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:51.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.615+0000 7f38ff204700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38e80a1590 0x7f38e80a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f38ec011490 tx=0x7f38ec009260 comp rx=0 tx=0).stop 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.615+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 msgr2=0x7f38f80736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.615+0000 7f38ff204700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f80736f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f38e400d950 tx=0x7f38e400dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 shutdown_connections 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38e80a1590 0x7f38e80a3a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38f8106f90 0x7f38f8073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8100f80 0x7f38f80731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 --2- 172.21.15.17:0/3388755830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f8101940 0x7f38f80736f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 >> 172.21.15.17:0/3388755830 conn(0x7f38f80780a0 msgr2=0x7f38f80ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 shutdown_connections 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:51.616+0000 7f38ff204700 1 -- 172.21.15.17:0/3388755830 wait complete. 2023-10-05T15:35:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:35:51.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:51 smithi079 ceph-mon[132936]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-10-05T15:35:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:51 smithi017 ceph-mon[129107]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-10-05T15:35:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:51 smithi167 ceph-mon[133366]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-10-05T15:35:52.204 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2023-10-05T15:35:50.598624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656730,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":642,"num_read_kb":440,"num_write":419,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336624,"kb_used_data":12384,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605200,"statfs":{"total":1151940427776,"available":1151595724800,"internally_reserved":0,"allocated":12681216,"data_stored":7985934,"data_compressed":320487,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":75,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003259"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775077+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:35:04.775077+0000","last_peered":"2023-10-05T15:35:04.775077+0000","last_clean":"2023-10-05T15:35:04.775077+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:35:04.775077+0000","last_undegraded":"2023-10-05T15:35:04.775077+0000","last_fullsized":"2023-10-05T15:35:04.775077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773833+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:35:04.773833+0000","last_peered":"2023-10-05T15:35:04.773833+0000","last_clean":"2023-10-05T15:35:04.773833+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:35:04.773833+0000","last_undegraded":"2023-10-05T15:35:04.773833+0000","last_fullsized":"2023-10-05T15:35:04.773833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774011+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:35:04.774011+0000","last_peered":"2023-10-05T15:35:04.774011+0000","last_clean":"2023-10-05T15:35:04.774011+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:35:04.774011+0000","last_undegraded":"2023-10-05T15:35:04.774011+0000","last_fullsized":"2023-10-05T15:35:04.774011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774235+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:35:04.774235+0000","last_peered":"2023-10-05T15:35:04.774235+0000","last_clean":"2023-10-05T15:35:04.774235+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:35:04.774235+0000","last_undegraded":"2023-10-05T15:35:04.774235+0000","last_fullsized":"2023-10-05T15:35:04.774235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113534+0000","last_change":"2023-10-05T15:35:06.113534+0000","last_active":"2023-10-05T15:35:06.113534+0000","last_peered":"2023-10-05T15:35:06.113534+0000","last_clean":"2023-10-05T15:35:06.113534+0000","last_became_active":"2023-10-05T15:35:06.113092+0000","last_became_peered":"2023-10-05T15:35:06.113092+0000","last_unstale":"2023-10-05T15:35:06.113534+0000","last_undegraded":"2023-10-05T15:35:06.113534+0000","last_fullsized":"2023-10-05T15:35:06.113534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:35:36.334844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778797+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:35:04.778797+0000","last_peered":"2023-10-05T15:35:04.778797+0000","last_clean":"2023-10-05T15:35:04.778797+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:35:04.778797+0000","last_undegraded":"2023-10-05T15:35:04.778797+0000","last_fullsized":"2023-10-05T15:35:04.778797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.781929+0000","last_change":"2023-10-05T15:35:05.781929+0000","last_active":"2023-10-05T15:35:05.781929+0000","last_peered":"2023-10-05T15:35:05.781929+0000","last_clean":"2023-10-05T15:35:05.781929+0000","last_became_active":"2023-10-05T15:35:05.781552+0000","last_became_peered":"2023-10-05T15:35:05.781552+0000","last_unstale":"2023-10-05T15:35:05.781929+0000","last_undegraded":"2023-10-05T15:35:05.781929+0000","last_fullsized":"2023-10-05T15:35:05.781929+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:28:34.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770315+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:35:04.770315+0000","last_peered":"2023-10-05T15:35:04.770315+0000","last_clean":"2023-10-05T15:35:04.770315+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:35:04.770315+0000","last_undegraded":"2023-10-05T15:35:04.770315+0000","last_fullsized":"2023-10-05T15:35:04.770315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779600+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:35:04.779600+0000","last_peered":"2023-10-05T15:35:04.779600+0000","last_clean":"2023-10-05T15:35:04.779600+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:35:04.779600+0000","last_undegraded":"2023-10-05T15:35:04.779600+0000","last_fullsized":"2023-10-05T15:35:04.779600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.780091+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:35:04.780091+0000","last_peered":"2023-10-05T15:35:04.780091+0000","last_clean":"2023-10-05T15:35:04.780091+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:35:04.780091+0000","last_undegraded":"2023-10-05T15:35:04.780091+0000","last_fullsized":"2023-10-05T15:35:04.780091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778589+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:35:04.778589+0000","last_peered":"2023-10-05T15:35:04.778589+0000","last_clean":"2023-10-05T15:35:04.778589+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:35:04.778589+0000","last_undegraded":"2023-10-05T15:35:04.778589+0000","last_fullsized":"2023-10-05T15:35:04.778589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774117+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:35:04.774117+0000","last_peered":"2023-10-05T15:35:04.774117+0000","last_clean":"2023-10-05T15:35:04.774117+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:35:04.774117+0000","last_undegraded":"2023-10-05T15:35:04.774117+0000","last_fullsized":"2023-10-05T15:35:04.774117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774920+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:35:04.774920+0000","last_peered":"2023-10-05T15:35:04.774920+0000","last_clean":"2023-10-05T15:35:04.774920+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:35:04.774920+0000","last_undegraded":"2023-10-05T15:35:04.774920+0000","last_fullsized":"2023-10-05T15:35:04.774920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773611+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:35:04.773611+0000","last_peered":"2023-10-05T15:35:04.773611+0000","last_clean":"2023-10-05T15:35:04.773611+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:35:04.773611+0000","last_undegraded":"2023-10-05T15:35:04.773611+0000","last_fullsized":"2023-10-05T15:35:04.773611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.959005+0000","last_change":"2023-10-05T15:35:05.959005+0000","last_active":"2023-10-05T15:35:05.959005+0000","last_peered":"2023-10-05T15:35:05.959005+0000","last_clean":"2023-10-05T15:35:05.959005+0000","last_became_active":"2023-10-05T15:35:05.958666+0000","last_became_peered":"2023-10-05T15:35:05.958666+0000","last_unstale":"2023-10-05T15:35:05.959005+0000","last_undegraded":"2023-10-05T15:35:05.959005+0000","last_fullsized":"2023-10-05T15:35:05.959005+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:58:50.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777901+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:35:04.777901+0000","last_peered":"2023-10-05T15:35:04.777901+0000","last_clean":"2023-10-05T15:35:04.777901+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:35:04.777901+0000","last_undegraded":"2023-10-05T15:35:04.777901+0000","last_fullsized":"2023-10-05T15:35:04.777901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774835+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:35:04.774835+0000","last_peered":"2023-10-05T15:35:04.774835+0000","last_clean":"2023-10-05T15:35:04.774835+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:35:04.774835+0000","last_undegraded":"2023-10-05T15:35:04.774835+0000","last_fullsized":"2023-10-05T15:35:04.774835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778415+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:35:04.778415+0000","last_peered":"2023-10-05T15:35:04.778415+0000","last_clean":"2023-10-05T15:35:04.778415+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:35:04.778415+0000","last_undegraded":"2023-10-05T15:35:04.778415+0000","last_fullsized":"2023-10-05T15:35:04.778415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771802+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:35:04.771802+0000","last_peered":"2023-10-05T15:35:04.771802+0000","last_clean":"2023-10-05T15:35:04.771802+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:35:04.771802+0000","last_undegraded":"2023-10-05T15:35:04.771802+0000","last_fullsized":"2023-10-05T15:35:04.771802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771362+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:35:04.771362+0000","last_peered":"2023-10-05T15:35:04.771362+0000","last_clean":"2023-10-05T15:35:04.771362+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:35:04.771362+0000","last_undegraded":"2023-10-05T15:35:04.771362+0000","last_fullsized":"2023-10-05T15:35:04.771362+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":81,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:47.693766+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:35:47.693766+0000","last_peered":"2023-10-05T15:35:47.693766+0000","last_clean":"2023-10-05T15:35:47.693766+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:35:47.693766+0000","last_undegraded":"2023-10-05T15:35:47.693766+0000","last_fullsized":"2023-10-05T15:35:47.693766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771175+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:35:04.771175+0000","last_peered":"2023-10-05T15:35:04.771175+0000","last_clean":"2023-10-05T15:35:04.771175+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:35:04.771175+0000","last_undegraded":"2023-10-05T15:35:04.771175+0000","last_fullsized":"2023-10-05T15:35:04.771175+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113477+0000","last_change":"2023-10-05T15:35:06.113477+0000","last_active":"2023-10-05T15:35:06.113477+0000","last_peered":"2023-10-05T15:35:06.113477+0000","last_clean":"2023-10-05T15:35:06.113477+0000","last_became_active":"2023-10-05T15:35:06.112876+0000","last_became_peered":"2023-10-05T15:35:06.112876+0000","last_unstale":"2023-10-05T15:35:06.113477+0000","last_undegraded":"2023-10-05T15:35:06.113477+0000","last_fullsized":"2023-10-05T15:35:06.113477+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:41:51.762182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771198+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:35:04.771198+0000","last_peered":"2023-10-05T15:35:04.771198+0000","last_clean":"2023-10-05T15:35:04.771198+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:35:04.771198+0000","last_undegraded":"2023-10-05T15:35:04.771198+0000","last_fullsized":"2023-10-05T15:35:04.771198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774268+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:35:04.774268+0000","last_peered":"2023-10-05T15:35:04.774268+0000","last_clean":"2023-10-05T15:35:04.774268+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:35:04.774268+0000","last_undegraded":"2023-10-05T15:35:04.774268+0000","last_fullsized":"2023-10-05T15:35:04.774268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.772902+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:35:04.772902+0000","last_peered":"2023-10-05T15:35:04.772902+0000","last_clean":"2023-10-05T15:35:04.772902+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:35:04.772902+0000","last_undegraded":"2023-10-05T15:35:04.772902+0000","last_fullsized":"2023-10-05T15:35:04.772902+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"92'12","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.772410+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:35:05.772410+0000","last_peered":"2023-10-05T15:35:05.772410+0000","last_clean":"2023-10-05T15:35:05.772410+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:35:05.772410+0000","last_undegraded":"2023-10-05T15:35:05.772410+0000","last_fullsized":"2023-10-05T15:35:05.772410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.780625+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:35:04.780625+0000","last_peered":"2023-10-05T15:35:04.780625+0000","last_clean":"2023-10-05T15:35:04.780625+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:35:04.780625+0000","last_undegraded":"2023-10-05T15:35:04.780625+0000","last_fullsized":"2023-10-05T15:35:04.780625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773941+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:35:04.773941+0000","last_peered":"2023-10-05T15:35:04.773941+0000","last_clean":"2023-10-05T15:35:04.773941+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:35:04.773941+0000","last_undegraded":"2023-10-05T15:35:04.773941+0000","last_fullsized":"2023-10-05T15:35:04.773941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775027+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:35:04.775027+0000","last_peered":"2023-10-05T15:35:04.775027+0000","last_clean":"2023-10-05T15:35:04.775027+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:35:04.775027+0000","last_undegraded":"2023-10-05T15:35:04.775027+0000","last_fullsized":"2023-10-05T15:35:04.775027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777827+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:35:04.777827+0000","last_peered":"2023-10-05T15:35:04.777827+0000","last_clean":"2023-10-05T15:35:04.777827+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:35:04.777827+0000","last_undegraded":"2023-10-05T15:35:04.777827+0000","last_fullsized":"2023-10-05T15:35:04.777827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771230+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:35:04.771230+0000","last_peered":"2023-10-05T15:35:04.771230+0000","last_clean":"2023-10-05T15:35:04.771230+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:35:04.771230+0000","last_undegraded":"2023-10-05T15:35:04.771230+0000","last_fullsized":"2023-10-05T15:35:04.771230+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":74,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:47.668753+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:35:47.668753+0000","last_peered":"2023-10-05T15:35:47.668753+0000","last_clean":"2023-10-05T15:35:47.668753+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:35:47.668753+0000","last_undegraded":"2023-10-05T15:35:47.668753+0000","last_fullsized":"2023-10-05T15:35:47.668753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774523+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:35:04.774523+0000","last_peered":"2023-10-05T15:35:04.774523+0000","last_clean":"2023-10-05T15:35:04.774523+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:35:04.774523+0000","last_undegraded":"2023-10-05T15:35:04.774523+0000","last_fullsized":"2023-10-05T15:35:04.774523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771525+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:35:04.771525+0000","last_peered":"2023-10-05T15:35:04.771525+0000","last_clean":"2023-10-05T15:35:04.771525+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:35:04.771525+0000","last_undegraded":"2023-10-05T15:35:04.771525+0000","last_fullsized":"2023-10-05T15:35:04.771525+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778711+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:35:04.778711+0000","last_peered":"2023-10-05T15:35:04.778711+0000","last_clean":"2023-10-05T15:35:04.778711+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:35:04.778711+0000","last_undegraded":"2023-10-05T15:35:04.778711+0000","last_fullsized":"2023-10-05T15:35:04.778711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778355+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:35:04.778355+0000","last_peered":"2023-10-05T15:35:04.778355+0000","last_clean":"2023-10-05T15:35:04.778355+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:35:04.778355+0000","last_undegraded":"2023-10-05T15:35:04.778355+0000","last_fullsized":"2023-10-05T15:35:04.778355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774714+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:35:04.774714+0000","last_peered":"2023-10-05T15:35:04.774714+0000","last_clean":"2023-10-05T15:35:04.774714+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:35:04.774714+0000","last_undegraded":"2023-10-05T15:35:04.774714+0000","last_fullsized":"2023-10-05T15:35:04.774714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774709+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:35:04.774709+0000","last_peered":"2023-10-05T15:35:04.774709+0000","last_clean":"2023-10-05T15:35:04.774709+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:35:04.774709+0000","last_undegraded":"2023-10-05T15:35:04.774709+0000","last_fullsized":"2023-10-05T15:35:04.774709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770492+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:35:04.770492+0000","last_peered":"2023-10-05T15:35:04.770492+0000","last_clean":"2023-10-05T15:35:04.770492+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:35:04.770492+0000","last_undegraded":"2023-10-05T15:35:04.770492+0000","last_fullsized":"2023-10-05T15:35:04.770492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773721+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:35:04.773721+0000","last_peered":"2023-10-05T15:35:04.773721+0000","last_clean":"2023-10-05T15:35:04.773721+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:35:04.773721+0000","last_undegraded":"2023-10-05T15:35:04.773721+0000","last_fullsized":"2023-10-05T15:35:04.773721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778164+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:35:04.778164+0000","last_peered":"2023-10-05T15:35:04.778164+0000","last_clean":"2023-10-05T15:35:04.778164+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:35:04.778164+0000","last_undegraded":"2023-10-05T15:35:04.778164+0000","last_fullsized":"2023-10-05T15:35:04.778164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777851+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:35:04.777851+0000","last_peered":"2023-10-05T15:35:04.777851+0000","last_clean":"2023-10-05T15:35:04.777851+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:35:04.777851+0000","last_undegraded":"2023-10-05T15:35:04.777851+0000","last_fullsized":"2023-10-05T15:35:04.777851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770807+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:35:04.770807+0000","last_peered":"2023-10-05T15:35:04.770807+0000","last_clean":"2023-10-05T15:35:04.770807+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:35:04.770807+0000","last_undegraded":"2023-10-05T15:35:04.770807+0000","last_fullsized":"2023-10-05T15:35:04.770807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":119,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:48.669352+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:35:48.669352+0000","last_peered":"2023-10-05T15:35:48.669352+0000","last_clean":"2023-10-05T15:35:48.669352+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:35:48.669352+0000","last_undegraded":"2023-10-05T15:35:48.669352+0000","last_fullsized":"2023-10-05T15:35:48.669352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779359+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:35:04.779359+0000","last_peered":"2023-10-05T15:35:04.779359+0000","last_clean":"2023-10-05T15:35:04.779359+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:35:04.779359+0000","last_undegraded":"2023-10-05T15:35:04.779359+0000","last_fullsized":"2023-10-05T15:35:04.779359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778463+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:35:04.778463+0000","last_peered":"2023-10-05T15:35:04.778463+0000","last_clean":"2023-10-05T15:35:04.778463+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:35:04.778463+0000","last_undegraded":"2023-10-05T15:35:04.778463+0000","last_fullsized":"2023-10-05T15:35:04.778463+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779000+0000","last_change":"2023-10-05T15:34:31.611897+0000","last_active":"2023-10-05T15:35:04.779000+0000","last_peered":"2023-10-05T15:35:04.779000+0000","last_clean":"2023-10-05T15:35:04.779000+0000","last_became_active":"2023-10-05T15:34:31.611550+0000","last_became_peered":"2023-10-05T15:34:31.611550+0000","last_unstale":"2023-10-05T15:35:04.779000+0000","last_undegraded":"2023-10-05T15:35:04.779000+0000","last_fullsized":"2023-10-05T15:35:04.779000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:21:00.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774268+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:35:04.774268+0000","last_peered":"2023-10-05T15:35:04.774268+0000","last_clean":"2023-10-05T15:35:04.774268+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:35:04.774268+0000","last_undegraded":"2023-10-05T15:35:04.774268+0000","last_fullsized":"2023-10-05T15:35:04.774268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773109+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:35:04.773109+0000","last_peered":"2023-10-05T15:35:04.773109+0000","last_clean":"2023-10-05T15:35:04.773109+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:35:04.773109+0000","last_undegraded":"2023-10-05T15:35:04.773109+0000","last_fullsized":"2023-10-05T15:35:04.773109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777649+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:35:04.777649+0000","last_peered":"2023-10-05T15:35:04.777649+0000","last_clean":"2023-10-05T15:35:04.777649+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:35:04.777649+0000","last_undegraded":"2023-10-05T15:35:04.777649+0000","last_fullsized":"2023-10-05T15:35:04.777649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.781201+0000","last_change":"2023-10-05T15:35:05.781201+0000","last_active":"2023-10-05T15:35:05.781201+0000","last_peered":"2023-10-05T15:35:05.781201+0000","last_clean":"2023-10-05T15:35:05.781201+0000","last_became_active":"2023-10-05T15:35:05.780760+0000","last_became_peered":"2023-10-05T15:35:05.780760+0000","last_unstale":"2023-10-05T15:35:05.781201+0000","last_undegraded":"2023-10-05T15:35:05.781201+0000","last_fullsized":"2023-10-05T15:35:05.781201+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:56:43.796707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777910+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:35:04.777910+0000","last_peered":"2023-10-05T15:35:04.777910+0000","last_clean":"2023-10-05T15:35:04.777910+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:35:04.777910+0000","last_undegraded":"2023-10-05T15:35:04.777910+0000","last_fullsized":"2023-10-05T15:35:04.777910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'33","reported_seq":154,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:48.680023+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:35:48.680023+0000","last_peered":"2023-10-05T15:35:48.680023+0000","last_clean":"2023-10-05T15:35:48.680023+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:35:48.680023+0000","last_undegraded":"2023-10-05T15:35:48.680023+0000","last_fullsized":"2023-10-05T15:35:48.680023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":109,"num_write":35,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775289+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:35:04.775289+0000","last_peered":"2023-10-05T15:35:04.775289+0000","last_clean":"2023-10-05T15:35:04.775289+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:35:04.775289+0000","last_undegraded":"2023-10-05T15:35:04.775289+0000","last_fullsized":"2023-10-05T15:35:04.775289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778090+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:35:04.778090+0000","last_peered":"2023-10-05T15:35:04.778090+0000","last_clean":"2023-10-05T15:35:04.778090+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:35:04.778090+0000","last_undegraded":"2023-10-05T15:35:04.778090+0000","last_fullsized":"2023-10-05T15:35:04.778090+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771192+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:35:04.771192+0000","last_peered":"2023-10-05T15:35:04.771192+0000","last_clean":"2023-10-05T15:35:04.771192+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:35:04.771192+0000","last_undegraded":"2023-10-05T15:35:04.771192+0000","last_fullsized":"2023-10-05T15:35:04.771192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774195+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:35:04.774195+0000","last_peered":"2023-10-05T15:35:04.774195+0000","last_clean":"2023-10-05T15:35:04.774195+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:35:04.774195+0000","last_undegraded":"2023-10-05T15:35:04.774195+0000","last_fullsized":"2023-10-05T15:35:04.774195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774764+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:35:04.774764+0000","last_peered":"2023-10-05T15:35:04.774764+0000","last_clean":"2023-10-05T15:35:04.774764+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:35:04.774764+0000","last_undegraded":"2023-10-05T15:35:04.774764+0000","last_fullsized":"2023-10-05T15:35:04.774764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777658+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:35:04.777658+0000","last_peered":"2023-10-05T15:35:04.777658+0000","last_clean":"2023-10-05T15:35:04.777658+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:35:04.777658+0000","last_undegraded":"2023-10-05T15:35:04.777658+0000","last_fullsized":"2023-10-05T15:35:04.777658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113316+0000","last_change":"2023-10-05T15:35:06.113316+0000","last_active":"2023-10-05T15:35:06.113316+0000","last_peered":"2023-10-05T15:35:06.113316+0000","last_clean":"2023-10-05T15:35:06.113316+0000","last_became_active":"2023-10-05T15:35:06.112866+0000","last_became_peered":"2023-10-05T15:35:06.112866+0000","last_unstale":"2023-10-05T15:35:06.113316+0000","last_undegraded":"2023-10-05T15:35:06.113316+0000","last_fullsized":"2023-10-05T15:35:06.113316+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:24:17.253672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778131+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:35:04.778131+0000","last_peered":"2023-10-05T15:35:04.778131+0000","last_clean":"2023-10-05T15:35:04.778131+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:35:04.778131+0000","last_undegraded":"2023-10-05T15:35:04.778131+0000","last_fullsized":"2023-10-05T15:35:04.778131+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:46.698937+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:35:46.698937+0000","last_peered":"2023-10-05T15:35:46.698937+0000","last_clean":"2023-10-05T15:35:46.698937+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:35:46.698937+0000","last_undegraded":"2023-10-05T15:35:46.698937+0000","last_fullsized":"2023-10-05T15:35:46.698937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779978+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:35:04.779978+0000","last_peered":"2023-10-05T15:35:04.779978+0000","last_clean":"2023-10-05T15:35:04.779978+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:35:04.779978+0000","last_undegraded":"2023-10-05T15:35:04.779978+0000","last_fullsized":"2023-10-05T15:35:04.779978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775871+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:35:04.775871+0000","last_peered":"2023-10-05T15:35:04.775871+0000","last_clean":"2023-10-05T15:35:04.775871+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:35:04.775871+0000","last_undegraded":"2023-10-05T15:35:04.775871+0000","last_fullsized":"2023-10-05T15:35:04.775871+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774079+0000","last_change":"2023-10-05T15:34:31.609929+0000","last_active":"2023-10-05T15:35:04.774079+0000","last_peered":"2023-10-05T15:35:04.774079+0000","last_clean":"2023-10-05T15:35:04.774079+0000","last_became_active":"2023-10-05T15:34:31.609604+0000","last_became_peered":"2023-10-05T15:34:31.609604+0000","last_unstale":"2023-10-05T15:35:04.774079+0000","last_undegraded":"2023-10-05T15:35:04.774079+0000","last_fullsized":"2023-10-05T15:35:04.774079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:12:46.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777387+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:35:04.777387+0000","last_peered":"2023-10-05T15:35:04.777387+0000","last_clean":"2023-10-05T15:35:04.777387+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:35:04.777387+0000","last_undegraded":"2023-10-05T15:35:04.777387+0000","last_fullsized":"2023-10-05T15:35:04.777387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777287+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:35:04.777287+0000","last_peered":"2023-10-05T15:35:04.777287+0000","last_clean":"2023-10-05T15:35:04.777287+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:35:04.777287+0000","last_undegraded":"2023-10-05T15:35:04.777287+0000","last_fullsized":"2023-10-05T15:35:04.777287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774915+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:35:04.774915+0000","last_peered":"2023-10-05T15:35:04.774915+0000","last_clean":"2023-10-05T15:35:04.774915+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:35:04.774915+0000","last_undegraded":"2023-10-05T15:35:04.774915+0000","last_fullsized":"2023-10-05T15:35:04.774915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774616+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:35:04.774616+0000","last_peered":"2023-10-05T15:35:04.774616+0000","last_clean":"2023-10-05T15:35:04.774616+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:35:04.774616+0000","last_undegraded":"2023-10-05T15:35:04.774616+0000","last_fullsized":"2023-10-05T15:35:04.774616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774419+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:35:04.774419+0000","last_peered":"2023-10-05T15:35:04.774419+0000","last_clean":"2023-10-05T15:35:04.774419+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:35:04.774419+0000","last_undegraded":"2023-10-05T15:35:04.774419+0000","last_fullsized":"2023-10-05T15:35:04.774419+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778514+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:35:04.778514+0000","last_peered":"2023-10-05T15:35:04.778514+0000","last_clean":"2023-10-05T15:35:04.778514+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:35:04.778514+0000","last_undegraded":"2023-10-05T15:35:04.778514+0000","last_fullsized":"2023-10-05T15:35:04.778514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779514+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:35:04.779514+0000","last_peered":"2023-10-05T15:35:04.779514+0000","last_clean":"2023-10-05T15:35:04.779514+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:35:04.779514+0000","last_undegraded":"2023-10-05T15:35:04.779514+0000","last_fullsized":"2023-10-05T15:35:04.779514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775141+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:35:04.775141+0000","last_peered":"2023-10-05T15:35:04.775141+0000","last_clean":"2023-10-05T15:35:04.775141+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:35:04.775141+0000","last_undegraded":"2023-10-05T15:35:04.775141+0000","last_fullsized":"2023-10-05T15:35:04.775141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":74,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:48.696455+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:35:48.696455+0000","last_peered":"2023-10-05T15:35:48.696455+0000","last_clean":"2023-10-05T15:35:48.696455+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:35:48.696455+0000","last_undegraded":"2023-10-05T15:35:48.696455+0000","last_fullsized":"2023-10-05T15:35:48.696455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779037+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:35:04.779037+0000","last_peered":"2023-10-05T15:35:04.779037+0000","last_clean":"2023-10-05T15:35:04.779037+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:35:04.779037+0000","last_undegraded":"2023-10-05T15:35:04.779037+0000","last_fullsized":"2023-10-05T15:35:04.779037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775681+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:35:04.775681+0000","last_peered":"2023-10-05T15:35:04.775681+0000","last_clean":"2023-10-05T15:35:04.775681+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:35:04.775681+0000","last_undegraded":"2023-10-05T15:35:04.775681+0000","last_fullsized":"2023-10-05T15:35:04.775681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778910+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:35:04.778910+0000","last_peered":"2023-10-05T15:35:04.778910+0000","last_clean":"2023-10-05T15:35:04.778910+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:35:04.778910+0000","last_undegraded":"2023-10-05T15:35:04.778910+0000","last_fullsized":"2023-10-05T15:35:04.778910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:47.699573+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:35:47.699573+0000","last_peered":"2023-10-05T15:35:47.699573+0000","last_clean":"2023-10-05T15:35:47.699573+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:35:47.699573+0000","last_undegraded":"2023-10-05T15:35:47.699573+0000","last_fullsized":"2023-10-05T15:35:47.699573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778400+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:35:04.778400+0000","last_peered":"2023-10-05T15:35:04.778400+0000","last_clean":"2023-10-05T15:35:04.778400+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:35:04.778400+0000","last_undegraded":"2023-10-05T15:35:04.778400+0000","last_fullsized":"2023-10-05T15:35:04.778400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770719+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:35:04.770719+0000","last_peered":"2023-10-05T15:35:04.770719+0000","last_clean":"2023-10-05T15:35:04.770719+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:35:04.770719+0000","last_undegraded":"2023-10-05T15:35:04.770719+0000","last_fullsized":"2023-10-05T15:35:04.770719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773009+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:35:04.773009+0000","last_peered":"2023-10-05T15:35:04.773009+0000","last_clean":"2023-10-05T15:35:04.773009+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:35:04.773009+0000","last_undegraded":"2023-10-05T15:35:04.773009+0000","last_fullsized":"2023-10-05T15:35:04.773009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":316,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779683+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:35:04.779683+0000","last_peered":"2023-10-05T15:35:04.779683+0000","last_clean":"2023-10-05T15:35:04.779683+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:35:04.779683+0000","last_undegraded":"2023-10-05T15:35:04.779683+0000","last_fullsized":"2023-10-05T15:35:04.779683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.112775+0000","last_change":"2023-10-05T15:35:06.112775+0000","last_active":"2023-10-05T15:35:06.112775+0000","last_peered":"2023-10-05T15:35:06.112775+0000","last_clean":"2023-10-05T15:35:06.112775+0000","last_became_active":"2023-10-05T15:35:06.112332+0000","last_became_peered":"2023-10-05T15:35:06.112332+0000","last_unstale":"2023-10-05T15:35:06.112775+0000","last_undegraded":"2023-10-05T15:35:06.112775+0000","last_fullsized":"2023-10-05T15:35:06.112775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:22.225861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774485+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:35:04.774485+0000","last_peered":"2023-10-05T15:35:04.774485+0000","last_clean":"2023-10-05T15:35:04.774485+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:35:04.774485+0000","last_undegraded":"2023-10-05T15:35:04.774485+0000","last_fullsized":"2023-10-05T15:35:04.774485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779868+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:35:04.779868+0000","last_peered":"2023-10-05T15:35:04.779868+0000","last_clean":"2023-10-05T15:35:04.779868+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:35:04.779868+0000","last_undegraded":"2023-10-05T15:35:04.779868+0000","last_fullsized":"2023-10-05T15:35:04.779868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774247+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:35:04.774247+0000","last_peered":"2023-10-05T15:35:04.774247+0000","last_clean":"2023-10-05T15:35:04.774247+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:35:04.774247+0000","last_undegraded":"2023-10-05T15:35:04.774247+0000","last_fullsized":"2023-10-05T15:35:04.774247+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775368+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:35:04.775368+0000","last_peered":"2023-10-05T15:35:04.775368+0000","last_clean":"2023-10-05T15:35:04.775368+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:35:04.775368+0000","last_undegraded":"2023-10-05T15:35:04.775368+0000","last_fullsized":"2023-10-05T15:35:04.775368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775296+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:35:04.775296+0000","last_peered":"2023-10-05T15:35:04.775296+0000","last_clean":"2023-10-05T15:35:04.775296+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:35:04.775296+0000","last_undegraded":"2023-10-05T15:35:04.775296+0000","last_fullsized":"2023-10-05T15:35:04.775296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770405+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:35:04.770405+0000","last_peered":"2023-10-05T15:35:04.770405+0000","last_clean":"2023-10-05T15:35:04.770405+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:35:04.770405+0000","last_undegraded":"2023-10-05T15:35:04.770405+0000","last_fullsized":"2023-10-05T15:35:04.770405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.658802+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:35:06.658802+0000","last_peered":"2023-10-05T15:35:06.658802+0000","last_clean":"2023-10-05T15:35:06.658802+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:35:06.658802+0000","last_undegraded":"2023-10-05T15:35:06.658802+0000","last_fullsized":"2023-10-05T15:35:06.658802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771291+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:35:04.771291+0000","last_peered":"2023-10-05T15:35:04.771291+0000","last_clean":"2023-10-05T15:35:04.771291+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:35:04.771291+0000","last_undegraded":"2023-10-05T15:35:04.771291+0000","last_fullsized":"2023-10-05T15:35:04.771291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770849+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:35:04.770849+0000","last_peered":"2023-10-05T15:35:04.770849+0000","last_clean":"2023-10-05T15:35:04.770849+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:35:04.770849+0000","last_undegraded":"2023-10-05T15:35:04.770849+0000","last_fullsized":"2023-10-05T15:35:04.770849+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774157+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:35:04.774157+0000","last_peered":"2023-10-05T15:35:04.774157+0000","last_clean":"2023-10-05T15:35:04.774157+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:35:04.774157+0000","last_undegraded":"2023-10-05T15:35:04.774157+0000","last_fullsized":"2023-10-05T15:35:04.774157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773914+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:35:04.773914+0000","last_peered":"2023-10-05T15:35:04.773914+0000","last_clean":"2023-10-05T15:35:04.773914+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:35:04.773914+0000","last_undegraded":"2023-10-05T15:35:04.773914+0000","last_fullsized":"2023-10-05T15:35:04.773914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773466+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:35:04.773466+0000","last_peered":"2023-10-05T15:35:04.773466+0000","last_clean":"2023-10-05T15:35:04.773466+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:35:04.773466+0000","last_undegraded":"2023-10-05T15:35:04.773466+0000","last_fullsized":"2023-10-05T15:35:04.773466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778008+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:35:04.778008+0000","last_peered":"2023-10-05T15:35:04.778008+0000","last_clean":"2023-10-05T15:35:04.778008+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:35:04.778008+0000","last_undegraded":"2023-10-05T15:35:04.778008+0000","last_fullsized":"2023-10-05T15:35:04.778008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774213+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:35:04.774213+0000","last_peered":"2023-10-05T15:35:04.774213+0000","last_clean":"2023-10-05T15:35:04.774213+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:35:04.774213+0000","last_undegraded":"2023-10-05T15:35:04.774213+0000","last_fullsized":"2023-10-05T15:35:04.774213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778680+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:35:04.778680+0000","last_peered":"2023-10-05T15:35:04.778680+0000","last_clean":"2023-10-05T15:35:04.778680+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:35:04.778680+0000","last_undegraded":"2023-10-05T15:35:04.778680+0000","last_fullsized":"2023-10-05T15:35:04.778680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770695+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:35:04.770695+0000","last_peered":"2023-10-05T15:35:04.770695+0000","last_clean":"2023-10-05T15:35:04.770695+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:35:04.770695+0000","last_undegraded":"2023-10-05T15:35:04.770695+0000","last_fullsized":"2023-10-05T15:35:04.770695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774829+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:35:04.774829+0000","last_peered":"2023-10-05T15:35:04.774829+0000","last_clean":"2023-10-05T15:35:04.774829+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:35:04.774829+0000","last_undegraded":"2023-10-05T15:35:04.774829+0000","last_fullsized":"2023-10-05T15:35:04.774829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.959978+0000","last_change":"2023-10-05T15:35:05.959978+0000","last_active":"2023-10-05T15:35:05.959978+0000","last_peered":"2023-10-05T15:35:05.959978+0000","last_clean":"2023-10-05T15:35:05.959978+0000","last_became_active":"2023-10-05T15:35:05.954464+0000","last_became_peered":"2023-10-05T15:35:05.954464+0000","last_unstale":"2023-10-05T15:35:05.959978+0000","last_undegraded":"2023-10-05T15:35:05.959978+0000","last_fullsized":"2023-10-05T15:35:05.959978+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:31:05.392741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771225+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:35:04.771225+0000","last_peered":"2023-10-05T15:35:04.771225+0000","last_clean":"2023-10-05T15:35:04.771225+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:35:04.771225+0000","last_undegraded":"2023-10-05T15:35:04.771225+0000","last_fullsized":"2023-10-05T15:35:04.771225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771648+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:35:04.771648+0000","last_peered":"2023-10-05T15:35:04.771648+0000","last_clean":"2023-10-05T15:35:04.771648+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:35:04.771648+0000","last_undegraded":"2023-10-05T15:35:04.771648+0000","last_fullsized":"2023-10-05T15:35:04.771648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773783+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:35:04.773783+0000","last_peered":"2023-10-05T15:35:04.773783+0000","last_clean":"2023-10-05T15:35:04.773783+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:35:04.773783+0000","last_undegraded":"2023-10-05T15:35:04.773783+0000","last_fullsized":"2023-10-05T15:35:04.773783+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774639+0000","last_change":"2023-10-05T15:34:31.604468+0000","last_active":"2023-10-05T15:35:04.774639+0000","last_peered":"2023-10-05T15:35:04.774639+0000","last_clean":"2023-10-05T15:35:04.774639+0000","last_became_active":"2023-10-05T15:34:31.604107+0000","last_became_peered":"2023-10-05T15:34:31.604107+0000","last_unstale":"2023-10-05T15:35:04.774639+0000","last_undegraded":"2023-10-05T15:35:04.774639+0000","last_fullsized":"2023-10-05T15:35:04.774639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:57:10.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.780145+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:35:04.780145+0000","last_peered":"2023-10-05T15:35:04.780145+0000","last_clean":"2023-10-05T15:35:04.780145+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:35:04.780145+0000","last_undegraded":"2023-10-05T15:35:04.780145+0000","last_fullsized":"2023-10-05T15:35:04.780145+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778494+0000","last_change":"2023-10-05T15:34:36.668436+0000","last_active":"2023-10-05T15:35:04.778494+0000","last_peered":"2023-10-05T15:35:04.778494+0000","last_clean":"2023-10-05T15:35:04.778494+0000","last_became_active":"2023-10-05T15:34:36.668002+0000","last_became_peered":"2023-10-05T15:34:36.668002+0000","last_unstale":"2023-10-05T15:35:04.778494+0000","last_undegraded":"2023-10-05T15:35:04.778494+0000","last_fullsized":"2023-10-05T15:35:04.778494+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:27:55.706225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":75,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:47.668860+0000","last_change":"2023-10-05T15:34:31.612135+0000","last_active":"2023-10-05T15:35:47.668860+0000","last_peered":"2023-10-05T15:35:47.668860+0000","last_clean":"2023-10-05T15:35:47.668860+0000","last_became_active":"2023-10-05T15:34:31.611686+0000","last_became_peered":"2023-10-05T15:34:31.611686+0000","last_unstale":"2023-10-05T15:35:47.668860+0000","last_undegraded":"2023-10-05T15:35:47.668860+0000","last_fullsized":"2023-10-05T15:35:47.668860+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:38:43.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778794+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:35:04.778794+0000","last_peered":"2023-10-05T15:35:04.778794+0000","last_clean":"2023-10-05T15:35:04.778794+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:35:04.778794+0000","last_undegraded":"2023-10-05T15:35:04.778794+0000","last_fullsized":"2023-10-05T15:35:04.778794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773767+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:35:04.773767+0000","last_peered":"2023-10-05T15:35:04.773767+0000","last_clean":"2023-10-05T15:35:04.773767+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:35:04.773767+0000","last_undegraded":"2023-10-05T15:35:04.773767+0000","last_fullsized":"2023-10-05T15:35:04.773767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777892+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:35:04.777892+0000","last_peered":"2023-10-05T15:35:04.777892+0000","last_clean":"2023-10-05T15:35:04.777892+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:35:04.777892+0000","last_undegraded":"2023-10-05T15:35:04.777892+0000","last_fullsized":"2023-10-05T15:35:04.777892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778505+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:35:04.778505+0000","last_peered":"2023-10-05T15:35:04.778505+0000","last_clean":"2023-10-05T15:35:04.778505+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:35:04.778505+0000","last_undegraded":"2023-10-05T15:35:04.778505+0000","last_fullsized":"2023-10-05T15:35:04.778505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.776999+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:35:04.776999+0000","last_peered":"2023-10-05T15:35:04.776999+0000","last_clean":"2023-10-05T15:35:04.776999+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:35:04.776999+0000","last_undegraded":"2023-10-05T15:35:04.776999+0000","last_fullsized":"2023-10-05T15:35:04.776999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775966+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:35:04.775966+0000","last_peered":"2023-10-05T15:35:04.775966+0000","last_clean":"2023-10-05T15:35:04.775966+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:35:04.775966+0000","last_undegraded":"2023-10-05T15:35:04.775966+0000","last_fullsized":"2023-10-05T15:35:04.775966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779284+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:35:04.779284+0000","last_peered":"2023-10-05T15:35:04.779284+0000","last_clean":"2023-10-05T15:35:04.779284+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:35:04.779284+0000","last_undegraded":"2023-10-05T15:35:04.779284+0000","last_fullsized":"2023-10-05T15:35:04.779284+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.959167+0000","last_change":"2023-10-05T15:35:05.959167+0000","last_active":"2023-10-05T15:35:05.959167+0000","last_peered":"2023-10-05T15:35:05.959167+0000","last_clean":"2023-10-05T15:35:05.959167+0000","last_became_active":"2023-10-05T15:35:05.958674+0000","last_became_peered":"2023-10-05T15:35:05.958674+0000","last_unstale":"2023-10-05T15:35:05.959167+0000","last_undegraded":"2023-10-05T15:35:05.959167+0000","last_fullsized":"2023-10-05T15:35:05.959167+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:55:03.244565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771113+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:35:04.771113+0000","last_peered":"2023-10-05T15:35:04.771113+0000","last_clean":"2023-10-05T15:35:04.771113+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:35:04.771113+0000","last_undegraded":"2023-10-05T15:35:04.771113+0000","last_fullsized":"2023-10-05T15:35:04.771113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771097+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:35:04.771097+0000","last_peered":"2023-10-05T15:35:04.771097+0000","last_clean":"2023-10-05T15:35:04.771097+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:35:04.771097+0000","last_undegraded":"2023-10-05T15:35:04.771097+0000","last_fullsized":"2023-10-05T15:35:04.771097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774023+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:35:04.774023+0000","last_peered":"2023-10-05T15:35:04.774023+0000","last_clean":"2023-10-05T15:35:04.774023+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:35:04.774023+0000","last_undegraded":"2023-10-05T15:35:04.774023+0000","last_fullsized":"2023-10-05T15:35:04.774023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775326+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:35:04.775326+0000","last_peered":"2023-10-05T15:35:04.775326+0000","last_clean":"2023-10-05T15:35:04.775326+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:35:04.775326+0000","last_undegraded":"2023-10-05T15:35:04.775326+0000","last_fullsized":"2023-10-05T15:35:04.775326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774349+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:35:04.774349+0000","last_peered":"2023-10-05T15:35:04.774349+0000","last_clean":"2023-10-05T15:35:04.774349+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:35:04.774349+0000","last_undegraded":"2023-10-05T15:35:04.774349+0000","last_fullsized":"2023-10-05T15:35:04.774349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.772122+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:35:04.772122+0000","last_peered":"2023-10-05T15:35:04.772122+0000","last_clean":"2023-10-05T15:35:04.772122+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:35:04.772122+0000","last_undegraded":"2023-10-05T15:35:04.772122+0000","last_fullsized":"2023-10-05T15:35:04.772122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113556+0000","last_change":"2023-10-05T15:35:06.113556+0000","last_active":"2023-10-05T15:35:06.113556+0000","last_peered":"2023-10-05T15:35:06.113556+0000","last_clean":"2023-10-05T15:35:06.113556+0000","last_became_active":"2023-10-05T15:35:06.113152+0000","last_became_peered":"2023-10-05T15:35:06.113152+0000","last_unstale":"2023-10-05T15:35:06.113556+0000","last_undegraded":"2023-10-05T15:35:06.113556+0000","last_fullsized":"2023-10-05T15:35:06.113556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:48.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778270+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:35:04.778270+0000","last_peered":"2023-10-05T15:35:04.778270+0000","last_clean":"2023-10-05T15:35:04.778270+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:35:04.778270+0000","last_undegraded":"2023-10-05T15:35:04.778270+0000","last_fullsized":"2023-10-05T15:35:04.778270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770604+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:35:04.770604+0000","last_peered":"2023-10-05T15:35:04.770604+0000","last_clean":"2023-10-05T15:35:04.770604+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:35:04.770604+0000","last_undegraded":"2023-10-05T15:35:04.770604+0000","last_fullsized":"2023-10-05T15:35:04.770604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778723+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:35:04.778723+0000","last_peered":"2023-10-05T15:35:04.778723+0000","last_clean":"2023-10-05T15:35:04.778723+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:35:04.778723+0000","last_undegraded":"2023-10-05T15:35:04.778723+0000","last_fullsized":"2023-10-05T15:35:04.778723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774832+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:35:04.774832+0000","last_peered":"2023-10-05T15:35:04.774832+0000","last_clean":"2023-10-05T15:35:04.774832+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:35:04.774832+0000","last_undegraded":"2023-10-05T15:35:04.774832+0000","last_fullsized":"2023-10-05T15:35:04.774832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774875+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:35:04.774875+0000","last_peered":"2023-10-05T15:35:04.774875+0000","last_clean":"2023-10-05T15:35:04.774875+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:35:04.774875+0000","last_undegraded":"2023-10-05T15:35:04.774875+0000","last_fullsized":"2023-10-05T15:35:04.774875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66116,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":516,"num_read_kb":331,"num_write":236,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":504376,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82599999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.79700000000000004,"15min":0.77900000000000003},"min":{"1min":0.59599999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.103,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.878},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.038},"last":0.751}]},{"osd":2,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":1.0620000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.034}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.67300000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95199999999999996,"5min":1.135,"15min":1.135},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1639999999999999,"5min":1.204,"15min":1.204},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0840000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0069999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.93200000000000005,"15min":0.92100000000000004},"min":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.242,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.69799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.155,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.1579999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.1339999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.88800000000000001},"min":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0960000000000001,"5min":1.722,"15min":1.722},"last":1.018},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1,"15min":0.998},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3009999999999999,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.097}]},{"osd":10,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94099999999999995,"15min":0.94199999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2649999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.196},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2849999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":1.056}]}]},{"osd":10,"up_from":73,"seq":313532612643,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1153871,"data_compressed":53855,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.746,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":1.145,"15min":1.145},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1040000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.085,"15min":1.085},"last":0.629}]},{"osd":3,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80300000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.83599999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78100000000000003,"5min":1.292,"15min":1.292},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96199999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0620000000000001,"5min":1.111,"15min":1.111},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.90900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0029999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.89000000000000001,"15min":0.91900000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.169,"15min":1.169},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.92300000000000004,"15min":0.95599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92100000000000004,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0249999999999999,"5min":1.264,"15min":1.264},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.95599999999999996,"15min":0.97299999999999998},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.097,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.83999999999999997}]},{"osd":9,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":1.014,"15min":1.048},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99299999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.97199999999999998,"15min":0.996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.165,"5min":1.55,"15min":1.55},"last":0.79900000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.74299999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":0.85699999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776168,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":503916,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99399999999999999,"5min":1.343,"15min":1.343},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82599999999999996,"15min":0.83499999999999996},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.085,"5min":1.109,"15min":1.109},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.71999999999999997,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0309999999999999,"5min":1.258,"15min":1.258},"last":0.624}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76000000000000001,"15min":0.78300000000000003},"min":{"1min":0.46500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.054,"5min":1.391,"15min":1.391},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.97899999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.012,"15min":1.038},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.89200000000000002,"15min":0.91200000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98799999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:35:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.82799999999999996}]}]},{"osd":8,"up_from":60,"seq":257698037804,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":504294,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56899999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1060000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.499},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0669999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.621}]},{"osd":2,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":1.04,"15min":1.04},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.004}]},{"osd":4,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.099,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.111,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.872},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.056,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.163,"5min":1.252,"15min":1.252},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3939999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1279999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94899999999999995,"15min":0.97499999999999998},"min":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.75700000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.032},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2729999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0649999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.75800000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.194,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90200000000000002},"min":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.79400000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:35:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.0509999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1100400,"data_compressed":53855,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.622,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5749999999999993,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.316},{"interface":"front","average":{"1min":1.103,"5min":0.65500000000000003,"15min":0.57099999999999995},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.9950000000000001,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.76800000000000002,"15min":0.71799999999999997},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.5309999999999997,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.80800000000000005,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":8.2840000000000007,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":8.5370000000000008,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.79500000000000004,"15min":0.75700000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.3289999999999997,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.5}]},{"osd":4,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":0.88700000000000001,"15min":0.80800000000000005},"min":{"1min":0.56599999999999995,"5min":0.5,"15min":0.5},"max":{"1min":8.609,"5min":8.609,"15min":8.609},"last":0.751}]},{"osd":6,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.4699999999999998,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1739999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48199999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:35:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":0.92700000000000005,"15min":0.873},"min":{"1min":0.72199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":6.5300000000000002,"5min":6.5300000000000002,"15min":6.5300000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1339999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.63600000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.123,"5min":1.28,"15min":1.28},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.3400000000000001,"5min":0.96899999999999997,"15min":0.90700000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":8.3219999999999992,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":0.69999999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0129999999999999,"15min":1.03},"min":{"1min":0.68799999999999994,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0620000000000001,"15min":1.0049999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:35:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.7249999999999996,"5min":8.7249999999999996,"15min":8.7249999999999996},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.6230000000000002,"5min":6.6230000000000002,"15min":6.6230000000000002},"last":0.77200000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462968,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":499420,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.42999999999999999},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":2.6880000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51800000000000002,"15min":0.48099999999999998},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":2.2200000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.014,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.6259999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.71799999999999997,"15min":0.67000000000000004},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.385,"15min":1.385},"last":2.536}]},{"osd":2,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":2.3119999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.6759999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":2.5750000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78100000000000003,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.085,"5min":1.121,"15min":1.121},"last":1.7529999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.23,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":2.7240000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.84899999999999998,"15min":0.82499999999999996},"min":{"1min":0.65200000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":2.3599999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.80800000000000005,"15min":0.78400000000000003},"min":{"1min":0.66400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":2.3969999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.014,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.7150000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0640000000000001,"5min":1.365,"15min":1.365},"last":1.7949999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.877,"15min":0.86499999999999999},"min":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.107,"5min":1.444,"15min":1.444},"last":2.7650000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:46 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":2.9830000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.89100000000000001},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":2.617}]},{"osd":10,"last update":"Thu Oct 5 15:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.748,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1799999999999999,"5min":1.252,"15min":1.252},"last":2.6520000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96999999999999997},"min":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":2.4359999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":2.476},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.831}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":559754,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.68000000000000005,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.35799999999999998},"max":{"1min":6.391,"5min":6.391,"15min":6.391},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.81899999999999995,"5min":0.96099999999999997,"15min":1.083},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.65300000000000002,"15min":0.59899999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1499999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.64500000000000002,"15min":0.59099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0660000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:35:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67100000000000004,"15min":0.64500000000000002},"min":{"1min":0.48099999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91300000000000003,"5min":1.046,"15min":1.046},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70699999999999996,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92800000000000005,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.78100000000000003,"15min":0.73799999999999999},"min":{"1min":0.622,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.77200000000000002,"15min":0.748},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1499999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:35:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.746,"15min":0.71999999999999997},"min":{"1min":0.66100000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0960000000000001,"5min":1.538,"15min":1.538},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:34:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0600000000000001,"5min":1.51,"15min":1.51},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.046,"5min":1.381,"15min":1.381},"last":0.40500000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1279999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.68799999999999994,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.218,"5min":1.625,"15min":1.625},"last":0.73199999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.872},"min":{"1min":0.69499999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2130000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":6.0750000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88300000000000001,"15min":0.88600000000000001},"min":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0820000000000001,"5min":1.282,"15min":1.282},"last":0.50700000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.66500000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.236,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.92500000000000004},"min":{"1min":0.77300000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2849999999999999,"5min":1.609,"15min":1.609},"last":0.59299999999999997}]},{"osd":11,"last update":"Thu Oct 5 15:35:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.63100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501266,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:35:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.68300000000000005,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.70099999999999996,"15min":0.65100000000000002},"min":{"1min":0.56399999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67000000000000004,"15min":0.61799999999999999},"min":{"1min":0.44800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.026},"last":0.498}]},{"osd":3,"last update":"Thu Oct 5 15:35:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.044,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.755,"15min":0.69699999999999995},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.65700000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.026,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.70799999999999996},"min":{"1min":0.499,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.405,"5min":1.417,"15min":1.417},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.69399999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:35:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.88600000000000001,"15min":0.88800000000000001},"min":{"1min":0.73799999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.86699999999999999},"min":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.63700000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89700000000000002,"15min":0.89600000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.877,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.70699999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:35:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85499999999999998,"15min":0.84499999999999997},"min":{"1min":0.70699999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3839999999999999,"5min":1.538,"15min":1.538},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.038,"5min":0.97399999999999998,"15min":0.96299999999999997},"min":{"1min":0.79500000000000004,"5min":0.748,"15min":0.748},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.97199999999999998,"15min":0.95999999999999996},"min":{"1min":0.79800000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1579999999999999,"5min":1.534,"15min":1.534},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92400000000000004,"15min":0.91600000000000004},"min":{"1min":0.75800000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2889999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.71899999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":560364,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.503}]},{"osd":1,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71499999999999997,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.40899999999999997,"15min":0.378},"max":{"1min":1.0920000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.58699999999999997},"min":{"1min":0.504,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0169999999999999,"5min":1.075,"15min":1.075},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.51100000000000001},"min":{"1min":0.42699999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.76000000000000001,"15min":0.72499999999999998},"min":{"1min":0.60999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.77600000000000002,"15min":0.73999999999999999},"min":{"1min":0.69699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.94699999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:35:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.018},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.1240000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.88200000000000001,"15min":0.88500000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.82299999999999995,"15min":0.81499999999999995},"min":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.0089999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.86199999999999999,"15min":0.85199999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.89900000000000002,"15min":0.88700000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.077}]},{"osd":11,"last update":"Thu Oct 5 15:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.147}]}]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":499128,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.40999999999999998},"min":{"1min":0.33800000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72199999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.432},"min":{"1min":0.374,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69699999999999995,"15min":0.64900000000000002},"min":{"1min":0.53000000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93200000000000005,"5min":1.097,"15min":1.097},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.754,"15min":0.69799999999999995},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.014,"5min":1.109,"15min":1.109},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72599999999999998,"15min":0.70399999999999996},"min":{"1min":0.64800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81799999999999995,"15min":0.77000000000000002},"min":{"1min":0.72999999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.62}]},{"osd":5,"last update":"Thu Oct 5 15:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79900000000000004,"15min":0.76300000000000001},"min":{"1min":0.498,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.123,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":1.089,"15min":1.089},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.409,"15min":1.409},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2410000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.73399999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95199999999999996,"5min":1.105,"15min":1.105},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92100000000000004,"15min":0.92700000000000005},"min":{"1min":0.621,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.81299999999999994}]},{"osd":10,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.66600000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.042,"5min":1.198,"15min":1.198},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.99399999999999999,"15min":1},"min":{"1min":0.77200000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1970000000000001,"5min":1.331,"15min":1.331},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:35:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.754},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.83399999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888130,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":503494,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.437},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72699999999999998,"5min":1.526,"15min":1.526},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.498,"15min":0.44800000000000001},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71099999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71399999999999997,"15min":0.67200000000000004},"min":{"1min":0.60099999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.71999999999999997,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.103,"5min":0.75900000000000001,"15min":0.65100000000000002},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":8.9619999999999997,"5min":8.9619999999999997,"15min":8.9619999999999997},"last":0.629}]},{"osd":5,"last update":"Thu Oct 5 15:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1719999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78800000000000003,"15min":0.76300000000000001},"min":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.196,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2669999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.88800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57099999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6839999999999993,"5min":8.6839999999999993,"15min":8.6839999999999993},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:34:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69099999999999995,"15min":0.65200000000000002},"min":{"1min":0.59599999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99099999999999999,"5min":1.659,"15min":1.659},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.76200000000000001,"15min":0.72799999999999998},"min":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0389999999999999,"5min":1.591,"15min":1.591},"last":0.505}]},{"osd":8,"last update":"Thu Oct 5 15:35:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79100000000000004,"15min":0.76400000000000001},"min":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0329999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85399999999999998,"15min":0.82799999999999996},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3220000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0329999999999999,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":6.3789999999999996,"5min":6.3789999999999996,"15min":6.3789999999999996},"last":0.73799999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.88300000000000001,"15min":0.89900000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.99099999999999999,"15min":1.0049999999999999},"min":{"1min":0.72299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.248,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.57799999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.81499999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724604,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1089536,"data_stored":1095651,"data_compressed":53855,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":1.671,"15min":1.671},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98899999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.68700000000000006,"15min":0.65100000000000002},"min":{"1min":0.58999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97499999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.67900000000000005,"15min":0.65500000000000003},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47399999999999998},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51700000000000002,"15min":0.48299999999999998},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83199999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.623}]},{"osd":3,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.69199999999999995,"15min":0.66500000000000004},"min":{"1min":0.54000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.88900000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71899999999999997,"15min":0.69199999999999995},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.72099999999999997,"15min":0.68500000000000005},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.103},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78100000000000003,"15min":0.753},"min":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.997}]},{"osd":7,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.042},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.79600000000000004,"15min":0.77200000000000002},"min":{"1min":0.68500000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.94199999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:35:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.71799999999999997,"15min":0.70199999999999996},"min":{"1min":0.56999999999999995,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.76800000000000002,"15min":0.746},"min":{"1min":0.58599999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.147}]},{"osd":9,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.89200000000000002},"min":{"1min":0.67900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.85799999999999998},"min":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.073}]},{"osd":10,"last update":"Thu Oct 5 15:35:13 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.83299999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.246},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.90200000000000002,"15min":0.88800000000000001},"min":{"1min":0.745,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.123}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:35:52.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-05T15:35:52.955 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:52 smithi167 ceph-mon[133366]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:52 smithi079 ceph-mon[132936]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:53.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:52 smithi017 ceph-mon[129107]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:53.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:53 smithi017 ceph-mon[129107]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:53 smithi167 ceph-mon[133366]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:53 smithi079 ceph-mon[132936]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:54.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 -- 172.21.15.17:0/2704086598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 msgr2=0x7ff48810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:54.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 --2- 172.21.15.17:0/2704086598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff48810ddb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff480009fc0 tx=0x7ff48000b330 comp rx=0 tx=0).stop 2023-10-05T15:35:54.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 -- 172.21.15.17:0/2704086598 shutdown_connections 2023-10-05T15:35:54.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 --2- 172.21.15.17:0/2704086598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff48810ddb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 --2- 172.21.15.17:0/2704086598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 0x7ff488107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 --2- 172.21.15.17:0/2704086598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff488100f80 0x7ff488101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 -- 172.21.15.17:0/2704086598 >> 172.21.15.17:0/2704086598 conn(0x7ff4880780a0 msgr2=0x7ff4880784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:54.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 -- 172.21.15.17:0/2704086598 shutdown_connections 2023-10-05T15:35:54.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.740+0000 7ff48cb28700 1 -- 172.21.15.17:0/2704086598 wait complete. 2023-10-05T15:35:54.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.741+0000 7ff48cb28700 1 Processor -- start 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.741+0000 7ff48cb28700 1 -- start start 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.741+0000 7ff48cb28700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff488100f80 0x7ff4880731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff48cb28700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff4880736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff48cb28700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 0x7ff488073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff48cb28700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881a54b0 con 0x7ff488101940 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff48cb28700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881a5620 con 0x7ff488106f90 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff48cb28700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881a57e0 con 0x7ff488100f80 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff4880736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff4880736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59812/0 (socket says 172.21.15.17:59812) 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 -- 172.21.15.17:0/3465717889 learned_addr learned my addr 172.21.15.17:0/3465717889 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:54.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff48659c700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff488100f80 0x7ff4880731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff486d9d700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 0x7ff488073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 -- 172.21.15.17:0/3465717889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff488100f80 msgr2=0x7ff4880731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff488100f80 0x7ff4880731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 -- 172.21.15.17:0/3465717889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 msgr2=0x7ff488073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 0x7ff488073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff485d9b700 1 -- 172.21.15.17:0/3465717889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009c40 con 0x7ff488101940 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.742+0000 7ff486d9d700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 0x7ff488073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.743+0000 7ff485d9b700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff4880736f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00e9a0 tx=0x7ff47c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.743+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c009790 con 0x7ff488101940 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.743+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff47c00cbd0 con 0x7ff488101940 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.743+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4881a5ac0 con 0x7ff488101940 2023-10-05T15:35:54.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.743+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00eee0 con 0x7ff488101940 2023-10-05T15:35:54.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.743+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881a6010 con 0x7ff488101940 2023-10-05T15:35:54.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.744+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48804ebb0 con 0x7ff488101940 2023-10-05T15:35:54.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.746+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7ff47c00cd40 con 0x7ff488101940 2023-10-05T15:35:54.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.747+0000 7ff4777fe700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4700a1590 0x7ff4700a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:54.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.747+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff47c014070 con 0x7ff488101940 2023-10-05T15:35:54.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.748+0000 7ff48659c700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4700a1590 0x7ff4700a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:54.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.748+0000 7ff48659c700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4700a1590 0x7ff4700a3a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff478005fd0 tx=0x7ff478009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:54.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.752+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff47c096550 con 0x7ff488101940 2023-10-05T15:35:54.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.957+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff488110fa0 con 0x7ff4700a1590 2023-10-05T15:35:54.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.970+0000 7ff4777fe700 1 -- 172.21.15.17:0/3465717889 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426808 (secure 0 0 0) 0x7ff488110fa0 con 0x7ff4700a1590 2023-10-05T15:35:54.979 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4700a1590 msgr2=0x7ff4700a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4700a1590 0x7ff4700a3a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff478005fd0 tx=0x7ff478009310 comp rx=0 tx=0).stop 2023-10-05T15:35:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 msgr2=0x7ff4880736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff4880736f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00e9a0 tx=0x7ff47c00ed60 comp rx=0 tx=0).stop 2023-10-05T15:35:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 shutdown_connections 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4700a1590 0x7ff4700a3a50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff488106f90 0x7ff488073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff488100f80 0x7ff4880731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 --2- 172.21.15.17:0/3465717889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff488101940 0x7ff4880736f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 >> 172.21.15.17:0/3465717889 conn(0x7ff4880780a0 msgr2=0x7ff4880ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 shutdown_connections 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:54.977+0000 7ff48cb28700 1 -- 172.21.15.17:0/3465717889 wait complete. 2023-10-05T15:35:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:35:55.551 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-10-05T15:35:54.599592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656730,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":682,"num_read_kb":460,"num_write":419,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336624,"kb_used_data":12384,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605200,"statfs":{"total":1151940427776,"available":1151595724800,"internally_reserved":0,"allocated":12681216,"data_stored":7985934,"data_compressed":320487,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003129"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775077+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:35:04.775077+0000","last_peered":"2023-10-05T15:35:04.775077+0000","last_clean":"2023-10-05T15:35:04.775077+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:35:04.775077+0000","last_undegraded":"2023-10-05T15:35:04.775077+0000","last_fullsized":"2023-10-05T15:35:04.775077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773833+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:35:04.773833+0000","last_peered":"2023-10-05T15:35:04.773833+0000","last_clean":"2023-10-05T15:35:04.773833+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:35:04.773833+0000","last_undegraded":"2023-10-05T15:35:04.773833+0000","last_fullsized":"2023-10-05T15:35:04.773833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774011+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:35:04.774011+0000","last_peered":"2023-10-05T15:35:04.774011+0000","last_clean":"2023-10-05T15:35:04.774011+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:35:04.774011+0000","last_undegraded":"2023-10-05T15:35:04.774011+0000","last_fullsized":"2023-10-05T15:35:04.774011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774235+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:35:04.774235+0000","last_peered":"2023-10-05T15:35:04.774235+0000","last_clean":"2023-10-05T15:35:04.774235+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:35:04.774235+0000","last_undegraded":"2023-10-05T15:35:04.774235+0000","last_fullsized":"2023-10-05T15:35:04.774235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113534+0000","last_change":"2023-10-05T15:35:06.113534+0000","last_active":"2023-10-05T15:35:06.113534+0000","last_peered":"2023-10-05T15:35:06.113534+0000","last_clean":"2023-10-05T15:35:06.113534+0000","last_became_active":"2023-10-05T15:35:06.113092+0000","last_became_peered":"2023-10-05T15:35:06.113092+0000","last_unstale":"2023-10-05T15:35:06.113534+0000","last_undegraded":"2023-10-05T15:35:06.113534+0000","last_fullsized":"2023-10-05T15:35:06.113534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:35:36.334844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778797+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:35:04.778797+0000","last_peered":"2023-10-05T15:35:04.778797+0000","last_clean":"2023-10-05T15:35:04.778797+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:35:04.778797+0000","last_undegraded":"2023-10-05T15:35:04.778797+0000","last_fullsized":"2023-10-05T15:35:04.778797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.781929+0000","last_change":"2023-10-05T15:35:05.781929+0000","last_active":"2023-10-05T15:35:05.781929+0000","last_peered":"2023-10-05T15:35:05.781929+0000","last_clean":"2023-10-05T15:35:05.781929+0000","last_became_active":"2023-10-05T15:35:05.781552+0000","last_became_peered":"2023-10-05T15:35:05.781552+0000","last_unstale":"2023-10-05T15:35:05.781929+0000","last_undegraded":"2023-10-05T15:35:05.781929+0000","last_fullsized":"2023-10-05T15:35:05.781929+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:28:34.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770315+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:35:04.770315+0000","last_peered":"2023-10-05T15:35:04.770315+0000","last_clean":"2023-10-05T15:35:04.770315+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:35:04.770315+0000","last_undegraded":"2023-10-05T15:35:04.770315+0000","last_fullsized":"2023-10-05T15:35:04.770315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779600+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:35:04.779600+0000","last_peered":"2023-10-05T15:35:04.779600+0000","last_clean":"2023-10-05T15:35:04.779600+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:35:04.779600+0000","last_undegraded":"2023-10-05T15:35:04.779600+0000","last_fullsized":"2023-10-05T15:35:04.779600+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.780091+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:35:04.780091+0000","last_peered":"2023-10-05T15:35:04.780091+0000","last_clean":"2023-10-05T15:35:04.780091+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:35:04.780091+0000","last_undegraded":"2023-10-05T15:35:04.780091+0000","last_fullsized":"2023-10-05T15:35:04.780091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778589+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:35:04.778589+0000","last_peered":"2023-10-05T15:35:04.778589+0000","last_clean":"2023-10-05T15:35:04.778589+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:35:04.778589+0000","last_undegraded":"2023-10-05T15:35:04.778589+0000","last_fullsized":"2023-10-05T15:35:04.778589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774117+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:35:04.774117+0000","last_peered":"2023-10-05T15:35:04.774117+0000","last_clean":"2023-10-05T15:35:04.774117+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:35:04.774117+0000","last_undegraded":"2023-10-05T15:35:04.774117+0000","last_fullsized":"2023-10-05T15:35:04.774117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774920+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:35:04.774920+0000","last_peered":"2023-10-05T15:35:04.774920+0000","last_clean":"2023-10-05T15:35:04.774920+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:35:04.774920+0000","last_undegraded":"2023-10-05T15:35:04.774920+0000","last_fullsized":"2023-10-05T15:35:04.774920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773611+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:35:04.773611+0000","last_peered":"2023-10-05T15:35:04.773611+0000","last_clean":"2023-10-05T15:35:04.773611+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:35:04.773611+0000","last_undegraded":"2023-10-05T15:35:04.773611+0000","last_fullsized":"2023-10-05T15:35:04.773611+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.959005+0000","last_change":"2023-10-05T15:35:05.959005+0000","last_active":"2023-10-05T15:35:05.959005+0000","last_peered":"2023-10-05T15:35:05.959005+0000","last_clean":"2023-10-05T15:35:05.959005+0000","last_became_active":"2023-10-05T15:35:05.958666+0000","last_became_peered":"2023-10-05T15:35:05.958666+0000","last_unstale":"2023-10-05T15:35:05.959005+0000","last_undegraded":"2023-10-05T15:35:05.959005+0000","last_fullsized":"2023-10-05T15:35:05.959005+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:58:50.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777901+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:35:04.777901+0000","last_peered":"2023-10-05T15:35:04.777901+0000","last_clean":"2023-10-05T15:35:04.777901+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:35:04.777901+0000","last_undegraded":"2023-10-05T15:35:04.777901+0000","last_fullsized":"2023-10-05T15:35:04.777901+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774835+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:35:04.774835+0000","last_peered":"2023-10-05T15:35:04.774835+0000","last_clean":"2023-10-05T15:35:04.774835+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:35:04.774835+0000","last_undegraded":"2023-10-05T15:35:04.774835+0000","last_fullsized":"2023-10-05T15:35:04.774835+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778415+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:35:04.778415+0000","last_peered":"2023-10-05T15:35:04.778415+0000","last_clean":"2023-10-05T15:35:04.778415+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:35:04.778415+0000","last_undegraded":"2023-10-05T15:35:04.778415+0000","last_fullsized":"2023-10-05T15:35:04.778415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771802+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:35:04.771802+0000","last_peered":"2023-10-05T15:35:04.771802+0000","last_clean":"2023-10-05T15:35:04.771802+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:35:04.771802+0000","last_undegraded":"2023-10-05T15:35:04.771802+0000","last_fullsized":"2023-10-05T15:35:04.771802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771362+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:35:04.771362+0000","last_peered":"2023-10-05T15:35:04.771362+0000","last_clean":"2023-10-05T15:35:04.771362+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:35:04.771362+0000","last_undegraded":"2023-10-05T15:35:04.771362+0000","last_fullsized":"2023-10-05T15:35:04.771362+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":86,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:52.702516+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:35:52.702516+0000","last_peered":"2023-10-05T15:35:52.702516+0000","last_clean":"2023-10-05T15:35:52.702516+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:35:52.702516+0000","last_undegraded":"2023-10-05T15:35:52.702516+0000","last_fullsized":"2023-10-05T15:35:52.702516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771175+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:35:04.771175+0000","last_peered":"2023-10-05T15:35:04.771175+0000","last_clean":"2023-10-05T15:35:04.771175+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:35:04.771175+0000","last_undegraded":"2023-10-05T15:35:04.771175+0000","last_fullsized":"2023-10-05T15:35:04.771175+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113477+0000","last_change":"2023-10-05T15:35:06.113477+0000","last_active":"2023-10-05T15:35:06.113477+0000","last_peered":"2023-10-05T15:35:06.113477+0000","last_clean":"2023-10-05T15:35:06.113477+0000","last_became_active":"2023-10-05T15:35:06.112876+0000","last_became_peered":"2023-10-05T15:35:06.112876+0000","last_unstale":"2023-10-05T15:35:06.113477+0000","last_undegraded":"2023-10-05T15:35:06.113477+0000","last_fullsized":"2023-10-05T15:35:06.113477+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:41:51.762182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771198+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:35:04.771198+0000","last_peered":"2023-10-05T15:35:04.771198+0000","last_clean":"2023-10-05T15:35:04.771198+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:35:04.771198+0000","last_undegraded":"2023-10-05T15:35:04.771198+0000","last_fullsized":"2023-10-05T15:35:04.771198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774268+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:35:04.774268+0000","last_peered":"2023-10-05T15:35:04.774268+0000","last_clean":"2023-10-05T15:35:04.774268+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:35:04.774268+0000","last_undegraded":"2023-10-05T15:35:04.774268+0000","last_fullsized":"2023-10-05T15:35:04.774268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.772902+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:35:04.772902+0000","last_peered":"2023-10-05T15:35:04.772902+0000","last_clean":"2023-10-05T15:35:04.772902+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:35:04.772902+0000","last_undegraded":"2023-10-05T15:35:04.772902+0000","last_fullsized":"2023-10-05T15:35:04.772902+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"92'12","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.772410+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:35:05.772410+0000","last_peered":"2023-10-05T15:35:05.772410+0000","last_clean":"2023-10-05T15:35:05.772410+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:35:05.772410+0000","last_undegraded":"2023-10-05T15:35:05.772410+0000","last_fullsized":"2023-10-05T15:35:05.772410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.780625+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:35:04.780625+0000","last_peered":"2023-10-05T15:35:04.780625+0000","last_clean":"2023-10-05T15:35:04.780625+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:35:04.780625+0000","last_undegraded":"2023-10-05T15:35:04.780625+0000","last_fullsized":"2023-10-05T15:35:04.780625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773941+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:35:04.773941+0000","last_peered":"2023-10-05T15:35:04.773941+0000","last_clean":"2023-10-05T15:35:04.773941+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:35:04.773941+0000","last_undegraded":"2023-10-05T15:35:04.773941+0000","last_fullsized":"2023-10-05T15:35:04.773941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775027+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:35:04.775027+0000","last_peered":"2023-10-05T15:35:04.775027+0000","last_clean":"2023-10-05T15:35:04.775027+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:35:04.775027+0000","last_undegraded":"2023-10-05T15:35:04.775027+0000","last_fullsized":"2023-10-05T15:35:04.775027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777827+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:35:04.777827+0000","last_peered":"2023-10-05T15:35:04.777827+0000","last_clean":"2023-10-05T15:35:04.777827+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:35:04.777827+0000","last_undegraded":"2023-10-05T15:35:04.777827+0000","last_fullsized":"2023-10-05T15:35:04.777827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771230+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:35:04.771230+0000","last_peered":"2023-10-05T15:35:04.771230+0000","last_clean":"2023-10-05T15:35:04.771230+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:35:04.771230+0000","last_undegraded":"2023-10-05T15:35:04.771230+0000","last_fullsized":"2023-10-05T15:35:04.771230+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":79,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:52.675589+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:35:52.675589+0000","last_peered":"2023-10-05T15:35:52.675589+0000","last_clean":"2023-10-05T15:35:52.675589+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:35:52.675589+0000","last_undegraded":"2023-10-05T15:35:52.675589+0000","last_fullsized":"2023-10-05T15:35:52.675589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774523+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:35:04.774523+0000","last_peered":"2023-10-05T15:35:04.774523+0000","last_clean":"2023-10-05T15:35:04.774523+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:35:04.774523+0000","last_undegraded":"2023-10-05T15:35:04.774523+0000","last_fullsized":"2023-10-05T15:35:04.774523+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771525+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:35:04.771525+0000","last_peered":"2023-10-05T15:35:04.771525+0000","last_clean":"2023-10-05T15:35:04.771525+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:35:04.771525+0000","last_undegraded":"2023-10-05T15:35:04.771525+0000","last_fullsized":"2023-10-05T15:35:04.771525+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778711+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:35:04.778711+0000","last_peered":"2023-10-05T15:35:04.778711+0000","last_clean":"2023-10-05T15:35:04.778711+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:35:04.778711+0000","last_undegraded":"2023-10-05T15:35:04.778711+0000","last_fullsized":"2023-10-05T15:35:04.778711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778355+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:35:04.778355+0000","last_peered":"2023-10-05T15:35:04.778355+0000","last_clean":"2023-10-05T15:35:04.778355+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:35:04.778355+0000","last_undegraded":"2023-10-05T15:35:04.778355+0000","last_fullsized":"2023-10-05T15:35:04.778355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774714+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:35:04.774714+0000","last_peered":"2023-10-05T15:35:04.774714+0000","last_clean":"2023-10-05T15:35:04.774714+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:35:04.774714+0000","last_undegraded":"2023-10-05T15:35:04.774714+0000","last_fullsized":"2023-10-05T15:35:04.774714+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774709+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:35:04.774709+0000","last_peered":"2023-10-05T15:35:04.774709+0000","last_clean":"2023-10-05T15:35:04.774709+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:35:04.774709+0000","last_undegraded":"2023-10-05T15:35:04.774709+0000","last_fullsized":"2023-10-05T15:35:04.774709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770492+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:35:04.770492+0000","last_peered":"2023-10-05T15:35:04.770492+0000","last_clean":"2023-10-05T15:35:04.770492+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:35:04.770492+0000","last_undegraded":"2023-10-05T15:35:04.770492+0000","last_fullsized":"2023-10-05T15:35:04.770492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773721+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:35:04.773721+0000","last_peered":"2023-10-05T15:35:04.773721+0000","last_clean":"2023-10-05T15:35:04.773721+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:35:04.773721+0000","last_undegraded":"2023-10-05T15:35:04.773721+0000","last_fullsized":"2023-10-05T15:35:04.773721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778164+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:35:04.778164+0000","last_peered":"2023-10-05T15:35:04.778164+0000","last_clean":"2023-10-05T15:35:04.778164+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:35:04.778164+0000","last_undegraded":"2023-10-05T15:35:04.778164+0000","last_fullsized":"2023-10-05T15:35:04.778164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777851+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:35:04.777851+0000","last_peered":"2023-10-05T15:35:04.777851+0000","last_clean":"2023-10-05T15:35:04.777851+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:35:04.777851+0000","last_undegraded":"2023-10-05T15:35:04.777851+0000","last_fullsized":"2023-10-05T15:35:04.777851+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770807+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:35:04.770807+0000","last_peered":"2023-10-05T15:35:04.770807+0000","last_clean":"2023-10-05T15:35:04.770807+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:35:04.770807+0000","last_undegraded":"2023-10-05T15:35:04.770807+0000","last_fullsized":"2023-10-05T15:35:04.770807+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":129,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:53.676278+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:35:53.676278+0000","last_peered":"2023-10-05T15:35:53.676278+0000","last_clean":"2023-10-05T15:35:53.676278+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:35:53.676278+0000","last_undegraded":"2023-10-05T15:35:53.676278+0000","last_fullsized":"2023-10-05T15:35:53.676278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779359+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:35:04.779359+0000","last_peered":"2023-10-05T15:35:04.779359+0000","last_clean":"2023-10-05T15:35:04.779359+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:35:04.779359+0000","last_undegraded":"2023-10-05T15:35:04.779359+0000","last_fullsized":"2023-10-05T15:35:04.779359+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778463+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:35:04.778463+0000","last_peered":"2023-10-05T15:35:04.778463+0000","last_clean":"2023-10-05T15:35:04.778463+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:35:04.778463+0000","last_undegraded":"2023-10-05T15:35:04.778463+0000","last_fullsized":"2023-10-05T15:35:04.778463+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779000+0000","last_change":"2023-10-05T15:34:31.611897+0000","last_active":"2023-10-05T15:35:04.779000+0000","last_peered":"2023-10-05T15:35:04.779000+0000","last_clean":"2023-10-05T15:35:04.779000+0000","last_became_active":"2023-10-05T15:34:31.611550+0000","last_became_peered":"2023-10-05T15:34:31.611550+0000","last_unstale":"2023-10-05T15:35:04.779000+0000","last_undegraded":"2023-10-05T15:35:04.779000+0000","last_fullsized":"2023-10-05T15:35:04.779000+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:21:00.656555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774268+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:35:04.774268+0000","last_peered":"2023-10-05T15:35:04.774268+0000","last_clean":"2023-10-05T15:35:04.774268+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:35:04.774268+0000","last_undegraded":"2023-10-05T15:35:04.774268+0000","last_fullsized":"2023-10-05T15:35:04.774268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773109+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:35:04.773109+0000","last_peered":"2023-10-05T15:35:04.773109+0000","last_clean":"2023-10-05T15:35:04.773109+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:35:04.773109+0000","last_undegraded":"2023-10-05T15:35:04.773109+0000","last_fullsized":"2023-10-05T15:35:04.773109+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777649+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:35:04.777649+0000","last_peered":"2023-10-05T15:35:04.777649+0000","last_clean":"2023-10-05T15:35:04.777649+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:35:04.777649+0000","last_undegraded":"2023-10-05T15:35:04.777649+0000","last_fullsized":"2023-10-05T15:35:04.777649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.781201+0000","last_change":"2023-10-05T15:35:05.781201+0000","last_active":"2023-10-05T15:35:05.781201+0000","last_peered":"2023-10-05T15:35:05.781201+0000","last_clean":"2023-10-05T15:35:05.781201+0000","last_became_active":"2023-10-05T15:35:05.780760+0000","last_became_peered":"2023-10-05T15:35:05.780760+0000","last_unstale":"2023-10-05T15:35:05.781201+0000","last_undegraded":"2023-10-05T15:35:05.781201+0000","last_fullsized":"2023-10-05T15:35:05.781201+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:56:43.796707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777910+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:35:04.777910+0000","last_peered":"2023-10-05T15:35:04.777910+0000","last_clean":"2023-10-05T15:35:04.777910+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:35:04.777910+0000","last_undegraded":"2023-10-05T15:35:04.777910+0000","last_fullsized":"2023-10-05T15:35:04.777910+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'33","reported_seq":164,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:53.686702+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:35:53.686702+0000","last_peered":"2023-10-05T15:35:53.686702+0000","last_clean":"2023-10-05T15:35:53.686702+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:35:53.686702+0000","last_undegraded":"2023-10-05T15:35:53.686702+0000","last_fullsized":"2023-10-05T15:35:53.686702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":112,"num_read_kb":114,"num_write":35,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775289+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:35:04.775289+0000","last_peered":"2023-10-05T15:35:04.775289+0000","last_clean":"2023-10-05T15:35:04.775289+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:35:04.775289+0000","last_undegraded":"2023-10-05T15:35:04.775289+0000","last_fullsized":"2023-10-05T15:35:04.775289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778090+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:35:04.778090+0000","last_peered":"2023-10-05T15:35:04.778090+0000","last_clean":"2023-10-05T15:35:04.778090+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:35:04.778090+0000","last_undegraded":"2023-10-05T15:35:04.778090+0000","last_fullsized":"2023-10-05T15:35:04.778090+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771192+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:35:04.771192+0000","last_peered":"2023-10-05T15:35:04.771192+0000","last_clean":"2023-10-05T15:35:04.771192+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:35:04.771192+0000","last_undegraded":"2023-10-05T15:35:04.771192+0000","last_fullsized":"2023-10-05T15:35:04.771192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774195+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:35:04.774195+0000","last_peered":"2023-10-05T15:35:04.774195+0000","last_clean":"2023-10-05T15:35:04.774195+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:35:04.774195+0000","last_undegraded":"2023-10-05T15:35:04.774195+0000","last_fullsized":"2023-10-05T15:35:04.774195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774764+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:35:04.774764+0000","last_peered":"2023-10-05T15:35:04.774764+0000","last_clean":"2023-10-05T15:35:04.774764+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:35:04.774764+0000","last_undegraded":"2023-10-05T15:35:04.774764+0000","last_fullsized":"2023-10-05T15:35:04.774764+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777658+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:35:04.777658+0000","last_peered":"2023-10-05T15:35:04.777658+0000","last_clean":"2023-10-05T15:35:04.777658+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:35:04.777658+0000","last_undegraded":"2023-10-05T15:35:04.777658+0000","last_fullsized":"2023-10-05T15:35:04.777658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113316+0000","last_change":"2023-10-05T15:35:06.113316+0000","last_active":"2023-10-05T15:35:06.113316+0000","last_peered":"2023-10-05T15:35:06.113316+0000","last_clean":"2023-10-05T15:35:06.113316+0000","last_became_active":"2023-10-05T15:35:06.112866+0000","last_became_peered":"2023-10-05T15:35:06.112866+0000","last_unstale":"2023-10-05T15:35:06.113316+0000","last_undegraded":"2023-10-05T15:35:06.113316+0000","last_fullsized":"2023-10-05T15:35:06.113316+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:24:17.253672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778131+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:35:04.778131+0000","last_peered":"2023-10-05T15:35:04.778131+0000","last_clean":"2023-10-05T15:35:04.778131+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:35:04.778131+0000","last_undegraded":"2023-10-05T15:35:04.778131+0000","last_fullsized":"2023-10-05T15:35:04.778131+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:51.704624+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:35:51.704624+0000","last_peered":"2023-10-05T15:35:51.704624+0000","last_clean":"2023-10-05T15:35:51.704624+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:35:51.704624+0000","last_undegraded":"2023-10-05T15:35:51.704624+0000","last_fullsized":"2023-10-05T15:35:51.704624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779978+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:35:04.779978+0000","last_peered":"2023-10-05T15:35:04.779978+0000","last_clean":"2023-10-05T15:35:04.779978+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:35:04.779978+0000","last_undegraded":"2023-10-05T15:35:04.779978+0000","last_fullsized":"2023-10-05T15:35:04.779978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775871+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:35:04.775871+0000","last_peered":"2023-10-05T15:35:04.775871+0000","last_clean":"2023-10-05T15:35:04.775871+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:35:04.775871+0000","last_undegraded":"2023-10-05T15:35:04.775871+0000","last_fullsized":"2023-10-05T15:35:04.775871+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774079+0000","last_change":"2023-10-05T15:34:31.609929+0000","last_active":"2023-10-05T15:35:04.774079+0000","last_peered":"2023-10-05T15:35:04.774079+0000","last_clean":"2023-10-05T15:35:04.774079+0000","last_became_active":"2023-10-05T15:34:31.609604+0000","last_became_peered":"2023-10-05T15:34:31.609604+0000","last_unstale":"2023-10-05T15:35:04.774079+0000","last_undegraded":"2023-10-05T15:35:04.774079+0000","last_fullsized":"2023-10-05T15:35:04.774079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:12:46.964828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777387+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:35:04.777387+0000","last_peered":"2023-10-05T15:35:04.777387+0000","last_clean":"2023-10-05T15:35:04.777387+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:35:04.777387+0000","last_undegraded":"2023-10-05T15:35:04.777387+0000","last_fullsized":"2023-10-05T15:35:04.777387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777287+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:35:04.777287+0000","last_peered":"2023-10-05T15:35:04.777287+0000","last_clean":"2023-10-05T15:35:04.777287+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:35:04.777287+0000","last_undegraded":"2023-10-05T15:35:04.777287+0000","last_fullsized":"2023-10-05T15:35:04.777287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774915+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:35:04.774915+0000","last_peered":"2023-10-05T15:35:04.774915+0000","last_clean":"2023-10-05T15:35:04.774915+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:35:04.774915+0000","last_undegraded":"2023-10-05T15:35:04.774915+0000","last_fullsized":"2023-10-05T15:35:04.774915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774616+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:35:04.774616+0000","last_peered":"2023-10-05T15:35:04.774616+0000","last_clean":"2023-10-05T15:35:04.774616+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:35:04.774616+0000","last_undegraded":"2023-10-05T15:35:04.774616+0000","last_fullsized":"2023-10-05T15:35:04.774616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774419+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:35:04.774419+0000","last_peered":"2023-10-05T15:35:04.774419+0000","last_clean":"2023-10-05T15:35:04.774419+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:35:04.774419+0000","last_undegraded":"2023-10-05T15:35:04.774419+0000","last_fullsized":"2023-10-05T15:35:04.774419+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778514+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:35:04.778514+0000","last_peered":"2023-10-05T15:35:04.778514+0000","last_clean":"2023-10-05T15:35:04.778514+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:35:04.778514+0000","last_undegraded":"2023-10-05T15:35:04.778514+0000","last_fullsized":"2023-10-05T15:35:04.778514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779514+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:35:04.779514+0000","last_peered":"2023-10-05T15:35:04.779514+0000","last_clean":"2023-10-05T15:35:04.779514+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:35:04.779514+0000","last_undegraded":"2023-10-05T15:35:04.779514+0000","last_fullsized":"2023-10-05T15:35:04.779514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775141+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:35:04.775141+0000","last_peered":"2023-10-05T15:35:04.775141+0000","last_clean":"2023-10-05T15:35:04.775141+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:35:04.775141+0000","last_undegraded":"2023-10-05T15:35:04.775141+0000","last_fullsized":"2023-10-05T15:35:04.775141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":74,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:48.696455+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:35:48.696455+0000","last_peered":"2023-10-05T15:35:48.696455+0000","last_clean":"2023-10-05T15:35:48.696455+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:35:48.696455+0000","last_undegraded":"2023-10-05T15:35:48.696455+0000","last_fullsized":"2023-10-05T15:35:48.696455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779037+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:35:04.779037+0000","last_peered":"2023-10-05T15:35:04.779037+0000","last_clean":"2023-10-05T15:35:04.779037+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:35:04.779037+0000","last_undegraded":"2023-10-05T15:35:04.779037+0000","last_fullsized":"2023-10-05T15:35:04.779037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775681+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:35:04.775681+0000","last_peered":"2023-10-05T15:35:04.775681+0000","last_clean":"2023-10-05T15:35:04.775681+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:35:04.775681+0000","last_undegraded":"2023-10-05T15:35:04.775681+0000","last_fullsized":"2023-10-05T15:35:04.775681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778910+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:35:04.778910+0000","last_peered":"2023-10-05T15:35:04.778910+0000","last_clean":"2023-10-05T15:35:04.778910+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:35:04.778910+0000","last_undegraded":"2023-10-05T15:35:04.778910+0000","last_fullsized":"2023-10-05T15:35:04.778910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":73,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:47.699573+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:35:47.699573+0000","last_peered":"2023-10-05T15:35:47.699573+0000","last_clean":"2023-10-05T15:35:47.699573+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:35:47.699573+0000","last_undegraded":"2023-10-05T15:35:47.699573+0000","last_fullsized":"2023-10-05T15:35:47.699573+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778400+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:35:04.778400+0000","last_peered":"2023-10-05T15:35:04.778400+0000","last_clean":"2023-10-05T15:35:04.778400+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:35:04.778400+0000","last_undegraded":"2023-10-05T15:35:04.778400+0000","last_fullsized":"2023-10-05T15:35:04.778400+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770719+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:35:04.770719+0000","last_peered":"2023-10-05T15:35:04.770719+0000","last_clean":"2023-10-05T15:35:04.770719+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:35:04.770719+0000","last_undegraded":"2023-10-05T15:35:04.770719+0000","last_fullsized":"2023-10-05T15:35:04.770719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773009+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:35:04.773009+0000","last_peered":"2023-10-05T15:35:04.773009+0000","last_clean":"2023-10-05T15:35:04.773009+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:35:04.773009+0000","last_undegraded":"2023-10-05T15:35:04.773009+0000","last_fullsized":"2023-10-05T15:35:04.773009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":316,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779683+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:35:04.779683+0000","last_peered":"2023-10-05T15:35:04.779683+0000","last_clean":"2023-10-05T15:35:04.779683+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:35:04.779683+0000","last_undegraded":"2023-10-05T15:35:04.779683+0000","last_fullsized":"2023-10-05T15:35:04.779683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.112775+0000","last_change":"2023-10-05T15:35:06.112775+0000","last_active":"2023-10-05T15:35:06.112775+0000","last_peered":"2023-10-05T15:35:06.112775+0000","last_clean":"2023-10-05T15:35:06.112775+0000","last_became_active":"2023-10-05T15:35:06.112332+0000","last_became_peered":"2023-10-05T15:35:06.112332+0000","last_unstale":"2023-10-05T15:35:06.112775+0000","last_undegraded":"2023-10-05T15:35:06.112775+0000","last_fullsized":"2023-10-05T15:35:06.112775+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:22.225861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774485+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:35:04.774485+0000","last_peered":"2023-10-05T15:35:04.774485+0000","last_clean":"2023-10-05T15:35:04.774485+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:35:04.774485+0000","last_undegraded":"2023-10-05T15:35:04.774485+0000","last_fullsized":"2023-10-05T15:35:04.774485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779868+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:35:04.779868+0000","last_peered":"2023-10-05T15:35:04.779868+0000","last_clean":"2023-10-05T15:35:04.779868+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:35:04.779868+0000","last_undegraded":"2023-10-05T15:35:04.779868+0000","last_fullsized":"2023-10-05T15:35:04.779868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774247+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:35:04.774247+0000","last_peered":"2023-10-05T15:35:04.774247+0000","last_clean":"2023-10-05T15:35:04.774247+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:35:04.774247+0000","last_undegraded":"2023-10-05T15:35:04.774247+0000","last_fullsized":"2023-10-05T15:35:04.774247+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775368+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:35:04.775368+0000","last_peered":"2023-10-05T15:35:04.775368+0000","last_clean":"2023-10-05T15:35:04.775368+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:35:04.775368+0000","last_undegraded":"2023-10-05T15:35:04.775368+0000","last_fullsized":"2023-10-05T15:35:04.775368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775296+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:35:04.775296+0000","last_peered":"2023-10-05T15:35:04.775296+0000","last_clean":"2023-10-05T15:35:04.775296+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:35:04.775296+0000","last_undegraded":"2023-10-05T15:35:04.775296+0000","last_fullsized":"2023-10-05T15:35:04.775296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770405+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:35:04.770405+0000","last_peered":"2023-10-05T15:35:04.770405+0000","last_clean":"2023-10-05T15:35:04.770405+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:35:04.770405+0000","last_undegraded":"2023-10-05T15:35:04.770405+0000","last_fullsized":"2023-10-05T15:35:04.770405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'10","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.658802+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:35:06.658802+0000","last_peered":"2023-10-05T15:35:06.658802+0000","last_clean":"2023-10-05T15:35:06.658802+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:35:06.658802+0000","last_undegraded":"2023-10-05T15:35:06.658802+0000","last_fullsized":"2023-10-05T15:35:06.658802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771291+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:35:04.771291+0000","last_peered":"2023-10-05T15:35:04.771291+0000","last_clean":"2023-10-05T15:35:04.771291+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:35:04.771291+0000","last_undegraded":"2023-10-05T15:35:04.771291+0000","last_fullsized":"2023-10-05T15:35:04.771291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770849+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:35:04.770849+0000","last_peered":"2023-10-05T15:35:04.770849+0000","last_clean":"2023-10-05T15:35:04.770849+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:35:04.770849+0000","last_undegraded":"2023-10-05T15:35:04.770849+0000","last_fullsized":"2023-10-05T15:35:04.770849+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774157+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:35:04.774157+0000","last_peered":"2023-10-05T15:35:04.774157+0000","last_clean":"2023-10-05T15:35:04.774157+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:35:04.774157+0000","last_undegraded":"2023-10-05T15:35:04.774157+0000","last_fullsized":"2023-10-05T15:35:04.774157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773914+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:35:04.773914+0000","last_peered":"2023-10-05T15:35:04.773914+0000","last_clean":"2023-10-05T15:35:04.773914+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:35:04.773914+0000","last_undegraded":"2023-10-05T15:35:04.773914+0000","last_fullsized":"2023-10-05T15:35:04.773914+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773466+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:35:04.773466+0000","last_peered":"2023-10-05T15:35:04.773466+0000","last_clean":"2023-10-05T15:35:04.773466+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:35:04.773466+0000","last_undegraded":"2023-10-05T15:35:04.773466+0000","last_fullsized":"2023-10-05T15:35:04.773466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778008+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:35:04.778008+0000","last_peered":"2023-10-05T15:35:04.778008+0000","last_clean":"2023-10-05T15:35:04.778008+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:35:04.778008+0000","last_undegraded":"2023-10-05T15:35:04.778008+0000","last_fullsized":"2023-10-05T15:35:04.778008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774213+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:35:04.774213+0000","last_peered":"2023-10-05T15:35:04.774213+0000","last_clean":"2023-10-05T15:35:04.774213+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:35:04.774213+0000","last_undegraded":"2023-10-05T15:35:04.774213+0000","last_fullsized":"2023-10-05T15:35:04.774213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778680+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:35:04.778680+0000","last_peered":"2023-10-05T15:35:04.778680+0000","last_clean":"2023-10-05T15:35:04.778680+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:35:04.778680+0000","last_undegraded":"2023-10-05T15:35:04.778680+0000","last_fullsized":"2023-10-05T15:35:04.778680+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770695+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:35:04.770695+0000","last_peered":"2023-10-05T15:35:04.770695+0000","last_clean":"2023-10-05T15:35:04.770695+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:35:04.770695+0000","last_undegraded":"2023-10-05T15:35:04.770695+0000","last_fullsized":"2023-10-05T15:35:04.770695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774829+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:35:04.774829+0000","last_peered":"2023-10-05T15:35:04.774829+0000","last_clean":"2023-10-05T15:35:04.774829+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:35:04.774829+0000","last_undegraded":"2023-10-05T15:35:04.774829+0000","last_fullsized":"2023-10-05T15:35:04.774829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.959978+0000","last_change":"2023-10-05T15:35:05.959978+0000","last_active":"2023-10-05T15:35:05.959978+0000","last_peered":"2023-10-05T15:35:05.959978+0000","last_clean":"2023-10-05T15:35:05.959978+0000","last_became_active":"2023-10-05T15:35:05.954464+0000","last_became_peered":"2023-10-05T15:35:05.954464+0000","last_unstale":"2023-10-05T15:35:05.959978+0000","last_undegraded":"2023-10-05T15:35:05.959978+0000","last_fullsized":"2023-10-05T15:35:05.959978+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:31:05.392741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771225+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:35:04.771225+0000","last_peered":"2023-10-05T15:35:04.771225+0000","last_clean":"2023-10-05T15:35:04.771225+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:35:04.771225+0000","last_undegraded":"2023-10-05T15:35:04.771225+0000","last_fullsized":"2023-10-05T15:35:04.771225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771648+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:35:04.771648+0000","last_peered":"2023-10-05T15:35:04.771648+0000","last_clean":"2023-10-05T15:35:04.771648+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:35:04.771648+0000","last_undegraded":"2023-10-05T15:35:04.771648+0000","last_fullsized":"2023-10-05T15:35:04.771648+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773783+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:35:04.773783+0000","last_peered":"2023-10-05T15:35:04.773783+0000","last_clean":"2023-10-05T15:35:04.773783+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:35:04.773783+0000","last_undegraded":"2023-10-05T15:35:04.773783+0000","last_fullsized":"2023-10-05T15:35:04.773783+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774639+0000","last_change":"2023-10-05T15:34:31.604468+0000","last_active":"2023-10-05T15:35:04.774639+0000","last_peered":"2023-10-05T15:35:04.774639+0000","last_clean":"2023-10-05T15:35:04.774639+0000","last_became_active":"2023-10-05T15:34:31.604107+0000","last_became_peered":"2023-10-05T15:34:31.604107+0000","last_unstale":"2023-10-05T15:35:04.774639+0000","last_undegraded":"2023-10-05T15:35:04.774639+0000","last_fullsized":"2023-10-05T15:35:04.774639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:57:10.312982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.780145+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:35:04.780145+0000","last_peered":"2023-10-05T15:35:04.780145+0000","last_clean":"2023-10-05T15:35:04.780145+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:35:04.780145+0000","last_undegraded":"2023-10-05T15:35:04.780145+0000","last_fullsized":"2023-10-05T15:35:04.780145+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778494+0000","last_change":"2023-10-05T15:34:36.668436+0000","last_active":"2023-10-05T15:35:04.778494+0000","last_peered":"2023-10-05T15:35:04.778494+0000","last_clean":"2023-10-05T15:35:04.778494+0000","last_became_active":"2023-10-05T15:34:36.668002+0000","last_became_peered":"2023-10-05T15:34:36.668002+0000","last_unstale":"2023-10-05T15:35:04.778494+0000","last_undegraded":"2023-10-05T15:35:04.778494+0000","last_fullsized":"2023-10-05T15:35:04.778494+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:27:55.706225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'6","reported_seq":80,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:52.675643+0000","last_change":"2023-10-05T15:34:31.612135+0000","last_active":"2023-10-05T15:35:52.675643+0000","last_peered":"2023-10-05T15:35:52.675643+0000","last_clean":"2023-10-05T15:35:52.675643+0000","last_became_active":"2023-10-05T15:34:31.611686+0000","last_became_peered":"2023-10-05T15:34:31.611686+0000","last_unstale":"2023-10-05T15:35:52.675643+0000","last_undegraded":"2023-10-05T15:35:52.675643+0000","last_fullsized":"2023-10-05T15:35:52.675643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:38:43.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778794+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:35:04.778794+0000","last_peered":"2023-10-05T15:35:04.778794+0000","last_clean":"2023-10-05T15:35:04.778794+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:35:04.778794+0000","last_undegraded":"2023-10-05T15:35:04.778794+0000","last_fullsized":"2023-10-05T15:35:04.778794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.773767+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:35:04.773767+0000","last_peered":"2023-10-05T15:35:04.773767+0000","last_clean":"2023-10-05T15:35:04.773767+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:35:04.773767+0000","last_undegraded":"2023-10-05T15:35:04.773767+0000","last_fullsized":"2023-10-05T15:35:04.773767+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.777892+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:35:04.777892+0000","last_peered":"2023-10-05T15:35:04.777892+0000","last_clean":"2023-10-05T15:35:04.777892+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:35:04.777892+0000","last_undegraded":"2023-10-05T15:35:04.777892+0000","last_fullsized":"2023-10-05T15:35:04.777892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778505+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:35:04.778505+0000","last_peered":"2023-10-05T15:35:04.778505+0000","last_clean":"2023-10-05T15:35:04.778505+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:35:04.778505+0000","last_undegraded":"2023-10-05T15:35:04.778505+0000","last_fullsized":"2023-10-05T15:35:04.778505+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.776999+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:35:04.776999+0000","last_peered":"2023-10-05T15:35:04.776999+0000","last_clean":"2023-10-05T15:35:04.776999+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:35:04.776999+0000","last_undegraded":"2023-10-05T15:35:04.776999+0000","last_fullsized":"2023-10-05T15:35:04.776999+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775966+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:35:04.775966+0000","last_peered":"2023-10-05T15:35:04.775966+0000","last_clean":"2023-10-05T15:35:04.775966+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:35:04.775966+0000","last_undegraded":"2023-10-05T15:35:04.775966+0000","last_fullsized":"2023-10-05T15:35:04.775966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.779284+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:35:04.779284+0000","last_peered":"2023-10-05T15:35:04.779284+0000","last_clean":"2023-10-05T15:35:04.779284+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:35:04.779284+0000","last_undegraded":"2023-10-05T15:35:04.779284+0000","last_fullsized":"2023-10-05T15:35:04.779284+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:05.959167+0000","last_change":"2023-10-05T15:35:05.959167+0000","last_active":"2023-10-05T15:35:05.959167+0000","last_peered":"2023-10-05T15:35:05.959167+0000","last_clean":"2023-10-05T15:35:05.959167+0000","last_became_active":"2023-10-05T15:35:05.958674+0000","last_became_peered":"2023-10-05T15:35:05.958674+0000","last_unstale":"2023-10-05T15:35:05.959167+0000","last_undegraded":"2023-10-05T15:35:05.959167+0000","last_fullsized":"2023-10-05T15:35:05.959167+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:55:03.244565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771113+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:35:04.771113+0000","last_peered":"2023-10-05T15:35:04.771113+0000","last_clean":"2023-10-05T15:35:04.771113+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:35:04.771113+0000","last_undegraded":"2023-10-05T15:35:04.771113+0000","last_fullsized":"2023-10-05T15:35:04.771113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.771097+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:35:04.771097+0000","last_peered":"2023-10-05T15:35:04.771097+0000","last_clean":"2023-10-05T15:35:04.771097+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:35:04.771097+0000","last_undegraded":"2023-10-05T15:35:04.771097+0000","last_fullsized":"2023-10-05T15:35:04.771097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774023+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:35:04.774023+0000","last_peered":"2023-10-05T15:35:04.774023+0000","last_clean":"2023-10-05T15:35:04.774023+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:35:04.774023+0000","last_undegraded":"2023-10-05T15:35:04.774023+0000","last_fullsized":"2023-10-05T15:35:04.774023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.775326+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:35:04.775326+0000","last_peered":"2023-10-05T15:35:04.775326+0000","last_clean":"2023-10-05T15:35:04.775326+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:35:04.775326+0000","last_undegraded":"2023-10-05T15:35:04.775326+0000","last_fullsized":"2023-10-05T15:35:04.775326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774349+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:35:04.774349+0000","last_peered":"2023-10-05T15:35:04.774349+0000","last_clean":"2023-10-05T15:35:04.774349+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:35:04.774349+0000","last_undegraded":"2023-10-05T15:35:04.774349+0000","last_fullsized":"2023-10-05T15:35:04.774349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.772122+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:35:04.772122+0000","last_peered":"2023-10-05T15:35:04.772122+0000","last_clean":"2023-10-05T15:35:04.772122+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:35:04.772122+0000","last_undegraded":"2023-10-05T15:35:04.772122+0000","last_fullsized":"2023-10-05T15:35:04.772122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-10-05T15:35:06.113556+0000","last_change":"2023-10-05T15:35:06.113556+0000","last_active":"2023-10-05T15:35:06.113556+0000","last_peered":"2023-10-05T15:35:06.113556+0000","last_clean":"2023-10-05T15:35:06.113556+0000","last_became_active":"2023-10-05T15:35:06.113152+0000","last_became_peered":"2023-10-05T15:35:06.113152+0000","last_unstale":"2023-10-05T15:35:06.113556+0000","last_undegraded":"2023-10-05T15:35:06.113556+0000","last_fullsized":"2023-10-05T15:35:06.113556+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:48.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778270+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:35:04.778270+0000","last_peered":"2023-10-05T15:35:04.778270+0000","last_clean":"2023-10-05T15:35:04.778270+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:35:04.778270+0000","last_undegraded":"2023-10-05T15:35:04.778270+0000","last_fullsized":"2023-10-05T15:35:04.778270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.770604+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:35:04.770604+0000","last_peered":"2023-10-05T15:35:04.770604+0000","last_clean":"2023-10-05T15:35:04.770604+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:35:04.770604+0000","last_undegraded":"2023-10-05T15:35:04.770604+0000","last_fullsized":"2023-10-05T15:35:04.770604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.778723+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:35:04.778723+0000","last_peered":"2023-10-05T15:35:04.778723+0000","last_clean":"2023-10-05T15:35:04.778723+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:35:04.778723+0000","last_undegraded":"2023-10-05T15:35:04.778723+0000","last_fullsized":"2023-10-05T15:35:04.778723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774832+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:35:04.774832+0000","last_peered":"2023-10-05T15:35:04.774832+0000","last_clean":"2023-10-05T15:35:04.774832+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:35:04.774832+0000","last_undegraded":"2023-10-05T15:35:04.774832+0000","last_fullsized":"2023-10-05T15:35:04.774832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-05T15:35:04.774875+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:35:04.774875+0000","last_peered":"2023-10-05T15:35:04.774875+0000","last_clean":"2023-10-05T15:35:04.774875+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:35:04.774875+0000","last_undegraded":"2023-10-05T15:35:04.774875+0000","last_fullsized":"2023-10-05T15:35:04.774875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66116,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":556,"num_read_kb":351,"num_write":236,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":504376,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.875,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82599999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.79700000000000004,"15min":0.77900000000000003},"min":{"1min":0.59599999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.103,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98999999999999999,"5min":1.038,"15min":1.038},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63800000000000001,"15min":0.627},"min":{"1min":0.437,"5min":0.37,"15min":0.37},"max":{"1min":1.0620000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.83099999999999996,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.67300000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0600000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.875}]},{"osd":5,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.497,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95199999999999996,"5min":1.135,"15min":1.135},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.78000000000000003},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1639999999999999,"5min":1.204,"15min":1.204},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.83599999999999997,"15min":0.85499999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0840000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0069999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.93200000000000005,"15min":0.92100000000000004},"min":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.242,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.69799999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.155,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.76000000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.92700000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89000000000000001,"15min":0.88800000000000001},"min":{"1min":0.621,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.0960000000000001,"5min":1.722,"15min":1.722},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1,"15min":0.998},"min":{"1min":0.754,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3009999999999999,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.995}]},{"osd":10,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94099999999999995,"15min":0.94199999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2649999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.90400000000000003,"15min":0.89200000000000002},"min":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.2849999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.80100000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612644,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":1153871,"data_compressed":53855,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60399999999999998,"15min":0.61499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.746,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.69099999999999995,"15min":0.71299999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":1.145,"15min":1.145},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72299999999999998,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1040000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.877},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.085,"15min":1.085},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.77500000000000002,"15min":0.79900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80300000000000005,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.83599999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78100000000000003,"5min":1.292,"15min":1.292},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.78700000000000003,"15min":0.81100000000000005},"min":{"1min":0.39800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.92600000000000005,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96199999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0620000000000001,"5min":1.111,"15min":1.111},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.89500000000000002,"15min":0.90900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0029999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.89000000000000001,"15min":0.91900000000000004},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.94099999999999995,"5min":1.169,"15min":1.169},"last":0.747},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.92300000000000004,"15min":0.95599999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92100000000000004,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.98199999999999998,"15min":1.0049999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0249999999999999,"5min":1.264,"15min":1.264},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.95599999999999996,"15min":0.97299999999999998},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.097,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.92800000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":1.014,"15min":1.048},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99299999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.97199999999999998,"15min":0.996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.165,"5min":1.55,"15min":1.55},"last":0.90700000000000003}]},{"osd":11,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.74299999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.93500000000000005,"15min":0.93700000000000006},"min":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":0.85499999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776169,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":503916,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.433}]},{"osd":1,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99399999999999999,"5min":1.343,"15min":1.343},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82599999999999996,"15min":0.83499999999999996},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.085,"5min":1.109,"15min":1.109},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.71999999999999997,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0309999999999999,"5min":1.258,"15min":1.258},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76000000000000001,"15min":0.78300000000000003},"min":{"1min":0.46500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.054,"5min":1.391,"15min":1.391},"last":0.75}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":0.67200000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.83699999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.012,"15min":1.038},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.89200000000000002,"15min":0.91200000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98799999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Oct 5 15:35:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.86299999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037805,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1032192,"data_stored":504294,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69199999999999995,"15min":0.68999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.56899999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1060000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0669999999999999,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":1.04,"15min":1.04},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.004}]},{"osd":4,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.099,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.44},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89500000000000002,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.111,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76200000000000001,"15min":0.76300000000000001},"min":{"1min":0.49299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96699999999999997,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.42799999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.056,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.163,"5min":1.252,"15min":1.252},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3939999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.95499999999999996,"15min":0.96499999999999997},"min":{"1min":0.68100000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1279999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94899999999999995,"15min":0.97499999999999998},"min":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.78500000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:34:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.96499999999999997,"15min":0.96899999999999997},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.026,"15min":1.032},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.2729999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.81100000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.75800000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.194,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.91000000000000003,"15min":0.90200000000000002},"min":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.84199999999999997}]},{"osd":11,"last update":"Thu Oct 5 15:35:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.85799999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1100400,"data_compressed":53855,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.622,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":8.5749999999999993,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.316},{"interface":"front","average":{"1min":1.103,"5min":0.65500000000000003,"15min":0.57099999999999995},"min":{"1min":0.34200000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.9950000000000001,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.76800000000000002,"15min":0.71799999999999997},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.5309999999999997,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.2230000000000001,"5min":0.80800000000000005,"15min":0.72599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":8.2840000000000007,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.79800000000000004,"15min":0.71699999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":8.5370000000000008,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.79500000000000004,"15min":0.75700000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.3289999999999997,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.5}]},{"osd":4,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80700000000000005,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.095,"5min":1.127,"15min":1.127},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":0.88700000000000001,"15min":0.80800000000000005},"min":{"1min":0.56599999999999995,"5min":0.5,"15min":0.5},"max":{"1min":8.609,"5min":8.609,"15min":8.609},"last":0.751}]},{"osd":6,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.4699999999999998,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1739999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.48199999999999998}]},{"osd":8,"last update":"Thu Oct 5 15:35:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":0.92700000000000005,"15min":0.873},"min":{"1min":0.72199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":6.5300000000000002,"5min":6.5300000000000002,"15min":6.5300000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91000000000000003,"15min":0.90000000000000002},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1339999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.63600000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.91600000000000004,"15min":0.92600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.123,"5min":1.28,"15min":1.28},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.3400000000000001,"5min":0.96899999999999997,"15min":0.90700000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":8.3219999999999992,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":0.69999999999999996}]},{"osd":10,"last update":"Thu Oct 5 15:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0129999999999999,"15min":1.03},"min":{"1min":0.68799999999999994,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.26,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0620000000000001,"15min":1.0049999999999999},"min":{"1min":0.748,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.4990000000000006,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:35:33 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.7249999999999996,"5min":8.7249999999999996,"15min":8.7249999999999996},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":6.6230000000000002,"5min":6.6230000000000002,"15min":6.6230000000000002},"last":0.77200000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462968,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":499420,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.42999999999999999},"min":{"1min":0.33500000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.77400000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":2.6880000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.51800000000000002,"15min":0.48099999999999998},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":2.2200000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70199999999999996,"15min":0.69499999999999995},"min":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.014,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.6259999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.71799999999999997,"15min":0.67000000000000004},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.069,"5min":1.385,"15min":1.385},"last":2.536}]},{"osd":2,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":2.3119999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.6759999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.64000000000000001,"15min":0.61399999999999999},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":2.5750000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.75700000000000001,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.495,"15min":0.495},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78100000000000003,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.085,"5min":1.121,"15min":1.121},"last":1.7529999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.80700000000000005,"15min":0.79900000000000004},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.23,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":2.7240000000000002},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.84899999999999998,"15min":0.82499999999999996},"min":{"1min":0.65200000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":2.3599999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.80800000000000005,"15min":0.78400000000000003},"min":{"1min":0.66400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.998,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":2.3969999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.82199999999999995,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.014,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.7150000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.0640000000000001,"5min":1.365,"15min":1.365},"last":1.7949999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.877,"15min":0.86499999999999999},"min":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.107,"5min":1.444,"15min":1.444},"last":2.7650000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:34:46 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90400000000000003,"15min":0.91000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":2.9830000000000001},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.89100000000000001},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0880000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":2.617}]},{"osd":10,"last update":"Thu Oct 5 15:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95899999999999996,"15min":0.95799999999999996},"min":{"1min":0.748,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.1799999999999999,"5min":1.252,"15min":1.252},"last":2.6520000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.97199999999999998,"15min":0.96999999999999997},"min":{"1min":0.76500000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":2.4359999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":2.476},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":1.831}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":559754,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.68000000000000005,"15min":0.59699999999999998},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.35799999999999998},"max":{"1min":6.391,"5min":6.391,"15min":6.391},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34999999999999998},"max":{"1min":0.81899999999999995,"5min":0.96099999999999997,"15min":1.083},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97699999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:35:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67100000000000004,"15min":0.64500000000000002},"min":{"1min":0.48099999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91300000000000003,"5min":1.046,"15min":1.046},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70699999999999996,"15min":0.65700000000000003},"min":{"1min":0.51600000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92800000000000005,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.78100000000000003,"15min":0.73799999999999999},"min":{"1min":0.622,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.117,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.77200000000000002,"15min":0.748},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1499999999999999,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.623}]},{"osd":6,"last update":"Thu Oct 5 15:35:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.746,"15min":0.71999999999999997},"min":{"1min":0.66100000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80600000000000005,"15min":0.78800000000000003},"min":{"1min":0.59299999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0960000000000001,"5min":1.538,"15min":1.538},"last":0.5}]},{"osd":7,"last update":"Thu Oct 5 15:34:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.48499999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0600000000000001,"5min":1.51,"15min":1.51},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.046,"5min":1.381,"15min":1.381},"last":0.66000000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:35:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1279999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.68799999999999994,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.218,"5min":1.625,"15min":1.625},"last":0.72599999999999998}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.93200000000000005,"15min":0.89100000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.091,"5min":1.282,"15min":1.282},"last":0.73999999999999999}]},{"osd":10,"last update":"Thu Oct 5 15:35:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.95599999999999996,"15min":0.95899999999999996},"min":{"1min":0.66500000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.236,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93400000000000005,"15min":0.92500000000000004},"min":{"1min":0.77300000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2849999999999999,"5min":1.609,"15min":1.609},"last":0.52100000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:35:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.60499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":501266,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:35:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64600000000000002,"15min":0.59199999999999997},"min":{"1min":0.46400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.68300000000000005,"15min":0.61799999999999999},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.70099999999999996,"15min":0.65100000000000002},"min":{"1min":0.56399999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.67000000000000004,"15min":0.61799999999999999},"min":{"1min":0.44800000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.0029999999999999,"5min":1.026,"15min":1.026},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Oct 5 15:35:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.044,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.755,"15min":0.69699999999999995},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.74199999999999999,"15min":0.72199999999999998},"min":{"1min":0.65700000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0229999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.52600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.026,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.70799999999999996},"min":{"1min":0.499,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.405,"5min":1.417,"15min":1.417},"last":0.754}]},{"osd":7,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.028}]},{"osd":8,"last update":"Thu Oct 5 15:35:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.88600000000000001,"15min":0.88800000000000001},"min":{"1min":0.73799999999999999,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.86399999999999999,"15min":0.86699999999999999},"min":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.002}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0840000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.125},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.581,"15min":1.581},"last":0.89300000000000002}]},{"osd":10,"last update":"Thu Oct 5 15:35:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.85499999999999998,"15min":0.84499999999999997},"min":{"1min":0.70699999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3839999999999999,"5min":1.538,"15min":1.538},"last":0.875},{"interface":"front","average":{"1min":1.038,"5min":0.97399999999999998,"15min":0.96299999999999997},"min":{"1min":0.79500000000000004,"5min":0.748,"15min":0.748},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.1519999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:35:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.97199999999999998,"15min":0.95999999999999996},"min":{"1min":0.79800000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1579999999999999,"5min":1.534,"15min":1.534},"last":1.105},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.92400000000000004,"15min":0.91600000000000004},"min":{"1min":0.75800000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2889999999999999,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0449999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1097728,"data_stored":560364,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71499999999999997,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.40899999999999997,"15min":0.378},"max":{"1min":1.0920000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.58699999999999997},"min":{"1min":0.504,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67000000000000004,"15min":0.62},"min":{"1min":0.48599999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0169999999999999,"5min":1.075,"15min":1.075},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.55400000000000005,"15min":0.51100000000000001},"min":{"1min":0.42699999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.56899999999999995,"15min":0.52300000000000002},"min":{"1min":0.35199999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.78600000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.76000000000000001,"15min":0.72499999999999998},"min":{"1min":0.60999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.006},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.77600000000000002,"15min":0.73999999999999999},"min":{"1min":0.69699999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:35:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.879},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.91200000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:35:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.125}]},{"osd":9,"last update":"Thu Oct 5 15:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.78200000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0780000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.86199999999999999,"15min":0.85199999999999998},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.89900000000000002,"15min":0.88700000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.0369999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.0980000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149767,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1024000,"data_stored":499128,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.45800000000000002,"15min":0.40999999999999998},"min":{"1min":0.33800000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72199999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.432},"min":{"1min":0.374,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.621,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.378}]},{"osd":1,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.69699999999999995,"15min":0.64900000000000002},"min":{"1min":0.53000000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93200000000000005,"5min":1.097,"15min":1.097},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66500000000000004,"15min":0.66400000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.754,"15min":0.69799999999999995},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.014,"5min":1.109,"15min":1.109},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72599999999999998,"15min":0.70399999999999996},"min":{"1min":0.64800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81799999999999995,"15min":0.77000000000000002},"min":{"1min":0.72999999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.79900000000000004,"15min":0.76300000000000001},"min":{"1min":0.498,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.123,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88200000000000001,"5min":1.089,"15min":1.089},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.624},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.409,"15min":1.409},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:34:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.76800000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.88,"15min":0.88200000000000001},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2410000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2210000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:35:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.88300000000000001,"15min":0.89000000000000001},"min":{"1min":0.66600000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.042,"5min":1.198,"15min":1.198},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.99399999999999999,"15min":1},"min":{"1min":0.77200000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.1970000000000001,"5min":1.331,"15min":1.331},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:35:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.745},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.82699999999999996}]}]},{"osd":4,"up_from":34,"seq":146028888131,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":503494,"data_compressed":17658,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.437},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72699999999999998,"5min":1.526,"15min":1.526},"last":0.31},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.498,"15min":0.44800000000000001},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71099999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71399999999999997,"15min":0.67200000000000004},"min":{"1min":0.60099999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.117,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94999999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.71999999999999997,"15min":0.64300000000000002},"min":{"1min":0.42699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":3.762,"5min":3.762,"15min":3.762},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.103,"5min":0.75900000000000001,"15min":0.65100000000000002},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":8.9619999999999997,"5min":8.9619999999999997,"15min":8.9619999999999997},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.80300000000000005,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1719999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78800000000000003,"15min":0.76300000000000001},"min":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.196,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2669999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.495},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.88800000000000001,"15min":0.75800000000000001},"min":{"1min":0.57099999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6839999999999993,"5min":8.6839999999999993,"15min":8.6839999999999993},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Oct 5 15:34:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69099999999999995,"15min":0.65200000000000002},"min":{"1min":0.59599999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99099999999999999,"5min":1.659,"15min":1.659},"last":0.624},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.76200000000000001,"15min":0.72799999999999998},"min":{"1min":0.51100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0389999999999999,"5min":1.591,"15min":1.591},"last":0.55000000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:35:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79100000000000004,"15min":0.76400000000000001},"min":{"1min":0.54900000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0329999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.85399999999999998,"15min":0.82799999999999996},"min":{"1min":0.68100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1459999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Thu Oct 5 15:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3220000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0329999999999999,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":6.3789999999999996,"5min":6.3789999999999996,"15min":6.3789999999999996},"last":0.63300000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:35:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.88300000000000001,"15min":0.89900000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0760000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.99099999999999999,"15min":1.0049999999999999},"min":{"1min":0.72299999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.248,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Oct 5 15:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1089536,"data_stored":1095651,"data_compressed":53855,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90500000000000003,"5min":1.671,"15min":1.671},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98899999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.68700000000000006,"15min":0.65100000000000002},"min":{"1min":0.58999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97499999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.67900000000000005,"15min":0.65500000000000003},"min":{"1min":0.56799999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.496,"15min":0.47399999999999998},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51700000000000002,"15min":0.48299999999999998},"min":{"1min":0.40100000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83199999999999996,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.69199999999999995,"15min":0.66500000000000004},"min":{"1min":0.54000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Oct 5 15:35:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.71899999999999997,"15min":0.69199999999999995},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95099999999999996,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.72099999999999997,"15min":0.68500000000000005},"min":{"1min":0.629,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.498,"15min":0.498},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78100000000000003,"15min":0.753},"min":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.79600000000000004,"15min":0.77200000000000002},"min":{"1min":0.68500000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.83699999999999997}]},{"osd":8,"last update":"Thu Oct 5 15:35:23 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.71799999999999997,"15min":0.70199999999999996},"min":{"1min":0.56999999999999995,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.76800000000000002,"15min":0.746},"min":{"1min":0.58599999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.4039999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.89200000000000002},"min":{"1min":0.67900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.355},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.85799999999999998},"min":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.3100000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:35:13 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.93300000000000005,"15min":0.91900000000000004},"min":{"1min":0.83299999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.45},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.90200000000000002,"15min":0.88800000000000001},"min":{"1min":0.745,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.1140000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:35:55.560 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-05T15:35:55.560 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-05T15:35:55.560 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-05T15:35:55.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-05T15:35:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:55 smithi167 ceph-mon[133366]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:35:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:55 smithi079 ceph-mon[132936]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:35:56.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:55 smithi017 ceph-mon[129107]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:35:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:35:56.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:56 smithi017 ceph-mon[129107]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:56.925 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:56 smithi017 ceph-mon[129107]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:56 smithi167 ceph-mon[133366]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:57.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:56 smithi167 ceph-mon[133366]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:56 smithi079 ceph-mon[132936]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:35:57.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:56 smithi079 ceph-mon[132936]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:35:57.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 -- 172.21.15.17:0/3948707811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 msgr2=0x7f86fc101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 --2- 172.21.15.17:0/3948707811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc101400 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f86f00099c0 tx=0x7f86f0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 -- 172.21.15.17:0/3948707811 shutdown_connections 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 --2- 172.21.15.17:0/3948707811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86fc101940 0x7f86fc10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 --2- 172.21.15.17:0/3948707811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86fc106f90 0x7f86fc107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 --2- 172.21.15.17:0/3948707811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc101400 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 -- 172.21.15.17:0/3948707811 >> 172.21.15.17:0/3948707811 conn(0x7f86fc0780a0 msgr2=0x7f86fc0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 -- 172.21.15.17:0/3948707811 shutdown_connections 2023-10-05T15:35:57.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.986+0000 7f8701a19700 1 -- 172.21.15.17:0/3948707811 wait complete. 2023-10-05T15:35:57.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.987+0000 7f8701a19700 1 Processor -- start 2023-10-05T15:35:57.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 -- start start 2023-10-05T15:35:57.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86fc101940 0x7f86fc199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86fc106f90 0x7f86fc19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc19e080 con 0x7f86fc100f80 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc19e1f0 con 0x7f86fc106f90 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f8701a19700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc19e3b0 con 0x7f86fc101940 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f86faffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f86faffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc1990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59832/0 (socket says 172.21.15.17:59832) 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.988+0000 7f86faffd700 1 -- 172.21.15.17:0/622873836 learned_addr learned my addr 172.21.15.17:0/622873836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86fb7fe700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86fc106f90 0x7f86fc19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86fa7fc700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86fc101940 0x7f86fc199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:57.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86faffd700 1 -- 172.21.15.17:0/622873836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86fc101940 msgr2=0x7f86fc199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86faffd700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86fc101940 0x7f86fc199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86faffd700 1 -- 172.21.15.17:0/622873836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86fc106f90 msgr2=0x7f86fc19da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86faffd700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86fc106f90 0x7f86fc19da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:57.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86faffd700 1 -- 172.21.15.17:0/622873836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00095f0 con 0x7f86fc100f80 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f86faffd700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc1990c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00d950 tx=0x7f86ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.989+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00f890 con 0x7f86fc100f80 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.990+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86ec00fe80 con 0x7f86fc100f80 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.990+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc19e690 con 0x7f86fc100f80 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.990+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00e3b0 con 0x7f86fc100f80 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.990+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc1a5ef0 con 0x7f86fc100f80 2023-10-05T15:35:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.991+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc04ebb0 con 0x7f86fc100f80 2023-10-05T15:35:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.993+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f86ec010460 con 0x7f86fc100f80 2023-10-05T15:35:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.994+0000 7f8700a17700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86e40a1510 0x7f86e40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.994+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f86ec0ccf90 con 0x7f86fc100f80 2023-10-05T15:35:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.994+0000 7f86fa7fc700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86e40a1510 0x7f86e40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:57.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.995+0000 7f86fa7fc700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86e40a1510 0x7f86e40a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f86f0006010 tx=0x7f86f0003680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:58.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:57.998+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86ec096120 con 0x7f86fc100f80 2023-10-05T15:35:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.253+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f86fc19a420 con 0x7f86fc100f80 2023-10-05T15:35:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.254+0000 7f8700a17700 1 -- 172.21.15.17:0/622873836 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f86ec016040 con 0x7f86fc100f80 2023-10-05T15:35:58.255 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:58.256 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86e40a1510 msgr2=0x7f86e40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86e40a1510 0x7f86e40a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f86f0006010 tx=0x7f86f0003680 comp rx=0 tx=0).stop 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 msgr2=0x7f86fc1990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc1990c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00d950 tx=0x7f86ec00dc60 comp rx=0 tx=0).stop 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 shutdown_connections 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86e40a1510 0x7f86e40a39d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:58.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86fc106f90 0x7f86fc19da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:58.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86fc100f80 0x7f86fc1990c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:58.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 --2- 172.21.15.17:0/622873836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86fc101940 0x7f86fc199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:58.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 >> 172.21.15.17:0/622873836 conn(0x7f86fc0780a0 msgr2=0x7f86fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:58.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 shutdown_connections 2023-10-05T15:35:58.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:58.256+0000 7f8701a19700 1 -- 172.21.15.17:0/622873836 wait complete. 2023-10-05T15:35:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:58 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/622873836' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-05T15:35:58.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:58 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/622873836' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-05T15:35:58.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:58 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/622873836' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-05T15:35:58.897 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-05T15:35:58.898 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:35:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 -- 172.21.15.17:0/3881356897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc108db0 msgr2=0x7f11cc10b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3881356897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc108db0 0x7f11cc10b240 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009f90 tx=0x7f11c400b330 comp rx=0 tx=0).stop 2023-10-05T15:35:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 -- 172.21.15.17:0/3881356897 shutdown_connections 2023-10-05T15:35:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3881356897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc108db0 0x7f11cc10b240 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3881356897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc074ef0 0x7f11cc073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3881356897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11cc073910 0x7f11cc073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 -- 172.21.15.17:0/3881356897 >> 172.21.15.17:0/3881356897 conn(0x7f11cc0fc420 msgr2=0x7f11cc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 -- 172.21.15.17:0/3881356897 shutdown_connections 2023-10-05T15:35:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.122+0000 7f11d37ff700 1 -- 172.21.15.17:0/3881356897 wait complete. 2023-10-05T15:35:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.123+0000 7f11d37ff700 1 Processor -- start 2023-10-05T15:35:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.123+0000 7f11d37ff700 1 -- start start 2023-10-05T15:35:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d37ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 0x7f11cc198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d37ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc074ef0 0x7f11cc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d37ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11cc108db0 0x7f11cc1a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d37ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1a0990 con 0x7f11cc073910 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d37ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1a0ad0 con 0x7f11cc074ef0 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d37ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc1a0c60 con 0x7f11cc108db0 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 0x7f11cc198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 0x7f11cc198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59852/0 (socket says 172.21.15.17:59852) 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d159b700 1 -- 172.21.15.17:0/3079171318 learned_addr learned my addr 172.21.15.17:0/3079171318 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d0d9a700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc074ef0 0x7f11cc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.124+0000 7f11d1d9c700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11cc108db0 0x7f11cc1a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d159b700 1 -- 172.21.15.17:0/3079171318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11cc108db0 msgr2=0x7f11cc1a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d159b700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11cc108db0 0x7f11cc1a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d159b700 1 -- 172.21.15.17:0/3079171318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc074ef0 msgr2=0x7f11cc199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d159b700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc074ef0 0x7f11cc199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d159b700 1 -- 172.21.15.17:0/3079171318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c4009c40 con 0x7f11cc073910 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d159b700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 0x7f11cc198e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f11c800e9c0 tx=0x7f11c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8004a30 con 0x7f11cc073910 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11c800cc50 con 0x7f11cc073910 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc1a0f40 con 0x7f11cc073910 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8005410 con 0x7f11cc073910 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.125+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc1a1360 con 0x7f11cc073910 2023-10-05T15:35:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.126+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11cc107460 con 0x7f11cc073910 2023-10-05T15:35:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.128+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f11c8005570 con 0x7f11cc073910 2023-10-05T15:35:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.130+0000 7f11c27fc700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11b80a1550 0x7f11b80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.130+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f11c8014070 con 0x7f11cc073910 2023-10-05T15:35:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.130+0000 7f11d0d9a700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11b80a1550 0x7f11b80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.131+0000 7f11d0d9a700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11b80a1550 0x7f11b80a3a10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11cc074c10 tx=0x7f11bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.133+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f11c8096460 con 0x7f11cc073910 2023-10-05T15:35:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.345+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11cc10e7e0 con 0x7f11cc073910 2023-10-05T15:35:59.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.346+0000 7f11c27fc700 1 -- 172.21.15.17:0/3079171318 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24386 (secure 0 0 0) 0x7f11c8099a80 con 0x7f11cc073910 2023-10-05T15:35:59.348 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:35:59.349 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":92,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:35:05.767531+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11b80a1550 msgr2=0x7f11b80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11b80a1550 0x7f11b80a3a10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11cc074c10 tx=0x7f11bc009260 comp rx=0 tx=0).stop 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 msgr2=0x7f11cc198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 0x7f11cc198e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f11c800e9c0 tx=0x7f11c800ecd0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 shutdown_connections 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f11b80a1550 0x7f11b80a3a10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11cc108db0 0x7f11cc1a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11cc073910 0x7f11cc198e10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 --2- 172.21.15.17:0/3079171318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11cc074ef0 0x7f11cc199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 >> 172.21.15.17:0/3079171318 conn(0x7f11cc0fc420 msgr2=0x7f11cc0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:59.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 shutdown_connections 2023-10-05T15:35:59.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.349+0000 7f11d37ff700 1 -- 172.21.15.17:0/3079171318 wait complete. 2023-10-05T15:35:59.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:35:59.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:35:59.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.574+0000 7f45d7fff700 1 -- 172.21.15.17:0/3441861649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 msgr2=0x7f45d0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.574+0000 7f45d7fff700 1 --2- 172.21.15.17:0/3441861649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d0073340 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009990 tx=0x7f45cc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 -- 172.21.15.17:0/3441861649 shutdown_connections 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 --2- 172.21.15.17:0/3441861649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d010d4b0 0x7f45d010f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 --2- 172.21.15.17:0/3441861649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d0073340 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 --2- 172.21.15.17:0/3441861649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45d0073910 0x7f45d0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 -- 172.21.15.17:0/3441861649 >> 172.21.15.17:0/3441861649 conn(0x7f45d00fc430 msgr2=0x7f45d00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 -- 172.21.15.17:0/3441861649 shutdown_connections 2023-10-05T15:35:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.575+0000 7f45d7fff700 1 -- 172.21.15.17:0/3441861649 wait complete. 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 Processor -- start 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 -- start start 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d0073910 0x7f45d019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45d010d4b0 0x7f45d01a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d01a4cd0 con 0x7f45d0074ef0 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d01a4e10 con 0x7f45d010d4b0 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.576+0000 7f45d7fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d01a4fa0 con 0x7f45d0073910 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59872/0 (socket says 172.21.15.17:59872) 2023-10-05T15:35:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 -- 172.21.15.17:0/1790747806 learned_addr learned my addr 172.21.15.17:0/1790747806 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d659c700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45d010d4b0 0x7f45d01a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d5d9b700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d0073910 0x7f45d019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 -- 172.21.15.17:0/1790747806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d0073910 msgr2=0x7f45d019d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d0073910 0x7f45d019d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 -- 172.21.15.17:0/1790747806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45d010d4b0 msgr2=0x7f45d01a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45d010d4b0 0x7f45d01a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 -- 172.21.15.17:0/1790747806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0095f0 con 0x7f45d0074ef0 2023-10-05T15:35:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45d559a700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d019d690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45c000d980 tx=0x7f45c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.577+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000f890 con 0x7f45d0074ef0 2023-10-05T15:35:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.578+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45c000fe80 con 0x7f45d0074ef0 2023-10-05T15:35:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.578+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0019360 con 0x7f45d0074ef0 2023-10-05T15:35:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.578+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d01a5280 con 0x7f45d0074ef0 2023-10-05T15:35:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.578+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d01a5740 con 0x7f45d0074ef0 2023-10-05T15:35:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.579+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d0103000 con 0x7f45d0074ef0 2023-10-05T15:35:59.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.581+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f45c000f9f0 con 0x7f45d0074ef0 2023-10-05T15:35:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:35:59 smithi167 ceph-mon[133366]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.582+0000 7f45c6ffd700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45bc0a1590 0x7f45bc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:35:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.583+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f45c00ccba0 con 0x7f45d0074ef0 2023-10-05T15:35:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.583+0000 7f45d5d9b700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45bc0a1590 0x7f45bc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:35:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.583+0000 7f45d5d9b700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45bc0a1590 0x7f45bc0a3a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00b5c0 tx=0x7f45cc009f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:35:59.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.586+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f45c0095d30 con 0x7f45d0074ef0 2023-10-05T15:35:59.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:35:59 smithi079 ceph-mon[132936]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:59.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:35:59 smithi017 ceph-mon[129107]: pgmap v349: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:35:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.804+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45d0112df0 con 0x7f45d0074ef0 2023-10-05T15:35:59.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.804+0000 7f45c6ffd700 1 -- 172.21.15.17:0/1790747806 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45c0099350 con 0x7f45d0074ef0 2023-10-05T15:35:59.806 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:35:59.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45bc0a1590 msgr2=0x7f45bc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45bc0a1590 0x7f45bc0a3a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00b5c0 tx=0x7f45cc009f00 comp rx=0 tx=0).stop 2023-10-05T15:35:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 msgr2=0x7f45d019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:35:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d019d690 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45c000d980 tx=0x7f45c000dc90 comp rx=0 tx=0).stop 2023-10-05T15:35:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 shutdown_connections 2023-10-05T15:35:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f45bc0a1590 0x7f45bc0a3a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45d010d4b0 0x7f45d01a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45d0073910 0x7f45d019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 --2- 172.21.15.17:0/1790747806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d0074ef0 0x7f45d019d690 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:35:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 >> 172.21.15.17:0/1790747806 conn(0x7f45d00fc430 msgr2=0x7f45d00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:35:59.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 shutdown_connections 2023-10-05T15:35:59.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:35:59.807+0000 7f45d7fff700 1 -- 172.21.15.17:0/1790747806 wait complete. 2023-10-05T15:35:59.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.033+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1531879304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102a30 msgr2=0x7f10d4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.033+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1531879304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102a30 0x7f10d4109350 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b0a0 tx=0x7f10cc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1531879304 shutdown_connections 2023-10-05T15:36:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1531879304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102a30 0x7f10d4109350 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1531879304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 0x7f10d41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1531879304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d4102070 0x7f10d41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1531879304 >> 172.21.15.17:0/1531879304 conn(0x7f10d40fc430 msgr2=0x7f10d40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:00.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1531879304 shutdown_connections 2023-10-05T15:36:00.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.034+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1531879304 wait complete. 2023-10-05T15:36:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 Processor -- start 2023-10-05T15:36:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 -- start start 2023-10-05T15:36:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 0x7f10d4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 0x7f10d40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d4102a30 0x7f10d40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4073f80 con 0x7f10d4102070 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40740f0 con 0x7f10d4100e90 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10dc1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d41a0c40 con 0x7f10d4102a30 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10d979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 0x7f10d40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10d979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 0x7f10d40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59890/0 (socket says 172.21.15.17:59890) 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.035+0000 7f10d979a700 1 -- 172.21.15.17:0/1088280359 learned_addr learned my addr 172.21.15.17:0/1088280359 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10da79c700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d4102a30 0x7f10d40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d9f9b700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 0x7f10d4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d979a700 1 -- 172.21.15.17:0/1088280359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d4102a30 msgr2=0x7f10d40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d979a700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d4102a30 0x7f10d40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d979a700 1 -- 172.21.15.17:0/1088280359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 msgr2=0x7f10d4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d979a700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 0x7f10d4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d979a700 1 -- 172.21.15.17:0/1088280359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009d00 con 0x7f10d4102070 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d9f9b700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 0x7f10d4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10d979a700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 0x7f10d40732a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f10c400e970 tx=0x7f10c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4009790 con 0x7f10d4102070 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10c40044b0 con 0x7f10d4102070 2023-10-05T15:36:00.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4003dd0 con 0x7f10d4102070 2023-10-05T15:36:00.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.036+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d41a0f20 con 0x7f10d4102070 2023-10-05T15:36:00.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.037+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d41a1350 con 0x7f10d4102070 2023-10-05T15:36:00.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.037+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d4107e40 con 0x7f10d4102070 2023-10-05T15:36:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.039+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f10c4003f30 con 0x7f10d4102070 2023-10-05T15:36:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.041+0000 7f10caffd700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10c00a1590 0x7f10c00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.041+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f10c4014070 con 0x7f10d4102070 2023-10-05T15:36:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.041+0000 7f10d9f9b700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10c00a1590 0x7f10c00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.042+0000 7f10d9f9b700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10c00a1590 0x7f10c00a3a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f10d4101be0 tx=0x7f10d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:00.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.045+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10c4096600 con 0x7f10d4102070 2023-10-05T15:36:00.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.256+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10d410c880 con 0x7f10d4102070 2023-10-05T15:36:00.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.256+0000 7f10caffd700 1 -- 172.21.15.17:0/1088280359 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10c4099c20 con 0x7f10d4102070 2023-10-05T15:36:00.258 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:00.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10c00a1590 msgr2=0x7f10c00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10c00a1590 0x7f10c00a3a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f10d4101be0 tx=0x7f10d0009260 comp rx=0 tx=0).stop 2023-10-05T15:36:00.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 msgr2=0x7f10d40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 0x7f10d40732a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f10c400e970 tx=0x7f10c400ed30 comp rx=0 tx=0).stop 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 shutdown_connections 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f10c00a1590 0x7f10c00a3a50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d4102a30 0x7f10d40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d4100e90 0x7f10d4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 --2- 172.21.15.17:0/1088280359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10d4102070 0x7f10d40732a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.258+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 >> 172.21.15.17:0/1088280359 conn(0x7f10d40fc430 msgr2=0x7f10d40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.259+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 shutdown_connections 2023-10-05T15:36:00.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.259+0000 7f10dc1ff700 1 -- 172.21.15.17:0/1088280359 wait complete. 2023-10-05T15:36:00.279 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:00.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.483+0000 7f78da3ff700 1 -- 172.21.15.17:0/1008540372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4102a30 msgr2=0x7f78d4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.483+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1008540372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4102a30 0x7f78d4109350 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00b0a0 tx=0x7f78cc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 -- 172.21.15.17:0/1008540372 shutdown_connections 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1008540372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4102a30 0x7f78d4109350 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1008540372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78d4100e90 0x7f78d41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1008540372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 0x7f78d41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 -- 172.21.15.17:0/1008540372 >> 172.21.15.17:0/1008540372 conn(0x7f78d40fc430 msgr2=0x7f78d40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 -- 172.21.15.17:0/1008540372 shutdown_connections 2023-10-05T15:36:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.484+0000 7f78da3ff700 1 -- 172.21.15.17:0/1008540372 wait complete. 2023-10-05T15:36:00.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 Processor -- start 2023-10-05T15:36:00.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 -- start start 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 0x7f78d4196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 0x7f78d4197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78d4102a30 0x7f78d419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d419e760 con 0x7f78d4100e90 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d419e8d0 con 0x7f78d4102070 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78da3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d419ea90 con 0x7f78d4102a30 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.485+0000 7f78cbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 0x7f78d4196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 0x7f78d4196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59916/0 (socket says 172.21.15.17:59916) 2023-10-05T15:36:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 -- 172.21.15.17:0/1315286581 learned_addr learned my addr 172.21.15.17:0/1315286581 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78d3fff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 0x7f78d4197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78d899c700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78d4102a30 0x7f78d419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 -- 172.21.15.17:0/1315286581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78d4102a30 msgr2=0x7f78d419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78d4102a30 0x7f78d419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 -- 172.21.15.17:0/1315286581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 msgr2=0x7f78d4197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 0x7f78d4197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 -- 172.21.15.17:0/1315286581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc009d00 con 0x7f78d4100e90 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78d3fff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 0x7f78d4197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78cbfff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 0x7f78d4196c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f78c400e970 tx=0x7f78c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4009790 con 0x7f78d4100e90 2023-10-05T15:36:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78c40044b0 con 0x7f78d4100e90 2023-10-05T15:36:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d419ed70 con 0x7f78d4100e90 2023-10-05T15:36:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.486+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4003dd0 con 0x7f78d4100e90 2023-10-05T15:36:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.487+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d419f1d0 con 0x7f78d4100e90 2023-10-05T15:36:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.488+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4107ec0 con 0x7f78d4100e90 2023-10-05T15:36:00.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.490+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f78c4003f30 con 0x7f78d4100e90 2023-10-05T15:36:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.491+0000 7f78d1ffb700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78c00a1510 0x7f78c00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.491+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f78c4014070 con 0x7f78d4100e90 2023-10-05T15:36:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.491+0000 7f78d3fff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78c00a1510 0x7f78c00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.492+0000 7f78d3fff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78c00a1510 0x7f78c00a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78bc005950 tx=0x7f78bc0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.493+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f78c40967a0 con 0x7f78d4100e90 2023-10-05T15:36:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:00 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3079171318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:00 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1790747806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:00 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1088280359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:00.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3079171318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:00.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1790747806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:00.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:00 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1088280359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:00.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:00 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3079171318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:00.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:00 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1790747806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:00.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:00 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1088280359' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.707+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78d402d020 con 0x7f78d4100e90 2023-10-05T15:36:00.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.708+0000 7f78d1ffb700 1 -- 172.21.15.17:0/1315286581 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78c4099dc0 con 0x7f78d4100e90 2023-10-05T15:36:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78c00a1510 msgr2=0x7f78c00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78c00a1510 0x7f78c00a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78bc005950 tx=0x7f78bc0058e0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 msgr2=0x7f78d4196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 0x7f78d4196c20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f78c400e970 tx=0x7f78c400ed30 comp rx=0 tx=0).stop 2023-10-05T15:36:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 shutdown_connections 2023-10-05T15:36:00.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f78c00a1510 0x7f78c00a39d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f78d4102a30 0x7f78d419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78d4100e90 0x7f78d4196c20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 --2- 172.21.15.17:0/1315286581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78d4102070 0x7f78d4197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 >> 172.21.15.17:0/1315286581 conn(0x7f78d40fc430 msgr2=0x7f78d40fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.710+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 shutdown_connections 2023-10-05T15:36:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.711+0000 7f78da3ff700 1 -- 172.21.15.17:0/1315286581 wait complete. 2023-10-05T15:36:00.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 -- 172.21.15.17:0/2862731995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4074ef0 msgr2=0x7fc1c4073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/2862731995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4074ef0 0x7fc1c4073340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009990 tx=0x7fc1b4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 -- 172.21.15.17:0/2862731995 shutdown_connections 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/2862731995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4108da0 0x7fc1c410b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/2862731995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4074ef0 0x7fc1c4073340 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/2862731995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4073910 0x7fc1c4073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 -- 172.21.15.17:0/2862731995 >> 172.21.15.17:0/2862731995 conn(0x7fc1c40fc430 msgr2=0x7fc1c40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 -- 172.21.15.17:0/2862731995 shutdown_connections 2023-10-05T15:36:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.935+0000 7fc1c8dff700 1 -- 172.21.15.17:0/2862731995 wait complete. 2023-10-05T15:36:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.937+0000 7fc1c8dff700 1 Processor -- start 2023-10-05T15:36:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.937+0000 7fc1c8dff700 1 -- start start 2023-10-05T15:36:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.937+0000 7fc1c8dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4073910 0x7fc1c4198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c8dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4074ef0 0x7fc1c4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c8dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 0x7fc1c41a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c8dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c41a0890 con 0x7fc1c4108da0 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c8dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c41a0a00 con 0x7fc1c4074ef0 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c8dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c41a0bc0 con 0x7fc1c4073910 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 0x7fc1c41a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 0x7fc1c41a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59946/0 (socket says 172.21.15.17:59946) 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 -- 172.21.15.17:0/848605381 learned_addr learned my addr 172.21.15.17:0/848605381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c259c700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4073910 0x7fc1c4198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4074ef0 0x7fc1c4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 -- 172.21.15.17:0/848605381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4073910 msgr2=0x7fc1c4198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4073910 0x7fc1c4198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 -- 172.21.15.17:0/848605381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4074ef0 msgr2=0x7fc1c4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4074ef0 0x7fc1c4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.938+0000 7fc1c2d9d700 1 -- 172.21.15.17:0/848605381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40095f0 con 0x7fc1c4108da0 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.939+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 0x7fc1c41a02c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00ef30 tx=0x7fc1bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.939+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc018070 con 0x7fc1c4108da0 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.939+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c41a0e40 con 0x7fc1c4108da0 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.939+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1bc00f040 con 0x7fc1c4108da0 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.939+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00cc70 con 0x7fc1c4108da0 2023-10-05T15:36:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.939+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c41a1210 con 0x7fc1c4108da0 2023-10-05T15:36:00.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.940+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c4107450 con 0x7fc1c4108da0 2023-10-05T15:36:00.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.942+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc1bc007500 con 0x7fc1c4108da0 2023-10-05T15:36:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.943+0000 7fc1b37fe700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1510 0x7fc1ac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.944+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc1bc0ccd20 con 0x7fc1c4108da0 2023-10-05T15:36:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.944+0000 7fc1c259c700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1510 0x7fc1ac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:00.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.944+0000 7fc1c259c700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1510 0x7fc1ac0a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4006010 tx=0x7fc1b400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:00.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:00.947+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc1bc095f40 con 0x7fc1c4108da0 2023-10-05T15:36:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.157+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc1c402cf70 con 0x7fc1c4108da0 2023-10-05T15:36:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.157+0000 7fc1b37fe700 1 -- 172.21.15.17:0/848605381 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc1bc099560 con 0x7fc1c4108da0 2023-10-05T15:36:01.159 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1510 msgr2=0x7fc1ac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1510 0x7fc1ac0a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4006010 tx=0x7fc1b400b260 comp rx=0 tx=0).stop 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 msgr2=0x7fc1c41a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 0x7fc1c41a02c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00ef30 tx=0x7fc1bc00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 shutdown_connections 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1510 0x7fc1ac0a39d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4108da0 0x7fc1c41a02c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4073910 0x7fc1c4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 --2- 172.21.15.17:0/848605381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4074ef0 0x7fc1c4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 >> 172.21.15.17:0/848605381 conn(0x7fc1c40fc430 msgr2=0x7fc1c40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:01.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 shutdown_connections 2023-10-05T15:36:01.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.160+0000 7fc1c8dff700 1 -- 172.21.15.17:0/848605381 wait complete. 2023-10-05T15:36:01.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 -- 172.21.15.17:0/4056803203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60100ea0 msgr2=0x7f8f601012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 --2- 172.21.15.17:0/4056803203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60100ea0 0x7f8f601012c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009990 tx=0x7f8f54009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 -- 172.21.15.17:0/4056803203 shutdown_connections 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 --2- 172.21.15.17:0/4056803203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60102a40 0x7f8f60109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 --2- 172.21.15.17:0/4056803203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60100ea0 0x7f8f601012c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 --2- 172.21.15.17:0/4056803203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f60102080 0x7f8f60102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 -- 172.21.15.17:0/4056803203 >> 172.21.15.17:0/4056803203 conn(0x7f8f600fc420 msgr2=0x7f8f600fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 -- 172.21.15.17:0/4056803203 shutdown_connections 2023-10-05T15:36:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.384+0000 7f8f66fff700 1 -- 172.21.15.17:0/4056803203 wait complete. 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.385+0000 7f8f66fff700 1 Processor -- start 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.385+0000 7f8f66fff700 1 -- start start 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f66fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60100ea0 0x7f8f60196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f66fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f60102080 0x7f8f60197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f66fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 0x7f8f6019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f66fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6019e760 con 0x7f8f60102a40 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f66fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6019e8a0 con 0x7f8f60100ea0 2023-10-05T15:36:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f66fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6019ea30 con 0x7f8f60102080 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 0x7f8f6019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 0x7f8f6019e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59966/0 (socket says 172.21.15.17:59966) 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 -- 172.21.15.17:0/2710632249 learned_addr learned my addr 172.21.15.17:0/2710632249 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f64d9b700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60100ea0 0x7f8f60196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f5ffff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f60102080 0x7f8f60197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 -- 172.21.15.17:0/2710632249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f60102080 msgr2=0x7f8f60197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f60102080 0x7f8f60197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 -- 172.21.15.17:0/2710632249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60100ea0 msgr2=0x7f8f60196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60100ea0 0x7f8f60196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f6559c700 1 -- 172.21.15.17:0/2710632249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f540095f0 con 0x7f8f60102a40 2023-10-05T15:36:01.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.386+0000 7f8f64d9b700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60100ea0 0x7f8f60196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.387+0000 7f8f6559c700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 0x7f8f6019e190 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800ef30 tx=0x7f8f5800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.387+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58018070 con 0x7f8f60102a40 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.387+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f5800f040 con 0x7f8f60102a40 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.387+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6019ecb0 con 0x7f8f60102a40 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.387+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58003d00 con 0x7f8f60102a40 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.387+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6019f1c0 con 0x7f8f60102a40 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.388+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f60108610 con 0x7f8f60102a40 2023-10-05T15:36:01.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.390+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f8f5800caa0 con 0x7f8f60102a40 2023-10-05T15:36:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.393+0000 7f8f5dffb700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f500a15d0 0x7f8f500a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.393+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8f580cce20 con 0x7f8f60102a40 2023-10-05T15:36:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.393+0000 7f8f64d9b700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f500a15d0 0x7f8f500a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.393+0000 7f8f64d9b700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f500a15d0 0x7f8f500a3a90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005910 tx=0x7f8f5400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:01.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.397+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8f58096040 con 0x7f8f60102a40 2023-10-05T15:36:01.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:01 smithi017 ceph-mon[129107]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-10-05T15:36:01.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:01 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1315286581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:01.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:01 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/848605381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:01 smithi167 ceph-mon[133366]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-10-05T15:36:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:01 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1315286581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:01.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:01 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/848605381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:01.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:01 smithi079 ceph-mon[132936]: pgmap v350: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-10-05T15:36:01.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:01 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1315286581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:01.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:01 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/848605381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.657+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f6010c610 con 0x7f8f60102a40 2023-10-05T15:36:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.658+0000 7f8f5dffb700 1 -- 172.21.15.17:0/2710632249 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f8f580b9090 con 0x7f8f60102a40 2023-10-05T15:36:01.660 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:01.660 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f500a15d0 msgr2=0x7f8f500a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f500a15d0 0x7f8f500a3a90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005910 tx=0x7f8f5400b260 comp rx=0 tx=0).stop 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 msgr2=0x7f8f6019e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 0x7f8f6019e190 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800ef30 tx=0x7f8f5800c450 comp rx=0 tx=0).stop 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 shutdown_connections 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8f500a15d0 0x7f8f500a3a90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f60102a40 0x7f8f6019e190 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f60100ea0 0x7f8f60196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 --2- 172.21.15.17:0/2710632249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f60102080 0x7f8f60197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 >> 172.21.15.17:0/2710632249 conn(0x7f8f600fc420 msgr2=0x7f8f60105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 shutdown_connections 2023-10-05T15:36:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.661+0000 7f8f66fff700 1 -- 172.21.15.17:0/2710632249 wait complete. 2023-10-05T15:36:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:01.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:01.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 -- 172.21.15.17:0/944359911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102080 msgr2=0x7fd948102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 --2- 172.21.15.17:0/944359911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102080 0x7fd948102500 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd938009990 tx=0x7fd938009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 -- 172.21.15.17:0/944359911 shutdown_connections 2023-10-05T15:36:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 --2- 172.21.15.17:0/944359911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd948102a40 0x7fd948109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 --2- 172.21.15.17:0/944359911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd948100ea0 0x7fd9481012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 --2- 172.21.15.17:0/944359911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102080 0x7fd948102500 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 -- 172.21.15.17:0/944359911 >> 172.21.15.17:0/944359911 conn(0x7fd9480fc420 msgr2=0x7fd9480fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 -- 172.21.15.17:0/944359911 shutdown_connections 2023-10-05T15:36:01.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.884+0000 7fd94fdff700 1 -- 172.21.15.17:0/944359911 wait complete. 2023-10-05T15:36:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.885+0000 7fd94fdff700 1 Processor -- start 2023-10-05T15:36:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 -- start start 2023-10-05T15:36:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd948100ea0 0x7fd948198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd948102080 0x7fd948199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 0x7fd9481a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481a0890 con 0x7fd948102a40 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481a0a00 con 0x7fd948100ea0 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94fdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481a0bc0 con 0x7fd948102080 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94e39c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 0x7fd9481a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94e39c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 0x7fd9481a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59986/0 (socket says 172.21.15.17:59986) 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94e39c700 1 -- 172.21.15.17:0/2712646977 learned_addr learned my addr 172.21.15.17:0/2712646977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.886+0000 7fd94db9b700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd948100ea0 0x7fd948198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94d39a700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd948102080 0x7fd948199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94e39c700 1 -- 172.21.15.17:0/2712646977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd948102080 msgr2=0x7fd948199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94e39c700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd948102080 0x7fd948199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94e39c700 1 -- 172.21.15.17:0/2712646977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd948100ea0 msgr2=0x7fd948198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94e39c700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd948100ea0 0x7fd948198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94e39c700 1 -- 172.21.15.17:0/2712646977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380095f0 con 0x7fd948102a40 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94e39c700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 0x7fd9481a02c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd940007ee0 tx=0x7fd94000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940017070 con 0x7fd948102a40 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd94000f040 con 0x7fd948102a40 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9481a0ea0 con 0x7fd948102a40 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940005710 con 0x7fd948102a40 2023-10-05T15:36:01.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.887+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9481a1270 con 0x7fd948102a40 2023-10-05T15:36:01.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.888+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94810c610 con 0x7fd948102a40 2023-10-05T15:36:01.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.890+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd940005870 con 0x7fd948102a40 2023-10-05T15:36:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.891+0000 7fd93effd700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9340a1550 0x7fd9340a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.892+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd9400cca10 con 0x7fd948102a40 2023-10-05T15:36:01.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.892+0000 7fd94db9b700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9340a1550 0x7fd9340a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:01.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.892+0000 7fd94db9b700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9340a1550 0x7fd9340a3a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd94819a220 tx=0x7fd944009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:01.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:01.896+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd940095ba0 con 0x7fd948102a40 2023-10-05T15:36:02.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.111+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9481a1490 con 0x7fd948102a40 2023-10-05T15:36:02.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.113+0000 7fd93effd700 1 -- 172.21.15.17:0/2712646977 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24386 (secure 0 0 0) 0x7fd9400991c0 con 0x7fd948102a40 2023-10-05T15:36:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:02.115 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":92,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:35:05.767531+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9340a1550 msgr2=0x7fd9340a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9340a1550 0x7fd9340a3a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd94819a220 tx=0x7fd944009260 comp rx=0 tx=0).stop 2023-10-05T15:36:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 msgr2=0x7fd9481a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 0x7fd9481a02c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd940007ee0 tx=0x7fd94000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 shutdown_connections 2023-10-05T15:36:02.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9340a1550 0x7fd9340a3a10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd948102a40 0x7fd9481a02c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd948100ea0 0x7fd948198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 --2- 172.21.15.17:0/2712646977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd948102080 0x7fd948199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 >> 172.21.15.17:0/2712646977 conn(0x7fd9480fc420 msgr2=0x7fd9480fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.115+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 shutdown_connections 2023-10-05T15:36:02.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.116+0000 7fd94fdff700 1 -- 172.21.15.17:0/2712646977 wait complete. 2023-10-05T15:36:02.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:36:02.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 -- 172.21.15.17:0/3144363512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 msgr2=0x7fddac1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3144363512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac1012b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009990 tx=0x7fdd9c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 -- 172.21.15.17:0/3144363512 shutdown_connections 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3144363512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddac102a30 0x7fddac109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3144363512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac1012b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3144363512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac102070 0x7fddac1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 -- 172.21.15.17:0/3144363512 >> 172.21.15.17:0/3144363512 conn(0x7fddac0fc430 msgr2=0x7fddac0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 -- 172.21.15.17:0/3144363512 shutdown_connections 2023-10-05T15:36:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.342+0000 7fddb13ff700 1 -- 172.21.15.17:0/3144363512 wait complete. 2023-10-05T15:36:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.343+0000 7fddb13ff700 1 Processor -- start 2023-10-05T15:36:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.343+0000 7fddb13ff700 1 -- start start 2023-10-05T15:36:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddb13ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddb13ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac102070 0x7fddac199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddb13ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddac102a30 0x7fddac1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddb13ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac1a0900 con 0x7fddac100e90 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddb13ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac1a0a70 con 0x7fddac102070 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddb13ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac1a0c30 con 0x7fddac102a30 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60006/0 (socket says 172.21.15.17:60006) 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 -- 172.21.15.17:0/3303310144 learned_addr learned my addr 172.21.15.17:0/3303310144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddab7fe700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddac102a30 0x7fddac1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaa7fc700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac102070 0x7fddac199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 -- 172.21.15.17:0/3303310144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddac102a30 msgr2=0x7fddac1a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddac102a30 0x7fddac1a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 -- 172.21.15.17:0/3303310144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac102070 msgr2=0x7fddac199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.344+0000 7fddaaffd700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac102070 0x7fddac199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fddaaffd700 1 -- 172.21.15.17:0/3303310144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0095f0 con 0x7fddac100e90 2023-10-05T15:36:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fddaaffd700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac198dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c005910 tx=0x7fdd9c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:02.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c01d070 con 0x7fddac100e90 2023-10-05T15:36:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd9c022470 con 0x7fddac100e90 2023-10-05T15:36:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac1a0eb0 con 0x7fddac100e90 2023-10-05T15:36:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00f6c0 con 0x7fddac100e90 2023-10-05T15:36:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.345+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac1a1270 con 0x7fddac100e90 2023-10-05T15:36:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.346+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac10c600 con 0x7fddac100e90 2023-10-05T15:36:02.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.348+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fdd9c022850 con 0x7fddac100e90 2023-10-05T15:36:02.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.350+0000 7fdd93fff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd940a1590 0x7fdd940a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.350+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdd9c0ceec0 con 0x7fddac100e90 2023-10-05T15:36:02.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.350+0000 7fddaa7fc700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd940a1590 0x7fdd940a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.350+0000 7fddaa7fc700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd940a1590 0x7fdd940a3a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fddac100bb0 tx=0x7fdda0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:02.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.352+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdd9c0980e0 con 0x7fddac100e90 2023-10-05T15:36:02.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.567+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fddac1a1460 con 0x7fddac100e90 2023-10-05T15:36:02.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.568+0000 7fdd93fff700 1 -- 172.21.15.17:0/3303310144 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd9c027020 con 0x7fddac100e90 2023-10-05T15:36:02.569 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:36:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd940a1590 msgr2=0x7fdd940a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd940a1590 0x7fdd940a3a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fddac100bb0 tx=0x7fdda0009260 comp rx=0 tx=0).stop 2023-10-05T15:36:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 msgr2=0x7fddac198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac198dc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c005910 tx=0x7fdd9c005740 comp rx=0 tx=0).stop 2023-10-05T15:36:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 shutdown_connections 2023-10-05T15:36:02.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd940a1590 0x7fdd940a3a50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddac102a30 0x7fddac1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddac100e90 0x7fddac198dc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 --2- 172.21.15.17:0/3303310144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddac102070 0x7fddac199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.570+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 >> 172.21.15.17:0/3303310144 conn(0x7fddac0fc430 msgr2=0x7fddac0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.571+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 shutdown_connections 2023-10-05T15:36:02.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.571+0000 7fddb13ff700 1 -- 172.21.15.17:0/3303310144 wait complete. 2023-10-05T15:36:02.591 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 -- 172.21.15.17:0/768634375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50102a40 msgr2=0x7efe50109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 --2- 172.21.15.17:0/768634375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50102a40 0x7efe50109360 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efe4800b0a0 tx=0x7efe4800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 -- 172.21.15.17:0/768634375 shutdown_connections 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 --2- 172.21.15.17:0/768634375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50102a40 0x7efe50109360 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 --2- 172.21.15.17:0/768634375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe50100ea0 0x7efe501012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 --2- 172.21.15.17:0/768634375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe50102080 0x7efe50102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 -- 172.21.15.17:0/768634375 >> 172.21.15.17:0/768634375 conn(0x7efe500fc460 msgr2=0x7efe500fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 -- 172.21.15.17:0/768634375 shutdown_connections 2023-10-05T15:36:02.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.799+0000 7efe575ff700 1 -- 172.21.15.17:0/768634375 wait complete. 2023-10-05T15:36:02.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 Processor -- start 2023-10-05T15:36:02.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 -- start start 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 0x7efe50074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe50102080 0x7efe500732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe50102a40 0x7efe500737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe50073f80 con 0x7efe50100ea0 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500740f0 con 0x7efe50102a40 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.800+0000 7efe575ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe501a0c50 con 0x7efe50102080 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 0x7efe50074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 0x7efe50074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60032/0 (socket says 172.21.15.17:60032) 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 -- 172.21.15.17:0/2133693553 learned_addr learned my addr 172.21.15.17:0/2133693553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe54b9a700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe50102080 0x7efe500732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe55b9c700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe50102a40 0x7efe500737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 -- 172.21.15.17:0/2133693553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe50102080 msgr2=0x7efe500732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe50102080 0x7efe500732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 -- 172.21.15.17:0/2133693553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe50102a40 msgr2=0x7efe500737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe50102a40 0x7efe500737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.801+0000 7efe5539b700 1 -- 172.21.15.17:0/2133693553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48009d00 con 0x7efe50100ea0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.802+0000 7efe5539b700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 0x7efe50074c60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e970 tx=0x7efe4c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.802+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c009790 con 0x7efe50100ea0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.802+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe4c00c7e0 con 0x7efe50100ea0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.802+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe501a0f30 con 0x7efe50100ea0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.802+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c003bd0 con 0x7efe50100ea0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.802+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe501a13b0 con 0x7efe50100ea0 2023-10-05T15:36:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.803+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe50107ea0 con 0x7efe50100ea0 2023-10-05T15:36:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.805+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7efe4c00c950 con 0x7efe50100ea0 2023-10-05T15:36:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.807+0000 7efe467fc700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efe3c0a1590 0x7efe3c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.807+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7efe4c014070 con 0x7efe50100ea0 2023-10-05T15:36:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.807+0000 7efe54b9a700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efe3c0a1590 0x7efe3c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.808+0000 7efe54b9a700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efe3c0a1590 0x7efe3c0a3a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe50100bc0 tx=0x7efe40007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:02.808+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe4c096640 con 0x7efe50100ea0 2023-10-05T15:36:02.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:02 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2710632249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:02 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2712646977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:02 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3303310144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:03.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.021+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe5010c870 con 0x7efe50100ea0 2023-10-05T15:36:03.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.021+0000 7efe467fc700 1 -- 172.21.15.17:0/2133693553 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe4c099c60 con 0x7efe50100ea0 2023-10-05T15:36:03.023 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:03.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.023+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efe3c0a1590 msgr2=0x7efe3c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.023+0000 7efe575ff700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efe3c0a1590 0x7efe3c0a3a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe50100bc0 tx=0x7efe40007400 comp rx=0 tx=0).stop 2023-10-05T15:36:03.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.023+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 msgr2=0x7efe50074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.023+0000 7efe575ff700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 0x7efe50074c60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e970 tx=0x7efe4c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.023+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 shutdown_connections 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7efe3c0a1590 0x7efe3c0a3a50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe50102a40 0x7efe500737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50100ea0 0x7efe50074c60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 --2- 172.21.15.17:0/2133693553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe50102080 0x7efe500732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 >> 172.21.15.17:0/2133693553 conn(0x7efe500fc460 msgr2=0x7efe500fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 shutdown_connections 2023-10-05T15:36:03.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.024+0000 7efe575ff700 1 -- 172.21.15.17:0/2133693553 wait complete. 2023-10-05T15:36:03.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:02 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2710632249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:02 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2712646977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:02 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3303310144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:02 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2710632249' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:02 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2712646977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:02 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3303310144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 -- 172.21.15.17:0/1505221019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c101fe0 msgr2=0x7fe56c102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 --2- 172.21.15.17:0/1505221019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c101fe0 0x7fe56c102460 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe558009990 tx=0x7fe558009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 -- 172.21.15.17:0/1505221019 shutdown_connections 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 --2- 172.21.15.17:0/1505221019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 0x7fe56c1092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 --2- 172.21.15.17:0/1505221019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c100e90 0x7fe56c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 --2- 172.21.15.17:0/1505221019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c101fe0 0x7fe56c102460 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 -- 172.21.15.17:0/1505221019 >> 172.21.15.17:0/1505221019 conn(0x7fe56c0fc420 msgr2=0x7fe56c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:03.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 -- 172.21.15.17:0/1505221019 shutdown_connections 2023-10-05T15:36:03.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.250+0000 7fe572fff700 1 -- 172.21.15.17:0/1505221019 wait complete. 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.251+0000 7fe572fff700 1 Processor -- start 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.251+0000 7fe572fff700 1 -- start start 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.251+0000 7fe572fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 0x7fe56c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.251+0000 7fe572fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c101fe0 0x7fe56c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.251+0000 7fe572fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 0x7fe56c19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe572fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c19e660 con 0x7fe56c100e90 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe572fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c19e7a0 con 0x7fe56c1029a0 2023-10-05T15:36:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe572fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c19e930 con 0x7fe56c101fe0 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 0x7fe56c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 0x7fe56c196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60044/0 (socket says 172.21.15.17:60044) 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 -- 172.21.15.17:0/1217388630 learned_addr learned my addr 172.21.15.17:0/1217388630 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe57159c700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 0x7fe56c19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe56bfff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c101fe0 0x7fe56c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 -- 172.21.15.17:0/1217388630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c101fe0 msgr2=0x7fe56c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c101fe0 0x7fe56c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 -- 172.21.15.17:0/1217388630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 msgr2=0x7fe56c19e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 0x7fe56c19e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 -- 172.21.15.17:0/1217388630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580095f0 con 0x7fe56c100e90 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe57159c700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 0x7fe56c19e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.252+0000 7fe570d9b700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 0x7fe56c196ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe56000e9a0 tx=0x7fe56000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.253+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560009790 con 0x7fe56c100e90 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.253+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe56000cbd0 con 0x7fe56c100e90 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.253+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c19ec10 con 0x7fe56c100e90 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.253+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560018680 con 0x7fe56c100e90 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.253+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c19f170 con 0x7fe56c100e90 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.254+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c10c590 con 0x7fe56c100e90 2023-10-05T15:36:03.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.256+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fe56000cd40 con 0x7fe56c100e90 2023-10-05T15:36:03.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.257+0000 7fe569ffb700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe55c0a1590 0x7fe55c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.257+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fe560014070 con 0x7fe56c100e90 2023-10-05T15:36:03.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.258+0000 7fe56bfff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe55c0a1590 0x7fe55c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.258+0000 7fe56bfff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe55c0a1590 0x7fe55c0a3a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe558006010 tx=0x7fe55800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:03.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.261+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe560052100 con 0x7fe56c100e90 2023-10-05T15:36:03.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.475+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe56c107e90 con 0x7fe56c100e90 2023-10-05T15:36:03.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.475+0000 7fe569ffb700 1 -- 172.21.15.17:0/1217388630 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe56009a0c0 con 0x7fe56c100e90 2023-10-05T15:36:03.477 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:03.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.477+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe55c0a1590 msgr2=0x7fe55c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.477+0000 7fe572fff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe55c0a1590 0x7fe55c0a3a50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe558006010 tx=0x7fe55800b260 comp rx=0 tx=0).stop 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 msgr2=0x7fe56c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 0x7fe56c196ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe56000e9a0 tx=0x7fe56000ed60 comp rx=0 tx=0).stop 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 shutdown_connections 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe55c0a1590 0x7fe55c0a3a50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56c1029a0 0x7fe56c19e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe56c100e90 0x7fe56c196ae0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 --2- 172.21.15.17:0/1217388630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe56c101fe0 0x7fe56c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 >> 172.21.15.17:0/1217388630 conn(0x7fe56c0fc420 msgr2=0x7fe56c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 shutdown_connections 2023-10-05T15:36:03.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.478+0000 7fe572fff700 1 -- 172.21.15.17:0/1217388630 wait complete. 2023-10-05T15:36:03.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 -- 172.21.15.17:0/2381355885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 msgr2=0x7f18a81024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/2381355885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a81024f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f189c009990 tx=0x7f189c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 -- 172.21.15.17:0/2381355885 shutdown_connections 2023-10-05T15:36:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/2381355885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8102a30 0x7f18a8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/2381355885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8100e90 0x7f18a81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/2381355885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a81024f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 -- 172.21.15.17:0/2381355885 >> 172.21.15.17:0/2381355885 conn(0x7f18a80fc430 msgr2=0x7f18a80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:03.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 -- 172.21.15.17:0/2381355885 shutdown_connections 2023-10-05T15:36:03.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.706+0000 7f18ad9ff700 1 -- 172.21.15.17:0/2381355885 wait complete. 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.707+0000 7f18ad9ff700 1 Processor -- start 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.707+0000 7f18ad9ff700 1 -- start start 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18ad9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 0x7f18a8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18ad9ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18ad9ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8102a30 0x7f18a81a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18ad9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81a0940 con 0x7f18a8100e90 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18ad9ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81a0a80 con 0x7f18a8102a30 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18ad9ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a81a0c10 con 0x7f18a8102070 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 0x7f18a8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 0x7f18a8198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60064/0 (socket says 172.21.15.17:60064) 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 -- 172.21.15.17:0/3129369523 learned_addr learned my addr 172.21.15.17:0/3129369523 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a67fc700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a77fe700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8102a30 0x7f18a81a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 -- 172.21.15.17:0/3129369523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 msgr2=0x7f18a8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 -- 172.21.15.17:0/3129369523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8102a30 msgr2=0x7f18a81a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8102a30 0x7f18a81a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a6ffd700 1 -- 172.21.15.17:0/3129369523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0009c40 con 0x7f18a8100e90 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a67fc700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.708+0000 7f18a77fe700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8102a30 0x7f18a81a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.709+0000 7f18a6ffd700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 0x7f18a8198dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f189800e970 tx=0x7f189800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.709+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898009790 con 0x7f18a8100e90 2023-10-05T15:36:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.709+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c0095f0 con 0x7f18a8100e90 2023-10-05T15:36:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.709+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18980044b0 con 0x7f18a8100e90 2023-10-05T15:36:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.709+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898003dd0 con 0x7f18a8100e90 2023-10-05T15:36:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.709+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a81a1200 con 0x7f18a8100e90 2023-10-05T15:36:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.710+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a810c600 con 0x7f18a8100e90 2023-10-05T15:36:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.712+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f1898003f30 con 0x7f18a8100e90 2023-10-05T15:36:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.713+0000 7f18ac9fd700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18900a1590 0x7f18900a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.714+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1898014070 con 0x7f18a8100e90 2023-10-05T15:36:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.714+0000 7f18a67fc700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18900a1590 0x7f18900a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.715+0000 7f18a67fc700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18900a1590 0x7f18900a3a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f189c0098e0 tx=0x7f189c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:03.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.718+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1898096600 con 0x7f18a8100e90 2023-10-05T15:36:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.932+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f18a81a1560 con 0x7f18a8100e90 2023-10-05T15:36:03.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.933+0000 7f18ac9fd700 1 -- 172.21.15.17:0/3129369523 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1898099c20 con 0x7f18a8100e90 2023-10-05T15:36:03.935 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18900a1590 msgr2=0x7f18900a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18900a1590 0x7f18900a3a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f189c0098e0 tx=0x7f189c005fd0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 msgr2=0x7f18a8198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:03.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 0x7f18a8198dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f189800e970 tx=0x7f189800ed30 comp rx=0 tx=0).stop 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 shutdown_connections 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18900a1590 0x7f18900a3a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18a8102a30 0x7f18a81a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18a8100e90 0x7f18a8198dc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 --2- 172.21.15.17:0/3129369523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a8102070 0x7f18a8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 >> 172.21.15.17:0/3129369523 conn(0x7f18a80fc430 msgr2=0x7f18a80fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.935+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 shutdown_connections 2023-10-05T15:36:03.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:03.936+0000 7f18ad9ff700 1 -- 172.21.15.17:0/3129369523 wait complete. 2023-10-05T15:36:03.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:03 smithi017 ceph-mon[129107]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:03.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:03 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2133693553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:03.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:03 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1217388630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:03.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:03 smithi167 ceph-mon[133366]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:03 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2133693553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:03 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1217388630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:03 smithi079 ceph-mon[132936]: pgmap v351: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:03 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2133693553' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:03 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1217388630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.158+0000 7f68263ff700 1 -- 172.21.15.17:0/3038870917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102080 msgr2=0x7f6820102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.158+0000 7f68263ff700 1 --2- 172.21.15.17:0/3038870917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102080 0x7f6820102500 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6814009990 tx=0x7f6814009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.158+0000 7f68263ff700 1 -- 172.21.15.17:0/3038870917 shutdown_connections 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.158+0000 7f68263ff700 1 --2- 172.21.15.17:0/3038870917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6820102a40 0x7f6820109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.159+0000 7f68263ff700 1 --2- 172.21.15.17:0/3038870917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820100ea0 0x7f68201012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.159+0000 7f68263ff700 1 --2- 172.21.15.17:0/3038870917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102080 0x7f6820102500 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.159+0000 7f68263ff700 1 -- 172.21.15.17:0/3038870917 >> 172.21.15.17:0/3038870917 conn(0x7f68200fc420 msgr2=0x7f68200fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.159+0000 7f68263ff700 1 -- 172.21.15.17:0/3038870917 shutdown_connections 2023-10-05T15:36:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.159+0000 7f68263ff700 1 -- 172.21.15.17:0/3038870917 wait complete. 2023-10-05T15:36:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 Processor -- start 2023-10-05T15:36:04.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 -- start start 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820100ea0 0x7f6820196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6820102080 0x7f6820197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 0x7f682019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682019e6d0 con 0x7f6820102a40 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682019e810 con 0x7f6820100ea0 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f68263ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682019e9a0 con 0x7f6820102080 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f682499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 0x7f682019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f682499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 0x7f682019e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51480/0 (socket says 172.21.15.17:51480) 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f682499c700 1 -- 172.21.15.17:0/2227461381 learned_addr learned my addr 172.21.15.17:0/2227461381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f681f7fe700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6820102080 0x7f6820197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.160+0000 7f681ffff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820100ea0 0x7f6820196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f682499c700 1 -- 172.21.15.17:0/2227461381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6820102080 msgr2=0x7f6820197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f682499c700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6820102080 0x7f6820197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f682499c700 1 -- 172.21.15.17:0/2227461381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820100ea0 msgr2=0x7f6820196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f682499c700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820100ea0 0x7f6820196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f682499c700 1 -- 172.21.15.17:0/2227461381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68140095f0 con 0x7f6820102a40 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f682499c700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 0x7f682019e100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f681800ef30 tx=0x7f681800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818018070 con 0x7f6820102a40 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f681800f040 con 0x7f6820102a40 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800cbc0 con 0x7f6820102a40 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.161+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682019ec20 con 0x7f6820102a40 2023-10-05T15:36:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.162+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682019f0e0 con 0x7f6820102a40 2023-10-05T15:36:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.162+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68201085e0 con 0x7f6820102a40 2023-10-05T15:36:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.164+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7f6818007500 con 0x7f6820102a40 2023-10-05T15:36:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.166+0000 7f681d7fa700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68080a15d0 0x7f68080a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.166+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f68180ccc50 con 0x7f6820102a40 2023-10-05T15:36:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.166+0000 7f681ffff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68080a15d0 0x7f68080a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.167+0000 7f681ffff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68080a15d0 0x7f68080a3a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6820101bf0 tx=0x7f6810009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:04.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.170+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6818095e70 con 0x7f6820102a40 2023-10-05T15:36:04.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.433+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f682002d020 con 0x7f6820102a40 2023-10-05T15:36:04.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.433+0000 7f681d7fa700 1 -- 172.21.15.17:0/2227461381 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f6818099490 con 0x7f6820102a40 2023-10-05T15:36:04.435 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:04.435 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68080a15d0 msgr2=0x7f68080a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68080a15d0 0x7f68080a3a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6820101bf0 tx=0x7f6810009260 comp rx=0 tx=0).stop 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 msgr2=0x7f682019e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 0x7f682019e100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f681800ef30 tx=0x7f681800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 shutdown_connections 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68080a15d0 0x7f68080a3a90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6820102a40 0x7f682019e100 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6820100ea0 0x7f6820196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 --2- 172.21.15.17:0/2227461381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6820102080 0x7f6820197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 >> 172.21.15.17:0/2227461381 conn(0x7f68200fc420 msgr2=0x7f6820105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:04.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 shutdown_connections 2023-10-05T15:36:04.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.436+0000 7f68263ff700 1 -- 172.21.15.17:0/2227461381 wait complete. 2023-10-05T15:36:04.439 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:04.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.688+0000 7fc243dff700 1 -- 172.21.15.17:0/659647750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c100ea0 msgr2=0x7fc23c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.688+0000 7fc243dff700 1 --2- 172.21.15.17:0/659647750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c100ea0 0x7fc23c1012c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc238009990 tx=0x7fc238009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 -- 172.21.15.17:0/659647750 shutdown_connections 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 --2- 172.21.15.17:0/659647750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c102a40 0x7fc23c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 --2- 172.21.15.17:0/659647750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c100ea0 0x7fc23c1012c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 --2- 172.21.15.17:0/659647750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc23c102080 0x7fc23c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 -- 172.21.15.17:0/659647750 >> 172.21.15.17:0/659647750 conn(0x7fc23c0fc420 msgr2=0x7fc23c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 -- 172.21.15.17:0/659647750 shutdown_connections 2023-10-05T15:36:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.689+0000 7fc243dff700 1 -- 172.21.15.17:0/659647750 wait complete. 2023-10-05T15:36:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 Processor -- start 2023-10-05T15:36:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 -- start start 2023-10-05T15:36:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c100ea0 0x7fc23c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 0x7fc23c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc23c102a40 0x7fc23c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1a08e0 con 0x7fc23c102080 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1a0a20 con 0x7fc23c100ea0 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc243dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c1a0bb0 con 0x7fc23c102a40 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc24139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 0x7fc23c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.690+0000 7fc24139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 0x7fc23c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51510/0 (socket says 172.21.15.17:51510) 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 -- 172.21.15.17:0/349541807 learned_addr learned my addr 172.21.15.17:0/349541807 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24239c700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc23c102a40 0x7fc23c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc241b9b700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c100ea0 0x7fc23c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 -- 172.21.15.17:0/349541807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc23c102a40 msgr2=0x7fc23c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc23c102a40 0x7fc23c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 -- 172.21.15.17:0/349541807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c100ea0 msgr2=0x7fc23c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c100ea0 0x7fc23c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 -- 172.21.15.17:0/349541807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380095f0 con 0x7fc23c102080 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc241b9b700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c100ea0 0x7fc23c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc24139a700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 0x7fc23c1992a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d980 tx=0x7fc22c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c004020 con 0x7fc23c102080 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc22c009730 con 0x7fc23c102080 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c003a00 con 0x7fc23c102080 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.691+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c1a0e90 con 0x7fc23c102080 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.692+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c1a12c0 con 0x7fc23c102080 2023-10-05T15:36:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.693+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c193400 con 0x7fc23c102080 2023-10-05T15:36:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.694+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fc22c0098a0 con 0x7fc23c102080 2023-10-05T15:36:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.696+0000 7fc232ffd700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc2280a15d0 0x7fc2280a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.696+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc22c0cce40 con 0x7fc23c102080 2023-10-05T15:36:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.696+0000 7fc241b9b700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc2280a15d0 0x7fc2280a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.697+0000 7fc241b9b700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc2280a15d0 0x7fc2280a3a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc23800b5c0 tx=0x7fc238005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:04.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.700+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc22c095fd0 con 0x7fc23c102080 2023-10-05T15:36:04.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.914+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc23c10c690 con 0x7fc23c102080 2023-10-05T15:36:04.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.916+0000 7fc232ffd700 1 -- 172.21.15.17:0/349541807 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+24386 (secure 0 0 0) 0x7fc22c0995f0 con 0x7fc23c102080 2023-10-05T15:36:04.918 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:04.918 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":92,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:35:05.767531+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc2280a15d0 msgr2=0x7fc2280a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc2280a15d0 0x7fc2280a3a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc23800b5c0 tx=0x7fc238005fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 msgr2=0x7fc23c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 0x7fc23c1992a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d980 tx=0x7fc22c00dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:04.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 shutdown_connections 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc2280a15d0 0x7fc2280a3a90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc23c102a40 0x7fc23c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc23c100ea0 0x7fc23c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 --2- 172.21.15.17:0/349541807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc23c102080 0x7fc23c1992a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.918+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 >> 172.21.15.17:0/349541807 conn(0x7fc23c0fc420 msgr2=0x7fc23c107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.919+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 shutdown_connections 2023-10-05T15:36:04.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:04.919+0000 7fc243dff700 1 -- 172.21.15.17:0/349541807 wait complete. 2023-10-05T15:36:04.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:04 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3129369523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:04.936 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:04 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2227461381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:04.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:04 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3129369523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:04 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2227461381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:04 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3129369523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:04 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2227461381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.139+0000 7fd3883ff700 1 -- 172.21.15.17:0/3892879240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380102080 msgr2=0x7fd380102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.139+0000 7fd3883ff700 1 --2- 172.21.15.17:0/3892879240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380102080 0x7fd380102500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd370009990 tx=0x7fd370009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 -- 172.21.15.17:0/3892879240 shutdown_connections 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 --2- 172.21.15.17:0/3892879240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd380102a40 0x7fd380109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 --2- 172.21.15.17:0/3892879240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380100ea0 0x7fd3801012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 --2- 172.21.15.17:0/3892879240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380102080 0x7fd380102500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 -- 172.21.15.17:0/3892879240 >> 172.21.15.17:0/3892879240 conn(0x7fd3800fc420 msgr2=0x7fd3800fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 -- 172.21.15.17:0/3892879240 shutdown_connections 2023-10-05T15:36:05.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.140+0000 7fd3883ff700 1 -- 172.21.15.17:0/3892879240 wait complete. 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 Processor -- start 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 -- start start 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 0x7fd380198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380102080 0x7fd3801992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd380102a40 0x7fd3801a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801a08e0 con 0x7fd380100ea0 2023-10-05T15:36:05.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801a0a20 con 0x7fd380102a40 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd3883ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801a0bb0 con 0x7fd380102080 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd38619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 0x7fd380198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd38619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 0x7fd380198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51534/0 (socket says 172.21.15.17:51534) 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.141+0000 7fd38619b700 1 -- 172.21.15.17:0/2399423918 learned_addr learned my addr 172.21.15.17:0/2399423918 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38699c700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd380102a40 0x7fd3801a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38599a700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380102080 0x7fd3801992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38619b700 1 -- 172.21.15.17:0/2399423918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380102080 msgr2=0x7fd3801992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38619b700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380102080 0x7fd3801992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38619b700 1 -- 172.21.15.17:0/2399423918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd380102a40 msgr2=0x7fd3801a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38619b700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd380102a40 0x7fd3801a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38619b700 1 -- 172.21.15.17:0/2399423918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700095f0 con 0x7fd380100ea0 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd38619b700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 0x7fd380198d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00e970 tx=0x7fd37c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c009790 con 0x7fd380100ea0 2023-10-05T15:36:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd37c00eec0 con 0x7fd380100ea0 2023-10-05T15:36:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c003c10 con 0x7fd380100ea0 2023-10-05T15:36:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.142+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3801a0e90 con 0x7fd380100ea0 2023-10-05T15:36:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.143+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3801a1260 con 0x7fd380100ea0 2023-10-05T15:36:05.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.144+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38010c610 con 0x7fd380100ea0 2023-10-05T15:36:05.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.146+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 136054+0+0 (secure 0 0 0) 0x7fd37c003db0 con 0x7fd380100ea0 2023-10-05T15:36:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.148+0000 7fd3777fe700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd36c0a15d0 0x7fd36c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.148+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd37c014070 con 0x7fd380100ea0 2023-10-05T15:36:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.148+0000 7fd38599a700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd36c0a15d0 0x7fd36c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.149+0000 7fd38599a700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd36c0a15d0 0x7fd36c0a3a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd3700098e0 tx=0x7fd37000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.152+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd37c096560 con 0x7fd380100ea0 2023-10-05T15:36:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.409+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3801a1790 con 0x7fd380100ea0 2023-10-05T15:36:05.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.410+0000 7fd3777fe700 1 -- 172.21.15.17:0/2399423918 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7fd37c099b80 con 0x7fd380100ea0 2023-10-05T15:36:05.412 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:05.412 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd36c0a15d0 msgr2=0x7fd36c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd36c0a15d0 0x7fd36c0a3a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd3700098e0 tx=0x7fd37000b260 comp rx=0 tx=0).stop 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 msgr2=0x7fd380198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 0x7fd380198d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00e970 tx=0x7fd37c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 shutdown_connections 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd36c0a15d0 0x7fd36c0a3a90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd380102a40 0x7fd3801a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd380100ea0 0x7fd380198d60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 --2- 172.21.15.17:0/2399423918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd380102080 0x7fd3801992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 >> 172.21.15.17:0/2399423918 conn(0x7fd3800fc420 msgr2=0x7fd3800fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 shutdown_connections 2023-10-05T15:36:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.413+0000 7fd3883ff700 1 -- 172.21.15.17:0/2399423918 wait complete. 2023-10-05T15:36:05.416 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:05.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-05T15:34:32.118456+0000', 'modified': '2023-10-05T15:35:01.582968+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24593, 'mds_1': 24569, 'mds_2': 24550, 'mds_3': 24539, 'mds_4': 24526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6833/978373819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 978373819}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 978373819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24470': {'gid': 24470, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6833/926038497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 926038497}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 926038497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24488': {'gid': 24488, 'name': 'd', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6837/3739441472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6836', 'nonce': 3739441472}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 3739441472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6835/331259911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 331259911}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 331259911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/4056762327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 4056762327}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 4056762327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.167:6837/2368363786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 2368363786}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2368363786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.79:6837/2714086354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 2714086354}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2714086354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.167:6839/3231858560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 3231858560}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 3231858560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24569': {'gid': 24569, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.17:6839/2274947328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 2274947328}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 2274947328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6839/2052945872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 2052945872}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 2052945872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-05T15:36:05.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-05T15:36:05.434 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 -- 172.21.15.17:0/1510061551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb28104c80 msgr2=0x7fdb2810b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 --2- 172.21.15.17:0/1510061551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb28104c80 0x7fdb2810b530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009fc0 tx=0x7fdb2000b330 comp rx=0 tx=0).stop 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 -- 172.21.15.17:0/1510061551 shutdown_connections 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 --2- 172.21.15.17:0/1510061551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb28104c80 0x7fdb2810b530 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 --2- 172.21.15.17:0/1510061551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb281030f0 0x7fdb28103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 --2- 172.21.15.17:0/1510061551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb281042e0 0x7fdb28104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 -- 172.21.15.17:0/1510061551 >> 172.21.15.17:0/1510061551 conn(0x7fdb280fe660 msgr2=0x7fdb28100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 -- 172.21.15.17:0/1510061551 shutdown_connections 2023-10-05T15:36:05.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.650+0000 7fdb305ff700 1 -- 172.21.15.17:0/1510061551 wait complete. 2023-10-05T15:36:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.652+0000 7fdb305ff700 1 Processor -- start 2023-10-05T15:36:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.652+0000 7fdb305ff700 1 -- start start 2023-10-05T15:36:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.652+0000 7fdb305ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb281030f0 0x7fdb28078c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.652+0000 7fdb305ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 0x7fdb280791a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.652+0000 7fdb305ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb28104c80 0x7fdb280757f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb305ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28075f90 con 0x7fdb281042e0 2023-10-05T15:36:05.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb305ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28076100 con 0x7fdb28104c80 2023-10-05T15:36:05.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb305ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb280762c0 con 0x7fdb281030f0 2023-10-05T15:36:05.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb2db9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 0x7fdb280791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb2db9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 0x7fdb280791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51552/0 (socket says 172.21.15.17:51552) 2023-10-05T15:36:05.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb2db9a700 1 -- 172.21.15.17:0/475954067 learned_addr learned my addr 172.21.15.17:0/475954067 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.653+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb281030f0 0x7fdb28078c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb28104c80 0x7fdb280757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2db9a700 1 -- 172.21.15.17:0/475954067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb281030f0 msgr2=0x7fdb28078c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2db9a700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb281030f0 0x7fdb28078c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2db9a700 1 -- 172.21.15.17:0/475954067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb28104c80 msgr2=0x7fdb280757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2db9a700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb28104c80 0x7fdb280757f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2db9a700 1 -- 172.21.15.17:0/475954067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb20009c40 con 0x7fdb281042e0 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb28104c80 0x7fdb280757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:05.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.654+0000 7fdb2db9a700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 0x7fdb280791a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800e9c0 tx=0x7fdb1800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.655+0000 7fdb1f7fe700 1 -- 172.21.15.17:0/475954067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800cbd0 con 0x7fdb281042e0 2023-10-05T15:36:05.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.655+0000 7fdb1f7fe700 1 -- 172.21.15.17:0/475954067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb1800cd30 con 0x7fdb281042e0 2023-10-05T15:36:05.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.655+0000 7fdb1f7fe700 1 -- 172.21.15.17:0/475954067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb18005520 con 0x7fdb281042e0 2023-10-05T15:36:05.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.655+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb281a5370 con 0x7fdb281042e0 2023-10-05T15:36:05.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.655+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb281a5800 con 0x7fdb281042e0 2023-10-05T15:36:05.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.659+0000 7fdb1f7fe700 1 -- 172.21.15.17:0/475954067 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdb18004750 con 0x7fdb281042e0 2023-10-05T15:36:05.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 Processor -- start 2023-10-05T15:36:05.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 -- start start 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049210 0x557435049630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 0x55743504a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x55743504ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb1f7fe700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb140a1550 0x7fdb140a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434fb1410 con 0x557435049b70 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434fa2bd0 con 0x55743504aa10 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.660+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434fa04f0 con 0x557435049210 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 0x55743504a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb1f7fe700 1 -- 172.21.15.17:0/475954067 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdb18014070 con 0x7fdb281042e0 2023-10-05T15:36:05.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 0x55743504a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51556/0 (socket says 172.21.15.17:51556) 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 -- 172.21.15.17:0/1613170773 learned_addr learned my addr 172.21.15.17:0/1613170773 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x55743504ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2db9a700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb140a1550 0x7fdb140a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049210 0x557435049630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 -- 172.21.15.17:0/1613170773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049210 msgr2=0x557435049630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049210 0x557435049630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 -- 172.21.15.17:0/1613170773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 msgr2=0x55743504ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x55743504ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.661+0000 7fdb2e39b700 1 -- 172.21.15.17:0/1613170773 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557434dc6d90 con 0x557435049b70 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.662+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 0x55743504a430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009bf0 tx=0x7fdb24009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fefdb45d88c936c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.662+0000 7fdb2db9a700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb140a1550 0x7fdb140a3a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdb18099f20 tx=0x7fdb180097d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.662+0000 7fdb1cbfe700 1 -- 172.21.15.17:0/1613170773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400eaa0 con 0x557435049b70 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.662+0000 7fdb1cbfe700 1 -- 172.21.15.17:0/1613170773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb24004cc0 con 0x557435049b70 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.662+0000 7fdb1cbfe700 1 -- 172.21.15.17:0/1613170773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb240054e0 con 0x557435049b70 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 -- 172.21.15.17:0/1613170773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 msgr2=0x55743504a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 0x55743504a430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009bf0 tx=0x7fdb24009f00 comp rx=0 tx=0).stop 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 -- 172.21.15.17:0/1613170773 shutdown_connections 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x55743504ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049210 0x557435049630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/1613170773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049b70 0x55743504a430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 -- 172.21.15.17:0/1613170773 >> 172.21.15.17:0/1613170773 conn(0x557434fbd210 msgr2=0x5574350440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 -- 172.21.15.17:0/1613170773 shutdown_connections 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 -- 172.21.15.17:0/1613170773 wait complete. 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.663+0000 7fdb43f95b80 1 -- start start 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 Processor -- start 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049210 0x557435052fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x5574350534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55743504aa10 0x55743505a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434f9bde0 con 0x55743504aa10 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434f386c0 con 0x557435049210 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434f38360 con 0x557435049b70 2023-10-05T15:36:05.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb43f95b80 10 client.0 _ll_register_callbacks cb 0x557434d957b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb2eb9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049210 0x557435052fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb2e39b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x5574350534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb2eb9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049210 0x557435052fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34062/0 (socket says 172.21.15.17:34062) 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/380244556 learned_addr learned my addr 172.21.15.17:0/380244556 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.664+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55743504aa10 0x55743505a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 msgr2=0x5574350534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x5574350534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/380244556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049210 msgr2=0x557435052fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049210 0x557435052fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/380244556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb24009820 con 0x55743504aa10 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x5574350534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55743504aa10 0x55743505a520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdb20007720 tx=0x7fdb20009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dacb2acf35c9a49 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.665+0000 7fdb11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:05.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb11ffb700 1 -- 172.21.15.17:0/380244556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000e070 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55743503bec0 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb11ffb700 1 -- 172.21.15.17:0/380244556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdb20026030 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb11ffb700 1 -- 172.21.15.17:0/380244556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb20007530 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb43f95b80 10 client.15270 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557434dafc10 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb11ffb700 1 -- 172.21.15.17:0/380244556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55743503bec0 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb11ffb700 1 -- 172.21.15.17:0/380244556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdb2000b050 con 0x55743504aa10 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.666+0000 7fdb43f95b80 10 client.15270 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.667+0000 7fdb43f95b80 10 client.15270 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.667+0000 7fdb43f95b80 20 client.15270 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.667+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55743505ebe0 0x55743505d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.667+0000 7fdb43f95b80 4 client.15270 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.667+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557434f94dc0 con 0x55743505ebe0 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.667+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55743505ebe0 0x55743505d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.668+0000 7fdb11ffb700 10 client.15270 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.668+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55743505ebe0 0x55743505d620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=415d15a586fd3bfc server_cookie=addf2603f2f7c8b2 in_seq=0 out_seq=0 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb11ffb700 1 -- 172.21.15.17:0/380244556 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557434f94dc0 con 0x55743505ebe0 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb11ffb700 10 client.15270 handle_command_reply: tid=0 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 client.15270 shutdown 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55743504aa10 msgr2=0x55743505a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55743504aa10 0x55743505a520 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdb20007720 tx=0x7fdb20009b20 comp rx=0 tx=0).stop 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 shutdown_connections 2023-10-05T15:36:05.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55743505ebe0 0x55743505d620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55743504aa10 0x55743505a520 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049210 0x557435052fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/380244556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x5574350534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb11ffb700 0 client.15270 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 >> 172.21.15.17:0/380244556 conn(0x557434fbd210 msgr2=0x557435043f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 shutdown_connections 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 1 -- 172.21.15.17:0/380244556 wait complete. 2023-10-05T15:36:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.669+0000 7fdb43f95b80 20 client.15270 trim_cache size 0 max 16384 2023-10-05T15:36:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 Processor -- start 2023-10-05T15:36:05.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 -- start start 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x557435042b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049b70 0x55743505a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55743504aa10 0x55743505acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434e1c8d0 con 0x557435049210 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557435054190 con 0x557435049b70 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.688+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557434f97ed0 con 0x55743504aa10 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x557435042b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x557435042b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51580/0 (socket says 172.21.15.17:51580) 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/915726053 learned_addr learned my addr 172.21.15.17:0/915726053 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/915726053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55743504aa10 msgr2=0x55743505acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55743504aa10 0x55743505acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/915726053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049b70 msgr2=0x55743505a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049b70 0x55743505a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/915726053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557434ded200 con 0x557435049210 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.689+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x557435042b70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009c10 tx=0x7fdb2000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbf1f8cfa67bbc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb1d3ff700 1 -- 172.21.15.17:0/915726053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000e070 con 0x557435049210 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb1d3ff700 1 -- 172.21.15.17:0/915726053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb20025020 con 0x557435049210 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb1d3ff700 1 -- 172.21.15.17:0/915726053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2002bba0 con 0x557435049210 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 -- 172.21.15.17:0/915726053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 msgr2=0x557435042b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x557435042b70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009c10 tx=0x7fdb2000b680 comp rx=0 tx=0).stop 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 -- 172.21.15.17:0/915726053 shutdown_connections 2023-10-05T15:36:05.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55743504aa10 0x55743505acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x557435042b70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/915726053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557435049b70 0x55743505a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 -- 172.21.15.17:0/915726053 >> 172.21.15.17:0/915726053 conn(0x557434fbd210 msgr2=0x557435051c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 -- 172.21.15.17:0/915726053 shutdown_connections 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.690+0000 7fdb43f95b80 1 -- 172.21.15.17:0/915726053 wait complete. 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 -- start start 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 Processor -- start 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x55743505d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x55743505ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x557435059480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557435059b00 con 0x557435049210 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557435059c70 con 0x55743504aa10 2023-10-05T15:36:05.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557435059e30 con 0x557435049b70 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.691+0000 7fdb43f95b80 10 client.0 _ll_register_callbacks cb 0x557434d957b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x55743505d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x55743505d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51596/0 (socket says 172.21.15.17:51596) 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/3738718705 learned_addr learned my addr 172.21.15.17:0/3738718705 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x55743505ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 msgr2=0x55743505ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x55743505ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/3738718705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 msgr2=0x557435059480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x557435059480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 -- 172.21.15.17:0/3738718705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557434dafc10 con 0x557435049210 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x55743505ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb2eb9c700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x55743505d870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdb2002b610 tx=0x7fdb20009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349cc85b6fd97637 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.692+0000 7fdb11ffb700 1 -- 172.21.15.17:0/3738718705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000e030 con 0x557435049210 2023-10-05T15:36:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb24004cc0 con 0x557435049210 2023-10-05T15:36:05.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb11ffb700 1 -- 172.21.15.17:0/3738718705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdb2000f070 con 0x557435049210 2023-10-05T15:36:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb11ffb700 1 -- 172.21.15.17:0/3738718705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb2002b940 con 0x557435049210 2023-10-05T15:36:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 10 client.15276 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557434dc5260 con 0x557435049210 2023-10-05T15:36:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb11ffb700 1 -- 172.21.15.17:0/3738718705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb24004cc0 con 0x557435049210 2023-10-05T15:36:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb11ffb700 1 -- 172.21.15.17:0/3738718705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdb2001ead0 con 0x557435049210 2023-10-05T15:36:05.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 10 client.15276 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 20 client.15276 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5574350b6870 0x5574350b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 4 client.15276 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.693+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557434f94ae0 con 0x5574350b6870 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.694+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5574350b6870 0x5574350b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.694+0000 7fdb2e39b700 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5574350b6870 0x5574350b2cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f1bba4b5658a470f server_cookie=82cd791df4616cbd in_seq=0 out_seq=0 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.694+0000 7fdb11ffb700 10 client.15276 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.694+0000 7fdb11ffb700 1 -- 172.21.15.17:0/3738718705 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557434f94ae0 con 0x5574350b6870 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.694+0000 7fdb11ffb700 10 client.15276 handle_command_reply: tid=0 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.694+0000 7fdb43f95b80 1 client.15276 shutdown 2023-10-05T15:36:05.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 msgr2=0x55743505d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x55743505d870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdb2002b610 tx=0x7fdb20009b70 comp rx=0 tx=0).stop 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/349541807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:05.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:05 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2399423918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 shutdown_connections 2023-10-05T15:36:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55743504aa10 0x557435059480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5574350b6870 0x5574350b2cf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557435049210 0x55743505d870 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 --2- 172.21.15.17:0/3738718705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557435049b70 0x55743505ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb11ffb700 0 client.15276 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 >> 172.21.15.17:0/3738718705 conn(0x557434fbd210 msgr2=0x557435043ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 shutdown_connections 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 1 -- 172.21.15.17:0/3738718705 wait complete. 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.695+0000 7fdb43f95b80 20 client.15276 trim_cache size 0 max 16384 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24526, 2023-10-05T15:36:05.702 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 64.940222000999995, 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 93, 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 114.744775074 2023-10-05T15:36:05.703 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb140a1550 msgr2=0x7fdb140a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb140a1550 0x7fdb140a3a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdb18099f20 tx=0x7fdb180097d0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 msgr2=0x7fdb280791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 0x7fdb280791a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800e9c0 tx=0x7fdb1800ed80 comp rx=0 tx=0).stop 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 shutdown_connections 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdb140a1550 0x7fdb140a3a10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb28104c80 0x7fdb280757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb281030f0 0x7fdb28078c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 --2- 172.21.15.17:0/475954067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdb281042e0 0x7fdb280791a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 >> 172.21.15.17:0/475954067 conn(0x7fdb280fe660 msgr2=0x7fdb28100900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 shutdown_connections 2023-10-05T15:36:05.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.696+0000 7fdb305ff700 1 -- 172.21.15.17:0/475954067 wait complete. 2023-10-05T15:36:05.716 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 -- 172.21.15.17:0/4189722796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c100e90 msgr2=0x7f543c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 --2- 172.21.15.17:0/4189722796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c100e90 0x7f543c1012b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5438009990 tx=0x7f5438009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 -- 172.21.15.17:0/4189722796 shutdown_connections 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 --2- 172.21.15.17:0/4189722796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 --2- 172.21.15.17:0/4189722796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c100e90 0x7f543c1012b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 --2- 172.21.15.17:0/4189722796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c102070 0x7f543c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 -- 172.21.15.17:0/4189722796 >> 172.21.15.17:0/4189722796 conn(0x7f543c0fc430 msgr2=0x7f543c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 -- 172.21.15.17:0/4189722796 shutdown_connections 2023-10-05T15:36:05.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.919+0000 7f5443bff700 1 -- 172.21.15.17:0/4189722796 wait complete. 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.920+0000 7f5443bff700 1 Processor -- start 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.920+0000 7f5443bff700 1 -- start start 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f5443bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c100e90 0x7f543c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f5443bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c102070 0x7f543c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f5443bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f5443bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c073f80 con 0x7f543c102a30 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f5443bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0740f0 con 0x7f543c100e90 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f5443bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c1a0bc0 con 0x7f543c102070 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c100e90 0x7f543c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51610/0 (socket says 172.21.15.17:51610) 2023-10-05T15:36:05.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 -- 172.21.15.17:0/2340263940 learned_addr learned my addr 172.21.15.17:0/2340263940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544119a700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c102070 0x7f543c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 -- 172.21.15.17:0/2340263940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c102070 msgr2=0x7f543c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c102070 0x7f543c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 -- 172.21.15.17:0/2340263940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c100e90 msgr2=0x7f543c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c100e90 0x7f543c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544219c700 1 -- 172.21.15.17:0/2340263940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380095f0 con 0x7f543c102a30 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.921+0000 7f544119a700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c102070 0x7f543c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.922+0000 7f544219c700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c0737e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f543400ef30 tx=0x7f543400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.922+0000 7f5432ffd700 1 -- 172.21.15.17:0/2340263940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434018070 con 0x7f543c102a30 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.922+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c1a0e40 con 0x7f543c102a30 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.922+0000 7f5432ffd700 1 -- 172.21.15.17:0/2340263940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f543400f040 con 0x7f543c102a30 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.922+0000 7f5432ffd700 1 -- 172.21.15.17:0/2340263940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543400cc70 con 0x7f543c102a30 2023-10-05T15:36:05.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.922+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c1a12c0 con 0x7f543c102a30 2023-10-05T15:36:05.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.925+0000 7f5432ffd700 1 -- 172.21.15.17:0/2340263940 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5434007500 con 0x7f543c102a30 2023-10-05T15:36:05.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.927+0000 7f54574d1b80 1 Processor -- start 2023-10-05T15:36:05.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.927+0000 7f54574d1b80 1 -- start start 2023-10-05T15:36:05.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f5432ffd700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54280a1500 0x7f54280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 0x557bd1a08630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f5432ffd700 1 -- 172.21.15.17:0/2340263940 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54340ccbf0 con 0x7f543c102a30 2023-10-05T15:36:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08b70 0x557bd1a09430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a09e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f54574d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1970410 con 0x557bd1a08210 2023-10-05T15:36:05.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f54574d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1961bd0 con 0x557bd1a09a10 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f54574d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd195f4f0 con 0x557bd1a08b70 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f544119a700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54280a1500 0x7f54280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f544199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 0x557bd1a08630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f544199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 0x557bd1a08630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51618/0 (socket says 172.21.15.17:51618) 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f544199b700 1 -- 172.21.15.17:0/1885402383 learned_addr learned my addr 172.21.15.17:0/1885402383 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.928+0000 7f544219c700 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a09e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544119a700 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08b70 0x557bd1a09430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544199b700 1 -- 172.21.15.17:0/1885402383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08b70 msgr2=0x557bd1a09430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544199b700 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08b70 0x557bd1a09430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544199b700 1 -- 172.21.15.17:0/1885402383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 msgr2=0x557bd1a09e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544199b700 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a09e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544199b700 1 -- 172.21.15.17:0/1885402383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd1785d90 con 0x557bd1a08210 2023-10-05T15:36:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544219c700 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a09e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544119a700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54280a1500 0x7f54280a39c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f543c100bb0 tx=0x7f542c0138a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f544199b700 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 0x557bd1a08630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f54380059d0 tx=0x7f5438005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4734ece8aa88c458 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f5427fff700 1 -- 172.21.15.17:0/1885402383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543801d070 con 0x557bd1a08210 2023-10-05T15:36:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f5427fff700 1 -- 172.21.15.17:0/1885402383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f543801e040 con 0x557bd1a08210 2023-10-05T15:36:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.929+0000 7f5427fff700 1 -- 172.21.15.17:0/1885402383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800b710 con 0x557bd1a08210 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 -- 172.21.15.17:0/1885402383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 msgr2=0x557bd1a08630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 0x557bd1a08630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f54380059d0 tx=0x7f5438005bc0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 -- 172.21.15.17:0/1885402383 shutdown_connections 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a09e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08210 0x557bd1a08630 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1885402383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08b70 0x557bd1a09430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.930+0000 7f54574d1b80 1 -- 172.21.15.17:0/1885402383 >> 172.21.15.17:0/1885402383 conn(0x557bd197c210 msgr2=0x557bd1a030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.931+0000 7f54574d1b80 1 -- 172.21.15.17:0/1885402383 shutdown_connections 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.931+0000 7f54574d1b80 1 -- 172.21.15.17:0/1885402383 wait complete. 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.931+0000 7f54574d1b80 1 -- start start 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.931+0000 7f54574d1b80 1 Processor -- start 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a11ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 0x557bd1a12410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a19450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd195ade0 con 0x557bd1a08b70 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd18f76c0 con 0x557bd1a09a10 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd18f7360 con 0x557bd1a08210 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f54574d1b80 10 client.0 _ll_register_callbacks cb 0x557bd17547b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 0x557bd1a12410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 0x557bd1a12410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51622/0 (socket says 172.21.15.17:51622) 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 -- 172.21.15.17:0/1112278894 learned_addr learned my addr 172.21.15.17:0/1112278894 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544199b700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a11ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544219c700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a19450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 -- 172.21.15.17:0/1112278894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 msgr2=0x557bd1a11ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a11ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 -- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 msgr2=0x557bd1a19450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a19450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.932+0000 7f544119a700 1 -- 172.21.15.17:0/1112278894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c1a12c0 con 0x557bd1a08b70 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f544119a700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 0x557bd1a12410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f542c009e40 tx=0x7f542c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdfd3ee802a270a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54257fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54257fa700 1 -- 172.21.15.17:0/1112278894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c00fc70 con 0x557bd1a08b70 2023-10-05T15:36:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bd19faec0 con 0x557bd1a08b70 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54257fa700 1 -- 172.21.15.17:0/1112278894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f542c00fdd0 con 0x557bd1a08b70 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54257fa700 1 -- 172.21.15.17:0/1112278894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f542c010e60 con 0x557bd1a08b70 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54574d1b80 10 client.15288 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f543c109c80 con 0x557bd1a08b70 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.933+0000 7f54257fa700 1 -- 172.21.15.17:0/1112278894 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557bd19faec0 con 0x557bd1a08b70 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54257fa700 1 -- 172.21.15.17:0/1112278894 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f542c026020 con 0x557bd1a08b70 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54574d1b80 10 client.15288 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54574d1b80 10 client.15288 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54574d1b80 20 client.15288 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a1db30 0x557bd1a1c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54574d1b80 4 client.15288 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:05.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bd1953dc0 con 0x557bd1a1db30 2023-10-05T15:36:05.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.934+0000 7f544199b700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a1db30 0x557bd1a1c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.935+0000 7f544199b700 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a1db30 0x557bd1a1c5a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=362f2c364d436622 server_cookie=44d9debe63f6ea24 in_seq=0 out_seq=0 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.935+0000 7f54257fa700 10 client.15288 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54257fa700 1 -- 172.21.15.17:0/1112278894 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557bd1953dc0 con 0x557bd1a1db30 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54257fa700 10 client.15288 handle_command_reply: tid=0 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 client.15288 shutdown 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 msgr2=0x557bd1a12410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 0x557bd1a12410 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f542c009e40 tx=0x7f542c0047c0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 shutdown_connections 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a09a10 0x557bd1a19450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a11ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a1db30 0x557bd1a1c5a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1112278894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a08b70 0x557bd1a12410 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54257fa700 0 client.15288 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 >> 172.21.15.17:0/1112278894 conn(0x557bd197c210 msgr2=0x557bd1a02f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 shutdown_connections 2023-10-05T15:36:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 1 -- 172.21.15.17:0/1112278894 wait complete. 2023-10-05T15:36:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.936+0000 7f54574d1b80 20 client.15288 trim_cache size 0 max 16384 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 Processor -- start 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 -- start start 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a19410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd17db8d0 con 0x557bd1a09a10 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1953dc0 con 0x557bd1a08b70 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.955+0000 7f54574d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1956ed0 con 0x557bd1a08210 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a19410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a19410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51636/0 (socket says 172.21.15.17:51636) 2023-10-05T15:36:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 -- 172.21.15.17:0/1058990123 learned_addr learned my addr 172.21.15.17:0/1058990123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544119a700 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544199b700 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 -- 172.21.15.17:0/1058990123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 msgr2=0x557bd1a0c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 -- 172.21.15.17:0/1058990123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 msgr2=0x557bd1a0ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 -- 172.21.15.17:0/1058990123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd176ec10 con 0x557bd1a09a10 2023-10-05T15:36:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.956+0000 7f544219c700 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a19410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f54340ca2f0 tx=0x7f5434099500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d899b79f4808bf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f5430bff700 1 -- 172.21.15.17:0/1058990123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543409a2a0 con 0x557bd1a09a10 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f5430bff700 1 -- 172.21.15.17:0/1058990123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5434099ba0 con 0x557bd1a09a10 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f5430bff700 1 -- 172.21.15.17:0/1058990123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340ca400 con 0x557bd1a09a10 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 -- 172.21.15.17:0/1058990123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 msgr2=0x557bd1a19410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a19410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f54340ca2f0 tx=0x7f5434099500 comp rx=0 tx=0).stop 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 -- 172.21.15.17:0/1058990123 shutdown_connections 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a19410 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 --2- 172.21.15.17:0/1058990123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 -- 172.21.15.17:0/1058990123 >> 172.21.15.17:0/1058990123 conn(0x557bd197c210 msgr2=0x557bd1a10c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 -- 172.21.15.17:0/1058990123 shutdown_connections 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.957+0000 7f54574d1b80 1 -- 172.21.15.17:0/1058990123 wait complete. 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 -- start start 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 Processor -- start 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a71520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1a194a0 con 0x557bd1a09a10 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1a19610 con 0x557bd1a08b70 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd1a197d0 con 0x557bd1a08210 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.958+0000 7f54574d1b80 10 client.0 _ll_register_callbacks cb 0x7f542c010740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a71520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a71520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51640/0 (socket says 172.21.15.17:51640) 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 -- 172.21.15.17:0/4187187061 learned_addr learned my addr 172.21.15.17:0/4187187061 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544199b700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544119a700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 -- 172.21.15.17:0/4187187061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 msgr2=0x557bd1a0e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 -- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 msgr2=0x557bd1a0e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 -- 172.21.15.17:0/4187187061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c1a0e40 con 0x557bd1a09a10 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f544219c700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a71520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f54340960a0 tx=0x7f5434097e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e8c0f4680755cc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.959+0000 7f54257fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54257fa700 1 -- 172.21.15.17:0/4187187061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340a1ea0 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f543801e040 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54257fa700 1 -- 172.21.15.17:0/4187187061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5434099090 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54257fa700 1 -- 172.21.15.17:0/4187187061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5434099290 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 10 client.15294 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557bd17ac200 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54257fa700 1 -- 172.21.15.17:0/4187187061 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f543801e040 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54257fa700 1 -- 172.21.15.17:0/4187187061 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5434078c40 con 0x557bd1a09a10 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 10 client.15294 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:05.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 10 client.15294 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:36:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 20 client.15294 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a766d0 0x557bd1a72bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 4 client.15294 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.960+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557bd1953ae0 con 0x557bd1a766d0 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.961+0000 7f544199b700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a766d0 0x557bd1a72bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.961+0000 7f544199b700 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a766d0 0x557bd1a72bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f44f66ca409122c6 server_cookie=ed9d043f08933d14 in_seq=0 out_seq=0 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.961+0000 7f54257fa700 10 client.15294 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54257fa700 1 -- 172.21.15.17:0/4187187061 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557bd1953ae0 con 0x557bd1a766d0 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54257fa700 10 client.15294 handle_command_reply: tid=0 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 client.15294 shutdown 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 msgr2=0x557bd1a71520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a71520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f54340960a0 tx=0x7f5434097e00 comp rx=0 tx=0).stop 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 shutdown_connections 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x557bd1a766d0 0x557bd1a72bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557bd1a09a10 0x557bd1a71520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557bd1a08210 0x557bd1a0e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 --2- 172.21.15.17:0/4187187061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557bd1a08b70 0x557bd1a0e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54257fa700 0 client.15294 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 >> 172.21.15.17:0/4187187061 conn(0x557bd197c210 msgr2=0x557bd1a10c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 shutdown_connections 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 1 -- 172.21.15.17:0/4187187061 wait complete. 2023-10-05T15:36:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.962+0000 7f54574d1b80 20 client.15294 trim_cache size 0 max 16384 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24539, 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 66.216939440000004, 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:05.969 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 93, 2023-10-05T15:36:05.970 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:05.970 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 111.998032909 2023-10-05T15:36:05.970 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:05.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54280a1500 msgr2=0x7f54280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54280a1500 0x7f54280a39c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f543c100bb0 tx=0x7f542c0138a0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 msgr2=0x7f543c0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c0737e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f543400ef30 tx=0x7f543400c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 shutdown_connections 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54280a1500 0x7f54280a39c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f543c102a30 0x7f543c0737e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f543c100e90 0x7f543c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 --2- 172.21.15.17:0/2340263940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f543c102070 0x7f543c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 >> 172.21.15.17:0/2340263940 conn(0x7f543c0fc430 msgr2=0x7f543c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 shutdown_connections 2023-10-05T15:36:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:05.963+0000 7f5443bff700 1 -- 172.21.15.17:0/2340263940 wait complete. 2023-10-05T15:36:05.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-05T15:36:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-10-05T15:36:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2023-10-05T15:36:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2023-10-05T15:36:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-05T15:36:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2023-10-05T15:36:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/349541807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:05 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2399423918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: pgmap v352: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-10-05T15:36:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2023-10-05T15:36:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2023-10-05T15:36:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-05T15:36:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2023-10-05T15:36:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/349541807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:05 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2399423918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 -- 172.21.15.17:0/2565872910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 msgr2=0x7fad6810b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 --2- 172.21.15.17:0/2565872910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad6810b230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad6000b0a0 tx=0x7fad6000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 -- 172.21.15.17:0/2565872910 shutdown_connections 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 --2- 172.21.15.17:0/2565872910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad6810b230 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 --2- 172.21.15.17:0/2565872910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad68074e90 0x7fad680732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 --2- 172.21.15.17:0/2565872910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad680738b0 0x7fad68073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 -- 172.21.15.17:0/2565872910 >> 172.21.15.17:0/2565872910 conn(0x7fad680fc460 msgr2=0x7fad680fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 -- 172.21.15.17:0/2565872910 shutdown_connections 2023-10-05T15:36:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.184+0000 7fad6ebff700 1 -- 172.21.15.17:0/2565872910 wait complete. 2023-10-05T15:36:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.186+0000 7fad6ebff700 1 Processor -- start 2023-10-05T15:36:06.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.186+0000 7fad6ebff700 1 -- start start 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.186+0000 7fad6ebff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad680738b0 0x7fad68198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.186+0000 7fad6ebff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad68074e90 0x7fad68199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6ebff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad681a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6ebff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad681a0950 con 0x7fad68108dc0 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6ebff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad681a0a90 con 0x7fad680738b0 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6ebff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad681a0c20 con 0x7fad68074e90 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad681a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad681a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51656/0 (socket says 172.21.15.17:51656) 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 -- 172.21.15.17:0/3302781885 learned_addr learned my addr 172.21.15.17:0/3302781885 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad680738b0 0x7fad68198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad67fff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad68074e90 0x7fad68199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 -- 172.21.15.17:0/3302781885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad68074e90 msgr2=0x7fad68199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad68074e90 0x7fad68199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 -- 172.21.15.17:0/3302781885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad680738b0 msgr2=0x7fad68198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad680738b0 0x7fad68198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.187+0000 7fad6d19c700 1 -- 172.21.15.17:0/3302781885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60009d00 con 0x7fad68108dc0 2023-10-05T15:36:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.188+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad681a0380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fad6000d010 tx=0x7fad6000bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.188+0000 7fad65ffb700 1 -- 172.21.15.17:0/3302781885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000e040 con 0x7fad68108dc0 2023-10-05T15:36:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.188+0000 7fad65ffb700 1 -- 172.21.15.17:0/3302781885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad60003e10 con 0x7fad68108dc0 2023-10-05T15:36:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.188+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad681a0ea0 con 0x7fad68108dc0 2023-10-05T15:36:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.188+0000 7fad65ffb700 1 -- 172.21.15.17:0/3302781885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60005260 con 0x7fad68108dc0 2023-10-05T15:36:06.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.188+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad681a12c0 con 0x7fad68108dc0 2023-10-05T15:36:06.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.191+0000 7fad65ffb700 1 -- 172.21.15.17:0/3302781885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fad6001da10 con 0x7fad68108dc0 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.192+0000 7fad65ffb700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fad580a1500 0x7fad580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 Processor -- start 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad65ffb700 1 -- 172.21.15.17:0/3302781885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fad600ce200 con 0x7fad68108dc0 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 -- start start 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fad580a1500 0x7fad580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe519410 con 0x55d4fe5b1210 2023-10-05T15:36:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe50abd0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad825d9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe5084f0 con 0x55d4fe5b1b70 2023-10-05T15:36:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad6c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad6c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51658/0 (socket says 172.21.15.17:51658) 2023-10-05T15:36:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.193+0000 7fad6c99b700 1 -- 172.21.15.17:0/3804517248 learned_addr learned my addr 172.21.15.17:0/3804517248 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad67fff700 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 -- 172.21.15.17:0/3804517248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 msgr2=0x55d4fe5b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 -- 172.21.15.17:0/3804517248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b2a10 msgr2=0x55d4fe5b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 -- 172.21.15.17:0/3804517248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4fe32ed90 con 0x55d4fe5b1210 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fad580a1500 0x7fad580a39c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad5c013650 tx=0x7fad5c013a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5b1630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fad5c013e10 tx=0x7fad5c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28e99c855ed75ed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.194+0000 7fad52ffd700 1 -- 172.21.15.17:0/3804517248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c012110 con 0x55d4fe5b1210 2023-10-05T15:36:06.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad52ffd700 1 -- 172.21.15.17:0/3804517248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad5c012270 con 0x55d4fe5b1210 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad52ffd700 1 -- 172.21.15.17:0/3804517248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0055c0 con 0x55d4fe5b1210 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 -- 172.21.15.17:0/3804517248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 msgr2=0x55d4fe5b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5b1630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fad5c013e10 tx=0x7fad5c020000 comp rx=0 tx=0).stop 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 -- 172.21.15.17:0/3804517248 shutdown_connections 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5b1630 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3804517248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 -- 172.21.15.17:0/3804517248 >> 172.21.15.17:0/3804517248 conn(0x55d4fe525210 msgr2=0x55d4fe5ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.195+0000 7fad825d9b80 1 -- 172.21.15.17:0/3804517248 shutdown_connections 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.196+0000 7fad825d9b80 1 -- 172.21.15.17:0/3804517248 wait complete. 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.196+0000 7fad825d9b80 1 -- start start 2023-10-05T15:36:06.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.196+0000 7fad825d9b80 1 Processor -- start 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1210 0x55d4fe5baf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe503de0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe4a06c0 con 0x55d4fe5b1210 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe4a0360 con 0x55d4fe5b1b70 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad825d9b80 10 client.0 _ll_register_callbacks cb 0x55d4fe2fd7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51672/0 (socket says 172.21.15.17:51672) 2023-10-05T15:36:06.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 -- 172.21.15.17:0/3660998274 learned_addr learned my addr 172.21.15.17:0/3660998274 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad67fff700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1210 0x55d4fe5baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 -- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 msgr2=0x55d4fe5bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5bb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 -- 172.21.15.17:0/3660998274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1210 msgr2=0x55d4fe5baf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1210 0x55d4fe5baf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.197+0000 7fad6d19c700 1 -- 172.21.15.17:0/3660998274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c020430 con 0x55d4fe5b2a10 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad6d19c700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c24f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fad6001dd60 tx=0x7fad6009ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4fea60ca0ac74d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad47fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad47fff700 1 -- 172.21.15.17:0/3660998274 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6001d680 con 0x55d4fe5b2a10 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad47fff700 1 -- 172.21.15.17:0/3660998274 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fad6009b8b0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4fe5a3ec0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad47fff700 1 -- 172.21.15.17:0/3660998274 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad600ce020 con 0x55d4fe5b2a10 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad825d9b80 10 client.15306 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d4fe317c10 con 0x55d4fe5b2a10 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.198+0000 7fad47fff700 1 -- 172.21.15.17:0/3660998274 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4fe5a3ec0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad47fff700 1 -- 172.21.15.17:0/3660998274 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fad600b3be0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad825d9b80 10 client.15306 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad825d9b80 10 client.15306 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad825d9b80 20 client.15306 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe5c68e0 0x55d4fe5c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad825d9b80 4 client.15306 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4fe4fcdc0 con 0x55d4fe5c68e0 2023-10-05T15:36:06.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.199+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe5c68e0 0x55d4fe5c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.200+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe5c68e0 0x55d4fe5c5420 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=714c9fc0f5e7ad40 server_cookie=58d7ed842cf6d788 in_seq=0 out_seq=0 2023-10-05T15:36:06.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.200+0000 7fad47fff700 10 client.15306 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad47fff700 1 -- 172.21.15.17:0/3660998274 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4fe4fcdc0 con 0x55d4fe5c68e0 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad47fff700 10 client.15306 handle_command_reply: tid=0 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 client.15306 shutdown 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 msgr2=0x55d4fe5c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c24f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fad6001dd60 tx=0x7fad6009ab10 comp rx=0 tx=0).stop 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 shutdown_connections 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe5c68e0 0x55d4fe5c5420 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c24f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1210 0x55d4fe5baf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3660998274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5bb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad47fff700 0 client.15306 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 >> 172.21.15.17:0/3660998274 conn(0x55d4fe525210 msgr2=0x55d4fe5abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 shutdown_connections 2023-10-05T15:36:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 1 -- 172.21.15.17:0/3660998274 wait complete. 2023-10-05T15:36:06.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.201+0000 7fad825d9b80 20 client.15306 trim_cache size 0 max 16384 2023-10-05T15:36:06.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 Processor -- start 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 -- start start 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe3848d0 con 0x55d4fe5b2a10 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe4fcdc0 con 0x55d4fe5b1b70 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad825d9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe5b22c0 con 0x55d4fe5b1210 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51680/0 (socket says 172.21.15.17:51680) 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad6d19c700 1 -- 172.21.15.17:0/722387649 learned_addr learned my addr 172.21.15.17:0/722387649 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.220+0000 7fad67fff700 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6c99b700 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6d19c700 1 -- 172.21.15.17:0/722387649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1210 msgr2=0x55d4fe5c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6d19c700 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6d19c700 1 -- 172.21.15.17:0/722387649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 msgr2=0x55d4fe5c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6d19c700 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6d19c700 1 -- 172.21.15.17:0/722387649 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4fe355200 con 0x55d4fe5b2a10 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6c99b700 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad6d19c700 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b8e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fad600976b0 tx=0x7fad60099760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13141ece4f94e86a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad537fe700 1 -- 172.21.15.17:0/722387649 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600ce040 con 0x55d4fe5b2a10 2023-10-05T15:36:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad537fe700 1 -- 172.21.15.17:0/722387649 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad60024310 con 0x55d4fe5b2a10 2023-10-05T15:36:06.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.221+0000 7fad537fe700 1 -- 172.21.15.17:0/722387649 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6009f300 con 0x55d4fe5b2a10 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 -- 172.21.15.17:0/722387649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 msgr2=0x55d4fe5b8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b8e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fad600976b0 tx=0x7fad60099760 comp rx=0 tx=0).stop 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 -- 172.21.15.17:0/722387649 shutdown_connections 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5b8e60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 --2- 172.21.15.17:0/722387649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 -- 172.21.15.17:0/722387649 >> 172.21.15.17:0/722387649 conn(0x55d4fe525210 msgr2=0x55d4fe5abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 -- 172.21.15.17:0/722387649 shutdown_connections 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 -- 172.21.15.17:0/722387649 wait complete. 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.222+0000 7fad825d9b80 1 -- start start 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 Processor -- start 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe5c2710 con 0x55d4fe5b1210 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe5c2880 con 0x55d4fe5b1b70 2023-10-05T15:36:06.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4fe61a320 con 0x55d4fe5b2a10 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad825d9b80 10 client.0 _ll_register_callbacks cb 0x7fad6009b010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad6c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad6d19c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad6c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51684/0 (socket says 172.21.15.17:51684) 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.223+0000 7fad6c99b700 1 -- 172.21.15.17:0/3160901960 learned_addr learned my addr 172.21.15.17:0/3160901960 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad67fff700 1 -- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b2a10 msgr2=0x55d4fe5c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad67fff700 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad67fff700 1 -- 172.21.15.17:0/3160901960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 msgr2=0x55d4fe5c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad67fff700 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad67fff700 1 -- 172.21.15.17:0/3160901960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4fe317c10 con 0x55d4fe5b1b70 2023-10-05T15:36:06.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad67fff700 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c1a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55d4fe5c7a50 tx=0x7fad540129b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecab0c25f0acb9e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad47fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad47fff700 1 -- 172.21.15.17:0/3160901960 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54004230 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.224+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad5c012270 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.225+0000 7fad47fff700 1 -- 172.21.15.17:0/3160901960 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fad54004390 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.225+0000 7fad47fff700 1 -- 172.21.15.17:0/3160901960 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad54004550 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.225+0000 7fad825d9b80 10 client.25166 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.225+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d4fe32d260 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.225+0000 7fad47fff700 1 -- 172.21.15.17:0/3160901960 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad5c012270 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.225+0000 7fad47fff700 1 -- 172.21.15.17:0/3160901960 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fad54011a10 con 0x55d4fe5b1b70 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad825d9b80 10 client.25166 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:06.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad825d9b80 10 client.25166 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad825d9b80 20 client.25166 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe61f660 0x55d4fe61bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad825d9b80 4 client.25166 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4fe4fcae0 con 0x55d4fe61f660 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.226+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe61f660 0x55d4fe61bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad6c99b700 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe61f660 0x55d4fe61bae0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d4d1fea2fa2020f server_cookie=60e5a3d30537ffa1 in_seq=0 out_seq=0 2023-10-05T15:36:06.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad47fff700 10 client.25166 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad47fff700 1 -- 172.21.15.17:0/3160901960 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d4fe4fcae0 con 0x55d4fe61f660 2023-10-05T15:36:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad47fff700 10 client.25166 handle_command_reply: tid=0 2023-10-05T15:36:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 client.25166 shutdown 2023-10-05T15:36:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 msgr2=0x55d4fe5c1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c1a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55d4fe5c7a50 tx=0x7fad540129b0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 shutdown_connections 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55d4fe61f660 0x55d4fe61bae0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d4fe5b2a10 0x55d4fe5c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d4fe5b1210 0x55d4fe5c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad47fff700 0 client.25166 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 --2- 172.21.15.17:0/3160901960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4fe5b1b70 0x55d4fe5c1a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 >> 172.21.15.17:0/3160901960 conn(0x55d4fe525210 msgr2=0x55d4fe5c2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 shutdown_connections 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 1 -- 172.21.15.17:0/3160901960 wait complete. 2023-10-05T15:36:06.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.227+0000 7fad825d9b80 20 client.25166 trim_cache size 0 max 16384 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24550, 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 67.488132092000001, 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 93, 2023-10-05T15:36:06.235 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:06.236 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 109.03578114699999 2023-10-05T15:36:06.236 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fad580a1500 msgr2=0x7fad580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fad580a1500 0x7fad580a39c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad5c013650 tx=0x7fad5c013a10 comp rx=0 tx=0).stop 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 msgr2=0x7fad681a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad681a0380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fad6000d010 tx=0x7fad6000bcc0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 shutdown_connections 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fad580a1500 0x7fad580a39c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad68108dc0 0x7fad681a0380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad680738b0 0x7fad68198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 --2- 172.21.15.17:0/3302781885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad68074e90 0x7fad68199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 >> 172.21.15.17:0/3302781885 conn(0x7fad680fc460 msgr2=0x7fad680fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 shutdown_connections 2023-10-05T15:36:06.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.228+0000 7fad6ebff700 1 -- 172.21.15.17:0/3302781885 wait complete. 2023-10-05T15:36:06.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 -- 172.21.15.17:0/3751402225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140ffe00 msgr2=0x7fd914100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/3751402225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140ffe00 0x7fd914100220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd904009920 tx=0x7fd904009c30 comp rx=0 tx=0).stop 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 -- 172.21.15.17:0/3751402225 shutdown_connections 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/3751402225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd914101990 0x7fd914108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/3751402225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9140ffe00 0x7fd914100220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/3751402225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd914100ff0 0x7fd914101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 -- 172.21.15.17:0/3751402225 >> 172.21.15.17:0/3751402225 conn(0x7fd9140fb370 msgr2=0x7fd9140fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 -- 172.21.15.17:0/3751402225 shutdown_connections 2023-10-05T15:36:06.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.450+0000 7fd91a3ff700 1 -- 172.21.15.17:0/3751402225 wait complete. 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.451+0000 7fd91a3ff700 1 Processor -- start 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.451+0000 7fd91a3ff700 1 -- start start 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 0x7fd914198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91a3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd914100ff0 0x7fd914199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91a3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd914101990 0x7fd9141a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141a0970 con 0x7fd9140ffe00 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91a3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141a0ab0 con 0x7fd914101990 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91a3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141a0c40 con 0x7fd914100ff0 2023-10-05T15:36:06.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 0x7fd914198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 0x7fd914198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51704/0 (socket says 172.21.15.17:51704) 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 -- 172.21.15.17:0/1320814722 learned_addr learned my addr 172.21.15.17:0/1320814722 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd91899c700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd914101990 0x7fd9141a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd9137fe700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd914100ff0 0x7fd914199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 -- 172.21.15.17:0/1320814722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd914100ff0 msgr2=0x7fd914199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd914100ff0 0x7fd914199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 -- 172.21.15.17:0/1320814722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd914101990 msgr2=0x7fd9141a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd914101990 0x7fd9141a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.452+0000 7fd913fff700 1 -- 172.21.15.17:0/1320814722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904009520 con 0x7fd9140ffe00 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.453+0000 7fd913fff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 0x7fd914198df0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd904009230 tx=0x7fd90400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.453+0000 7fd9117fa700 1 -- 172.21.15.17:0/1320814722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90401c070 con 0x7fd9140ffe00 2023-10-05T15:36:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.453+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9141a0ec0 con 0x7fd9140ffe00 2023-10-05T15:36:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.453+0000 7fd9117fa700 1 -- 172.21.15.17:0/1320814722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd90400bec0 con 0x7fd9140ffe00 2023-10-05T15:36:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.453+0000 7fd9117fa700 1 -- 172.21.15.17:0/1320814722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904004930 con 0x7fd9140ffe00 2023-10-05T15:36:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.453+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9141a1230 con 0x7fd9140ffe00 2023-10-05T15:36:06.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.456+0000 7fd9117fa700 1 -- 172.21.15.17:0/1320814722 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd904020070 con 0x7fd9140ffe00 2023-10-05T15:36:06.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.457+0000 7fd92dd54b80 1 Processor -- start 2023-10-05T15:36:06.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd9117fa700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8fc0a1480 0x7fd8fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 -- start start 2023-10-05T15:36:06.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd9117fa700 1 -- 172.21.15.17:0/1320814722 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9040cde50 con 0x7fd9140ffe00 2023-10-05T15:36:06.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd91899c700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8fc0a1480 0x7fd8fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbe0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0b70 0x558a7cbe1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe1a10 0x558a7cbe1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cb48410 con 0x558a7cbe0b70 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cb39bd0 con 0x558a7cbe0210 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cb374f0 con 0x558a7cbe1a10 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd913fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbe0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd9137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0b70 0x558a7cbe1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd913fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbe0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34218/0 (socket says 172.21.15.17:34218) 2023-10-05T15:36:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.458+0000 7fd913fff700 1 -- 172.21.15.17:0/4168813433 learned_addr learned my addr 172.21.15.17:0/4168813433 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd91899c700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8fc0a1480 0x7fd8fc0a3940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00f540 tx=0x7fd90c009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd913fff700 1 -- 172.21.15.17:0/4168813433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe1a10 msgr2=0x558a7cbe1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd91899c700 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe1a10 0x558a7cbe1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd913fff700 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe1a10 0x558a7cbe1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd913fff700 1 -- 172.21.15.17:0/4168813433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0b70 msgr2=0x558a7cbe1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd913fff700 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0b70 0x558a7cbe1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd913fff700 1 -- 172.21.15.17:0/4168813433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7c95dd90 con 0x558a7cbe0210 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd91899c700 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe1a10 0x558a7cbe1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd9137fe700 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0b70 0x558a7cbe1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd913fff700 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbe0630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd904097300 tx=0x7fd904009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17effd1d39e59d3c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.459+0000 7fd8fa7fc700 1 -- 172.21.15.17:0/4168813433 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90409d070 con 0x558a7cbe0210 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd8fa7fc700 1 -- 172.21.15.17:0/4168813433 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd90409ae00 con 0x558a7cbe0210 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd8fa7fc700 1 -- 172.21.15.17:0/4168813433 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904099230 con 0x558a7cbe0210 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 -- 172.21.15.17:0/4168813433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 msgr2=0x558a7cbe0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbe0630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd904097300 tx=0x7fd904009260 comp rx=0 tx=0).stop 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 -- 172.21.15.17:0/4168813433 shutdown_connections 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe1a10 0x558a7cbe1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbe0630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/4168813433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0b70 0x558a7cbe1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 -- 172.21.15.17:0/4168813433 >> 172.21.15.17:0/4168813433 conn(0x558a7cb54210 msgr2=0x558a7cbdb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 -- 172.21.15.17:0/4168813433 shutdown_connections 2023-10-05T15:36:06.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.460+0000 7fd92dd54b80 1 -- 172.21.15.17:0/4168813433 wait complete. 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.461+0000 7fd92dd54b80 1 -- start start 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.461+0000 7fd92dd54b80 1 Processor -- start 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0210 0x558a7cbe9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0b70 0x558a7cbea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbf1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cb32de0 con 0x558a7cbe1a10 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cacf6c0 con 0x558a7cbe0b70 2023-10-05T15:36:06.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cacf360 con 0x558a7cbe0210 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd92dd54b80 10 client.0 _ll_register_callbacks cb 0x558a7c92c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbf1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbf1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51712/0 (socket says 172.21.15.17:51712) 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 -- 172.21.15.17:0/2460337010 learned_addr learned my addr 172.21.15.17:0/2460337010 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd913fff700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0210 0x558a7cbe9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd9137fe700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0b70 0x558a7cbea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 -- 172.21.15.17:0/2460337010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0210 msgr2=0x558a7cbe9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0210 0x558a7cbe9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 -- 172.21.15.17:0/2460337010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0b70 msgr2=0x558a7cbea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0b70 0x558a7cbea1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd91899c700 1 -- 172.21.15.17:0/2460337010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd908009920 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.462+0000 7fd9137fe700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0b70 0x558a7cbea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd91899c700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbf1220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd90c019e30 tx=0x7fd90c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b1bc570cc2b92b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd8f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd8f37fe700 1 -- 172.21.15.17:0/2460337010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00e040 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a7cbd2ec0 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd8f37fe700 1 -- 172.21.15.17:0/2460337010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd90c023480 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd8f37fe700 1 -- 172.21.15.17:0/2460337010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd90c017e50 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd92dd54b80 10 client.15324 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.463+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fd9141a1230 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd8f37fe700 1 -- 172.21.15.17:0/2460337010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a7cbd2ec0 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd8f37fe700 1 -- 172.21.15.17:0/2460337010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd90c0226c0 con 0x558a7cbe1a10 2023-10-05T15:36:06.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd92dd54b80 10 client.15324 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd92dd54b80 10 client.15324 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd92dd54b80 20 client.15324 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cbf5870 0x558a7cbf42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd92dd54b80 4 client.15324 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a7cb2bdc0 con 0x558a7cbf5870 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.464+0000 7fd913fff700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cbf5870 0x558a7cbf42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.465+0000 7fd8f37fe700 10 client.15324 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.465+0000 7fd913fff700 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cbf5870 0x558a7cbf42f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ccfb12f23b48b2b3 server_cookie=11608fa5ef6bcb76 in_seq=0 out_seq=0 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.465+0000 7fd8f37fe700 1 -- 172.21.15.17:0/2460337010 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a7cb2bdc0 con 0x558a7cbf5870 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.465+0000 7fd8f37fe700 10 client.15324 handle_command_reply: tid=0 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.465+0000 7fd92dd54b80 1 client.15324 shutdown 2023-10-05T15:36:06.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 msgr2=0x558a7cbf1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbf1220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd90c019e30 tx=0x7fd90c004b40 comp rx=0 tx=0).stop 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 shutdown_connections 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cbf5870 0x558a7cbf42f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbf1220 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0210 0x558a7cbe9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/2460337010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0b70 0x558a7cbea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd8f37fe700 0 client.15324 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 >> 172.21.15.17:0/2460337010 conn(0x558a7cb54210 msgr2=0x558a7cbdaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 shutdown_connections 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 1 -- 172.21.15.17:0/2460337010 wait complete. 2023-10-05T15:36:06.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.466+0000 7fd92dd54b80 20 client.15324 trim_cache size 0 max 16384 2023-10-05T15:36:06.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 Processor -- start 2023-10-05T15:36:06.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 -- start start 2023-10-05T15:36:06.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 0x558a7cbe7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbf1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe1a10 0x558a7cbe8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7c9b38d0 con 0x558a7cbe0210 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cb2eed0 con 0x558a7cbe1a10 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cad94d0 con 0x558a7cbe0b70 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.485+0000 7fd913fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 0x558a7cbe7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 0x558a7cbe7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51718/0 (socket says 172.21.15.17:51718) 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 -- 172.21.15.17:0/1322383404 learned_addr learned my addr 172.21.15.17:0/1322383404 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd91899c700 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe1a10 0x558a7cbe8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 -- 172.21.15.17:0/1322383404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 msgr2=0x558a7cbf1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbf1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 -- 172.21.15.17:0/1322383404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe1a10 msgr2=0x558a7cbe8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe1a10 0x558a7cbe8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 -- 172.21.15.17:0/1322383404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a7c946c10 con 0x558a7cbe0210 2023-10-05T15:36:06.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd913fff700 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 0x558a7cbe7e90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd90409f110 tx=0x7fd904097270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e1f9f9c440f97d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd8faffd700 1 -- 172.21.15.17:0/1322383404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90409d040 con 0x558a7cbe0210 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd8faffd700 1 -- 172.21.15.17:0/1322383404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd90409ef50 con 0x558a7cbe0210 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.486+0000 7fd8faffd700 1 -- 172.21.15.17:0/1322383404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90409b2c0 con 0x558a7cbe0210 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 -- 172.21.15.17:0/1322383404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 msgr2=0x558a7cbe7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 0x558a7cbe7e90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd90409f110 tx=0x7fd904097270 comp rx=0 tx=0).stop 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 -- 172.21.15.17:0/1322383404 shutdown_connections 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe1a10 0x558a7cbe8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe0210 0x558a7cbe7e90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/1322383404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbf1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 -- 172.21.15.17:0/1322383404 >> 172.21.15.17:0/1322383404 conn(0x558a7cb54210 msgr2=0x558a7cbdaf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 -- 172.21.15.17:0/1322383404 shutdown_connections 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.487+0000 7fd92dd54b80 1 -- 172.21.15.17:0/1322383404 wait complete. 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.488+0000 7fd92dd54b80 1 -- start start 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.488+0000 7fd92dd54b80 1 Processor -- start 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbf0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbedd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cbee280 con 0x558a7cbe1a10 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cbee3f0 con 0x558a7cbe0210 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a7cc49260 con 0x558a7cbe0b70 2023-10-05T15:36:06.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd92dd54b80 10 client.0 _ll_register_callbacks cb 0x7fd90c019800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbedd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbedd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51734/0 (socket says 172.21.15.17:51734) 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 -- 172.21.15.17:0/3197026706 learned_addr learned my addr 172.21.15.17:0/3197026706 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd913fff700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbf0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd9137fe700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 -- 172.21.15.17:0/3197026706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 msgr2=0x558a7cbed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 -- 172.21.15.17:0/3197026706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 msgr2=0x558a7cbf0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbf0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.489+0000 7fd91899c700 1 -- 172.21.15.17:0/3197026706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a7c95dd90 con 0x558a7cbe1a10 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd91899c700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbedd40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd90c019e30 tx=0x7fd90c022e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05c0c11f4cb233c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd8f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:06.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd8f37fe700 1 -- 172.21.15.17:0/3197026706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c03a070 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd90409ae00 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd8f37fe700 1 -- 172.21.15.17:0/3197026706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd90c017df0 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd8f37fe700 1 -- 172.21.15.17:0/3197026706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd90c00e040 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd92dd54b80 10 client.15330 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558a7c984200 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.490+0000 7fd8f37fe700 1 -- 172.21.15.17:0/3197026706 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd90409ae00 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd8f37fe700 1 -- 172.21.15.17:0/3197026706 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd90c03d020 con 0x558a7cbe1a10 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd92dd54b80 10 client.15330 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd92dd54b80 10 client.15330 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd92dd54b80 20 client.15330 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cc4e3e0 0x558a7cc4a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd92dd54b80 4 client.15330 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:06.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558a7cb2bae0 con 0x558a7cc4e3e0 2023-10-05T15:36:06.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd913fff700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cc4e3e0 0x558a7cc4a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd913fff700 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cc4e3e0 0x558a7cc4a8a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=622a3799faa98d74 server_cookie=dbd984375b8c108b in_seq=0 out_seq=0 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.491+0000 7fd8f37fe700 10 client.15330 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd8f37fe700 1 -- 172.21.15.17:0/3197026706 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x558a7cb2bae0 con 0x558a7cc4e3e0 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd8f37fe700 10 client.15330 handle_command_reply: tid=0 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 client.15330 shutdown 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 msgr2=0x558a7cbedd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbedd40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd90c019e30 tx=0x7fd90c022e50 comp rx=0 tx=0).stop 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 shutdown_connections 2023-10-05T15:36:06.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558a7cc4e3e0 0x558a7cc4a8a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a7cbe1a10 0x558a7cbedd40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558a7cbe0210 0x558a7cbf0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 --2- 172.21.15.17:0/3197026706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558a7cbe0b70 0x558a7cbed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd8f37fe700 0 client.15330 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 >> 172.21.15.17:0/3197026706 conn(0x558a7cb54210 msgr2=0x558a7cbf1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 shutdown_connections 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 1 -- 172.21.15.17:0/3197026706 wait complete. 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.492+0000 7fd92dd54b80 20 client.15330 trim_cache size 0 max 16384 2023-10-05T15:36:06.499 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24569, 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 68.764734790000006, 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 93, 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 106.041620823 2023-10-05T15:36:06.500 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:06.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8fc0a1480 msgr2=0x7fd8fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8fc0a1480 0x7fd8fc0a3940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00f540 tx=0x7fd90c009920 comp rx=0 tx=0).stop 2023-10-05T15:36:06.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 msgr2=0x7fd914198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 0x7fd914198df0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd904009230 tx=0x7fd90400b790 comp rx=0 tx=0).stop 2023-10-05T15:36:06.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 shutdown_connections 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8fc0a1480 0x7fd8fc0a3940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd914101990 0x7fd9141a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ffe00 0x7fd914198df0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 --2- 172.21.15.17:0/1320814722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd914100ff0 0x7fd914199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 >> 172.21.15.17:0/1320814722 conn(0x7fd9140fb370 msgr2=0x7fd9140fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 shutdown_connections 2023-10-05T15:36:06.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.493+0000 7fd91a3ff700 1 -- 172.21.15.17:0/1320814722 wait complete. 2023-10-05T15:36:06.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-05T15:36:06.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 -- 172.21.15.17:0/3092050041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102070 msgr2=0x7f8a201024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 --2- 172.21.15.17:0/3092050041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102070 0x7f8a201024f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009990 tx=0x7f8a10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 -- 172.21.15.17:0/3092050041 shutdown_connections 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 --2- 172.21.15.17:0/3092050041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20102a30 0x7f8a20109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 --2- 172.21.15.17:0/3092050041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a20100e90 0x7f8a201012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 --2- 172.21.15.17:0/3092050041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102070 0x7f8a201024f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.725+0000 7f8a27fff700 1 -- 172.21.15.17:0/3092050041 >> 172.21.15.17:0/3092050041 conn(0x7f8a200fc430 msgr2=0x7f8a200fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.726+0000 7f8a27fff700 1 -- 172.21.15.17:0/3092050041 shutdown_connections 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.726+0000 7f8a27fff700 1 -- 172.21.15.17:0/3092050041 wait complete. 2023-10-05T15:36:06.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.727+0000 7f8a27fff700 1 Processor -- start 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.727+0000 7f8a27fff700 1 -- start start 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a27fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 0x7f8a20074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a20102070 0x7f8a200732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a27fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102a30 0x7f8a200737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a27fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20073f80 con 0x7f8a20102a30 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a27fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200740f0 con 0x7f8a20102070 2023-10-05T15:36:06.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a27fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201a0c10 con 0x7f8a20100e90 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a2659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102a30 0x7f8a200737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 0x7f8a20074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a2559a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a20102070 0x7f8a200732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 0x7f8a20074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:55904/0 (socket says 172.21.15.17:55904) 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a2659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102a30 0x7f8a200737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51744/0 (socket says 172.21.15.17:51744) 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2542048230 learned_addr learned my addr 172.21.15.17:0/2542048230 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2542048230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a20102070 msgr2=0x7f8a200732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a20102070 0x7f8a200732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102a30 msgr2=0x7f8a200737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102a30 0x7f8a200737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.728+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2542048230 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100095f0 con 0x7f8a20100e90 2023-10-05T15:36:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.729+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 0x7f8a20074c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e970 tx=0x7f8a1c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.729+0000 7f8a16ffd700 1 -- 172.21.15.17:0/2542048230 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c009790 con 0x7f8a20100e90 2023-10-05T15:36:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.729+0000 7f8a16ffd700 1 -- 172.21.15.17:0/2542048230 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c00c7e0 con 0x7f8a20100e90 2023-10-05T15:36:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.729+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a201a0ef0 con 0x7f8a20100e90 2023-10-05T15:36:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.729+0000 7f8a16ffd700 1 -- 172.21.15.17:0/2542048230 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c003bd0 con 0x7f8a20100e90 2023-10-05T15:36:06.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.729+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a201a1320 con 0x7f8a20100e90 2023-10-05T15:36:06.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.733+0000 7f8a16ffd700 1 -- 172.21.15.17:0/2542048230 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8a1c00c950 con 0x7f8a20100e90 2023-10-05T15:36:06.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 Processor -- start 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 -- start start 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a16ffd700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a0c0a1500 0x7f8a0c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7548630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7549430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d7549e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d74b0410 con 0x5648d7548210 2023-10-05T15:36:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d74a1bd0 con 0x5648d7548b70 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d749f4f0 con 0x5648d7549a10 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a16ffd700 1 -- 172.21.15.17:0/2542048230 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8a1c014070 con 0x7f8a20100e90 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a25d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7548630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a2659c700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a0c0a1500 0x7f8a0c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.734+0000 7f8a25d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7548630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51746/0 (socket says 172.21.15.17:51746) 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 -- 172.21.15.17:0/1866062104 learned_addr learned my addr 172.21.15.17:0/1866062104 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a2559a700 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7549430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a2659c700 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d7549e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 -- 172.21.15.17:0/1866062104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 msgr2=0x5648d7549e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d7549e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 -- 172.21.15.17:0/1866062104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 msgr2=0x5648d7549430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7549430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 -- 172.21.15.17:0/1866062104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648d72c5d90 con 0x5648d7548210 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a2559a700 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7549430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7548630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c096640 tx=0x7f8a1c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cbdfe19e81d604 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a2659c700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a0c0a1500 0x7f8a0c0a39c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5648d75491f0 tx=0x7f8a18009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.735+0000 7f8a0bfff700 1 -- 172.21.15.17:0/1866062104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0ac720 con 0x5648d7548210 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a0bfff700 1 -- 172.21.15.17:0/1866062104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c0ac540 con 0x5648d7548210 2023-10-05T15:36:06.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a0bfff700 1 -- 172.21.15.17:0/1866062104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c09e290 con 0x5648d7548210 2023-10-05T15:36:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 -- 172.21.15.17:0/1866062104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 msgr2=0x5648d7548630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7548630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c096640 tx=0x7f8a1c00cf50 comp rx=0 tx=0).stop 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 -- 172.21.15.17:0/1866062104 shutdown_connections 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d7549e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7548630 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/1866062104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7549430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 -- 172.21.15.17:0/1866062104 >> 172.21.15.17:0/1866062104 conn(0x5648d74bc210 msgr2=0x5648d75430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.736+0000 7f8a3b942b80 1 -- 172.21.15.17:0/1866062104 shutdown_connections 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.737+0000 7f8a3b942b80 1 -- 172.21.15.17:0/1866062104 wait complete. 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.737+0000 7f8a3b942b80 1 -- start start 2023-10-05T15:36:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.737+0000 7f8a3b942b80 1 Processor -- start 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d7552020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 0x5648d7552560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d75595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d749ade0 con 0x5648d7548b70 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d74376c0 con 0x5648d7548210 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d7437360 con 0x5648d7549a10 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a3b942b80 10 client.0 _ll_register_callbacks cb 0x5648d72947b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.738+0000 7f8a2559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 0x5648d7552560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a2559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 0x5648d7552560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51754/0 (socket says 172.21.15.17:51754) 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a2559a700 1 -- 172.21.15.17:0/2232576287 learned_addr learned my addr 172.21.15.17:0/2232576287 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d7552020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a2659c700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d75595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2232576287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 msgr2=0x5648d75595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d75595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2232576287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 msgr2=0x5648d7552560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 0x5648d7552560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2232576287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a20109c80 con 0x5648d7548210 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a2559a700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 0x5648d7552560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d7552020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5648d7550720 tx=0x7f8a1c099db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba46fd522c293d9d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a097fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a097fa700 1 -- 172.21.15.17:0/2232576287 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c09a840 con 0x5648d7548210 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a097fa700 1 -- 172.21.15.17:0/2232576287 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8a1c0a24d0 con 0x5648d7548210 2023-10-05T15:36:06.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.739+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648d753aec0 con 0x5648d7548210 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a097fa700 1 -- 172.21.15.17:0/2232576287 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a1c09e290 con 0x5648d7548210 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 10 client.25196 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8a201a1320 con 0x5648d7548210 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a097fa700 1 -- 172.21.15.17:0/2232576287 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c0b6070 con 0x5648d7548210 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a097fa700 1 -- 172.21.15.17:0/2232576287 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8a1c09a3a0 con 0x5648d7548210 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 10 client.25196 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 10 client.25196 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 20 client.25196 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d755d7f0 0x5648d755c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 4 client.25196 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:06.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.740+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648d7493dc0 con 0x5648d755d7f0 2023-10-05T15:36:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.741+0000 7f8a2559a700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d755d7f0 0x5648d755c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.741+0000 7f8a2559a700 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d755d7f0 0x5648d755c4d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60100d49fb721e86 server_cookie=6171d3916a2c071c in_seq=0 out_seq=0 2023-10-05T15:36:06.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.741+0000 7f8a097fa700 10 client.25196 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a097fa700 1 -- 172.21.15.17:0/2232576287 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648d7493dc0 con 0x5648d755d7f0 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a097fa700 10 client.25196 handle_command_reply: tid=0 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 client.25196 shutdown 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 msgr2=0x5648d7552020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d7552020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x5648d7550720 tx=0x7f8a1c099db0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 shutdown_connections 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d755d7f0 0x5648d755c4d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d75595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d7552020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2232576287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548b70 0x5648d7552560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a097fa700 0 client.25196 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 >> 172.21.15.17:0/2232576287 conn(0x5648d74bc210 msgr2=0x5648d7542f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 shutdown_connections 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.742+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2232576287 wait complete. 2023-10-05T15:36:06.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.743+0000 7f8a3b942b80 20 client.25196 trim_cache size 0 max 16384 2023-10-05T15:36:06.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.761+0000 7f8a3b942b80 1 Processor -- start 2023-10-05T15:36:06.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.761+0000 7f8a3b942b80 1 -- start start 2023-10-05T15:36:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7550c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7559560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d754c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d731b8d0 con 0x5648d7548210 2023-10-05T15:36:06.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d7550750 con 0x5648d7548b70 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d7552f20 con 0x5648d7549a10 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7550c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7550c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51756/0 (socket says 172.21.15.17:51756) 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2999626660 learned_addr learned my addr 172.21.15.17:0/2999626660 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a2659c700 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d754c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2999626660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 msgr2=0x5648d754c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a2559a700 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7559560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d754c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2999626660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 msgr2=0x5648d7559560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7559560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 -- 172.21.15.17:0/2999626660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648d72aec10 con 0x5648d7548210 2023-10-05T15:36:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a2559a700 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7559560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.762+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7550c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c099e40 tx=0x7f8a1c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2cea122ac4e97e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a14ff9700 1 -- 172.21.15.17:0/2999626660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0a24d0 con 0x5648d7548210 2023-10-05T15:36:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a14ff9700 1 -- 172.21.15.17:0/2999626660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c0b6030 con 0x5648d7548210 2023-10-05T15:36:06.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a14ff9700 1 -- 172.21.15.17:0/2999626660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0985f0 con 0x5648d7548210 2023-10-05T15:36:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2999626660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 msgr2=0x5648d7550c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7550c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c099e40 tx=0x7f8a1c00cf50 comp rx=0 tx=0).stop 2023-10-05T15:36:06.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2999626660 shutdown_connections 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7549a10 0x5648d754c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7548210 0x5648d7550c80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/2999626660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548b70 0x5648d7559560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2999626660 >> 172.21.15.17:0/2999626660 conn(0x5648d74bc210 msgr2=0x5648d7566150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.763+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2999626660 shutdown_connections 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.764+0000 7f8a3b942b80 1 -- 172.21.15.17:0/2999626660 wait complete. 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.764+0000 7f8a3b942b80 1 -- start start 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.764+0000 7f8a3b942b80 1 Processor -- start 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d75556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7548b70 0x5648d7555c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 0x5648d7558c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d7559170 con 0x5648d7549a10 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d75592e0 con 0x5648d7548210 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648d75594a0 con 0x5648d7548b70 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a3b942b80 10 client.0 _ll_register_callbacks cb 0x7f8a1c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a2659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 0x5648d7558c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a2659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 0x5648d7558c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51764/0 (socket says 172.21.15.17:51764) 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a2659c700 1 -- 172.21.15.17:0/4133011905 learned_addr learned my addr 172.21.15.17:0/4133011905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d75556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.765+0000 7f8a2559a700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7548b70 0x5648d7555c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a2659c700 1 -- 172.21.15.17:0/4133011905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7548b70 msgr2=0x5648d7555c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a2659c700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7548b70 0x5648d7555c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a2659c700 1 -- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 msgr2=0x5648d75556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a2659c700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d75556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a2659c700 1 -- 172.21.15.17:0/4133011905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a201a1320 con 0x5648d7549a10 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d75556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a2659c700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 0x5648d7558c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8a18018940 tx=0x7f8a18004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5569abcfc3adcf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a097fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a097fa700 1 -- 172.21.15.17:0/4133011905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e070 con 0x5648d7549a10 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a1c0ac540 con 0x5648d7549a10 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a097fa700 1 -- 172.21.15.17:0/4133011905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8a1801a700 con 0x5648d7549a10 2023-10-05T15:36:06.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.766+0000 7f8a097fa700 1 -- 172.21.15.17:0/4133011905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a1801a8c0 con 0x5648d7549a10 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 10 client.15348 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5648d72ec200 con 0x5648d7549a10 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a097fa700 1 -- 172.21.15.17:0/4133011905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c0ac540 con 0x5648d7549a10 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a097fa700 1 -- 172.21.15.17:0/4133011905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8a18025070 con 0x5648d7549a10 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 10 client.15348 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 20 client.15348 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d75b5df0 0x5648d75b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 4 client.15348 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.767+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5648d7493ae0 con 0x5648d75b5df0 2023-10-05T15:36:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d75b5df0 0x5648d75b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a25d9b700 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d75b5df0 0x5648d75b2270 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5349a882c63d9e server_cookie=ebb52501d4507c7e in_seq=0 out_seq=0 2023-10-05T15:36:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a097fa700 10 client.15348 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a097fa700 1 -- 172.21.15.17:0/4133011905 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5648d7493ae0 con 0x5648d75b5df0 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a097fa700 10 client.15348 handle_command_reply: tid=0 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a3b942b80 1 client.15348 shutdown 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 msgr2=0x5648d7558c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 0x5648d7558c30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8a18018940 tx=0x7f8a18004b40 comp rx=0 tx=0).stop 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.768+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 shutdown_connections 2023-10-05T15:36:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648d75b5df0 0x5648d75b2270 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648d7549a10 0x5648d7558c30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648d7548210 0x5648d75556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a097fa700 0 client.15348 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 --2- 172.21.15.17:0/4133011905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648d7548b70 0x5648d7555c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 >> 172.21.15.17:0/4133011905 conn(0x5648d74bc210 msgr2=0x5648d7550c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 shutdown_connections 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 1 -- 172.21.15.17:0/4133011905 wait complete. 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a3b942b80 20 client.15348 trim_cache size 0 max 16384 2023-10-05T15:36:06.776 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24593, 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 94.141881424999994, 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:06.777 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 100.11574724 2023-10-05T15:36:06.778 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:06.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a0c0a1500 msgr2=0x7f8a0c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a0c0a1500 0x7f8a0c0a39c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5648d75491f0 tx=0x7f8a18009920 comp rx=0 tx=0).stop 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 msgr2=0x7f8a20074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 0x7f8a20074c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e970 tx=0x7f8a1c00ec80 comp rx=0 tx=0).stop 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 shutdown_connections 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a0c0a1500 0x7f8a0c0a39c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a20102a30 0x7f8a200737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a20100e90 0x7f8a20074c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 --2- 172.21.15.17:0/2542048230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a20102070 0x7f8a200732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.769+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 >> 172.21.15.17:0/2542048230 conn(0x7f8a200fc430 msgr2=0x7f8a200fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.770+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 shutdown_connections 2023-10-05T15:36:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:06.770+0000 7f8a27fff700 1 -- 172.21.15.17:0/2542048230 wait complete. 2023-10-05T15:36:06.786 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-10-05T15:36:06.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2023-10-05T15:36:06.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2023-10-05T15:36:06.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-05T15:36:06.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2023-10-05T15:36:06.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: osdmap e93: 12 total, 12 up, 12 in 2023-10-05T15:36:06.787 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:06 smithi017 ceph-mon[129107]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-10-05T15:36:06.789 INFO:tasks.cephadm:Setup complete, yielding 2023-10-05T15:36:06.789 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-05T15:36:06.799 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:36:06.800 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-05T15:36:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-10-05T15:36:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2023-10-05T15:36:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2023-10-05T15:36:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-05T15:36:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2023-10-05T15:36:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: osdmap e93: 12 total, 12 up, 12 in 2023-10-05T15:36:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:06 smithi167 ceph-mon[133366]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-10-05T15:36:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-10-05T15:36:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2023-10-05T15:36:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2023-10-05T15:36:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-05T15:36:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2023-10-05T15:36:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: osdmap e93: 12 total, 12 up, 12 in 2023-10-05T15:36:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:06 smithi079 ceph-mon[132936]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-10-05T15:36:07.536 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:07.918 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:07 smithi017 ceph-mon[129107]: pgmap v354: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-10-05T15:36:07.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:07 smithi017 ceph-mon[129107]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-05T15:36:07.919 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:07 smithi017 ceph-mon[129107]: osdmap e94: 12 total, 12 up, 12 in 2023-10-05T15:36:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:07 smithi167 ceph-mon[133366]: pgmap v354: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-10-05T15:36:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:07 smithi167 ceph-mon[133366]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-05T15:36:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:07 smithi167 ceph-mon[133366]: osdmap e94: 12 total, 12 up, 12 in 2023-10-05T15:36:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:07 smithi079 ceph-mon[132936]: pgmap v354: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2023-10-05T15:36:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:07 smithi079 ceph-mon[132936]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-05T15:36:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:07 smithi079 ceph-mon[132936]: osdmap e94: 12 total, 12 up, 12 in 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 -- 172.21.15.17:0/2767121428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48102b10 msgr2=0x7f3d481093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 --2- 172.21.15.17:0/2767121428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48102b10 0x7f3d481093c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000b0d0 tx=0x7f3d4000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 -- 172.21.15.17:0/2767121428 shutdown_connections 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 --2- 172.21.15.17:0/2767121428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48102b10 0x7f3d481093c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 --2- 172.21.15.17:0/2767121428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d48100f70 0x7f3d48101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 --2- 172.21.15.17:0/2767121428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48102170 0x7f3d481025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.354+0000 7f3d4e629700 1 -- 172.21.15.17:0/2767121428 >> 172.21.15.17:0/2767121428 conn(0x7f3d480fc4d0 msgr2=0x7f3d480fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.355+0000 7f3d4e629700 1 -- 172.21.15.17:0/2767121428 shutdown_connections 2023-10-05T15:36:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.355+0000 7f3d4e629700 1 -- 172.21.15.17:0/2767121428 wait complete. 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 Processor -- start 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 -- start start 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 0x7f3d48196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d48102170 0x7f3d48197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48102b10 0x7f3d4819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4819e790 con 0x7f3d48100f70 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4819e8d0 con 0x7f3d48102170 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d4e629700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4819ea90 con 0x7f3d48102b10 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d47fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 0x7f3d48196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d47fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 0x7f3d48196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51790/0 (socket says 172.21.15.17:51790) 2023-10-05T15:36:09.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.356+0000 7f3d47fff700 1 -- 172.21.15.17:0/1911055301 learned_addr learned my addr 172.21.15.17:0/1911055301 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d4cbc6700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48102b10 0x7f3d4819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d477fe700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d48102170 0x7f3d48197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d47fff700 1 -- 172.21.15.17:0/1911055301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48102b10 msgr2=0x7f3d4819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d47fff700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48102b10 0x7f3d4819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d47fff700 1 -- 172.21.15.17:0/1911055301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d48102170 msgr2=0x7f3d48197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d47fff700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d48102170 0x7f3d48197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d47fff700 1 -- 172.21.15.17:0/1911055301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009d00 con 0x7f3d48100f70 2023-10-05T15:36:09.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d47fff700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 0x7f3d48196c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d980 tx=0x7f3d3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.357+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38004020 con 0x7f3d48100f70 2023-10-05T15:36:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.358+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4819ed70 con 0x7f3d48100f70 2023-10-05T15:36:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.358+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d38009730 con 0x7f3d48100f70 2023-10-05T15:36:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.358+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d380039c0 con 0x7f3d48100f70 2023-10-05T15:36:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.358+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4819f200 con 0x7f3d48100f70 2023-10-05T15:36:09.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.359+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d48108570 con 0x7f3d48100f70 2023-10-05T15:36:09.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.361+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3d380098a0 con 0x7f3d48100f70 2023-10-05T15:36:09.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.363+0000 7f3d457fa700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d300a1480 0x7f3d300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.363+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3d380ccdf0 con 0x7f3d48100f70 2023-10-05T15:36:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.363+0000 7f3d477fe700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d300a1480 0x7f3d300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:09.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.364+0000 7f3d477fe700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d300a1480 0x7f3d300a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c005950 tx=0x7f3d3c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:09.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.368+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3d38096050 con 0x7f3d48100f70 2023-10-05T15:36:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.593+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d4802d2e0 con 0x7f3d300a1480 2023-10-05T15:36:09.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.594+0000 7f3d457fa700 1 -- 172.21.15.17:0/1911055301 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3d4802d2e0 con 0x7f3d300a1480 2023-10-05T15:36:09.596 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2023-10-05T15:36:09.596 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2023-10-05T15:36:09.596 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d300a1480 msgr2=0x7f3d300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d300a1480 0x7f3d300a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c005950 tx=0x7f3d3c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 msgr2=0x7f3d48196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 0x7f3d48196c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d980 tx=0x7f3d3800dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 shutdown_connections 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d300a1480 0x7f3d300a3940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d48102b10 0x7f3d4819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d48100f70 0x7f3d48196c40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 --2- 172.21.15.17:0/1911055301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d48102170 0x7f3d48197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 >> 172.21.15.17:0/1911055301 conn(0x7f3d480fc4d0 msgr2=0x7f3d481056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 shutdown_connections 2023-10-05T15:36:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:09.597+0000 7f3d4e629700 1 -- 172.21.15.17:0/1911055301 wait complete. 2023-10-05T15:36:09.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:09 smithi017 ceph-mon[129107]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 127 B/s wr, 6 op/s; 212 B/s, 0 objects/s recovering 2023-10-05T15:36:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:09 smithi167 ceph-mon[133366]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 127 B/s wr, 6 op/s; 212 B/s, 0 objects/s recovering 2023-10-05T15:36:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:09 smithi079 ceph-mon[132936]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 127 B/s wr, 6 op/s; 212 B/s, 0 objects/s recovering 2023-10-05T15:36:10.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-05T15:36:10.874 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:10.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:10 smithi017 ceph-mon[129107]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:11.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:10 smithi167 ceph-mon[133366]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:11.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:10 smithi079 ceph-mon[132936]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:11.865 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:11 smithi017 ceph-mon[129107]: pgmap v357: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 639 B/s wr, 11 op/s; 212 B/s, 0 objects/s recovering 2023-10-05T15:36:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:11 smithi167 ceph-mon[133366]: pgmap v357: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 639 B/s wr, 11 op/s; 212 B/s, 0 objects/s recovering 2023-10-05T15:36:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:11 smithi079 ceph-mon[132936]: pgmap v357: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 639 B/s wr, 11 op/s; 212 B/s, 0 objects/s recovering 2023-10-05T15:36:12.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 -- 172.21.15.17:0/3067780352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 msgr2=0x7f69a4106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 --2- 172.21.15.17:0/3067780352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a4106720 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6998009990 tx=0x7f6998009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 -- 172.21.15.17:0/3067780352 shutdown_connections 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 --2- 172.21.15.17:0/3067780352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69a4106c60 0x7f69a41090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 --2- 172.21.15.17:0/3067780352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a4101a00 0x7f69a4103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 --2- 172.21.15.17:0/3067780352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a4106720 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 -- 172.21.15.17:0/3067780352 >> 172.21.15.17:0/3067780352 conn(0x7f69a40fb3f0 msgr2=0x7f69a40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 -- 172.21.15.17:0/3067780352 shutdown_connections 2023-10-05T15:36:12.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.570+0000 7f69aa259700 1 -- 172.21.15.17:0/3067780352 wait complete. 2023-10-05T15:36:12.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.571+0000 7f69aa259700 1 Processor -- start 2023-10-05T15:36:12.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.571+0000 7f69aa259700 1 -- start start 2023-10-05T15:36:12.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69aa259700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69a4101a00 0x7f69a4101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:12.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69aa259700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a40ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:12.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69aa259700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a4106c60 0x7f69a40ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:12.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69aa259700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a4100670 con 0x7f69a4104330 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69aa259700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41007e0 con 0x7f69a4101a00 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69aa259700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a41a0b80 con 0x7f69a4106c60 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a40ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a40ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51810/0 (socket says 172.21.15.17:51810) 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 -- 172.21.15.17:0/1706604595 learned_addr learned my addr 172.21.15.17:0/1706604595 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a37fe700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69a4101a00 0x7f69a4101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a3fff700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a4106c60 0x7f69a40ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 -- 172.21.15.17:0/1706604595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a4106c60 msgr2=0x7f69a40ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a4106c60 0x7f69a40ffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 -- 172.21.15.17:0/1706604595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69a4101a00 msgr2=0x7f69a4101360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69a4101a00 0x7f69a4101360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.572+0000 7f69a2ffd700 1 -- 172.21.15.17:0/1706604595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980095f0 con 0x7f69a4104330 2023-10-05T15:36:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.573+0000 7f69a2ffd700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a40ff9b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6998005910 tx=0x7f6998004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.573+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699801d070 con 0x7f69a4104330 2023-10-05T15:36:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.573+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6998004c70 con 0x7f69a4104330 2023-10-05T15:36:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.573+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a41a0e00 con 0x7f69a4104330 2023-10-05T15:36:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.573+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6998003a30 con 0x7f69a4104330 2023-10-05T15:36:12.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.573+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a41a1210 con 0x7f69a4104330 2023-10-05T15:36:12.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.574+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a40fcf70 con 0x7f69a4104330 2023-10-05T15:36:12.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.576+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6998005000 con 0x7f69a4104330 2023-10-05T15:36:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.578+0000 7f69a0ff9700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f698c0a1500 0x7f698c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:12.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.578+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f69980ce320 con 0x7f69a4104330 2023-10-05T15:36:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.578+0000 7f69a37fe700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f698c0a1500 0x7f698c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:12.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.578+0000 7f69a37fe700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f698c0a1500 0x7f698c0a39c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f699400ac50 tx=0x7f699400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:12.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.580+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f699809b0a0 con 0x7f69a4104330 2023-10-05T15:36:12.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.805+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69a402d1e0 con 0x7f698c0a1500 2023-10-05T15:36:12.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.820+0000 7f69a0ff9700 1 -- 172.21.15.17:0/1706604595 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f69a402d1e0 con 0x7f698c0a1500 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (109s) 23s ago 109s 15.8M - 18.0.0-6578-g689b3d5a 83c9d078d785 856aea266b90 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi079 running (106s) 33s ago 106s 29.4M - 18.0.0-6578-g689b3d5a 83c9d078d785 47c2665ebdd0 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi167 running (2m) 33s ago 2m 17.2M - 18.0.0-6578-g689b3d5a 83c9d078d785 9abddbfc6f87 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (2m) 23s ago 2m 16.2M - 18.0.0-6578-g689b3d5a 83c9d078d785 72f825ebd3bb 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi079 running (2m) 33s ago 2m 16.1M - 18.0.0-6578-g689b3d5a 83c9d078d785 2e91ba23dc5c 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi167 running (2m) 33s ago 2m 17.3M - 18.0.0-6578-g689b3d5a 83c9d078d785 61460d96e9e3 2023-10-05T15:36:12.822 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (112s) 23s ago 112s 17.4M - 18.0.0-6578-g689b3d5a 83c9d078d785 64d3e4dec737 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi079 running (119s) 33s ago 118s 17.5M - 18.0.0-6578-g689b3d5a 83c9d078d785 5ac66f0e6010 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi167 running (115s) 33s ago 115s 17.3M - 18.0.0-6578-g689b3d5a 83c9d078d785 a0eef803d8d5 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (2m) 23s ago 2m 13.8M - 18.0.0-6578-g689b3d5a 83c9d078d785 131ba25cb718 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi079 running (2m) 33s ago 2m 16.2M - 18.0.0-6578-g689b3d5a 83c9d078d785 eb381ae965e2 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi167 running (2m) 33s ago 2m 16.1M - 18.0.0-6578-g689b3d5a 83c9d078d785 258d817afe98 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (10m) 23s ago 9m 527M - 18.0.0-6578-g689b3d5a 83c9d078d785 bfd56eacfde9 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi079 *:8443,8765 running (7m) 33s ago 7m 452M - 18.0.0-6578-g689b3d5a 83c9d078d785 30e2da6135b6 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi167 *:8443,8765 running (7m) 33s ago 7m 452M - 18.0.0-6578-g689b3d5a 83c9d078d785 0cfbcc5064f6 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (10m) 23s ago 10m 99.7M 2048M 18.0.0-6578-g689b3d5a 83c9d078d785 76700c0a255d 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi079 running (8m) 33s ago 8m 66.5M 2048M 18.0.0-6578-g689b3d5a 83c9d078d785 25ce400afe67 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi167 running (8m) 33s ago 8m 63.6M 2048M 18.0.0-6578-g689b3d5a 83c9d078d785 5737034d7f94 2023-10-05T15:36:12.823 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 23s ago 7m 72.5M 4318M 18.0.0-6578-g689b3d5a 83c9d078d785 61a56ca3bd00 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi079 running (7m) 33s ago 7m 79.2M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 6c8b7e18a42b 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi167 running (6m) 33s ago 6m 77.2M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 a00d0703ba07 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (6m) 23s ago 6m 67.1M 4318M 18.0.0-6578-g689b3d5a 83c9d078d785 73a72102c53b 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi079 running (5m) 33s ago 5m 66.3M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 ddacd020f804 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi167 running (5m) 33s ago 5m 70.5M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 1db4f8c6f965 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (4m) 23s ago 4m 63.9M 4318M 18.0.0-6578-g689b3d5a 83c9d078d785 715bfedc16a0 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi079 running (4m) 33s ago 4m 67.7M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 edb9717f4401 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi167 running (4m) 33s ago 4m 63.8M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 258976a788ba 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 23s ago 3m 62.9M 4318M 18.0.0-6578-g689b3d5a 83c9d078d785 5942e3cfad3f 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi079 running (3m) 33s ago 3m 63.4M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 6e40bcef807a 2023-10-05T15:36:12.824 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi167 running (2m) 33s ago 2m 55.7M 4316M 18.0.0-6578-g689b3d5a 83c9d078d785 73d7fa12d554 2023-10-05T15:36:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f698c0a1500 msgr2=0x7f698c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f698c0a1500 0x7f698c0a39c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f699400ac50 tx=0x7f699400a380 comp rx=0 tx=0).stop 2023-10-05T15:36:12.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 msgr2=0x7f69a40ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a40ff9b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6998005910 tx=0x7f6998004730 comp rx=0 tx=0).stop 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 shutdown_connections 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f698c0a1500 0x7f698c0a39c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69a4106c60 0x7f69a40ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69a4101a00 0x7f69a4101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.822+0000 7f69aa259700 1 --2- 172.21.15.17:0/1706604595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a4104330 0x7f69a40ff9b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.823+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 >> 172.21.15.17:0/1706604595 conn(0x7f69a40fb3f0 msgr2=0x7f69a4102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.823+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 shutdown_connections 2023-10-05T15:36:12.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:12.823+0000 7f69aa259700 1 -- 172.21.15.17:0/1706604595 wait complete. 2023-10-05T15:36:13.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:12 smithi017 ceph-mon[129107]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-10-05T15:36:13.014 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:12 smithi017 ceph-mon[129107]: Cluster is now healthy 2023-10-05T15:36:13.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:12 smithi167 ceph-mon[133366]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-10-05T15:36:13.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:12 smithi167 ceph-mon[133366]: Cluster is now healthy 2023-10-05T15:36:13.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:12 smithi079 ceph-mon[132936]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-10-05T15:36:13.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:12 smithi079 ceph-mon[132936]: Cluster is now healthy 2023-10-05T15:36:13.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-05T15:36:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:13 smithi167 ceph-mon[133366]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 639 B/s wr, 6 op/s; 226 B/s, 1 objects/s recovering 2023-10-05T15:36:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:13 smithi079 ceph-mon[132936]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 639 B/s wr, 6 op/s; 226 B/s, 1 objects/s recovering 2023-10-05T15:36:14.111 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:14.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:13 smithi017 ceph-mon[129107]: pgmap v358: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 639 B/s wr, 6 op/s; 226 B/s, 1 objects/s recovering 2023-10-05T15:36:14.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:14 smithi017 ceph-mon[129107]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:15.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:14 smithi167 ceph-mon[133366]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:15.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:14 smithi079 ceph-mon[132936]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 -- 172.21.15.17:0/843060169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628102170 msgr2=0x7fa6281025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/843060169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628102170 0x7fa6281025d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa6180099c0 tx=0x7fa618009cd0 comp rx=0 tx=0).stop 2023-10-05T15:36:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 -- 172.21.15.17:0/843060169 shutdown_connections 2023-10-05T15:36:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/843060169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa628102b10 0x7fa6281093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/843060169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa628100f70 0x7fa628101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/843060169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628102170 0x7fa6281025d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 -- 172.21.15.17:0/843060169 >> 172.21.15.17:0/843060169 conn(0x7fa6280fc4d0 msgr2=0x7fa6280fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 -- 172.21.15.17:0/843060169 shutdown_connections 2023-10-05T15:36:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.837+0000 7fa62fe4c700 1 -- 172.21.15.17:0/843060169 wait complete. 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.838+0000 7fa62fe4c700 1 Processor -- start 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.838+0000 7fa62fe4c700 1 -- start start 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62fe4c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 0x7fa628074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62fe4c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa628102170 0x7fa6280732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62fe4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa628102b10 0x7fa6280737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62fe4c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628073f60 con 0x7fa628100f70 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62fe4c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280740d0 con 0x7fa628102b10 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62fe4c700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281a0c10 con 0x7fa628102170 2023-10-05T15:36:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 0x7fa628074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 0x7fa628074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59760/0 (socket says 172.21.15.17:59760) 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 -- 172.21.15.17:0/1871400663 learned_addr learned my addr 172.21.15.17:0/1871400663 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62e3e9700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa628102b10 0x7fa6280737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62d3e7700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa628102170 0x7fa6280732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 -- 172.21.15.17:0/1871400663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa628102170 msgr2=0x7fa6280732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa628102170 0x7fa6280732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 -- 172.21.15.17:0/1871400663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa628102b10 msgr2=0x7fa6280737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa628102b10 0x7fa6280737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.839+0000 7fa62dbe8700 1 -- 172.21.15.17:0/1871400663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180095f0 con 0x7fa628100f70 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.840+0000 7fa62dbe8700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 0x7fa628074c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa62400e970 tx=0x7fa62400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:15.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.840+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624009790 con 0x7fa628100f70 2023-10-05T15:36:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.840+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6240044b0 con 0x7fa628100f70 2023-10-05T15:36:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.840+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6281a0ef0 con 0x7fa628100f70 2023-10-05T15:36:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.840+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6281a1300 con 0x7fa628100f70 2023-10-05T15:36:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.840+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624003dd0 con 0x7fa628100f70 2023-10-05T15:36:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.841+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c005320 con 0x7fa628100f70 2023-10-05T15:36:15.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.843+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa62400cbd0 con 0x7fa628100f70 2023-10-05T15:36:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.844+0000 7fa61effd700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6140a1480 0x7fa6140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.845+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa624014070 con 0x7fa628100f70 2023-10-05T15:36:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.845+0000 7fa62d3e7700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6140a1480 0x7fa6140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.846+0000 7fa62d3e7700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6140a1480 0x7fa6140a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa618009990 tx=0x7fa618005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:15.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:15.849+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa624096640 con 0x7fa628100f70 2023-10-05T15:36:15.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:15 smithi017 ceph-mon[129107]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 570 B/s wr, 9 op/s; 202 B/s, 1 objects/s recovering 2023-10-05T15:36:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.069+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa60c000bf0 con 0x7fa6140a1480 2023-10-05T15:36:16.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.075+0000 7fa61effd700 1 -- 172.21.15.17:0/1871400663 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fa60c000bf0 con 0x7fa6140a1480 2023-10-05T15:36:16.076 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-05T15:36:16.077 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 36s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2023-10-05T15:36:16.077 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 36s ago 8m smithi017=x;smithi079=y;smithi167=z;count:3 2023-10-05T15:36:16.077 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 36s ago 8m smithi017:172.21.15.17=a;smithi079:172.21.15.79=b;smithi167:172.21.15.167=c;count:3 2023-10-05T15:36:16.077 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 36s ago - 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6140a1480 msgr2=0x7fa6140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6140a1480 0x7fa6140a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa618009990 tx=0x7fa618005fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 msgr2=0x7fa628074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 0x7fa628074c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa62400e970 tx=0x7fa62400ed30 comp rx=0 tx=0).stop 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 shutdown_connections 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa6140a1480 0x7fa6140a3940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa628102b10 0x7fa6280737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa628100f70 0x7fa628074c50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:16.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 --2- 172.21.15.17:0/1871400663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa628102170 0x7fa6280732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:16.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 >> 172.21.15.17:0/1871400663 conn(0x7fa6280fc4d0 msgr2=0x7fa6280fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:16.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 shutdown_connections 2023-10-05T15:36:16.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:16.077+0000 7fa62fe4c700 1 -- 172.21.15.17:0/1871400663 wait complete. 2023-10-05T15:36:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:15 smithi167 ceph-mon[133366]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 570 B/s wr, 9 op/s; 202 B/s, 1 objects/s recovering 2023-10-05T15:36:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:15 smithi079 ceph-mon[132936]: pgmap v359: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 570 B/s wr, 9 op/s; 202 B/s, 1 objects/s recovering 2023-10-05T15:36:16.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-05T15:36:17.350 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:17.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:17 smithi017 ceph-mon[129107]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:17.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:17 smithi017 ceph-mon[129107]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 9 op/s; 181 B/s, 1 objects/s recovering 2023-10-05T15:36:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:17 smithi167 ceph-mon[133366]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:17 smithi167 ceph-mon[133366]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 9 op/s; 181 B/s, 1 objects/s recovering 2023-10-05T15:36:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:17 smithi079 ceph-mon[132936]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:17 smithi079 ceph-mon[132936]: pgmap v360: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 511 B/s wr, 9 op/s; 181 B/s, 1 objects/s recovering 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.044+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/900043890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 msgr2=0x7f3c74101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.044+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/900043890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74101390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3c700099c0 tx=0x7f3c70009cd0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/900043890 shutdown_connections 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/900043890 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 0x7f3c741093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/900043890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74101390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/900043890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c74102170 0x7f3c741025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/900043890 >> 172.21.15.17:0/900043890 conn(0x7f3c740fc4d0 msgr2=0x7f3c740fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:19.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/900043890 shutdown_connections 2023-10-05T15:36:19.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.045+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/900043890 wait complete. 2023-10-05T15:36:19.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.046+0000 7f3c7b3a5700 1 Processor -- start 2023-10-05T15:36:19.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.046+0000 7f3c7b3a5700 1 -- start start 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c7b3a5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c7b3a5700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c74102170 0x7f3c74199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c7b3a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 0x7f3c741a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c7b3a5700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c741a0980 con 0x7f3c74100f70 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c7b3a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c741a0ac0 con 0x7f3c74102b10 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c7b3a5700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c741a0c50 con 0x7f3c74102170 2023-10-05T15:36:19.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c79141700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c79141700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59784/0 (socket says 172.21.15.17:59784) 2023-10-05T15:36:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.047+0000 7f3c79141700 1 -- 172.21.15.17:0/3778428434 learned_addr learned my addr 172.21.15.17:0/3778428434 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79942700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 0x7f3c741a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:19.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c78940700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c74102170 0x7f3c74199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79141700 1 -- 172.21.15.17:0/3778428434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c74102170 msgr2=0x7f3c74199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79141700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c74102170 0x7f3c74199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79141700 1 -- 172.21.15.17:0/3778428434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 msgr2=0x7f3c741a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79141700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 0x7f3c741a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79141700 1 -- 172.21.15.17:0/3778428434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700095f0 con 0x7f3c74100f70 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79942700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 0x7f3c741a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c79141700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74198df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009990 tx=0x7f3c70003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7001d070 con 0x7f3c74100f70 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c7000bda0 con 0x7f3c74100f70 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c741a0ed0 con 0x7f3c74100f70 2023-10-05T15:36:19.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.048+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70022e20 con 0x7f3c74100f70 2023-10-05T15:36:19.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.049+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c741a1230 con 0x7f3c74100f70 2023-10-05T15:36:19.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.050+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7410c760 con 0x7f3c74100f70 2023-10-05T15:36:19.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.052+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3c70003ee0 con 0x7f3c74100f70 2023-10-05T15:36:19.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.053+0000 7f3c6a7fc700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c600a1480 0x7f3c600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.053+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3c700ce5a0 con 0x7f3c74100f70 2023-10-05T15:36:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.053+0000 7f3c78940700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c600a1480 0x7f3c600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:19.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.054+0000 7f3c78940700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c600a1480 0x7f3c600a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c64005950 tx=0x7f3c640058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:19.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.058+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3c70097890 con 0x7f3c74100f70 2023-10-05T15:36:19.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.272+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c74108b50 con 0x7f3c600a1480 2023-10-05T15:36:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.274+0000 7f3c6a7fc700 1 -- 172.21.15.17:0/3778428434 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f3c74108b50 con 0x7f3c600a1480 2023-10-05T15:36:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2023-10-05T15:36:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2023-10-05T15:36:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:smithi079 172.21.15.79 2023-10-05T15:36:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:smithi167 172.21.15.167 2023-10-05T15:36:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2023-10-05T15:36:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c600a1480 msgr2=0x7f3c600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c600a1480 0x7f3c600a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c64005950 tx=0x7f3c640058e0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 msgr2=0x7f3c74198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74198df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009990 tx=0x7f3c70003b00 comp rx=0 tx=0).stop 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 shutdown_connections 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c600a1480 0x7f3c600a3940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c74102b10 0x7f3c741a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c74100f70 0x7f3c74198df0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 --2- 172.21.15.17:0/3778428434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c74102170 0x7f3c74199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.276+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 >> 172.21.15.17:0/3778428434 conn(0x7f3c740fc4d0 msgr2=0x7f3c740fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.277+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 shutdown_connections 2023-10-05T15:36:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:19.277+0000 7f3c7b3a5700 1 -- 172.21.15.17:0/3778428434 wait complete. 2023-10-05T15:36:19.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-05T15:36:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:19 smithi167 ceph-mon[133366]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 428 B/s wr, 9 op/s; 151 B/s, 1 objects/s recovering 2023-10-05T15:36:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:19 smithi079 ceph-mon[132936]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 428 B/s wr, 9 op/s; 151 B/s, 1 objects/s recovering 2023-10-05T15:36:20.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:19 smithi017 ceph-mon[129107]: pgmap v361: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 428 B/s wr, 9 op/s; 151 B/s, 1 objects/s recovering 2023-10-05T15:36:20.489 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:21.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:20 smithi167 ceph-mon[133366]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:21.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:20 smithi079 ceph-mon[132936]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:21.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:20 smithi017 ceph-mon[129107]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:21.990 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:21 smithi017 ceph-mon[129107]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s; 9 B/s, 0 objects/s recovering 2023-10-05T15:36:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:21 smithi167 ceph-mon[133366]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s; 9 B/s, 0 objects/s recovering 2023-10-05T15:36:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:21 smithi079 ceph-mon[132936]: pgmap v362: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 12 op/s; 9 B/s, 0 objects/s recovering 2023-10-05T15:36:22.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3621799669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8104330 msgr2=0x7fe3e8106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:22.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3621799669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8104330 0x7fe3e8106720 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009990 tx=0x7fe3dc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3621799669 shutdown_connections 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3621799669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8106c60 0x7fe3e81090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3621799669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 0x7fe3e8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3621799669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8104330 0x7fe3e8106720 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.202+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3621799669 >> 172.21.15.17:0/3621799669 conn(0x7fe3e80fb3f0 msgr2=0x7fe3e80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.203+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3621799669 shutdown_connections 2023-10-05T15:36:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.203+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3621799669 wait complete. 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 Processor -- start 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 -- start start 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 0x7fe3e8196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8104330 0x7fe3e81970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8106c60 0x7fe3e819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e819e720 con 0x7fe3e8106c60 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e819e860 con 0x7fe3e8104330 2023-10-05T15:36:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.204+0000 7fe3ecc7f700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e819e9f0 con 0x7fe3e8101a00 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 0x7fe3e8196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 0x7fe3e8196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:56674/0 (socket says 172.21.15.17:56674) 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e659c700 1 -- 172.21.15.17:0/3288597277 learned_addr learned my addr 172.21.15.17:0/3288597277 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8104330 0x7fe3e81970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e6d9d700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8106c60 0x7fe3e819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 -- 172.21.15.17:0/3288597277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 msgr2=0x7fe3e8196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 0x7fe3e8196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 -- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8106c60 msgr2=0x7fe3e819e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8106c60 0x7fe3e819e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 -- 172.21.15.17:0/3288597277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0095f0 con 0x7fe3e8104330 2023-10-05T15:36:22.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e6d9d700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8106c60 0x7fe3e819e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.205+0000 7fe3e5d9b700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8104330 0x7fe3e81970d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc000c00 tx=0x7fe3dc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.206+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc01d070 con 0x7fe3e8104330 2023-10-05T15:36:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.206+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e819ec70 con 0x7fe3e8104330 2023-10-05T15:36:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.206+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3dc00bdb0 con 0x7fe3e8104330 2023-10-05T15:36:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.206+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc022cf0 con 0x7fe3e8104330 2023-10-05T15:36:22.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.206+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e819f0e0 con 0x7fe3e8104330 2023-10-05T15:36:22.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.207+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e80fcf70 con 0x7fe3e8104330 2023-10-05T15:36:22.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.209+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe3dc022470 con 0x7fe3e8104330 2023-10-05T15:36:22.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.211+0000 7fe3d77fe700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe3d00a1480 0x7fe3d00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:22.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.211+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe3dc0cea70 con 0x7fe3e8104330 2023-10-05T15:36:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.211+0000 7fe3e659c700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe3d00a1480 0x7fe3d00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:22.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.212+0000 7fe3e659c700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe3d00a1480 0x7fe3d00a3940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009d20 tx=0x7fe3d8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:22.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.213+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe3dc097d60 con 0x7fe3e8104330 2023-10-05T15:36:22.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.430+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3e810c750 con 0x7fe3d00a1480 2023-10-05T15:36:22.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.432+0000 7fe3d77fe700 1 -- 172.21.15.17:0/3288597277 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fe3e810c750 con 0x7fe3d00a1480 2023-10-05T15:36:22.434 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-05T15:36:22.434 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago Has a FileSystem, LVM detected 2023-10-05T15:36:22.434 INFO:teuthology.orchestra.run.smithi017.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2023-10-05T15:36:22.435 INFO:teuthology.orchestra.run.smithi017.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-05T15:36:22.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe3d00a1480 msgr2=0x7fe3d00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:22.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe3d00a1480 0x7fe3d00a3940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009d20 tx=0x7fe3d8009260 comp rx=0 tx=0).stop 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8104330 msgr2=0x7fe3e81970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8104330 0x7fe3e81970d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc000c00 tx=0x7fe3dc004730 comp rx=0 tx=0).stop 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 shutdown_connections 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe3d00a1480 0x7fe3d00a3940 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3e8106c60 0x7fe3e819e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3e8101a00 0x7fe3e8196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 --2- 172.21.15.17:0/3288597277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3e8104330 0x7fe3e81970d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:22.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 >> 172.21.15.17:0/3288597277 conn(0x7fe3e80fb3f0 msgr2=0x7fe3e8102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:22.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 shutdown_connections 2023-10-05T15:36:22.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:22.435+0000 7fe3ecc7f700 1 -- 172.21.15.17:0/3288597277 wait complete. 2023-10-05T15:36:22.987 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-05T15:36:22.995 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:36:22.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-05T15:36:23.732 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:24.020 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:23 smithi017 ceph-mon[129107]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:24.020 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:23 smithi017 ceph-mon[129107]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2023-10-05T15:36:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:23 smithi167 ceph-mon[133366]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:23 smithi167 ceph-mon[133366]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2023-10-05T15:36:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:23 smithi079 ceph-mon[132936]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-05T15:36:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:23 smithi079 ceph-mon[132936]: pgmap v363: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 9 B/s, 0 objects/s recovering 2023-10-05T15:36:25.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 -- 172.21.15.17:0/1555499404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34100f70 msgr2=0x7f1d34101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:25.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 --2- 172.21.15.17:0/1555499404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34100f70 0x7f1d34101390 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1d240099c0 tx=0x7f1d24009cd0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 -- 172.21.15.17:0/1555499404 shutdown_connections 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 --2- 172.21.15.17:0/1555499404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d34102b10 0x7f1d341093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 --2- 172.21.15.17:0/1555499404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34100f70 0x7f1d34101390 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 --2- 172.21.15.17:0/1555499404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34102170 0x7f1d341025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.360+0000 7f1d38b71700 1 -- 172.21.15.17:0/1555499404 >> 172.21.15.17:0/1555499404 conn(0x7f1d340fc4d0 msgr2=0x7f1d340fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.361+0000 7f1d38b71700 1 -- 172.21.15.17:0/1555499404 shutdown_connections 2023-10-05T15:36:25.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.361+0000 7f1d38b71700 1 -- 172.21.15.17:0/1555499404 wait complete. 2023-10-05T15:36:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 Processor -- start 2023-10-05T15:36:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 -- start start 2023-10-05T15:36:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34100f70 0x7f1d34074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d34102170 0x7f1d340732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 0x7f1d340737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34073f60 con 0x7f1d34102b10 2023-10-05T15:36:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340740d0 con 0x7f1d34100f70 2023-10-05T15:36:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d38b71700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d341a0c20 con 0x7f1d34102170 2023-10-05T15:36:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d32d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 0x7f1d340737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34100f70 0x7f1d34074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d32d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 0x7f1d340737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46988/0 (socket says 172.21.15.17:46988) 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.362+0000 7f1d32d9d700 1 -- 172.21.15.17:0/3340573052 learned_addr learned my addr 172.21.15.17:0/3340573052 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d31d9b700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d34102170 0x7f1d340732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d32d9d700 1 -- 172.21.15.17:0/3340573052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d34102170 msgr2=0x7f1d340732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d32d9d700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d34102170 0x7f1d340732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d32d9d700 1 -- 172.21.15.17:0/3340573052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34100f70 msgr2=0x7f1d34074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d32d9d700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34100f70 0x7f1d34074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d32d9d700 1 -- 172.21.15.17:0/3340573052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240095f0 con 0x7f1d34102b10 2023-10-05T15:36:25.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d3259c700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34100f70 0x7f1d34074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:25.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d32d9d700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 0x7f1d340737e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00ef30 tx=0x7f1d2c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:25.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c018070 con 0x7f1d34102b10 2023-10-05T15:36:25.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d2c00f040 con 0x7f1d34102b10 2023-10-05T15:36:25.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.363+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00cbc0 con 0x7f1d34102b10 2023-10-05T15:36:25.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.364+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d341a0ea0 con 0x7f1d34102b10 2023-10-05T15:36:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.364+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d341a12b0 con 0x7f1d34102b10 2023-10-05T15:36:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.365+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d34107f40 con 0x7f1d34102b10 2023-10-05T15:36:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.367+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1d2c00cd80 con 0x7f1d34102b10 2023-10-05T15:36:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.368+0000 7f1d237fe700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d1c0a1480 0x7f1d1c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.368+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1d2c0ccb90 con 0x7f1d34102b10 2023-10-05T15:36:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.368+0000 7f1d3259c700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d1c0a1480 0x7f1d1c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:25.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.369+0000 7f1d3259c700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d1c0a1480 0x7f1d1c0a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1d24000c00 tx=0x7f1d2400bda0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.373+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d2c095e80 con 0x7f1d34102b10 2023-10-05T15:36:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.627+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1d3410c670 con 0x7f1d34102b10 2023-10-05T15:36:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.627+0000 7f1d237fe700 1 -- 172.21.15.17:0/3340573052 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2967 (secure 0 0 0) 0x7f1d2c0994a0 con 0x7f1d34102b10 2023-10-05T15:36:25.629 INFO:teuthology.orchestra.run.smithi017.stdout:e27 2023-10-05T15:36:25.629 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-05T15:36:25.629 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 27 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-05T15:36:25.630 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-10-05T15:34:32.118456+0000 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2023-10-05T15:35:01.582968+0000 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2023-10-05T15:36:25.631 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 5 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2,3,4 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24593,1=24569,2=24550,3=24539,4=24526} 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2023-10-05T15:36:25.632 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3,4] 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2023-10-05T15:36:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{0:24593} state up:active seq 3 addr [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{0:24514} state up:standby-replay seq 1 addr [v2:172.21.15.167:6834/4056762327,v1:172.21.15.167:6835/4056762327] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{1:24569} state up:active seq 11 addr [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{1:24497} state up:standby-replay seq 1 addr [v2:172.21.15.79:6834/331259911,v1:172.21.15.79:6835/331259911] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{2:24550} state up:active seq 12 addr [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{2:24488} state up:standby-replay seq 1 addr [v2:172.21.15.17:6836/3739441472,v1:172.21.15.17:6837/3739441472] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{3:24539} state up:active seq 13 addr [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{3:24470} state up:standby-replay seq 1 addr [v2:172.21.15.79:6832/926038497,v1:172.21.15.79:6833/926038497] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.634 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{4:24526} state up:active seq 14 addr [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{4:24457} state up:standby-replay seq 1 addr [v2:172.21.15.167:6832/978373819,v1:172.21.15.167:6833/978373819] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:14604} state up:standby seq 1 addr [v2:172.21.15.17:6834/906244086,v1:172.21.15.17:6835/906244086] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.635 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{-1:14694} state up:standby seq 1 addr [v2:172.21.15.17:6840/3361787400,v1:172.21.15.17:6841/3361787400] compat {c=[1],r=[1],i=[fff]}] 2023-10-05T15:36:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.629+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d1c0a1480 msgr2=0x7f1d1c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.629+0000 7f1d38b71700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d1c0a1480 0x7f1d1c0a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1d24000c00 tx=0x7f1d2400bda0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.629+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 msgr2=0x7f1d340737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.629+0000 7f1d38b71700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 0x7f1d340737e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00ef30 tx=0x7f1d2c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 shutdown_connections 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d1c0a1480 0x7f1d1c0a3940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d34102b10 0x7f1d340737e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d34100f70 0x7f1d34074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 --2- 172.21.15.17:0/3340573052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d34102170 0x7f1d340732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 >> 172.21.15.17:0/3340573052 conn(0x7f1d340fc4d0 msgr2=0x7f1d340fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 shutdown_connections 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:25.630+0000 7f1d38b71700 1 -- 172.21.15.17:0/3340573052 wait complete. 2023-10-05T15:36:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:25 smithi017 ceph-mon[129107]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:25.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:25 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3340573052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-05T15:36:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:25 smithi167 ceph-mon[133366]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:25 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3340573052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-05T15:36:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:25 smithi079 ceph-mon[132936]: pgmap v364: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:25 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3340573052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-05T15:36:26.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-05T15:36:26.973 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:27.874 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:27 smithi017 ceph-mon[129107]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:36:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:27 smithi167 ceph-mon[133366]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:36:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:27 smithi079 ceph-mon[132936]: pgmap v365: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:36:28.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.543+0000 7f1697e31700 1 -- 172.21.15.17:0/4170560522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690100f70 msgr2=0x7f1690101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.543+0000 7f1697e31700 1 --2- 172.21.15.17:0/4170560522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690100f70 0x7f1690101390 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f168c0099c0 tx=0x7f168c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 -- 172.21.15.17:0/4170560522 shutdown_connections 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 --2- 172.21.15.17:0/4170560522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1690102b10 0x7f16901093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 --2- 172.21.15.17:0/4170560522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690100f70 0x7f1690101390 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 --2- 172.21.15.17:0/4170560522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1690102170 0x7f16901025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 -- 172.21.15.17:0/4170560522 >> 172.21.15.17:0/4170560522 conn(0x7f16900fc4d0 msgr2=0x7f16900fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 -- 172.21.15.17:0/4170560522 shutdown_connections 2023-10-05T15:36:28.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.544+0000 7f1697e31700 1 -- 172.21.15.17:0/4170560522 wait complete. 2023-10-05T15:36:28.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 Processor -- start 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 -- start start 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1690100f70 0x7f1690196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1690102170 0x7f1690197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 0x7f169019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169019e6c0 con 0x7f1690102b10 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169019e800 con 0x7f1690102170 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.545+0000 7f1697e31700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169019e990 con 0x7f1690100f70 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 0x7f169019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 0x7f169019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47004/0 (socket says 172.21.15.17:47004) 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 -- 172.21.15.17:0/3490984059 learned_addr learned my addr 172.21.15.17:0/3490984059 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:28.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16953cc700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1690102170 0x7f1690197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f1695bcd700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1690100f70 0x7f1690196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 -- 172.21.15.17:0/3490984059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1690100f70 msgr2=0x7f1690196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1690100f70 0x7f1690196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 -- 172.21.15.17:0/3490984059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1690102170 msgr2=0x7f1690197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1690102170 0x7f1690197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 -- 172.21.15.17:0/3490984059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0095f0 con 0x7f1690102b10 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.546+0000 7f16963ce700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 0x7f169019e0f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1688007f10 tx=0x7f168800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.547+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688017070 con 0x7f1690102b10 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.547+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169019ec70 con 0x7f1690102b10 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.547+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168800f040 con 0x7f1690102b10 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.547+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688005570 con 0x7f1690102b10 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.547+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169019f1c0 con 0x7f1690102b10 2023-10-05T15:36:28.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.548+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169010c670 con 0x7f1690102b10 2023-10-05T15:36:28.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.550+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f168800db20 con 0x7f1690102b10 2023-10-05T15:36:28.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.551+0000 7f1686ffd700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f167c0a1500 0x7f167c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:28.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.551+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f16880cc790 con 0x7f1690102b10 2023-10-05T15:36:28.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.552+0000 7f1695bcd700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f167c0a1500 0x7f167c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:28.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.552+0000 7f1695bcd700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f167c0a1500 0x7f167c0a39c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f168c006010 tx=0x7f168c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:28.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.556+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f16880959f0 con 0x7f1690102b10 2023-10-05T15:36:28.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.770+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f169010c860 con 0x7f1690102b10 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.771+0000 7f1686ffd700 1 -- 172.21.15.17:0/3490984059 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) v1 ==== 56+0+5717 (secure 0 0 0) 0x7f1688099010 con 0x7f1690102b10 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 94 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-10-05T15:26:04.208122+0000 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2023-10-05T15:36:06.637846+0000 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-05T15:36:28.773 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 27 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release reef 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2023-10-05T15:36:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/867902841,v1:172.21.15.17:6803/867902841] [v2:172.21.15.17:6804/867902841,v1:172.21.15.17:6805/867902841] exists,up 85786796-98b0-494a-b862-5fa0b52d790c 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/1221166656,v1:172.21.15.79:6801/1221166656] [v2:172.21.15.79:6802/1221166656,v1:172.21.15.79:6803/1221166656] exists,up d310ac43-5077-4247-b05c-b9abb149b3cb 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/3358437232,v1:172.21.15.167:6801/3358437232] [v2:172.21.15.167:6802/3358437232,v1:172.21.15.167:6803/3358437232] exists,up 8f6fd364-521b-41e1-861c-04fd2a5cb36c 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 26 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/33404576,v1:172.21.15.17:6811/33404576] [v2:172.21.15.17:6812/33404576,v1:172.21.15.17:6813/33404576] exists,up bb98ddec-27ee-4273-91c7-2178495341fa 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 34 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/1876046713,v1:172.21.15.79:6809/1876046713] [v2:172.21.15.79:6810/1876046713,v1:172.21.15.79:6811/1876046713] exists,up 11dee7d6-6a17-4531-8de5-323fd02055fc 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 39 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/4076480812,v1:172.21.15.167:6809/4076480812] [v2:172.21.15.167:6810/4076480812,v1:172.21.15.167:6811/4076480812] exists,up 4a0bd55e-6aec-46a3-8ce4-a3b18e9df728 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 47 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/4099404166,v1:172.21.15.17:6819/4099404166] [v2:172.21.15.17:6820/4099404166,v1:172.21.15.17:6821/4099404166] exists,up be4fc642-f0e3-47fd-91e9-1e589c8218cb 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 52 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/2170841881,v1:172.21.15.79:6817/2170841881] [v2:172.21.15.79:6818/2170841881,v1:172.21.15.79:6819/2170841881] exists,up 846db2d8-4524-4e02-8667-6a7d56e10453 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 60 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/3580182047,v1:172.21.15.167:6817/3580182047] [v2:172.21.15.167:6818/3580182047,v1:172.21.15.167:6819/3580182047] exists,up 207e8b8a-3383-4888-ab40-8f8117eba824 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 68 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/1313927132,v1:172.21.15.17:6827/1313927132] [v2:172.21.15.17:6828/1313927132,v1:172.21.15.17:6829/1313927132] exists,up e6012aed-94f6-4c37-bcf7-82dc08b176f9 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 73 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6824/1370861812,v1:172.21.15.79:6825/1370861812] [v2:172.21.15.79:6826/1370861812,v1:172.21.15.79:6827/1370861812] exists,up f0d1cd24-7df4-47a3-8143-247ffd402689 2023-10-05T15:36:28.775 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 81 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/1885248558,v1:172.21.15.167:6825/1885248558] [v2:172.21.15.167:6826/1885248558,v1:172.21.15.167:6827/1885248558] exists,up e961ada4-773e-40ad-8dfb-30356919eedc 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.b [8,11] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.c [2,4] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.10 [8,11] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.16 [2,4] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.13 [4,9] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.14 [4,7] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.20 [5,9] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.27 [4,6] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.31 [4,8] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.39 [5,8] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.3b [3,9] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.6 [9,11] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.a [5,8] 2023-10-05T15:36:28.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.c [9,10] 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 4.18 [9,8] 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2395163877 expires 2023-10-06T15:27:04.477848+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/2369336529 expires 2023-10-06T15:27:04.477848+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/2369336529 expires 2023-10-06T15:27:04.477848+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2135774582 expires 2023-10-06T15:27:04.477848+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3151379810 expires 2023-10-06T15:26:37.743145+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2053167755 expires 2023-10-06T15:26:37.743145+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/3129756101 expires 2023-10-06T15:26:37.743145+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3360652288 expires 2023-10-06T15:27:04.477848+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/4090412968 expires 2023-10-06T15:26:37.743145+0000 2023-10-05T15:36:28.777 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/3129756101 expires 2023-10-06T15:26:37.743145+0000 2023-10-05T15:36:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.773+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f167c0a1500 msgr2=0x7f167c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.773+0000 7f1697e31700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f167c0a1500 0x7f167c0a39c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f168c006010 tx=0x7f168c005e80 comp rx=0 tx=0).stop 2023-10-05T15:36:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.773+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 msgr2=0x7f169019e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.773+0000 7f1697e31700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 0x7f169019e0f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1688007f10 tx=0x7f168800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 shutdown_connections 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f167c0a1500 0x7f167c0a39c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1690102b10 0x7f169019e0f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1690100f70 0x7f1690196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 --2- 172.21.15.17:0/3490984059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1690102170 0x7f1690197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 >> 172.21.15.17:0/3490984059 conn(0x7f16900fc4d0 msgr2=0x7f16900fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 shutdown_connections 2023-10-05T15:36:28.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:28.774+0000 7f1697e31700 1 -- 172.21.15.17:0/3490984059 wait complete. 2023-10-05T15:36:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:28 smithi167 ceph-mon[133366]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:36:29.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:28 smithi079 ceph-mon[132936]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:36:29.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:28 smithi017 ceph-mon[129107]: pgmap v366: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:36:29.266 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-05T15:36:29.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 -- 172.21.15.17:0/2197483857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102080 msgr2=0x7f3374102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 --2- 172.21.15.17:0/2197483857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102080 0x7f3374102500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3368009990 tx=0x7f3368009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 -- 172.21.15.17:0/2197483857 shutdown_connections 2023-10-05T15:36:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 --2- 172.21.15.17:0/2197483857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3374102a40 0x7f3374109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 --2- 172.21.15.17:0/2197483857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3374100ea0 0x7f33741012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 --2- 172.21.15.17:0/2197483857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102080 0x7f3374102500 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 -- 172.21.15.17:0/2197483857 >> 172.21.15.17:0/2197483857 conn(0x7f33740fc420 msgr2=0x7f33740fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 -- 172.21.15.17:0/2197483857 shutdown_connections 2023-10-05T15:36:29.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.483+0000 7f337a7ff700 1 -- 172.21.15.17:0/2197483857 wait complete. 2023-10-05T15:36:29.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.484+0000 7f337a7ff700 1 Processor -- start 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.484+0000 7f337a7ff700 1 -- start start 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f337a7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3374100ea0 0x7f3374196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f337a7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3374102080 0x7f33741970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f337a7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 0x7f337419e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f337a7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337419e6e0 con 0x7f3374102a40 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f337a7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337419e820 con 0x7f3374100ea0 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f337a7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337419e9b0 con 0x7f3374102080 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f3378d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 0x7f337419e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f3378d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 0x7f337419e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47016/0 (socket says 172.21.15.17:47016) 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f3378d9c700 1 -- 172.21.15.17:0/3058136859 learned_addr learned my addr 172.21.15.17:0/3058136859 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:29.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f33737fe700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3374102080 0x7f33741970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.485+0000 7f3373fff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3374100ea0 0x7f3374196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f3378d9c700 1 -- 172.21.15.17:0/3058136859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3374102080 msgr2=0x7f33741970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f3378d9c700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3374102080 0x7f33741970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f3378d9c700 1 -- 172.21.15.17:0/3058136859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3374100ea0 msgr2=0x7f3374196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f3378d9c700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3374100ea0 0x7f3374196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f3378d9c700 1 -- 172.21.15.17:0/3058136859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680095f0 con 0x7f3374102a40 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f3378d9c700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 0x7f337419e110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f336c00ef30 tx=0x7f336c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c018070 con 0x7f3374102a40 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f336c00f040 con 0x7f3374102a40 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c00cbc0 con 0x7f3374102a40 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337419ec30 con 0x7f3374102a40 2023-10-05T15:36:29.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.486+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337419f0f0 con 0x7f3374102a40 2023-10-05T15:36:29.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.487+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337410c610 con 0x7f3374102a40 2023-10-05T15:36:29.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.489+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f336c007500 con 0x7f3374102a40 2023-10-05T15:36:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.491+0000 7f33717fa700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f335c0a1550 0x7f335c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.491+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f336c0ccb50 con 0x7f3374102a40 2023-10-05T15:36:29.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.491+0000 7f3373fff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f335c0a1550 0x7f335c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.492+0000 7f3373fff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f335c0a1550 0x7f335c0a3a10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3374101bf0 tx=0x7f336400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:29.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.495+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f336c095e40 con 0x7f3374102a40 2023-10-05T15:36:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.707+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f337410c850 con 0x7f3374102a40 2023-10-05T15:36:29.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.709+0000 7f33717fa700 1 -- 172.21.15.17:0/3058136859 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7f336c099460 con 0x7f3374102a40 2023-10-05T15:36:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:29.711 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.711+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f335c0a1550 msgr2=0x7f335c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.711+0000 7f337a7ff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f335c0a1550 0x7f335c0a3a10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3374101bf0 tx=0x7f336400b410 comp rx=0 tx=0).stop 2023-10-05T15:36:29.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.711+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 msgr2=0x7f337419e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.711+0000 7f337a7ff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 0x7f337419e110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f336c00ef30 tx=0x7f336c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 shutdown_connections 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f335c0a1550 0x7f335c0a3a10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3374102a40 0x7f337419e110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3374100ea0 0x7f3374196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 --2- 172.21.15.17:0/3058136859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3374102080 0x7f33741970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 >> 172.21.15.17:0/3058136859 conn(0x7f33740fc420 msgr2=0x7f33740fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 shutdown_connections 2023-10-05T15:36:29.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.712+0000 7f337a7ff700 1 -- 172.21.15.17:0/3058136859 wait complete. 2023-10-05T15:36:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:36:29.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:36:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 -- 172.21.15.17:0/1746227715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c100e90 msgr2=0x7fa98c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 --2- 172.21.15.17:0/1746227715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c100e90 0x7fa98c1012b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009990 tx=0x7fa97c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 -- 172.21.15.17:0/1746227715 shutdown_connections 2023-10-05T15:36:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 --2- 172.21.15.17:0/1746227715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c102a30 0x7fa98c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 --2- 172.21.15.17:0/1746227715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c100e90 0x7fa98c1012b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 --2- 172.21.15.17:0/1746227715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c102070 0x7fa98c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 -- 172.21.15.17:0/1746227715 >> 172.21.15.17:0/1746227715 conn(0x7fa98c0fc430 msgr2=0x7fa98c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 -- 172.21.15.17:0/1746227715 shutdown_connections 2023-10-05T15:36:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.939+0000 7fa9921ff700 1 -- 172.21.15.17:0/1746227715 wait complete. 2023-10-05T15:36:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.941+0000 7fa9921ff700 1 Processor -- start 2023-10-05T15:36:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.941+0000 7fa9921ff700 1 -- start start 2023-10-05T15:36:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa9921ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c100e90 0x7fa98c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa9921ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 0x7fa98c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa9921ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c102a30 0x7fa98c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa9921ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c073f80 con 0x7fa98c102070 2023-10-05T15:36:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa9921ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0740f0 con 0x7fa98c100e90 2023-10-05T15:36:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa9921ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1a0bd0 con 0x7fa98c102a30 2023-10-05T15:36:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 0x7fa98c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 0x7fa98c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47034/0 (socket says 172.21.15.17:47034) 2023-10-05T15:36:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 -- 172.21.15.17:0/4045309674 learned_addr learned my addr 172.21.15.17:0/4045309674 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa98bfff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c102a30 0x7fa98c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa98b7fe700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c100e90 0x7fa98c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 -- 172.21.15.17:0/4045309674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c102a30 msgr2=0x7fa98c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c102a30 0x7fa98c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 -- 172.21.15.17:0/4045309674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c100e90 msgr2=0x7fa98c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:29.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c100e90 0x7fa98c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:29.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa983fff700 1 -- 172.21.15.17:0/4045309674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c0095f0 con 0x7fa98c102070 2023-10-05T15:36:29.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.942+0000 7fa98b7fe700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c100e90 0x7fa98c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:29.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.943+0000 7fa983fff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 0x7fa98c0732a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e970 tx=0x7fa97400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:29.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.943+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974009790 con 0x7fa98c102070 2023-10-05T15:36:29.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.943+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa97400eec0 con 0x7fa98c102070 2023-10-05T15:36:29.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.943+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974003c10 con 0x7fa98c102070 2023-10-05T15:36:29.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.943+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c1a0eb0 con 0x7fa98c102070 2023-10-05T15:36:29.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.943+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c1a1330 con 0x7fa98c102070 2023-10-05T15:36:29.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.944+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c107ef0 con 0x7fa98c102070 2023-10-05T15:36:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.946+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa974003db0 con 0x7fa98c102070 2023-10-05T15:36:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.947+0000 7fa9897fa700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9780a1500 0x7fa9780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.948+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa974014070 con 0x7fa98c102070 2023-10-05T15:36:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.948+0000 7fa98b7fe700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9780a1500 0x7fa9780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.948+0000 7fa98b7fe700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9780a1500 0x7fa9780a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0098e0 tx=0x7fa97c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:29.951+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa974096560 con 0x7fa98c102070 2023-10-05T15:36:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:29 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3490984059' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-05T15:36:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:29 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3058136859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:29 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3490984059' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-05T15:36:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:29 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3058136859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:30.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.162+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa98c02cf70 con 0x7fa98c102070 2023-10-05T15:36:30.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.162+0000 7fa9897fa700 1 -- 172.21.15.17:0/4045309674 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa974099b80 con 0x7fa98c102070 2023-10-05T15:36:30.164 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:36:30.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9780a1500 msgr2=0x7fa9780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9780a1500 0x7fa9780a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0098e0 tx=0x7fa97c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 msgr2=0x7fa98c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 0x7fa98c0732a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e970 tx=0x7fa97400ec80 comp rx=0 tx=0).stop 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 shutdown_connections 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9780a1500 0x7fa9780a39c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa98c102a30 0x7fa98c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa98c100e90 0x7fa98c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 --2- 172.21.15.17:0/4045309674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa98c102070 0x7fa98c0732a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 >> 172.21.15.17:0/4045309674 conn(0x7fa98c0fc430 msgr2=0x7fa98c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 shutdown_connections 2023-10-05T15:36:30.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.165+0000 7fa9921ff700 1 -- 172.21.15.17:0/4045309674 wait complete. 2023-10-05T15:36:30.183 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:29 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3490984059' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-05T15:36:30.183 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:29 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3058136859' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:30.185 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 -- 172.21.15.17:0/3267916793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 msgr2=0x7f364c109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 --2- 172.21.15.17:0/3267916793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c109360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f364400b0a0 tx=0x7f364400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 -- 172.21.15.17:0/3267916793 shutdown_connections 2023-10-05T15:36:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 --2- 172.21.15.17:0/3267916793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c109360 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 --2- 172.21.15.17:0/3267916793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f364c100ea0 0x7f364c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 --2- 172.21.15.17:0/3267916793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c102080 0x7f364c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 -- 172.21.15.17:0/3267916793 >> 172.21.15.17:0/3267916793 conn(0x7f364c0fc460 msgr2=0x7f364c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 -- 172.21.15.17:0/3267916793 shutdown_connections 2023-10-05T15:36:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.389+0000 7f36519ff700 1 -- 172.21.15.17:0/3267916793 wait complete. 2023-10-05T15:36:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.390+0000 7f36519ff700 1 Processor -- start 2023-10-05T15:36:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 -- start start 2023-10-05T15:36:30.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c100ea0 0x7f364c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f364c102080 0x7f364c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c19e780 con 0x7f364c102a40 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c19e8f0 con 0x7f364c100ea0 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.391+0000 7f36519ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c19eab0 con 0x7f364c102080 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c19e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47048/0 (socket says 172.21.15.17:47048) 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 -- 172.21.15.17:0/3656842956 learned_addr learned my addr 172.21.15.17:0/3656842956 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:30.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364affd700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c100ea0 0x7f364c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364a7fc700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f364c102080 0x7f364c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 -- 172.21.15.17:0/3656842956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f364c102080 msgr2=0x7f364c197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f364c102080 0x7f364c197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 -- 172.21.15.17:0/3656842956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c100ea0 msgr2=0x7f364c196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c100ea0 0x7f364c196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 -- 172.21.15.17:0/3656842956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644009d00 con 0x7f364c102a40 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364affd700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c100ea0 0x7f364c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:30.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.392+0000 7f364b7fe700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c19e1b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f364400b070 tx=0x7f3644004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:30.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.393+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400e040 con 0x7f364c102a40 2023-10-05T15:36:30.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.393+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3644003e90 con 0x7f364c102a40 2023-10-05T15:36:30.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.393+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644004020 con 0x7f364c102a40 2023-10-05T15:36:30.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.393+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c19ed30 con 0x7f364c102a40 2023-10-05T15:36:30.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.393+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c19f160 con 0x7f364c102a40 2023-10-05T15:36:30.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.394+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c107ea0 con 0x7f364c102a40 2023-10-05T15:36:30.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.396+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f364401b660 con 0x7f364c102a40 2023-10-05T15:36:30.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.397+0000 7f36509fd700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36340a1480 0x7f36340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.397+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f36440cee30 con 0x7f364c102a40 2023-10-05T15:36:30.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.397+0000 7f364affd700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36340a1480 0x7f36340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.398+0000 7f364affd700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36340a1480 0x7f36340a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f363c005950 tx=0x7f363c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:30.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.399+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3644098120 con 0x7f364c102a40 2023-10-05T15:36:30.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.608+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f364c02cf70 con 0x7f364c102a40 2023-10-05T15:36:30.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.608+0000 7f36509fd700 1 -- 172.21.15.17:0/3656842956 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f364409b740 con 0x7f364c102a40 2023-10-05T15:36:30.610 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36340a1480 msgr2=0x7f36340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36340a1480 0x7f36340a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f363c005950 tx=0x7f363c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 msgr2=0x7f364c19e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c19e1b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f364400b070 tx=0x7f3644004c80 comp rx=0 tx=0).stop 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 shutdown_connections 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36340a1480 0x7f36340a3940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f364c102a40 0x7f364c19e1b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f364c100ea0 0x7f364c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 --2- 172.21.15.17:0/3656842956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f364c102080 0x7f364c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 >> 172.21.15.17:0/3656842956 conn(0x7f364c0fc460 msgr2=0x7f364c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 shutdown_connections 2023-10-05T15:36:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.611+0000 7f36519ff700 1 -- 172.21.15.17:0/3656842956 wait complete. 2023-10-05T15:36:30.631 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 -- 172.21.15.17:0/689977035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 msgr2=0x7fd32810b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 --2- 172.21.15.17:0/689977035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd32810b230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd320009f90 tx=0x7fd32000b330 comp rx=0 tx=0).stop 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 -- 172.21.15.17:0/689977035 shutdown_connections 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 --2- 172.21.15.17:0/689977035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd32810b230 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 --2- 172.21.15.17:0/689977035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd328074ef0 0x7fd328073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 --2- 172.21.15.17:0/689977035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd328073910 0x7fd328073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 -- 172.21.15.17:0/689977035 >> 172.21.15.17:0/689977035 conn(0x7fd3280fc430 msgr2=0x7fd3280fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 -- 172.21.15.17:0/689977035 shutdown_connections 2023-10-05T15:36:30.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.838+0000 7fd32cfff700 1 -- 172.21.15.17:0/689977035 wait complete. 2023-10-05T15:36:30.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 Processor -- start 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 -- start start 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd328073910 0x7fd328198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd328074ef0 0x7fd328199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd3281a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281a09b0 con 0x7fd328108da0 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281a0af0 con 0x7fd328074ef0 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.839+0000 7fd32cfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3281a0c80 con 0x7fd328073910 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd3281a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd3281a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47074/0 (socket says 172.21.15.17:47074) 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 -- 172.21.15.17:0/2469089590 learned_addr learned my addr 172.21.15.17:0/2469089590 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd32659c700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd328074ef0 0x7fd328199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd31e59c700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd328073910 0x7fd328198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 -- 172.21.15.17:0/2469089590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd328073910 msgr2=0x7fd328198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd328073910 0x7fd328198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 -- 172.21.15.17:0/2469089590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd328074ef0 msgr2=0x7fd328199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd328074ef0 0x7fd328199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 -- 172.21.15.17:0/2469089590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320009c40 con 0x7fd328108da0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.840+0000 7fd326d9d700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd3281a03e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd320009f60 tx=0x7fd320008d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.841+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000e040 con 0x7fd328108da0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.841+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd32000be00 con 0x7fd328108da0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.841+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3200052a0 con 0x7fd328108da0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.841+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3281a0f00 con 0x7fd328108da0 2023-10-05T15:36:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.841+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3281a12d0 con 0x7fd328108da0 2023-10-05T15:36:30.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.842+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd328107450 con 0x7fd328108da0 2023-10-05T15:36:30.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.844+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd32001d990 con 0x7fd328108da0 2023-10-05T15:36:30.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.845+0000 7fd31ffff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3140a1500 0x7fd3140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:30.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.845+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd3200ce5d0 con 0x7fd328108da0 2023-10-05T15:36:30.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.845+0000 7fd31e59c700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3140a1500 0x7fd3140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:30.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.846+0000 7fd31e59c700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3140a1500 0x7fd3140a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd318005fd0 tx=0x7fd318009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:30.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:30.849+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd320097920 con 0x7fd328108da0 2023-10-05T15:36:30.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:30 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4045309674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:30.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:30 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3656842956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:30.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:30 smithi017 ceph-mon[129107]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:36:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.063+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd32802cf70 con 0x7fd328108da0 2023-10-05T15:36:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.063+0000 7fd31ffff700 1 -- 172.21.15.17:0/2469089590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd32009af40 con 0x7fd328108da0 2023-10-05T15:36:31.065 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:31.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.065+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3140a1500 msgr2=0x7fd3140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.065+0000 7fd32cfff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3140a1500 0x7fd3140a39c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd318005fd0 tx=0x7fd318009310 comp rx=0 tx=0).stop 2023-10-05T15:36:31.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.065+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 msgr2=0x7fd3281a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.065+0000 7fd32cfff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd3281a03e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd320009f60 tx=0x7fd320008d00 comp rx=0 tx=0).stop 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 shutdown_connections 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3140a1500 0x7fd3140a39c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd328108da0 0x7fd3281a03e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd328073910 0x7fd328198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 --2- 172.21.15.17:0/2469089590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd328074ef0 0x7fd328199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 >> 172.21.15.17:0/2469089590 conn(0x7fd3280fc430 msgr2=0x7fd3280fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 shutdown_connections 2023-10-05T15:36:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.066+0000 7fd32cfff700 1 -- 172.21.15.17:0/2469089590 wait complete. 2023-10-05T15:36:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:30 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4045309674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:30 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3656842956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:31.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:30 smithi167 ceph-mon[133366]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:36:31.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:31.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:30 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4045309674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:31.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:30 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3656842956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:31.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:30 smithi079 ceph-mon[132936]: pgmap v367: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:36:31.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 -- 172.21.15.17:0/3168076000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac100e90 msgr2=0x7f39ac1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3168076000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac100e90 0x7f39ac1012b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009990 tx=0x7f39a0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 -- 172.21.15.17:0/3168076000 shutdown_connections 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3168076000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39ac102a30 0x7f39ac109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3168076000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac100e90 0x7f39ac1012b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3168076000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac102070 0x7f39ac1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 -- 172.21.15.17:0/3168076000 >> 172.21.15.17:0/3168076000 conn(0x7f39ac0fc430 msgr2=0x7f39ac0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 -- 172.21.15.17:0/3168076000 shutdown_connections 2023-10-05T15:36:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.291+0000 7f39b2dff700 1 -- 172.21.15.17:0/3168076000 wait complete. 2023-10-05T15:36:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.292+0000 7f39b2dff700 1 Processor -- start 2023-10-05T15:36:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 -- start start 2023-10-05T15:36:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac100e90 0x7f39ac196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 0x7f39ac1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39ac102a30 0x7f39ac19e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19e6f0 con 0x7f39ac102070 2023-10-05T15:36:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19e830 con 0x7f39ac102a30 2023-10-05T15:36:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39b2dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac19e9c0 con 0x7f39ac100e90 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39abfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 0x7f39ac1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39abfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 0x7f39ac1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47106/0 (socket says 172.21.15.17:47106) 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.293+0000 7f39abfff700 1 -- 172.21.15.17:0/3069000744 learned_addr learned my addr 172.21.15.17:0/3069000744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39b139c700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39ac102a30 0x7f39ac19e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39b0b9b700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac100e90 0x7f39ac196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39abfff700 1 -- 172.21.15.17:0/3069000744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac100e90 msgr2=0x7f39ac196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39abfff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac100e90 0x7f39ac196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39abfff700 1 -- 172.21.15.17:0/3069000744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39ac102a30 msgr2=0x7f39ac19e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39abfff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39ac102a30 0x7f39ac19e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39abfff700 1 -- 172.21.15.17:0/3069000744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a00095f0 con 0x7f39ac102070 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39abfff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 0x7f39ac1970b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f399800e950 tx=0x7f399800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998009770 con 0x7f39ac102070 2023-10-05T15:36:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f399800eea0 con 0x7f39ac102070 2023-10-05T15:36:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac19eca0 con 0x7f39ac102070 2023-10-05T15:36:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.294+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998003cc0 con 0x7f39ac102070 2023-10-05T15:36:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.295+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac19f1b0 con 0x7f39ac102070 2023-10-05T15:36:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.295+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ac107f80 con 0x7f39ac102070 2023-10-05T15:36:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.297+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3998003e20 con 0x7f39ac102070 2023-10-05T15:36:31.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.300+0000 7f39a9ffb700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f399c0a1500 0x7f399c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.300+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3998014070 con 0x7f39ac102070 2023-10-05T15:36:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.300+0000 7f39b0b9b700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f399c0a1500 0x7f399c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.301+0000 7f39b0b9b700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f399c0a1500 0x7f399c0a39c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005910 tx=0x7f39a000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:31.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.304+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3998096570 con 0x7f39ac102070 2023-10-05T15:36:31.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.515+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f39ac0008d0 con 0x7f39ac102070 2023-10-05T15:36:31.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.515+0000 7f39a9ffb700 1 -- 172.21.15.17:0/3069000744 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3998099b90 con 0x7f39ac102070 2023-10-05T15:36:31.517 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f399c0a1500 msgr2=0x7f399c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f399c0a1500 0x7f399c0a39c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39a0005910 tx=0x7f39a000b260 comp rx=0 tx=0).stop 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 msgr2=0x7f39ac1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 0x7f39ac1970b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f399800e950 tx=0x7f399800ec60 comp rx=0 tx=0).stop 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 shutdown_connections 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f399c0a1500 0x7f399c0a39c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39ac102a30 0x7f39ac19e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39ac100e90 0x7f39ac196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 --2- 172.21.15.17:0/3069000744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39ac102070 0x7f39ac1970b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 >> 172.21.15.17:0/3069000744 conn(0x7f39ac0fc430 msgr2=0x7f39ac0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 shutdown_connections 2023-10-05T15:36:31.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.518+0000 7f39b2dff700 1 -- 172.21.15.17:0/3069000744 wait complete. 2023-10-05T15:36:31.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 -- 172.21.15.17:0/4272748747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 msgr2=0x7f4ed8102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 --2- 172.21.15.17:0/4272748747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8102500 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009990 tx=0x7f4ecc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 -- 172.21.15.17:0/4272748747 shutdown_connections 2023-10-05T15:36:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 --2- 172.21.15.17:0/4272748747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8102a40 0x7f4ed8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 --2- 172.21.15.17:0/4272748747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed8100ea0 0x7f4ed81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 --2- 172.21.15.17:0/4272748747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8102500 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 -- 172.21.15.17:0/4272748747 >> 172.21.15.17:0/4272748747 conn(0x7f4ed80fc420 msgr2=0x7f4ed80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 -- 172.21.15.17:0/4272748747 shutdown_connections 2023-10-05T15:36:31.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.742+0000 7f4edddff700 1 -- 172.21.15.17:0/4272748747 wait complete. 2023-10-05T15:36:31.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.743+0000 7f4edddff700 1 Processor -- start 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.743+0000 7f4edddff700 1 -- start start 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.743+0000 7f4edddff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8100ea0 0x7f4ed8196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.743+0000 7f4edddff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.743+0000 7f4edddff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed8102a40 0x7f4ed819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4edddff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed819e6a0 con 0x7f4ed8102080 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4edddff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed819e7e0 con 0x7f4ed8100ea0 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4edddff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed819e970 con 0x7f4ed8102a40 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47124/0 (socket says 172.21.15.17:47124) 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 -- 172.21.15.17:0/1268125465 learned_addr learned my addr 172.21.15.17:0/1268125465 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed7fff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed8102a40 0x7f4ed819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed77fe700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8100ea0 0x7f4ed8196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 -- 172.21.15.17:0/1268125465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed8102a40 msgr2=0x7f4ed819e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed8102a40 0x7f4ed819e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 -- 172.21.15.17:0/1268125465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8100ea0 msgr2=0x7f4ed8196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8100ea0 0x7f4ed8196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 -- 172.21.15.17:0/1268125465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0095f0 con 0x7f4ed8102080 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed77fe700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8100ea0 0x7f4ed8196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.744+0000 7f4ed6ffd700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8197060 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0059d0 tx=0x7f4ecc003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.745+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc01d070 con 0x7f4ed8102080 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.745+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ecc00bd70 con 0x7f4ed8102080 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.745+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed819ebf0 con 0x7f4ed8102080 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.745+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc022dc0 con 0x7f4ed8102080 2023-10-05T15:36:31.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.745+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed819f070 con 0x7f4ed8102080 2023-10-05T15:36:31.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.746+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed81085e0 con 0x7f4ed8102080 2023-10-05T15:36:31.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.748+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4ecc003fb0 con 0x7f4ed8102080 2023-10-05T15:36:31.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.749+0000 7f4ed4ff9700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4ec00a1550 0x7f4ec00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:31.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.749+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4ecc0ce6c0 con 0x7f4ed8102080 2023-10-05T15:36:31.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.749+0000 7f4ed77fe700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4ec00a1550 0x7f4ec00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:31.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.750+0000 7f4ed77fe700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4ec00a1550 0x7f4ec00a3a10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005fd0 tx=0x7f4ec8005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:31.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:31.753+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ecc0979b0 con 0x7f4ed8102080 2023-10-05T15:36:31.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:31 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2469089590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:31 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3069000744' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.015+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ed810c5c0 con 0x7f4ed8102080 2023-10-05T15:36:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.016+0000 7f4ed4ff9700 1 -- 172.21.15.17:0/1268125465 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f4ecc09afd0 con 0x7f4ed8102080 2023-10-05T15:36:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:32.018 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.018+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4ec00a1550 msgr2=0x7f4ec00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.018+0000 7f4edddff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4ec00a1550 0x7f4ec00a3a10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005fd0 tx=0x7f4ec8005f00 comp rx=0 tx=0).stop 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 msgr2=0x7f4ed8197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8197060 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0059d0 tx=0x7f4ecc003b00 comp rx=0 tx=0).stop 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 shutdown_connections 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4ec00a1550 0x7f4ec00a3a10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ed8102a40 0x7f4ed819e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ed8100ea0 0x7f4ed8196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 --2- 172.21.15.17:0/1268125465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed8102080 0x7f4ed8197060 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 >> 172.21.15.17:0/1268125465 conn(0x7f4ed80fc420 msgr2=0x7f4ed8105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 shutdown_connections 2023-10-05T15:36:32.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.019+0000 7f4edddff700 1 -- 172.21.15.17:0/1268125465 wait complete. 2023-10-05T15:36:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:32.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:31 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2469089590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:31 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3069000744' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:31 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2469089590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:31 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3069000744' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 -- 172.21.15.17:0/998174155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180100ea0 msgr2=0x7fe1801012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 --2- 172.21.15.17:0/998174155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180100ea0 0x7fe1801012c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe170009990 tx=0x7fe170009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 -- 172.21.15.17:0/998174155 shutdown_connections 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 --2- 172.21.15.17:0/998174155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe180109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 --2- 172.21.15.17:0/998174155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180100ea0 0x7fe1801012c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 --2- 172.21.15.17:0/998174155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe180102080 0x7fe180102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 -- 172.21.15.17:0/998174155 >> 172.21.15.17:0/998174155 conn(0x7fe1800fc420 msgr2=0x7fe1800fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 -- 172.21.15.17:0/998174155 shutdown_connections 2023-10-05T15:36:32.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.241+0000 7fe1857ff700 1 -- 172.21.15.17:0/998174155 wait complete. 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.242+0000 7fe1857ff700 1 Processor -- start 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.242+0000 7fe1857ff700 1 -- start start 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.242+0000 7fe1857ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe180100ea0 0x7fe180198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.242+0000 7fe1857ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180102080 0x7fe180199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe1857ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe1801a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe1857ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801a0880 con 0x7fe180102a40 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe1857ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801a09f0 con 0x7fe180102080 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe1857ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801a0bb0 con 0x7fe180100ea0 2023-10-05T15:36:32.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe1801a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe1801a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47136/0 (socket says 172.21.15.17:47136) 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 -- 172.21.15.17:0/1040067985 learned_addr learned my addr 172.21.15.17:0/1040067985 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17e7fc700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180102080 0x7fe180199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17effd700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe180100ea0 0x7fe180198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 -- 172.21.15.17:0/1040067985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe180100ea0 msgr2=0x7fe180198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe180100ea0 0x7fe180198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 -- 172.21.15.17:0/1040067985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180102080 msgr2=0x7fe180199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180102080 0x7fe180199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.243+0000 7fe17f7fe700 1 -- 172.21.15.17:0/1040067985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700095f0 con 0x7fe180102a40 2023-10-05T15:36:32.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.244+0000 7fe17f7fe700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe1801a02b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe17800ef30 tx=0x7fe17800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.244+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178018070 con 0x7fe180102a40 2023-10-05T15:36:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.244+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe17800f040 con 0x7fe180102a40 2023-10-05T15:36:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.244+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1801a0e30 con 0x7fe180102a40 2023-10-05T15:36:32.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.244+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800cbc0 con 0x7fe180102a40 2023-10-05T15:36:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.244+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1801a1200 con 0x7fe180102a40 2023-10-05T15:36:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.245+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18010c610 con 0x7fe180102a40 2023-10-05T15:36:32.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.247+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe178007500 con 0x7fe180102a40 2023-10-05T15:36:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.248+0000 7fe167fff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1680a14d0 0x7fe1680a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.248+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe1780ccbb0 con 0x7fe180102a40 2023-10-05T15:36:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.248+0000 7fe17effd700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1680a14d0 0x7fe1680a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.249+0000 7fe17effd700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1680a14d0 0x7fe1680a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1700098e0 tx=0x7fe17000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:32.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.253+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe178095ea0 con 0x7fe180102a40 2023-10-05T15:36:32.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.471+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1801a13f0 con 0x7fe180102a40 2023-10-05T15:36:32.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.473+0000 7fe167fff700 1 -- 172.21.15.17:0/1040067985 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7fe1780994c0 con 0x7fe180102a40 2023-10-05T15:36:32.475 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:32.475 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1680a14d0 msgr2=0x7fe1680a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1680a14d0 0x7fe1680a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1700098e0 tx=0x7fe17000b260 comp rx=0 tx=0).stop 2023-10-05T15:36:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 msgr2=0x7fe1801a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe1801a02b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe17800ef30 tx=0x7fe17800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 shutdown_connections 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1680a14d0 0x7fe1680a3990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe180102a40 0x7fe1801a02b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe180100ea0 0x7fe180198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 --2- 172.21.15.17:0/1040067985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe180102080 0x7fe180199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.475+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 >> 172.21.15.17:0/1040067985 conn(0x7fe1800fc420 msgr2=0x7fe1800fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.476+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 shutdown_connections 2023-10-05T15:36:32.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.476+0000 7fe1857ff700 1 -- 172.21.15.17:0/1040067985 wait complete. 2023-10-05T15:36:32.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:36:32.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 -- 172.21.15.17:0/2595191558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102070 msgr2=0x7f38481024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 --2- 172.21.15.17:0/2595191558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102070 0x7f38481024f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3838009990 tx=0x7f3838009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 -- 172.21.15.17:0/2595191558 shutdown_connections 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 --2- 172.21.15.17:0/2595191558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3848102a30 0x7f3848109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 --2- 172.21.15.17:0/2595191558 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3848100e90 0x7f38481012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 --2- 172.21.15.17:0/2595191558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102070 0x7f38481024f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 -- 172.21.15.17:0/2595191558 >> 172.21.15.17:0/2595191558 conn(0x7f38480fc430 msgr2=0x7f38480fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 -- 172.21.15.17:0/2595191558 shutdown_connections 2023-10-05T15:36:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.704+0000 7f38505ff700 1 -- 172.21.15.17:0/2595191558 wait complete. 2023-10-05T15:36:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.705+0000 7f38505ff700 1 Processor -- start 2023-10-05T15:36:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.705+0000 7f38505ff700 1 -- start start 2023-10-05T15:36:32.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f38505ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3848100e90 0x7f3848196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f38505ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3848102070 0x7f3848197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f38505ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 0x7f384819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f38505ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819e6d0 con 0x7f3848102a30 2023-10-05T15:36:32.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f38505ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819e810 con 0x7f3848100e90 2023-10-05T15:36:32.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f38505ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819e9a0 con 0x7f3848102070 2023-10-05T15:36:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f384eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 0x7f384819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f384eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 0x7f384819e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47144/0 (socket says 172.21.15.17:47144) 2023-10-05T15:36:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f384eb9c700 1 -- 172.21.15.17:0/2256154306 learned_addr learned my addr 172.21.15.17:0/2256154306 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f384db9a700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3848102070 0x7f3848197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.706+0000 7f384e39b700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3848100e90 0x7f3848196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f384eb9c700 1 -- 172.21.15.17:0/2256154306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3848102070 msgr2=0x7f3848197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f384eb9c700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3848102070 0x7f3848197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f384eb9c700 1 -- 172.21.15.17:0/2256154306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3848100e90 msgr2=0x7f3848196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f384eb9c700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3848100e90 0x7f3848196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f384eb9c700 1 -- 172.21.15.17:0/2256154306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380095f0 con 0x7f3848102a30 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f384eb9c700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 0x7f384819e100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f384000ef30 tx=0x7f384000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840018070 con 0x7f3848102a30 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f384000f040 con 0x7f3848102a30 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384000cbc0 con 0x7f3848102a30 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384819ec20 con 0x7f3848102a30 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.707+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384819f0e0 con 0x7f3848102a30 2023-10-05T15:36:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.708+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3848107f20 con 0x7f3848102a30 2023-10-05T15:36:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.710+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3840007500 con 0x7f3848102a30 2023-10-05T15:36:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.711+0000 7f383f7fe700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38340a1500 0x7f38340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.712+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f38400ccb50 con 0x7f3848102a30 2023-10-05T15:36:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.712+0000 7f384e39b700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38340a1500 0x7f38340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.712+0000 7f384e39b700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38340a1500 0x7f38340a39c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3848101be0 tx=0x7f3844009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:32.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.715+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3840095e40 con 0x7f3848102a30 2023-10-05T15:36:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.925+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f384802cfa0 con 0x7f3848102a30 2023-10-05T15:36:32.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.926+0000 7f383f7fe700 1 -- 172.21.15.17:0/2256154306 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3840099460 con 0x7f3848102a30 2023-10-05T15:36:32.927 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38340a1500 msgr2=0x7f38340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38340a1500 0x7f38340a39c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3848101be0 tx=0x7f3844009260 comp rx=0 tx=0).stop 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 msgr2=0x7f384819e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 0x7f384819e100 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f384000ef30 tx=0x7f384000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 shutdown_connections 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f38340a1500 0x7f38340a39c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3848102a30 0x7f384819e100 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3848100e90 0x7f3848196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 --2- 172.21.15.17:0/2256154306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3848102070 0x7f3848197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 >> 172.21.15.17:0/2256154306 conn(0x7f38480fc430 msgr2=0x7f38480fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 shutdown_connections 2023-10-05T15:36:32.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:32.928+0000 7f38505ff700 1 -- 172.21.15.17:0/2256154306 wait complete. 2023-10-05T15:36:32.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:32 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1268125465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:32 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1040067985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:32 smithi167 ceph-mon[133366]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:33.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:32 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1268125465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:33.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:32 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1040067985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:33.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:32 smithi079 ceph-mon[132936]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 -- 172.21.15.17:0/2324862873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4101940 msgr2=0x7f7bc4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/2324862873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4101940 0x7f7bc4103d30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009990 tx=0x7f7bb4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 -- 172.21.15.17:0/2324862873 shutdown_connections 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/2324862873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4106ba0 0x7f7bc4109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/2324862873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4101940 0x7f7bc4103d30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/2324862873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 0x7f7bc4106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 -- 172.21.15.17:0/2324862873 >> 172.21.15.17:0/2324862873 conn(0x7f7bc40fb330 msgr2=0x7f7bc40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 -- 172.21.15.17:0/2324862873 shutdown_connections 2023-10-05T15:36:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.152+0000 7f7bca7ff700 1 -- 172.21.15.17:0/2324862873 wait complete. 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.153+0000 7f7bca7ff700 1 Processor -- start 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.153+0000 7f7bca7ff700 1 -- start start 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bca7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 0x7f7bc4196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bca7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 0x7f7bc4196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bca7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4106ba0 0x7f7bc419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bca7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc419e620 con 0x7f7bc4106ba0 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bca7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc419e760 con 0x7f7bc4101940 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bca7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc419e8f0 con 0x7f7bc4104270 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 0x7f7bc4196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bc8d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4106ba0 0x7f7bc419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 0x7f7bc4196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36202/0 (socket says 172.21.15.17:36202) 2023-10-05T15:36:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.154+0000 7f7bc3fff700 1 -- 172.21.15.17:0/1361421118 learned_addr learned my addr 172.21.15.17:0/1361421118 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc37fe700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 0x7f7bc4196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc8d9c700 1 -- 172.21.15.17:0/1361421118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 msgr2=0x7f7bc4196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc8d9c700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 0x7f7bc4196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc8d9c700 1 -- 172.21.15.17:0/1361421118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 msgr2=0x7f7bc4196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc8d9c700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 0x7f7bc4196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc8d9c700 1 -- 172.21.15.17:0/1361421118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40095f0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc37fe700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 0x7f7bc4196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc3fff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 0x7f7bc4196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc8d9c700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4106ba0 0x7f7bc419e050 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc007f10 tx=0x7f7bbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00ddd0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bbc00f040 con 0x7f7bc4106ba0 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0059c0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc419ebd0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.155+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc419f090 con 0x7f7bc4106ba0 2023-10-05T15:36:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.156+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40fceb0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.158+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7bbc005020 con 0x7f7bc4106ba0 2023-10-05T15:36:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.160+0000 7f7bc17fa700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7bac0a1480 0x7f7bac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.160+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7bbc0cc9b0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.160+0000 7f7bc3fff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7bac0a1480 0x7f7bac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.161+0000 7f7bc3fff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7bac0a1480 0x7f7bac0a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4006010 tx=0x7f7bb400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:33.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.164+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7bbc04f100 con 0x7f7bc4106ba0 2023-10-05T15:36:33.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:32 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1268125465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:33.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:32 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1040067985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:33.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:32 smithi017 ceph-mon[129107]: pgmap v368: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:33.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.376+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bc40008d0 con 0x7f7bc4106ba0 2023-10-05T15:36:33.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.376+0000 7f7bc17fa700 1 -- 172.21.15.17:0/1361421118 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7bbc095c10 con 0x7f7bc4106ba0 2023-10-05T15:36:33.378 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7bac0a1480 msgr2=0x7f7bac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7bac0a1480 0x7f7bac0a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4006010 tx=0x7f7bb400b540 comp rx=0 tx=0).stop 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4106ba0 msgr2=0x7f7bc419e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4106ba0 0x7f7bc419e050 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc007f10 tx=0x7f7bbc00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 shutdown_connections 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7bac0a1480 0x7f7bac0a3940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7bc4106ba0 0x7f7bc419e050 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bc4101940 0x7f7bc4196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 --2- 172.21.15.17:0/1361421118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bc4104270 0x7f7bc4196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 >> 172.21.15.17:0/1361421118 conn(0x7f7bc40fb330 msgr2=0x7f7bc41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:33.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 shutdown_connections 2023-10-05T15:36:33.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.379+0000 7f7bca7ff700 1 -- 172.21.15.17:0/1361421118 wait complete. 2023-10-05T15:36:33.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:33.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 -- 172.21.15.17:0/1442555989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c102a30 msgr2=0x7f3e6c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 --2- 172.21.15.17:0/1442555989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c102a30 0x7f3e6c109350 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400b0a0 tx=0x7f3e6400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 -- 172.21.15.17:0/1442555989 shutdown_connections 2023-10-05T15:36:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 --2- 172.21.15.17:0/1442555989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c102a30 0x7f3e6c109350 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 --2- 172.21.15.17:0/1442555989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6c100e90 0x7f3e6c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 --2- 172.21.15.17:0/1442555989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c102070 0x7f3e6c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 -- 172.21.15.17:0/1442555989 >> 172.21.15.17:0/1442555989 conn(0x7f3e6c0fc430 msgr2=0x7f3e6c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 -- 172.21.15.17:0/1442555989 shutdown_connections 2023-10-05T15:36:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.602+0000 7f3e73bff700 1 -- 172.21.15.17:0/1442555989 wait complete. 2023-10-05T15:36:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.603+0000 7f3e73bff700 1 Processor -- start 2023-10-05T15:36:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 -- start start 2023-10-05T15:36:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 0x7f3e6c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6c102070 0x7f3e6c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c102a30 0x7f3e6c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c073f80 con 0x7f3e6c100e90 2023-10-05T15:36:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0740f0 con 0x7f3e6c102a30 2023-10-05T15:36:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e73bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c1a0ca0 con 0x7f3e6c102070 2023-10-05T15:36:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e7199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 0x7f3e6c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e7199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 0x7f3e6c074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47200/0 (socket says 172.21.15.17:47200) 2023-10-05T15:36:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e7199b700 1 -- 172.21.15.17:0/2736420945 learned_addr learned my addr 172.21.15.17:0/2736420945 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e7119a700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6c102070 0x7f3e6c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.604+0000 7f3e7219c700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c102a30 0x7f3e6c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e7199b700 1 -- 172.21.15.17:0/2736420945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6c102070 msgr2=0x7f3e6c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e7199b700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6c102070 0x7f3e6c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e7199b700 1 -- 172.21.15.17:0/2736420945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c102a30 msgr2=0x7f3e6c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e7199b700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c102a30 0x7f3e6c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e7199b700 1 -- 172.21.15.17:0/2736420945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009d00 con 0x7f3e6c100e90 2023-10-05T15:36:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e7199b700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 0x7f3e6c074c60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800d980 tx=0x7f3e6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800f890 con 0x7f3e6c100e90 2023-10-05T15:36:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e6800fe80 con 0x7f3e6c100e90 2023-10-05T15:36:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c1a0f80 con 0x7f3e6c100e90 2023-10-05T15:36:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68019360 con 0x7f3e6c100e90 2023-10-05T15:36:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.605+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c1a1400 con 0x7f3e6c100e90 2023-10-05T15:36:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.606+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c10c600 con 0x7f3e6c100e90 2023-10-05T15:36:33.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.608+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3e6800f9f0 con 0x7f3e6c100e90 2023-10-05T15:36:33.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.610+0000 7f3e62ffd700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e580a1500 0x7f3e580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:33.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.610+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3e680ccaa0 con 0x7f3e6c100e90 2023-10-05T15:36:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.610+0000 7f3e7119a700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e580a1500 0x7f3e580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.611+0000 7f3e7119a700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e580a1500 0x7f3e580a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c100bb0 tx=0x7f3e5c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.614+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e68095d00 con 0x7f3e6c100e90 2023-10-05T15:36:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.825+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e6c107e80 con 0x7f3e6c100e90 2023-10-05T15:36:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.825+0000 7f3e62ffd700 1 -- 172.21.15.17:0/2736420945 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e68099320 con 0x7f3e6c100e90 2023-10-05T15:36:33.827 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e580a1500 msgr2=0x7f3e580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e580a1500 0x7f3e580a39c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c100bb0 tx=0x7f3e5c00b410 comp rx=0 tx=0).stop 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 msgr2=0x7f3e6c074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 0x7f3e6c074c60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800d980 tx=0x7f3e6800dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 shutdown_connections 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3e580a1500 0x7f3e580a39c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e6c102a30 0x7f3e6c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e6c100e90 0x7f3e6c074c60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 --2- 172.21.15.17:0/2736420945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e6c102070 0x7f3e6c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 >> 172.21.15.17:0/2736420945 conn(0x7f3e6c0fc430 msgr2=0x7f3e6c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 shutdown_connections 2023-10-05T15:36:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:33.828+0000 7f3e73bff700 1 -- 172.21.15.17:0/2736420945 wait complete. 2023-10-05T15:36:33.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 -- 172.21.15.17:0/1739779590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434102070 msgr2=0x7f94341024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 --2- 172.21.15.17:0/1739779590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434102070 0x7f94341024f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9428009990 tx=0x7f9428009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 -- 172.21.15.17:0/1739779590 shutdown_connections 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 --2- 172.21.15.17:0/1739779590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9434102a30 0x7f9434109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 --2- 172.21.15.17:0/1739779590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434100e90 0x7f94341012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 --2- 172.21.15.17:0/1739779590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434102070 0x7f94341024f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 -- 172.21.15.17:0/1739779590 >> 172.21.15.17:0/1739779590 conn(0x7f94340fc430 msgr2=0x7f94340fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 -- 172.21.15.17:0/1739779590 shutdown_connections 2023-10-05T15:36:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.053+0000 7f9438dff700 1 -- 172.21.15.17:0/1739779590 wait complete. 2023-10-05T15:36:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 Processor -- start 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 -- start start 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 0x7f9434198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434102070 0x7f94341992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9434102a30 0x7f94341a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341a08e0 con 0x7f9434100e90 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341a0a20 con 0x7f9434102070 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.054+0000 7f9438dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341a0bb0 con 0x7f9434102a30 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 0x7f9434198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 0x7f9434198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35570/0 (socket says 172.21.15.17:35570) 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 -- 172.21.15.17:0/2591025451 learned_addr learned my addr 172.21.15.17:0/2591025451 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f9431d9b700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434102070 0x7f94341992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f9432d9d700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9434102a30 0x7f94341a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 -- 172.21.15.17:0/2591025451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9434102a30 msgr2=0x7f94341a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9434102a30 0x7f94341a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 -- 172.21.15.17:0/2591025451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434102070 msgr2=0x7f94341992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434102070 0x7f94341992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 -- 172.21.15.17:0/2591025451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280095f0 con 0x7f9434100e90 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f9431d9b700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434102070 0x7f94341992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.055+0000 7f943259c700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 0x7f9434198d60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f942400c970 tx=0x7f942400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.056+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424004220 con 0x7f9434100e90 2023-10-05T15:36:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.056+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9424007d30 con 0x7f9434100e90 2023-10-05T15:36:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.056+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94341a0e90 con 0x7f9434100e90 2023-10-05T15:36:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.056+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424003bf0 con 0x7f9434100e90 2023-10-05T15:36:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.056+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94341a12b0 con 0x7f9434100e90 2023-10-05T15:36:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.057+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94341933f0 con 0x7f9434100e90 2023-10-05T15:36:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.059+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f94240078a0 con 0x7f9434100e90 2023-10-05T15:36:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.060+0000 7f94237fe700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f941c0a1480 0x7f941c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.060+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f94240ccda0 con 0x7f9434100e90 2023-10-05T15:36:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.060+0000 7f9431d9b700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f941c0a1480 0x7f941c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.061+0000 7f9431d9b700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f941c0a1480 0x7f941c0a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9428006010 tx=0x7f942800b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.064+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9424096000 con 0x7f9434100e90 2023-10-05T15:36:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:33 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2256154306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:33 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1361421118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:33 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2256154306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:33 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1361421118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:33 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2256154306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:33 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1361421118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:34.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.276+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f943402d2e0 con 0x7f9434100e90 2023-10-05T15:36:34.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.276+0000 7f94237fe700 1 -- 172.21.15.17:0/2591025451 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9424099620 con 0x7f9434100e90 2023-10-05T15:36:34.278 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f941c0a1480 msgr2=0x7f941c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f941c0a1480 0x7f941c0a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9428006010 tx=0x7f942800b540 comp rx=0 tx=0).stop 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 msgr2=0x7f9434198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 0x7f9434198d60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f942400c970 tx=0x7f942400cd30 comp rx=0 tx=0).stop 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 shutdown_connections 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f941c0a1480 0x7f941c0a3940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9434102a30 0x7f94341a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9434100e90 0x7f9434198d60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 --2- 172.21.15.17:0/2591025451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9434102070 0x7f94341992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 >> 172.21.15.17:0/2591025451 conn(0x7f94340fc430 msgr2=0x7f9434107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 shutdown_connections 2023-10-05T15:36:34.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.279+0000 7f9438dff700 1 -- 172.21.15.17:0/2591025451 wait complete. 2023-10-05T15:36:34.299 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 -- 172.21.15.17:0/3425215900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4073910 msgr2=0x7fd3b4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/3425215900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4073910 0x7fd3b4073d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098f0 tx=0x7fd3a4009c00 comp rx=0 tx=0).stop 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 -- 172.21.15.17:0/3425215900 shutdown_connections 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/3425215900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4108db0 0x7fd3b410b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/3425215900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 0x7fd3b4073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/3425215900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4073910 0x7fd3b4073d90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 -- 172.21.15.17:0/3425215900 >> 172.21.15.17:0/3425215900 conn(0x7fd3b40fc420 msgr2=0x7fd3b40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 -- 172.21.15.17:0/3425215900 shutdown_connections 2023-10-05T15:36:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.501+0000 7fd3bbbff700 1 -- 172.21.15.17:0/3425215900 wait complete. 2023-10-05T15:36:34.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 Processor -- start 2023-10-05T15:36:34.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 -- start start 2023-10-05T15:36:34.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 0x7fd3b4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 0x7fd3b41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4108db0 0x7fd3b41a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b41a08e0 con 0x7fd3b4073910 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b41a0a20 con 0x7fd3b4108db0 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.502+0000 7fd3bbbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b41a0bb0 con 0x7fd3b4074ef0 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 0x7fd3b4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 0x7fd3b4198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35592/0 (socket says 172.21.15.17:35592) 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 -- 172.21.15.17:0/2414835794 learned_addr learned my addr 172.21.15.17:0/2414835794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b919a700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 0x7fd3b41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 -- 172.21.15.17:0/2414835794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 msgr2=0x7fd3b41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3ba19c700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4108db0 0x7fd3b41a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 0x7fd3b41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 -- 172.21.15.17:0/2414835794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4108db0 msgr2=0x7fd3b41a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4108db0 0x7fd3b41a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 -- 172.21.15.17:0/2414835794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009520 con 0x7fd3b4073910 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b919a700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 0x7fd3b41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.503+0000 7fd3b999b700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 0x7fd3b4198d60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000d950 tx=0x7fd3b000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.504+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0009b40 con 0x7fd3b4073910 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.504+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3b0009ca0 con 0x7fd3b4073910 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.504+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b41a0e90 con 0x7fd3b4073910 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.504+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000f620 con 0x7fd3b4073910 2023-10-05T15:36:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.504+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b41a12b0 con 0x7fd3b4073910 2023-10-05T15:36:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.505+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b4107460 con 0x7fd3b4073910 2023-10-05T15:36:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.507+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd3b0010460 con 0x7fd3b4073910 2023-10-05T15:36:34.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.508+0000 7fd3aaffd700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3a00a14d0 0x7fd3a00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:34.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.508+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd3b00cd3f0 con 0x7fd3b4073910 2023-10-05T15:36:34.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.509+0000 7fd3b919a700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3a00a14d0 0x7fd3a00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:34.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.509+0000 7fd3b919a700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3a00a14d0 0x7fd3a00a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098c0 tx=0x7fd3a4019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:34.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.513+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3b00966b0 con 0x7fd3b4073910 2023-10-05T15:36:34.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.773+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b410e7e0 con 0x7fd3b4073910 2023-10-05T15:36:34.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.774+0000 7fd3aaffd700 1 -- 172.21.15.17:0/2414835794 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7fd3b0099cd0 con 0x7fd3b4073910 2023-10-05T15:36:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:34.776 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.776+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3a00a14d0 msgr2=0x7fd3a00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.776+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3a00a14d0 0x7fd3a00a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098c0 tx=0x7fd3a4019040 comp rx=0 tx=0).stop 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.776+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 msgr2=0x7fd3b4198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.776+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 0x7fd3b4198d60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000d950 tx=0x7fd3b000dd10 comp rx=0 tx=0).stop 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 shutdown_connections 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd3a00a14d0 0x7fd3a00a3990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b4108db0 0x7fd3b41a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4073910 0x7fd3b4198d60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 --2- 172.21.15.17:0/2414835794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b4074ef0 0x7fd3b41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 >> 172.21.15.17:0/2414835794 conn(0x7fd3b40fc420 msgr2=0x7fd3b40fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 shutdown_connections 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.777+0000 7fd3bbbff700 1 -- 172.21.15.17:0/2414835794 wait complete. 2023-10-05T15:36:34.779 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:34.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:34.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 -- 172.21.15.17:0/1790456276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102080 msgr2=0x7fb168102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 --2- 172.21.15.17:0/1790456276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102080 0x7fb168102500 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009990 tx=0x7fb15c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 -- 172.21.15.17:0/1790456276 shutdown_connections 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 --2- 172.21.15.17:0/1790456276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb168102a40 0x7fb168109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 --2- 172.21.15.17:0/1790456276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb168100ea0 0x7fb1681012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 --2- 172.21.15.17:0/1790456276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102080 0x7fb168102500 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 -- 172.21.15.17:0/1790456276 >> 172.21.15.17:0/1790456276 conn(0x7fb1680fc420 msgr2=0x7fb1680fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 -- 172.21.15.17:0/1790456276 shutdown_connections 2023-10-05T15:36:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.998+0000 7fb16cbff700 1 -- 172.21.15.17:0/1790456276 wait complete. 2023-10-05T15:36:35.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 Processor -- start 2023-10-05T15:36:35.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 -- start start 2023-10-05T15:36:35.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb168100ea0 0x7fb168196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb168102080 0x7fb168197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 0x7fb16819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16819e6a0 con 0x7fb168102a40 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16819e7e0 con 0x7fb168102080 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:34.999+0000 7fb16cbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16819e970 con 0x7fb168100ea0 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 0x7fb16819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 0x7fb16819e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35606/0 (socket says 172.21.15.17:35606) 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 -- 172.21.15.17:0/3703603617 learned_addr learned my addr 172.21.15.17:0/3703603617 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb16659c700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb168100ea0 0x7fb168196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb165d9b700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb168102080 0x7fb168197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 -- 172.21.15.17:0/3703603617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb168100ea0 msgr2=0x7fb168196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb168100ea0 0x7fb168196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 -- 172.21.15.17:0/3703603617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb168102080 msgr2=0x7fb168197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb168102080 0x7fb168197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 -- 172.21.15.17:0/3703603617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c0095f0 con 0x7fb168102a40 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.000+0000 7fb166d9d700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 0x7fb16819e0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb160007ee0 tx=0x7fb16000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.001+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160017070 con 0x7fb168102a40 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.001+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb16000f040 con 0x7fb168102a40 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.001+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16819ec50 con 0x7fb168102a40 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.001+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160005710 con 0x7fb168102a40 2023-10-05T15:36:35.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.001+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16819f160 con 0x7fb168102a40 2023-10-05T15:36:35.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.002+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb168108500 con 0x7fb168102a40 2023-10-05T15:36:35.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.004+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb160005870 con 0x7fb168102a40 2023-10-05T15:36:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.007+0000 7fb1577fe700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1500a1550 0x7fb1500a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.007+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb1600cc860 con 0x7fb168102a40 2023-10-05T15:36:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.007+0000 7fb16659c700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1500a1550 0x7fb1500a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.007+0000 7fb16659c700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1500a1550 0x7fb1500a3a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb168101bf0 tx=0x7fb15800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.011+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb160095b20 con 0x7fb168102a40 2023-10-05T15:36:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:34 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2736420945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:34 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2591025451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:35.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:34 smithi167 ceph-mon[133366]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:35.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:34 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2736420945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:35.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:34 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2591025451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:35.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:34 smithi079 ceph-mon[132936]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:35.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:34 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2736420945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:35.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:34 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2591025451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:35.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:34 smithi017 ceph-mon[129107]: pgmap v369: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:36:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.221+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb16810c610 con 0x7fb168102a40 2023-10-05T15:36:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.223+0000 7fb1577fe700 1 -- 172.21.15.17:0/3703603617 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7fb160099140 con 0x7fb168102a40 2023-10-05T15:36:35.225 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:35.225 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1500a1550 msgr2=0x7fb1500a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1500a1550 0x7fb1500a3a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb168101bf0 tx=0x7fb15800b410 comp rx=0 tx=0).stop 2023-10-05T15:36:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 msgr2=0x7fb16819e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 0x7fb16819e0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb160007ee0 tx=0x7fb16000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 shutdown_connections 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1500a1550 0x7fb1500a3a10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb168102a40 0x7fb16819e0d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb168100ea0 0x7fb168196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 --2- 172.21.15.17:0/3703603617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb168102080 0x7fb168197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 >> 172.21.15.17:0/3703603617 conn(0x7fb1680fc420 msgr2=0x7fb168105640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.225+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 shutdown_connections 2023-10-05T15:36:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.226+0000 7fb16cbff700 1 -- 172.21.15.17:0/3703603617 wait complete. 2023-10-05T15:36:35.247 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-05T15:34:32.118456+0000', 'modified': '2023-10-05T15:35:01.582968+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24593, 'mds_1': 24569, 'mds_2': 24550, 'mds_3': 24539, 'mds_4': 24526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24457': {'gid': 24457, 'name': 'l', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6833/978373819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 978373819}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 978373819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24470': {'gid': 24470, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6833/926038497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 926038497}, {'type': 'v1', 'addr': '172.21.15.79:6833', 'nonce': 926038497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24488': {'gid': 24488, 'name': 'd', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.17:6837/3739441472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6836', 'nonce': 3739441472}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 3739441472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6835/331259911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 331259911}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 331259911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/4056762327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 4056762327}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 4056762327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.167:6837/2368363786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 2368363786}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2368363786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24539': {'gid': 24539, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.79:6837/2714086354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 2714086354}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 2714086354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.167:6839/3231858560', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 3231858560}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 3231858560}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24569': {'gid': 24569, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.17:6839/2274947328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 2274947328}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 2274947328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6839/2052945872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 2052945872}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 2052945872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-05T15:36:35.247 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-05T15:36:35.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-05T15:36:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 -- 172.21.15.17:0/733158704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4102a40 msgr2=0x7fc1c4109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/733158704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4102a40 0x7fc1c4109360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00b0a0 tx=0x7fc1bc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 -- 172.21.15.17:0/733158704 shutdown_connections 2023-10-05T15:36:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/733158704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4102a40 0x7fc1c4109360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/733158704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4100ea0 0x7fc1c41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/733158704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4102080 0x7fc1c4102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 -- 172.21.15.17:0/733158704 >> 172.21.15.17:0/733158704 conn(0x7fc1c40fc460 msgr2=0x7fc1c40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 -- 172.21.15.17:0/733158704 shutdown_connections 2023-10-05T15:36:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.450+0000 7fc1c8bff700 1 -- 172.21.15.17:0/733158704 wait complete. 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.451+0000 7fc1c8bff700 1 Processor -- start 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 -- start start 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 0x7fc1c4196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4102080 0x7fc1c4197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4102a40 0x7fc1c419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c419e760 con 0x7fc1c4100ea0 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c419e8a0 con 0x7fc1c4102080 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c8bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c419ea30 con 0x7fc1c4102a40 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 0x7fc1c4196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 0x7fc1c4196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35616/0 (socket says 172.21.15.17:35616) 2023-10-05T15:36:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c259c700 1 -- 172.21.15.17:0/2528744656 learned_addr learned my addr 172.21.15.17:0/2528744656 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.452+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4102a40 0x7fc1c419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4102080 0x7fc1c4197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c259c700 1 -- 172.21.15.17:0/2528744656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4102a40 msgr2=0x7fc1c419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4102a40 0x7fc1c419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c259c700 1 -- 172.21.15.17:0/2528744656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4102080 msgr2=0x7fc1c4197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4102080 0x7fc1c4197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c259c700 1 -- 172.21.15.17:0/2528744656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc009d00 con 0x7fc1c4100ea0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 0x7fc1c4196be0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e970 tx=0x7fc1b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1b37fe700 1 -- 172.21.15.17:0/2528744656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4009790 con 0x7fc1c4100ea0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c419ed10 con 0x7fc1c4100ea0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1b37fe700 1 -- 172.21.15.17:0/2528744656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1b40044b0 con 0x7fc1c4100ea0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1b37fe700 1 -- 172.21.15.17:0/2528744656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4003dd0 con 0x7fc1c4100ea0 2023-10-05T15:36:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.453+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c419f1c0 con 0x7fc1c4100ea0 2023-10-05T15:36:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.456+0000 7fc1b37fe700 1 -- 172.21.15.17:0/2528744656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc1b4003f30 con 0x7fc1c4100ea0 2023-10-05T15:36:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.458+0000 7fc1dc603b80 1 Processor -- start 2023-10-05T15:36:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.458+0000 7fc1dc603b80 1 -- start start 2023-10-05T15:36:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1b37fe700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1480 0x7fc1ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1b37fe700 1 -- 172.21.15.17:0/2528744656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc1b4014070 con 0x7fc1c4100ea0 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x56274115c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 0x56274115d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115da10 0x56274115de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627410c4410 con 0x56274115da10 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627410b5bd0 con 0x56274115cb70 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627410b34f0 con 0x56274115c210 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1480 0x7fc1ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 0x56274115d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1c2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115da10 0x56274115de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 0x56274115d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53674/0 (socket says 172.21.15.17:53674) 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/3103430425 learned_addr learned my addr 172.21.15.17:0/3103430425 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.459+0000 7fc1c259c700 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x56274115c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/3103430425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 msgr2=0x56274115c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x56274115c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/3103430425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115da10 msgr2=0x56274115de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115da10 0x56274115de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/3103430425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562740ed9d90 con 0x56274115cb70 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1480 0x7fc1ac0a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009fd0 tx=0x7fc1bc009470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 0x56274115d430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800bd20 tx=0x7fc1b800f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efd786229e09c02 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.460+0000 7fc1b0ff9700 1 -- 172.21.15.17:0/3103430425 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800fda0 con 0x56274115cb70 2023-10-05T15:36:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1b0ff9700 1 -- 172.21.15.17:0/3103430425 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1b800be70 con 0x56274115cb70 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1b0ff9700 1 -- 172.21.15.17:0/3103430425 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011680 con 0x56274115cb70 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 -- 172.21.15.17:0/3103430425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 msgr2=0x56274115d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 0x56274115d430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800bd20 tx=0x7fc1b800f640 comp rx=0 tx=0).stop 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 -- 172.21.15.17:0/3103430425 shutdown_connections 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115da10 0x56274115de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x56274115c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/3103430425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115cb70 0x56274115d430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 -- 172.21.15.17:0/3103430425 >> 172.21.15.17:0/3103430425 conn(0x5627410d0210 msgr2=0x5627411570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 -- 172.21.15.17:0/3103430425 shutdown_connections 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.461+0000 7fc1dc603b80 1 -- 172.21.15.17:0/3103430425 wait complete. 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.462+0000 7fc1dc603b80 1 -- start start 2023-10-05T15:36:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.462+0000 7fc1dc603b80 1 Processor -- start 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x562741165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 0x562741166520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x56274116d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627410aede0 con 0x56274115cb70 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56274104b6c0 con 0x56274115da10 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56274104b360 con 0x56274115c210 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1dc603b80 10 client.0 _ll_register_callbacks cb 0x562740ea87b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 0x562741166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 0x562741166520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35630/0 (socket says 172.21.15.17:35630) 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/2067145757 learned_addr learned my addr 172.21.15.17:0/2067145757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x562741165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x56274116d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 msgr2=0x562741165fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x562741165fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/2067145757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 msgr2=0x56274116d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x56274116d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c1d9b700 1 -- 172.21.15.17:0/2067145757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b800b980 con 0x56274115cb70 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.463+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x562741165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 0x562741166520 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8005910 tx=0x7fc1b8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b32c12a15afa5d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/2067145757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b801a870 con 0x56274115cb70 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56274114eec0 con 0x56274115cb70 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/2067145757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc1b801a9d0 con 0x56274115cb70 2023-10-05T15:36:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/2067145757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1b8011440 con 0x56274115cb70 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1dc603b80 10 client.15480 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.464+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562740ec2c10 con 0x56274115cb70 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/2067145757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56274114eec0 con 0x56274115cb70 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/2067145757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc1b8022070 con 0x56274115cb70 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1dc603b80 10 client.15480 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1dc603b80 10 client.15480 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1dc603b80 20 client.15480 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x562741171af0 0x5627411705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1dc603b80 4 client.15480 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.465+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627410a7dc0 con 0x562741171af0 2023-10-05T15:36:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.466+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x562741171af0 0x5627411705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.466+0000 7fc1c259c700 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x562741171af0 0x5627411705b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fc3ec9530b2f7fde server_cookie=46faa635478279b9 in_seq=0 out_seq=0 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.466+0000 7fc1a9ffb700 10 client.15480 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/2067145757 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627410a7dc0 con 0x562741171af0 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1a9ffb700 10 client.15480 handle_command_reply: tid=0 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 client.15480 shutdown 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 msgr2=0x562741166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 0x562741166520 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8005910 tx=0x7fc1b8005810 comp rx=0 tx=0).stop 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 shutdown_connections 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x56274116d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115c210 0x562741165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x562741171af0 0x5627411705b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/2067145757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115cb70 0x562741166520 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1a9ffb700 0 client.15480 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.467+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 >> 172.21.15.17:0/2067145757 conn(0x5627410d0210 msgr2=0x562741156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.468+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 shutdown_connections 2023-10-05T15:36:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.468+0000 7fc1dc603b80 1 -- 172.21.15.17:0/2067145757 wait complete. 2023-10-05T15:36:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.468+0000 7fc1dc603b80 20 client.15480 trim_cache size 0 max 16384 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 Processor -- start 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 -- start start 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x562741160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x562741160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562740f2f8d0 con 0x56274115c210 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627411512b0 con 0x56274115da10 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627410a7df0 con 0x56274115cb70 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1c259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x562741160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1c259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x562741160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35646/0 (socket says 172.21.15.17:35646) 2023-10-05T15:36:35.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.486+0000 7fc1c259c700 1 -- 172.21.15.17:0/924324896 learned_addr learned my addr 172.21.15.17:0/924324896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c259c700 1 -- 172.21.15.17:0/924324896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 msgr2=0x562741160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x562741160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c259c700 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x562741160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c259c700 1 -- 172.21.15.17:0/924324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 msgr2=0x5627411705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c259c700 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c259c700 1 -- 172.21.15.17:0/924324896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562740f00200 con 0x56274115c210 2023-10-05T15:36:35.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x562741160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1c259c700 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x562741160980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc1b409a010 tx=0x7fc1b40046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d0e845553f1d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1b17fa700 1 -- 172.21.15.17:0/924324896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40b6070 con 0x56274115c210 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1b17fa700 1 -- 172.21.15.17:0/924324896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1b409e460 con 0x56274115c210 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.487+0000 7fc1b17fa700 1 -- 172.21.15.17:0/924324896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40cac00 con 0x56274115c210 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 -- 172.21.15.17:0/924324896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 msgr2=0x562741160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x562741160980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc1b409a010 tx=0x7fc1b40046a0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 -- 172.21.15.17:0/924324896 shutdown_connections 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x562741160980 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/924324896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x562741160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 -- 172.21.15.17:0/924324896 >> 172.21.15.17:0/924324896 conn(0x5627410d0210 msgr2=0x562741164c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 -- 172.21.15.17:0/924324896 shutdown_connections 2023-10-05T15:36:35.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 -- 172.21.15.17:0/924324896 wait complete. 2023-10-05T15:36:35.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.488+0000 7fc1dc603b80 1 -- start start 2023-10-05T15:36:35.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 Processor -- start 2023-10-05T15:36:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x5627411c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x5627411c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627411c94c0 con 0x56274115c210 2023-10-05T15:36:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627411c9600 con 0x56274115da10 2023-10-05T15:36:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627411c9790 con 0x56274115cb70 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.489+0000 7fc1dc603b80 10 client.0 _ll_register_callbacks cb 0x7fc1bc009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x5627411c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x5627411c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35656/0 (socket says 172.21.15.17:35656) 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 -- 172.21.15.17:0/1214903077 learned_addr learned my addr 172.21.15.17:0/1214903077 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c2d9d700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x5627411c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 -- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 msgr2=0x5627411c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x5627411c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 -- 172.21.15.17:0/1214903077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 msgr2=0x5627411c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 -- 172.21.15.17:0/1214903077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c419f1c0 con 0x56274115c210 2023-10-05T15:36:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x5627411c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1c259c700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x5627411c1a00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cfd0 tx=0x7fc1b4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da7a1eb5a51b73d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/1214903077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40b6070 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/1214903077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc1b40b0070 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.490+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1b800be70 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/1214903077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1b40cac00 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 10 client.15486 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562740ed8260 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/1214903077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1b800be70 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/1214903077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc1b409e110 con 0x56274115c210 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 10 client.15486 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-05T15:36:35.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 20 client.15486 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5627411ce7d0 0x5627411cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 4 client.15486 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.491+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5627410a7ae0 con 0x5627411ce7d0 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.492+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5627411ce7d0 0x5627411cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.492+0000 7fc1c1d9b700 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5627411ce7d0 0x5627411cac50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b05d3af1b01f6067 server_cookie=3916af799c5ae520 in_seq=0 out_seq=0 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.492+0000 7fc1a9ffb700 10 client.15486 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.492+0000 7fc1a9ffb700 1 -- 172.21.15.17:0/1214903077 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5627410a7ae0 con 0x5627411ce7d0 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1a9ffb700 10 client.15486 handle_command_reply: tid=0 2023-10-05T15:36:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 client.15486 shutdown 2023-10-05T15:36:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 msgr2=0x5627411c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x5627411c1a00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cfd0 tx=0x7fc1b4005d50 comp rx=0 tx=0).stop 2023-10-05T15:36:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 shutdown_connections 2023-10-05T15:36:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56274115da10 0x5627411c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x5627411ce7d0 0x5627411cac50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56274115c210 0x5627411c1a00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 --2- 172.21.15.17:0/1214903077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56274115cb70 0x5627411c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1a9ffb700 0 client.15486 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 >> 172.21.15.17:0/1214903077 conn(0x5627410d0210 msgr2=0x562741160980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 shutdown_connections 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 1 -- 172.21.15.17:0/1214903077 wait complete. 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.493+0000 7fc1dc603b80 20 client.15486 trim_cache size 0 max 16384 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2023-10-05T15:36:35.499 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24526, 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 94.738172039000005, 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 144.54272563000001 2023-10-05T15:36:35.500 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1480 msgr2=0x7fc1ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1480 0x7fc1ac0a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009fd0 tx=0x7fc1bc009470 comp rx=0 tx=0).stop 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 msgr2=0x7fc1c4196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 0x7fc1c4196be0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400e970 tx=0x7fc1b400ed30 comp rx=0 tx=0).stop 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 shutdown_connections 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1ac0a1480 0x7fc1ac0a3940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1c4102a40 0x7fc1c419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1c4100ea0 0x7fc1c4196be0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 --2- 172.21.15.17:0/2528744656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1c4102080 0x7fc1c4197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 >> 172.21.15.17:0/2528744656 conn(0x7fc1c40fc460 msgr2=0x7fc1c40fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 shutdown_connections 2023-10-05T15:36:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.494+0000 7fc1c8bff700 1 -- 172.21.15.17:0/2528744656 wait complete. 2023-10-05T15:36:35.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 -- 172.21.15.17:0/1911830962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 msgr2=0x7fe2201066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 --2- 172.21.15.17:0/1911830962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe2201066c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe214009990 tx=0x7fe214009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 -- 172.21.15.17:0/1911830962 shutdown_connections 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 --2- 172.21.15.17:0/1911830962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe220106c00 0x7fe220109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 --2- 172.21.15.17:0/1911830962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2201019a0 0x7fe220103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 --2- 172.21.15.17:0/1911830962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe2201066c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 -- 172.21.15.17:0/1911830962 >> 172.21.15.17:0/1911830962 conn(0x7fe2200fb330 msgr2=0x7fe2200fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 -- 172.21.15.17:0/1911830962 shutdown_connections 2023-10-05T15:36:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.716+0000 7fe2265ff700 1 -- 172.21.15.17:0/1911830962 wait complete. 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.717+0000 7fe2265ff700 1 Processor -- start 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.717+0000 7fe2265ff700 1 -- start start 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe2265ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2201019a0 0x7fe220196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe2265ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe220197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe2265ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220106c00 0x7fe22019e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe2265ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22019e6b0 con 0x7fe2201042d0 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe2265ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22019e7f0 con 0x7fe220106c00 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe2265ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22019e980 con 0x7fe2201019a0 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe21f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe220197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe21f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe220197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35666/0 (socket says 172.21.15.17:35666) 2023-10-05T15:36:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe21f7fe700 1 -- 172.21.15.17:0/3726341709 learned_addr learned my addr 172.21.15.17:0/3726341709 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe21ffff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2201019a0 0x7fe220196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.718+0000 7fe224b9c700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220106c00 0x7fe22019e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21f7fe700 1 -- 172.21.15.17:0/3726341709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2201019a0 msgr2=0x7fe220196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2201019a0 0x7fe220196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21f7fe700 1 -- 172.21.15.17:0/3726341709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220106c00 msgr2=0x7fe22019e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220106c00 0x7fe22019e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21f7fe700 1 -- 172.21.15.17:0/3726341709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140095f0 con 0x7fe2201042d0 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe220197070 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe214005910 tx=0x7fe214005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21d7fa700 1 -- 172.21.15.17:0/3726341709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21401d070 con 0x7fe2201042d0 2023-10-05T15:36:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21d7fa700 1 -- 172.21.15.17:0/3726341709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe214022470 con 0x7fe2201042d0 2023-10-05T15:36:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22019ec00 con 0x7fe2201042d0 2023-10-05T15:36:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.719+0000 7fe21d7fa700 1 -- 172.21.15.17:0/3726341709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214022ea0 con 0x7fe2201042d0 2023-10-05T15:36:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.720+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22019f080 con 0x7fe2201042d0 2023-10-05T15:36:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.723+0000 7fe21d7fa700 1 -- 172.21.15.17:0/3726341709 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe21400ba60 con 0x7fe2201042d0 2023-10-05T15:36:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.724+0000 7fe239e7db80 1 Processor -- start 2023-10-05T15:36:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.724+0000 7fe21d7fa700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2080a1500 0x7fe2080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.724+0000 7fe239e7db80 1 -- start start 2023-10-05T15:36:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe21d7fa700 1 -- 172.21.15.17:0/3726341709 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe2140ce3b0 con 0x7fe2201042d0 2023-10-05T15:36:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe224b9c700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2080a1500 0x7fe2080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 0x55a19a967630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a968430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a968e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe239e7db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a8cf410 con 0x55a19a967210 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe239e7db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a8c0bd0 con 0x55a19a968a10 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe239e7db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a8be4f0 con 0x55a19a967b70 2023-10-05T15:36:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe21ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 0x55a19a967630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe21ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 0x55a19a967630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35682/0 (socket says 172.21.15.17:35682) 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe21ffff700 1 -- 172.21.15.17:0/4229938000 learned_addr learned my addr 172.21.15.17:0/4229938000 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a968430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.725+0000 7fe224b9c700 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a968e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe21ffff700 1 -- 172.21.15.17:0/4229938000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 msgr2=0x55a19a968430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe21ffff700 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a968430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe224b9c700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2080a1500 0x7fe2080a39c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe218003ee0 tx=0x7fe218009130 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe21ffff700 1 -- 172.21.15.17:0/4229938000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 msgr2=0x55a19a968e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe21ffff700 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a968e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe21ffff700 1 -- 172.21.15.17:0/4229938000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a19a6e4d90 con 0x55a19a967210 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe21ffff700 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 0x55a19a967630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe210009d80 tx=0x7fe210011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3c3bc165ff02ba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe2067fc700 1 -- 172.21.15.17:0/4229938000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210004230 con 0x55a19a967210 2023-10-05T15:36:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe2067fc700 1 -- 172.21.15.17:0/4229938000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe210004390 con 0x55a19a967210 2023-10-05T15:36:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.726+0000 7fe2067fc700 1 -- 172.21.15.17:0/4229938000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2100197e0 con 0x55a19a967210 2023-10-05T15:36:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 -- 172.21.15.17:0/4229938000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 msgr2=0x55a19a967630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 0x55a19a967630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe210009d80 tx=0x7fe210011720 comp rx=0 tx=0).stop 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 -- 172.21.15.17:0/4229938000 shutdown_connections 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a968e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967210 0x55a19a967630 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 --2- 172.21.15.17:0/4229938000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a968430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 -- 172.21.15.17:0/4229938000 >> 172.21.15.17:0/4229938000 conn(0x55a19a8db210 msgr2=0x55a19a9620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 -- 172.21.15.17:0/4229938000 shutdown_connections 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.727+0000 7fe239e7db80 1 -- 172.21.15.17:0/4229938000 wait complete. 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 -- start start 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 Processor -- start 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a970f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a9784e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a8b9de0 con 0x55a19a968a10 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a8566c0 con 0x55a19a967210 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a856360 con 0x55a19a967b70 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.728+0000 7fe239e7db80 10 client.0 _ll_register_callbacks cb 0x55a19a6b37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a9784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a9784e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35698/0 (socket says 172.21.15.17:35698) 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 -- 172.21.15.17:0/189404821 learned_addr learned my addr 172.21.15.17:0/189404821 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe21ffff700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a970f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 -- 172.21.15.17:0/189404821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 msgr2=0x55a19a9714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 -- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 msgr2=0x55a19a970f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a970f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 -- 172.21.15.17:0/189404821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2100099e0 con 0x55a19a968a10 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe224b9c700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a9784e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe218008890 tx=0x7fe218004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139cc3526344031e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe1ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.729+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/189404821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218015950 con 0x55a19a968a10 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a19a959ec0 con 0x55a19a968a10 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/189404821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe218015ab0 con 0x55a19a968a10 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/189404821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe218015c70 con 0x55a19a968a10 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 10 client.15498 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a19a6cdc10 con 0x55a19a968a10 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/189404821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a19a959ec0 con 0x55a19a968a10 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/189404821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe2180163f0 con 0x55a19a968a10 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 10 client.15498 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 10 client.15498 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 20 client.15498 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a97cc20 0x55a19a97b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 4 client.15498 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.730+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a19a8b2dc0 con 0x55a19a97cc20 2023-10-05T15:36:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.731+0000 7fe21ffff700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a97cc20 0x55a19a97b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.731+0000 7fe21ffff700 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a97cc20 0x55a19a97b640 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=98591ee52494c6a8 server_cookie=697d574ea1ea1ca4 in_seq=0 out_seq=0 2023-10-05T15:36:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.731+0000 7fe1ff7fe700 10 client.15498 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.732+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/189404821 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a19a8b2dc0 con 0x55a19a97cc20 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.732+0000 7fe1ff7fe700 10 client.15498 handle_command_reply: tid=0 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.732+0000 7fe239e7db80 1 client.15498 shutdown 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.732+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 msgr2=0x55a19a9784e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.732+0000 7fe239e7db80 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a9784e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe218008890 tx=0x7fe218004b40 comp rx=0 tx=0).stop 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 shutdown_connections 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a97cc20 0x55a19a97b640 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a9784e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a970f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 --2- 172.21.15.17:0/189404821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 >> 172.21.15.17:0/189404821 conn(0x55a19a8db210 msgr2=0x55a19a961f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe1ff7fe700 0 client.15498 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 shutdown_connections 2023-10-05T15:36:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 1 -- 172.21.15.17:0/189404821 wait complete. 2023-10-05T15:36:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.733+0000 7fe239e7db80 20 client.15498 trim_cache size 0 max 16384 2023-10-05T15:36:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.751+0000 7fe239e7db80 1 Processor -- start 2023-10-05T15:36:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.751+0000 7fe239e7db80 1 -- start start 2023-10-05T15:36:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a96b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a96be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe239e7db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a73a8d0 con 0x55a19a968a10 2023-10-05T15:36:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe239e7db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a8604d0 con 0x55a19a967210 2023-10-05T15:36:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe239e7db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a746de0 con 0x55a19a967b70 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a96be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a96be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35712/0 (socket says 172.21.15.17:35712) 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 -- 172.21.15.17:0/2236372888 learned_addr learned my addr 172.21.15.17:0/2236372888 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 -- 172.21.15.17:0/2236372888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 msgr2=0x55a19a9784a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 -- 172.21.15.17:0/2236372888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 msgr2=0x55a19a96b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe21ffff700 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a96b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a96b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.752+0000 7fe224b9c700 1 -- 172.21.15.17:0/2236372888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a19a70b200 con 0x55a19a968a10 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.753+0000 7fe21ffff700 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a96b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.753+0000 7fe224b9c700 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a96be20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe2180167d0 tx=0x7fe2180154c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f72291fe215951 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.753+0000 7fe206ffd700 1 -- 172.21.15.17:0/2236372888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218016bc0 con 0x55a19a968a10 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.753+0000 7fe206ffd700 1 -- 172.21.15.17:0/2236372888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe21800f040 con 0x55a19a968a10 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.753+0000 7fe206ffd700 1 -- 172.21.15.17:0/2236372888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218022820 con 0x55a19a968a10 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 -- 172.21.15.17:0/2236372888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 msgr2=0x55a19a96be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a96be20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe2180167d0 tx=0x7fe2180154c0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 -- 172.21.15.17:0/2236372888 shutdown_connections 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a968a10 0x55a19a96be20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a967210 0x55a19a96b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2236372888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 -- 172.21.15.17:0/2236372888 >> 172.21.15.17:0/2236372888 conn(0x55a19a8db210 msgr2=0x55a19a985580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 -- 172.21.15.17:0/2236372888 shutdown_connections 2023-10-05T15:36:35.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 -- 172.21.15.17:0/2236372888 wait complete. 2023-10-05T15:36:35.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 -- start start 2023-10-05T15:36:35.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.754+0000 7fe239e7db80 1 Processor -- start 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967210 0x55a19a96ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a96cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a96e6f0 con 0x55a19a967b70 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a96d4a0 con 0x55a19a968a10 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a19a96d660 con 0x55a19a967210 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe239e7db80 10 client.0 _ll_register_callbacks cb 0x7fe2180047b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe21f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe21f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35728/0 (socket says 172.21.15.17:35728) 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe21f7fe700 1 -- 172.21.15.17:0/2735504223 learned_addr learned my addr 172.21.15.17:0/2735504223 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe224b9c700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a96cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe21f7fe700 1 -- 172.21.15.17:0/2735504223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967210 msgr2=0x55a19a96ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.755+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967210 0x55a19a96ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe21f7fe700 1 -- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 msgr2=0x55a19a96cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a96cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe21f7fe700 1 -- 172.21.15.17:0/2735504223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a19a6cdc10 con 0x55a19a967b70 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe224b9c700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a96cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe21f7fe700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe21409b0c0 tx=0x7fe214005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296fdbb2b7c286e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe1ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:35.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/2735504223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21409bac0 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/2735504223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe21409b3c0 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe210004390 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/2735504223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe21409f510 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe239e7db80 10 client.15504 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a19a6e3260 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.756+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/2735504223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe210004390 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/2735504223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe21409a8b0 con 0x55a19a967b70 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe239e7db80 10 client.15504 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe239e7db80 10 client.15504 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe239e7db80 20 client.15504 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a9d51b0 0x55a19a9d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe239e7db80 4 client.15504 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a19a8b2ae0 con 0x55a19a9d51b0 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.757+0000 7fe21ffff700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a9d51b0 0x55a19a9d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe21ffff700 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a9d51b0 0x55a19a9d15f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6ffc33d16d6cea2c server_cookie=7c85d0c8f886fd13 in_seq=0 out_seq=0 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe1ff7fe700 10 client.15504 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe1ff7fe700 1 -- 172.21.15.17:0/2735504223 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a19a8b2ae0 con 0x55a19a9d51b0 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe1ff7fe700 10 client.15504 handle_command_reply: tid=0 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 client.15504 shutdown 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 msgr2=0x55a19a9784a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe21409b0c0 tx=0x7fe214005fd0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 shutdown_connections 2023-10-05T15:36:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a19a968a10 0x55a19a96cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a19a967210 0x55a19a96ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a19a9d51b0 0x55a19a9d15f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 --2- 172.21.15.17:0/2735504223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a19a967b70 0x55a19a9784a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe1ff7fe700 0 client.15504 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.758+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 >> 172.21.15.17:0/2735504223 conn(0x55a19a8db210 msgr2=0x55a19a96b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 shutdown_connections 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe239e7db80 1 -- 172.21.15.17:0/2735504223 wait complete. 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe239e7db80 20 client.15504 trim_cache size 0 max 16384 2023-10-05T15:36:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24539, 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 96.013351030999999, 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 141.79444497099999 2023-10-05T15:36:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:35.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2080a1500 msgr2=0x7fe2080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2080a1500 0x7fe2080a39c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe218003ee0 tx=0x7fe218009130 comp rx=0 tx=0).stop 2023-10-05T15:36:35.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 msgr2=0x7fe220197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe220197070 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe214005910 tx=0x7fe214005720 comp rx=0 tx=0).stop 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 shutdown_connections 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe2080a1500 0x7fe2080a39c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220106c00 0x7fe22019e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2201019a0 0x7fe220196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 --2- 172.21.15.17:0/3726341709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2201042d0 0x7fe220197070 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.759+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 >> 172.21.15.17:0/3726341709 conn(0x7fe2200fb330 msgr2=0x7fe220102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.760+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 shutdown_connections 2023-10-05T15:36:35.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.760+0000 7fe2265ff700 1 -- 172.21.15.17:0/3726341709 wait complete. 2023-10-05T15:36:35.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-05T15:36:35.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 -- 172.21.15.17:0/395110550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102070 msgr2=0x7f86841024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 --2- 172.21.15.17:0/395110550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102070 0x7f86841024f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8674009990 tx=0x7f8674009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 -- 172.21.15.17:0/395110550 shutdown_connections 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 --2- 172.21.15.17:0/395110550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8684102a30 0x7f8684109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 --2- 172.21.15.17:0/395110550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8684100e90 0x7f86841012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 --2- 172.21.15.17:0/395110550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102070 0x7f86841024f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 -- 172.21.15.17:0/395110550 >> 172.21.15.17:0/395110550 conn(0x7f86840fc430 msgr2=0x7f86840fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 -- 172.21.15.17:0/395110550 shutdown_connections 2023-10-05T15:36:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.984+0000 7f868c7ff700 1 -- 172.21.15.17:0/395110550 wait complete. 2023-10-05T15:36:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 Processor -- start 2023-10-05T15:36:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 -- start start 2023-10-05T15:36:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8684100e90 0x7f8684074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8684102070 0x7f86840732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 0x7f86840737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684073f80 con 0x7f8684102a30 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840740f0 con 0x7f8684102070 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.985+0000 7f868c7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86841a0c10 con 0x7f8684100e90 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 0x7f86840737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 0x7f86840737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35748/0 (socket says 172.21.15.17:35748) 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 -- 172.21.15.17:0/861135839 learned_addr learned my addr 172.21.15.17:0/861135839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f8689d9a700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8684102070 0x7f86840732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868a59b700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8684100e90 0x7f8684074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 -- 172.21.15.17:0/861135839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8684100e90 msgr2=0x7f8684074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8684100e90 0x7f8684074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 -- 172.21.15.17:0/861135839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8684102070 msgr2=0x7f86840732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:35.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8684102070 0x7f86840732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 -- 172.21.15.17:0/861135839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740095f0 con 0x7f8684102a30 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.986+0000 7f868ad9c700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 0x7f86840737e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f867c007ee0 tx=0x7f867c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.987+0000 7f867b7fe700 1 -- 172.21.15.17:0/861135839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c017070 con 0x7f8684102a30 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.987+0000 7f867b7fe700 1 -- 172.21.15.17:0/861135839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f867c00f040 con 0x7f8684102a30 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.987+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86841a0ef0 con 0x7f8684102a30 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.987+0000 7f867b7fe700 1 -- 172.21.15.17:0/861135839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c005570 con 0x7f8684102a30 2023-10-05T15:36:35.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.987+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86841a1320 con 0x7f8684102a30 2023-10-05T15:36:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.991+0000 7f867b7fe700 1 -- 172.21.15.17:0/861135839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f867c00db20 con 0x7f8684102a30 2023-10-05T15:36:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.992+0000 7f86a01f1b80 1 Processor -- start 2023-10-05T15:36:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 -- start start 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed51210 0x557c4ed51630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed52430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed52a10 0x557c4ed52e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ecb9410 con 0x557c4ed51b70 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ecaabd0 con 0x557c4ed52a10 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4eca84f0 con 0x557c4ed51210 2023-10-05T15:36:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f867b7fe700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86700a1480 0x7f86700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f867b7fe700 1 -- 172.21.15.17:0/861135839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f867c0cc860 con 0x7f8684102a30 2023-10-05T15:36:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f868a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed52430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f868a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed52430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35752/0 (socket says 172.21.15.17:35752) 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f868a59b700 1 -- 172.21.15.17:0/2215816039 learned_addr learned my addr 172.21.15.17:0/2215816039 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.993+0000 7f868ad9c700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86700a1480 0x7f86700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f8689d9a700 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed51210 0x557c4ed51630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f8689d9a700 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed52a10 0x557c4ed52e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868a59b700 1 -- 172.21.15.17:0/2215816039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed51210 msgr2=0x557c4ed51630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868a59b700 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed51210 0x557c4ed51630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868a59b700 1 -- 172.21.15.17:0/2215816039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed52a10 msgr2=0x557c4ed52e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868a59b700 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed52a10 0x557c4ed52e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868a59b700 1 -- 172.21.15.17:0/2215816039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c4eaced90 con 0x557c4ed51b70 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f8689d9a700 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed52a10 0x557c4ed52e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868ad9c700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86700a1480 0x7f86700a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f867c007fd0 tx=0x7f867c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.994+0000 7f868a59b700 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed52430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d30 tx=0x7f8680011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbd89fdb6685496 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f8678ff9700 1 -- 172.21.15.17:0/2215816039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680004220 con 0x557c4ed51b70 2023-10-05T15:36:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f8678ff9700 1 -- 172.21.15.17:0/2215816039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8680004380 con 0x557c4ed51b70 2023-10-05T15:36:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f8678ff9700 1 -- 172.21.15.17:0/2215816039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680019780 con 0x557c4ed51b70 2023-10-05T15:36:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 -- 172.21.15.17:0/2215816039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 msgr2=0x557c4ed52430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed52430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d30 tx=0x7f8680011720 comp rx=0 tx=0).stop 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 -- 172.21.15.17:0/2215816039 shutdown_connections 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed52a10 0x557c4ed52e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed51210 0x557c4ed51630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/2215816039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed52430 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.995+0000 7f86a01f1b80 1 -- 172.21.15.17:0/2215816039 >> 172.21.15.17:0/2215816039 conn(0x557c4ecc5210 msgr2=0x557c4ed4c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.996+0000 7f86a01f1b80 1 -- 172.21.15.17:0/2215816039 shutdown_connections 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.996+0000 7f86a01f1b80 1 -- 172.21.15.17:0/2215816039 wait complete. 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.996+0000 7f86a01f1b80 1 -- start start 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.996+0000 7f86a01f1b80 1 Processor -- start 2023-10-05T15:36:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4eca3de0 con 0x557c4ed51210 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ec406c0 con 0x557c4ed51b70 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ec40360 con 0x557c4ed52a10 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f86a01f1b80 10 client.0 _ll_register_callbacks cb 0x557c4ea9d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35764/0 (socket says 172.21.15.17:35764) 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 -- 172.21.15.17:0/1636079257 learned_addr learned my addr 172.21.15.17:0/1636079257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f868a59b700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 -- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 msgr2=0x557c4ed624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 -- 172.21.15.17:0/1636079257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 msgr2=0x557c4ed5b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.997+0000 7f8689d9a700 1 -- 172.21.15.17:0/1636079257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8680009960 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f868a59b700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f8689d9a700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5af70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8674009990 tx=0x7f8674005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6491798783799ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f866dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f866dffb700 1 -- 172.21.15.17:0/1636079257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867401d040 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f866dffb700 1 -- 172.21.15.17:0/1636079257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f867400b920 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c4ed43ec0 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f866dffb700 1 -- 172.21.15.17:0/1636079257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8674003d70 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f86a01f1b80 10 client.15516 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.998+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557c4eab7c10 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f866dffb700 1 -- 172.21.15.17:0/1636079257 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c4ed43ec0 con 0x557c4ed51210 2023-10-05T15:36:36.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f866dffb700 1 -- 172.21.15.17:0/1636079257 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f867400fc30 con 0x557c4ed51210 2023-10-05T15:36:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f86a01f1b80 10 client.15516 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f86a01f1b80 10 client.15516 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:36:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f86a01f1b80 20 client.15516 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4ed66b60 0x557c4ed65640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f86a01f1b80 4 client.15516 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:36.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:35.999+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c4ec9cdc0 con 0x557c4ed66b60 2023-10-05T15:36:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.000+0000 7f868a59b700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4ed66b60 0x557c4ed65640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.000+0000 7f866dffb700 10 client.15516 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.000+0000 7f868a59b700 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4ed66b60 0x557c4ed65640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d74d9aa5f2951352 server_cookie=63911800073a9e60 in_seq=0 out_seq=0 2023-10-05T15:36:36.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.001+0000 7f866dffb700 1 -- 172.21.15.17:0/1636079257 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c4ec9cdc0 con 0x557c4ed66b60 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.001+0000 7f866dffb700 10 client.15516 handle_command_reply: tid=0 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.001+0000 7f86a01f1b80 1 client.15516 shutdown 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.001+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 msgr2=0x557c4ed5af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.001+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5af70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8674009990 tx=0x7f8674005810 comp rx=0 tx=0).stop 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 shutdown_connections 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4ed66b60 0x557c4ed65640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5af70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/1636079257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f866dffb700 0 client.15516 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:36.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 >> 172.21.15.17:0/1636079257 conn(0x557c4ecc5210 msgr2=0x557c4ed4bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 shutdown_connections 2023-10-05T15:36:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 1 -- 172.21.15.17:0/1636079257 wait complete. 2023-10-05T15:36:36.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.002+0000 7f86a01f1b80 20 client.15516 trim_cache size 0 max 16384 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.020+0000 7f86a01f1b80 1 Processor -- start 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.020+0000 7f86a01f1b80 1 -- start start 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.020+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51210 0x557c4ed59c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.020+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed62480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.020+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4eb248d0 con 0x557c4ed51b70 2023-10-05T15:36:36.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ed64210 con 0x557c4ed51210 2023-10-05T15:36:36.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ec9fed0 con 0x557c4ed52a10 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f868a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed62480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f868a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed62480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35780/0 (socket says 172.21.15.17:35780) 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f868a59b700 1 -- 172.21.15.17:0/3314900987 learned_addr learned my addr 172.21.15.17:0/3314900987 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51210 0x557c4ed59c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 -- 172.21.15.17:0/3314900987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 msgr2=0x557c4ed4bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed4bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 -- 172.21.15.17:0/3314900987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 msgr2=0x557c4ed62480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed62480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.021+0000 7f8689d9a700 1 -- 172.21.15.17:0/3314900987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c4eaf5200 con 0x557c4ed51210 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51210 0x557c4ed59c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8674027610 tx=0x7f8674009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bdfcffef623f7bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86797fa700 1 -- 172.21.15.17:0/3314900987 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674003cf0 con 0x557c4ed51210 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86797fa700 1 -- 172.21.15.17:0/3314900987 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86740163a0 con 0x557c4ed51210 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86797fa700 1 -- 172.21.15.17:0/3314900987 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674027ba0 con 0x557c4ed51210 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3314900987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51210 msgr2=0x557c4ed59c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51210 0x557c4ed59c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8674027610 tx=0x7f8674009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3314900987 shutdown_connections 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51210 0x557c4ed59c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3314900987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51b70 0x557c4ed62480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.022+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3314900987 >> 172.21.15.17:0/3314900987 conn(0x557c4ecc5210 msgr2=0x557c4ed4ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.023+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3314900987 shutdown_connections 2023-10-05T15:36:36.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.023+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3314900987 wait complete. 2023-10-05T15:36:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.023+0000 7f86a01f1b80 1 -- start start 2023-10-05T15:36:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.023+0000 7f86a01f1b80 1 Processor -- start 2023-10-05T15:36:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ed61de0 con 0x557c4ed51210 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ed61f50 con 0x557c4ed51b70 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4ed62110 con 0x557c4ed52a10 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f86a01f1b80 10 client.0 _ll_register_callbacks cb 0x557c4ea9d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35790/0 (socket says 172.21.15.17:35790) 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 -- 172.21.15.17:0/3898881141 learned_addr learned my addr 172.21.15.17:0/3898881141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f868a59b700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 -- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 msgr2=0x557c4ed618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 -- 172.21.15.17:0/3898881141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 msgr2=0x557c4ed5cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f8689d9a700 1 -- 172.21.15.17:0/3898881141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c4eab7c10 con 0x557c4ed51210 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.024+0000 7f868a59b700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f8689d9a700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5c6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f867400b2a0 tx=0x7f8674009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e91a20f7c0880a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f866dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f866dffb700 1 -- 172.21.15.17:0/3898881141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867401d070 con 0x557c4ed51210 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8680004380 con 0x557c4ed51210 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f866dffb700 1 -- 172.21.15.17:0/3898881141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8674000e40 con 0x557c4ed51210 2023-10-05T15:36:36.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f866dffb700 1 -- 172.21.15.17:0/3898881141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8674016720 con 0x557c4ed51210 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f86a01f1b80 10 client.15522 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557c4eacd260 con 0x557c4ed51210 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f866dffb700 1 -- 172.21.15.17:0/3898881141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8680004380 con 0x557c4ed51210 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.025+0000 7f866dffb700 1 -- 172.21.15.17:0/3898881141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f867400bb20 con 0x557c4ed51210 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f86a01f1b80 10 client.15522 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f86a01f1b80 10 client.15522 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f86a01f1b80 20 client.15522 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4edbea90 0x557c4edbaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f86a01f1b80 4 client.15522 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557c4ec9cae0 con 0x557c4edbea90 2023-10-05T15:36:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.026+0000 7f868a59b700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4edbea90 0x557c4edbaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.027+0000 7f868a59b700 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4edbea90 0x557c4edbaf20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7cf510d786d967 server_cookie=87243a009a295bcf in_seq=0 out_seq=0 2023-10-05T15:36:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.027+0000 7f866dffb700 10 client.15522 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:36.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.027+0000 7f866dffb700 1 -- 172.21.15.17:0/3898881141 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557c4ec9cae0 con 0x557c4edbea90 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.027+0000 7f866dffb700 10 client.15522 handle_command_reply: tid=0 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.027+0000 7f86a01f1b80 1 client.15522 shutdown 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 msgr2=0x557c4ed5c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5c6a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f867400b2a0 tx=0x7f8674009330 comp rx=0 tx=0).stop 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 shutdown_connections 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x557c4edbea90 0x557c4edbaf20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c4ed52a10 0x557c4ed618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c4ed51210 0x557c4ed5c6a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f866dffb700 0 client.15522 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 --2- 172.21.15.17:0/3898881141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557c4ed51b70 0x557c4ed5cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 >> 172.21.15.17:0/3898881141 conn(0x557c4ecc5210 msgr2=0x557c4ed58d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 shutdown_connections 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 1 -- 172.21.15.17:0/3898881141 wait complete. 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f86a01f1b80 20 client.15522 trim_cache size 0 max 16384 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24550, 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:36.036 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 97.288636420000003, 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 138.83629539399999 2023-10-05T15:36:36.037 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86700a1480 msgr2=0x7f86700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.028+0000 7f868c7ff700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86700a1480 0x7f86700a3940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f867c007fd0 tx=0x7f867c00b040 comp rx=0 tx=0).stop 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 msgr2=0x7f86840737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 0x7f86840737e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f867c007ee0 tx=0x7f867c00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 shutdown_connections 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f86700a1480 0x7f86700a3940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8684102a30 0x7f86840737e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8684100e90 0x7f8684074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 --2- 172.21.15.17:0/861135839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8684102070 0x7f86840732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 >> 172.21.15.17:0/861135839 conn(0x7f86840fc430 msgr2=0x7f86840fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 shutdown_connections 2023-10-05T15:36:36.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.029+0000 7f868c7ff700 1 -- 172.21.15.17:0/861135839 wait complete. 2023-10-05T15:36:36.046 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:35 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2414835794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:36.046 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:35 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3703603617' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:36.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2023-10-05T15:36:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:35 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2414835794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:35 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3703603617' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:35 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2414835794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:35 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3703603617' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 -- 172.21.15.17:0/359236415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 msgr2=0x7f733c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 --2- 172.21.15.17:0/359236415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c073340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f732c009990 tx=0x7f732c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 -- 172.21.15.17:0/359236415 shutdown_connections 2023-10-05T15:36:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 --2- 172.21.15.17:0/359236415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c108da0 0x7f733c10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 --2- 172.21.15.17:0/359236415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c073340 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 --2- 172.21.15.17:0/359236415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c073910 0x7f733c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 -- 172.21.15.17:0/359236415 >> 172.21.15.17:0/359236415 conn(0x7f733c0fc430 msgr2=0x7f733c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 -- 172.21.15.17:0/359236415 shutdown_connections 2023-10-05T15:36:36.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.250+0000 7f7343fff700 1 -- 172.21.15.17:0/359236415 wait complete. 2023-10-05T15:36:36.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.251+0000 7f7343fff700 1 Processor -- start 2023-10-05T15:36:36.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 -- start start 2023-10-05T15:36:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c073910 0x7f733c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c108da0 0x7f733c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c1a08e0 con 0x7f733c074ef0 2023-10-05T15:36:36.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c1a0a20 con 0x7f733c108da0 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.252+0000 7f7343fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c1a0bb0 con 0x7f733c073910 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35800/0 (socket says 172.21.15.17:35800) 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 -- 172.21.15.17:0/2887631810 learned_addr learned my addr 172.21.15.17:0/2887631810 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f7341d9b700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c073910 0x7f733c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734259c700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c108da0 0x7f733c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 -- 172.21.15.17:0/2887631810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c073910 msgr2=0x7f733c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c073910 0x7f733c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 -- 172.21.15.17:0/2887631810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c108da0 msgr2=0x7f733c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c108da0 0x7f733c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 -- 172.21.15.17:0/2887631810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0095f0 con 0x7f733c074ef0 2023-10-05T15:36:36.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f734159a700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c1992a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f733000d980 tx=0x7f733000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.253+0000 7f733affd700 1 -- 172.21.15.17:0/2887631810 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000b950 con 0x7f733c074ef0 2023-10-05T15:36:36.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.254+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c1a0e90 con 0x7f733c074ef0 2023-10-05T15:36:36.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.254+0000 7f733affd700 1 -- 172.21.15.17:0/2887631810 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7330007620 con 0x7f733c074ef0 2023-10-05T15:36:36.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.254+0000 7f733affd700 1 -- 172.21.15.17:0/2887631810 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000f3c0 con 0x7f733c074ef0 2023-10-05T15:36:36.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.254+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c1a1310 con 0x7f733c074ef0 2023-10-05T15:36:36.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.258+0000 7f733affd700 1 -- 172.21.15.17:0/2887631810 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f733000bab0 con 0x7f733c074ef0 2023-10-05T15:36:36.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.258+0000 7f73579f7b80 1 Processor -- start 2023-10-05T15:36:36.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 -- start start 2023-10-05T15:36:36.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761210 0x55c336761630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c336762430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336762a10 0x55c336762e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3366c9410 con 0x55c336761b70 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3366babd0 con 0x55c336761210 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f73579f7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3366b84f0 con 0x55c336762a10 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f7341d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c336762430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f7341d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c336762430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35814/0 (socket says 172.21.15.17:35814) 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f7341d9b700 1 -- 172.21.15.17:0/219153611 learned_addr learned my addr 172.21.15.17:0/219153611 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f734159a700 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336762a10 0x55c336762e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.259+0000 7f734259c700 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761210 0x55c336761630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7341d9b700 1 -- 172.21.15.17:0/219153611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336762a10 msgr2=0x55c336762e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7341d9b700 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336762a10 0x55c336762e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7341d9b700 1 -- 172.21.15.17:0/219153611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761210 msgr2=0x55c336761630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7341d9b700 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761210 0x55c336761630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7341d9b700 1 -- 172.21.15.17:0/219153611 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3364ded90 con 0x55c336761b70 2023-10-05T15:36:36.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7341d9b700 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c336762430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f732c015000 tx=0x7f732c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38259cec7a2d1ec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7323fff700 1 -- 172.21.15.17:0/219153611 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c01d070 con 0x55c336761b70 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7323fff700 1 -- 172.21.15.17:0/219153611 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f732c01e040 con 0x55c336761b70 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.260+0000 7f7323fff700 1 -- 172.21.15.17:0/219153611 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c004760 con 0x55c336761b70 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f733affd700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f73240a1480 0x7f73240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f733affd700 1 -- 172.21.15.17:0/2887631810 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f73300cd260 con 0x7f733c074ef0 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f734259c700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f73240a1480 0x7f73240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 -- 172.21.15.17:0/219153611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 msgr2=0x55c336762430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c336762430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f732c015000 tx=0x7f732c009ee0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 -- 172.21.15.17:0/219153611 shutdown_connections 2023-10-05T15:36:36.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336762a10 0x55c336762e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761210 0x55c336761630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 --2- 172.21.15.17:0/219153611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c336762430 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.261+0000 7f73579f7b80 1 -- 172.21.15.17:0/219153611 >> 172.21.15.17:0/219153611 conn(0x55c3366d5210 msgr2=0x55c33675c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.262+0000 7f73579f7b80 1 -- 172.21.15.17:0/219153611 shutdown_connections 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.262+0000 7f734259c700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f73240a1480 0x7f73240a3940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7334009d90 tx=0x7f7334009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.262+0000 7f73579f7b80 1 -- 172.21.15.17:0/219153611 wait complete. 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.262+0000 7f73579f7b80 1 -- start start 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.262+0000 7f73579f7b80 1 Processor -- start 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 0x55c33676af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761b70 0x55c33676b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c3367724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3366b3de0 con 0x55c336761210 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3366506c0 con 0x55c336762a10 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c336650360 con 0x55c336761b70 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f73579f7b80 10 client.0 _ll_register_callbacks cb 0x55c3364ad7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 0x55c33676af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 0x55c33676af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35824/0 (socket says 172.21.15.17:35824) 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 -- 172.21.15.17:0/3942429315 learned_addr learned my addr 172.21.15.17:0/3942429315 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f734159a700 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761b70 0x55c33676b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 -- 172.21.15.17:0/3942429315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761b70 msgr2=0x55c33676b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761b70 0x55c33676b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 -- 172.21.15.17:0/3942429315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 msgr2=0x55c3367724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c3367724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.263+0000 7f7341d9b700 1 -- 172.21.15.17:0/3942429315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c10be50 con 0x55c336761210 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f7341d9b700 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 0x55c33676af50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f732c005920 tx=0x7f732c0053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e114965e9b5f5d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73217fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73217fa700 1 -- 172.21.15.17:0/3942429315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c01d070 con 0x55c336761210 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c336753ec0 con 0x55c336761210 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73217fa700 1 -- 172.21.15.17:0/3942429315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f732c003c30 con 0x55c336761210 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73217fa700 1 -- 172.21.15.17:0/3942429315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f732c003df0 con 0x55c336761210 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73579f7b80 10 client.15534 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:36.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.264+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c3364c7c10 con 0x55c336761210 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73217fa700 1 -- 172.21.15.17:0/3942429315 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c336753ec0 con 0x55c336761210 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73217fa700 1 -- 172.21.15.17:0/3942429315 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f732c00fc20 con 0x55c336761210 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73579f7b80 10 client.15534 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73579f7b80 10 client.15534 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73579f7b80 20 client.15534 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73579f7b80 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c336776670 0x55c336775400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73579f7b80 4 client.15534 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3366acdc0 con 0x55c336776670 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.265+0000 7f734159a700 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c336776670 0x55c336775400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.266+0000 7f734159a700 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c336776670 0x55c336775400 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d451b2bd2e1be65 server_cookie=dd97da4c429db367 in_seq=0 out_seq=0 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.266+0000 7f73217fa700 10 client.15534 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.266+0000 7f73217fa700 1 -- 172.21.15.17:0/3942429315 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c3366acdc0 con 0x55c336776670 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.266+0000 7f73217fa700 10 client.15534 handle_command_reply: tid=0 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.266+0000 7f73579f7b80 1 client.15534 shutdown 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 msgr2=0x55c33676af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 0x55c33676af50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f732c005920 tx=0x7f732c0053a0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 shutdown_connections 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c336776670 0x55c336775400 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c3367724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761210 0x55c33676af50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 --2- 172.21.15.17:0/3942429315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761b70 0x55c33676b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73217fa700 0 client.15534 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 >> 172.21.15.17:0/3942429315 conn(0x55c3366d5210 msgr2=0x55c33675bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 shutdown_connections 2023-10-05T15:36:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 1 -- 172.21.15.17:0/3942429315 wait complete. 2023-10-05T15:36:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.267+0000 7f73579f7b80 20 client.15534 trim_cache size 0 max 16384 2023-10-05T15:36:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.285+0000 7f73579f7b80 1 Processor -- start 2023-10-05T15:36:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.285+0000 7f73579f7b80 1 -- start start 2023-10-05T15:36:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336775400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761b70 0x55c336775940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 0x55c336772490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f73579f7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3365348d0 con 0x55c336762a10 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f73579f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3366afed0 con 0x55c336761b70 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f73579f7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33665a4d0 con 0x55c336761210 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 0x55c336772490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 0x55c336772490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35838/0 (socket says 172.21.15.17:35838) 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734259c700 1 -- 172.21.15.17:0/970864100 learned_addr learned my addr 172.21.15.17:0/970864100 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734159a700 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761b70 0x55c336775940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f7341d9b700 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336775400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734159a700 1 -- 172.21.15.17:0/970864100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 msgr2=0x55c336775400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734159a700 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336775400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734159a700 1 -- 172.21.15.17:0/970864100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 msgr2=0x55c336772490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.286+0000 7f734159a700 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 0x55c336772490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.287+0000 7f734159a700 1 -- 172.21.15.17:0/970864100 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c336505200 con 0x55c336761b70 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.287+0000 7f734259c700 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 0x55c336772490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.287+0000 7f734159a700 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761b70 0x55c336775940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73300caa10 tx=0x7f73300d0d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e32d4d01d9a5187 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.287+0000 7f7338ff9700 1 -- 172.21.15.17:0/970864100 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330099d20 con 0x55c336761b70 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.287+0000 7f7338ff9700 1 -- 172.21.15.17:0/970864100 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7330099b40 con 0x55c336761b70 2023-10-05T15:36:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.287+0000 7f7338ff9700 1 -- 172.21.15.17:0/970864100 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733009a270 con 0x55c336761b70 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 -- 172.21.15.17:0/970864100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761b70 msgr2=0x55c336775940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761b70 0x55c336775940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f73300caa10 tx=0x7f73300d0d00 comp rx=0 tx=0).stop 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 -- 172.21.15.17:0/970864100 shutdown_connections 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336762a10 0x55c336772490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336775400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 --2- 172.21.15.17:0/970864100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336761b70 0x55c336775940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 -- 172.21.15.17:0/970864100 >> 172.21.15.17:0/970864100 conn(0x55c3366d5210 msgr2=0x55c33677efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 -- 172.21.15.17:0/970864100 shutdown_connections 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 -- 172.21.15.17:0/970864100 wait complete. 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.288+0000 7f73579f7b80 1 -- start start 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 Processor -- start 2023-10-05T15:36:36.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336772050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c33676eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c33676f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c336772870 con 0x55c336761b70 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33676f5a0 con 0x55c336762a10 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c33676f760 con 0x55c336761210 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f73579f7b80 10 client.0 _ll_register_callbacks cb 0x7f7334009190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f734159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c33676eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f734159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c33676eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35840/0 (socket says 172.21.15.17:35840) 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f734159a700 1 -- 172.21.15.17:0/1190691693 learned_addr learned my addr 172.21.15.17:0/1190691693 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f7341d9b700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336772050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.289+0000 7f734259c700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c33676f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734159a700 1 -- 172.21.15.17:0/1190691693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 msgr2=0x55c336772050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734159a700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336772050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734159a700 1 -- 172.21.15.17:0/1190691693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 msgr2=0x55c33676f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734159a700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c33676f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734159a700 1 -- 172.21.15.17:0/1190691693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334007ca0 con 0x55c336761b70 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734259c700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c33676f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f734159a700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c33676eaf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f733000bfd0 tx=0x7f73300d0a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0a1c38255d7353 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73217fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73217fa700 1 -- 172.21.15.17:0/1190691693 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330010460 con 0x55c336761b70 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f732c01e040 con 0x55c336761b70 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73217fa700 1 -- 172.21.15.17:0/1190691693 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f733009e330 con 0x55c336761b70 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73217fa700 1 -- 172.21.15.17:0/1190691693 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73300a2570 con 0x55c336761b70 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73579f7b80 10 client.15540 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.290+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f733c1a1310 con 0x55c336761b70 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73217fa700 1 -- 172.21.15.17:0/1190691693 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f732c01e040 con 0x55c336761b70 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73217fa700 1 -- 172.21.15.17:0/1190691693 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f733009a440 con 0x55c336761b70 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73579f7b80 10 client.15540 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73579f7b80 10 client.15540 resolve_mds: resolved name 'g' to daemon mds.g 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73579f7b80 20 client.15540 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73579f7b80 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c3367ceea0 0x55c3367cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73579f7b80 4 client.15540 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3366acae0 con 0x55c3367ceea0 2023-10-05T15:36:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.291+0000 7f7341d9b700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c3367ceea0 0x55c3367cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73217fa700 10 client.15540 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f7341d9b700 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c3367ceea0 0x55c3367cb380 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7b857df90442275 server_cookie=f9d55da9669ea1e6 in_seq=0 out_seq=0 2023-10-05T15:36:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73217fa700 1 -- 172.21.15.17:0/1190691693 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55c3366acae0 con 0x55c3367ceea0 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73217fa700 10 client.15540 handle_command_reply: tid=0 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 client.15540 shutdown 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 msgr2=0x55c33676eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c33676eaf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f733000bfd0 tx=0x7f73300d0a70 comp rx=0 tx=0).stop 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 shutdown_connections 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x55c3367ceea0 0x55c3367cb380 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c336762a10 0x55c33676f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c336761210 0x55c336772050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73217fa700 0 client.15540 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 --2- 172.21.15.17:0/1190691693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c336761b70 0x55c33676eaf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 >> 172.21.15.17:0/1190691693 conn(0x55c3366d5210 msgr2=0x55c336775400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 shutdown_connections 2023-10-05T15:36:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.292+0000 7f73579f7b80 1 -- 172.21.15.17:0/1190691693 wait complete. 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f73579f7b80 20 client.15540 trim_cache size 0 max 16384 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24569, 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:36.300 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 98.565052645999998, 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 135.84192081 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f73240a1480 msgr2=0x7f73240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f73240a1480 0x7f73240a3940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7334009d90 tx=0x7f7334009040 comp rx=0 tx=0).stop 2023-10-05T15:36:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 msgr2=0x7f733c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c1992a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f733000d980 tx=0x7f733000dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 shutdown_connections 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f73240a1480 0x7f73240a3940 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c108da0 0x7f733c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f733c073910 0x7f733c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 --2- 172.21.15.17:0/2887631810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f733c074ef0 0x7f733c1992a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 >> 172.21.15.17:0/2887631810 conn(0x7f733c0fc430 msgr2=0x7f733c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 shutdown_connections 2023-10-05T15:36:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.293+0000 7f7343fff700 1 -- 172.21.15.17:0/2887631810 wait complete. 2023-10-05T15:36:36.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 -- 172.21.15.17:0/1033763235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 msgr2=0x7f59b81012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 --2- 172.21.15.17:0/1033763235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b81012b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59a80098f0 tx=0x7f59a8009c00 comp rx=0 tx=0).stop 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 -- 172.21.15.17:0/1033763235 shutdown_connections 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 --2- 172.21.15.17:0/1033763235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 --2- 172.21.15.17:0/1033763235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b81012b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 --2- 172.21.15.17:0/1033763235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b8102070 0x7f59b81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 -- 172.21.15.17:0/1033763235 >> 172.21.15.17:0/1033763235 conn(0x7f59b80fc430 msgr2=0x7f59b80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 -- 172.21.15.17:0/1033763235 shutdown_connections 2023-10-05T15:36:36.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.514+0000 7f59be7ff700 1 -- 172.21.15.17:0/1033763235 wait complete. 2023-10-05T15:36:36.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.515+0000 7f59be7ff700 1 Processor -- start 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.515+0000 7f59be7ff700 1 -- start start 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59be7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59be7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b8102070 0x7f59b81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59be7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b81a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59be7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81a08e0 con 0x7f59b8102a30 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59be7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81a0a50 con 0x7f59b8100e90 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59be7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81a0c10 con 0x7f59b8102070 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b81a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b81a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35868/0 (socket says 172.21.15.17:35868) 2023-10-05T15:36:36.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59affff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59bcd9c700 1 -- 172.21.15.17:0/116634024 learned_addr learned my addr 172.21.15.17:0/116634024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.516+0000 7f59b7fff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b8102070 0x7f59b81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59bcd9c700 1 -- 172.21.15.17:0/116634024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b8102070 msgr2=0x7f59b81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b8102070 0x7f59b81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59bcd9c700 1 -- 172.21.15.17:0/116634024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 msgr2=0x7f59b8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b8198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59bcd9c700 1 -- 172.21.15.17:0/116634024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8009520 con 0x7f59b8102a30 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59affff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b81a0310 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c110 tx=0x7f59b000c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59b5ffb700 1 -- 172.21.15.17:0/116634024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0017070 con 0x7f59b8102a30 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59b5ffb700 1 -- 172.21.15.17:0/116634024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59b000e050 con 0x7f59b8102a30 2023-10-05T15:36:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b81a0e90 con 0x7f59b8102a30 2023-10-05T15:36:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59b5ffb700 1 -- 172.21.15.17:0/116634024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0007820 con 0x7f59b8102a30 2023-10-05T15:36:36.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.517+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b81a1260 con 0x7f59b8102a30 2023-10-05T15:36:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.520+0000 7f59b5ffb700 1 -- 172.21.15.17:0/116634024 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f59b000ca20 con 0x7f59b8102a30 2023-10-05T15:36:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 Processor -- start 2023-10-05T15:36:36.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59b5ffb700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59a40a1480 0x7f59a40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 -- start start 2023-10-05T15:36:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59b5ffb700 1 -- 172.21.15.17:0/116634024 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f59b00ccb50 con 0x7f59b8102a30 2023-10-05T15:36:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59b7fff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59a40a1480 0x7f59a40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe485630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe486430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe486e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe3ed410 con 0x5647fe485b70 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe3debd0 con 0x5647fe485210 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.522+0000 7f59d2134b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe3dc4f0 con 0x5647fe486a10 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe486430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe486430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35882/0 (socket says 172.21.15.17:35882) 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59affff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe485630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 -- 172.21.15.17:0/2459809850 learned_addr learned my addr 172.21.15.17:0/2459809850 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe486e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59a40a1480 0x7f59a40a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f59b8100bb0 tx=0x7f59a0011720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 -- 172.21.15.17:0/2459809850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 msgr2=0x5647fe486e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe486e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 -- 172.21.15.17:0/2459809850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 msgr2=0x5647fe485630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe485630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 -- 172.21.15.17:0/2459809850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647fe202d90 con 0x5647fe485b70 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.523+0000 7f59b7fff700 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe486430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f59a0011f90 tx=0x7f59a001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3144e3fc7e961aa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.524+0000 7f59ae7fc700 1 -- 172.21.15.17:0/2459809850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a001ddb0 con 0x5647fe485b70 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.524+0000 7f59ae7fc700 1 -- 172.21.15.17:0/2459809850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59a00044b0 con 0x5647fe485b70 2023-10-05T15:36:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.524+0000 7f59ae7fc700 1 -- 172.21.15.17:0/2459809850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a000f3c0 con 0x5647fe485b70 2023-10-05T15:36:36.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.524+0000 7f59d2134b80 1 -- 172.21.15.17:0/2459809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 msgr2=0x5647fe486430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.524+0000 7f59d2134b80 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe486430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f59a0011f90 tx=0x7f59a001c000 comp rx=0 tx=0).stop 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 -- 172.21.15.17:0/2459809850 shutdown_connections 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe486e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe485630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 --2- 172.21.15.17:0/2459809850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe486430 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 -- 172.21.15.17:0/2459809850 >> 172.21.15.17:0/2459809850 conn(0x5647fe3f9210 msgr2=0x5647fe4800f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 -- 172.21.15.17:0/2459809850 shutdown_connections 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 -- 172.21.15.17:0/2459809850 wait complete. 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 -- start start 2023-10-05T15:36:36.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.525+0000 7f59d2134b80 1 Processor -- start 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe48f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485b70 0x5647fe48f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe496590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe3d7de0 con 0x5647fe486a10 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe3746c0 con 0x5647fe485210 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe374360 con 0x5647fe485b70 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59d2134b80 10 client.0 _ll_register_callbacks cb 0x5647fe1d17b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe496590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe496590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35896/0 (socket says 172.21.15.17:35896) 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1485442644 learned_addr learned my addr 172.21.15.17:0/1485442644 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59b7fff700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485b70 0x5647fe48f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59affff700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe48f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1485442644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485b70 msgr2=0x5647fe48f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485b70 0x5647fe48f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 msgr2=0x5647fe48f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe48f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1485442644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a0011cd0 con 0x5647fe486a10 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.526+0000 7f59affff700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe48f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe496590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f59b00062a0 tx=0x7f59b0099fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db252f656007ede server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59977fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59977fe700 1 -- 172.21.15.17:0/1485442644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b009dbc0 con 0x5647fe486a10 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59977fe700 1 -- 172.21.15.17:0/1485442644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f59b00a1e00 con 0x5647fe486a10 2023-10-05T15:36:36.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647fe477ec0 con 0x5647fe486a10 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59977fe700 1 -- 172.21.15.17:0/1485442644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59b00b2260 con 0x5647fe486a10 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59d2134b80 10 client.15552 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5647fe1ebc10 con 0x5647fe486a10 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59977fe700 1 -- 172.21.15.17:0/1485442644 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5647fe477ec0 con 0x5647fe486a10 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.527+0000 7f59977fe700 1 -- 172.21.15.17:0/1485442644 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f59b0095860 con 0x5647fe486a10 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59d2134b80 10 client.15552 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59d2134b80 10 client.15552 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59d2134b80 20 client.15552 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe49abb0 0x5647fe4996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59d2134b80 4 client.15552 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647fe3d0dc0 con 0x5647fe49abb0 2023-10-05T15:36:36.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.528+0000 7f59affff700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe49abb0 0x5647fe4996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.529+0000 7f59affff700 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe49abb0 0x5647fe4996a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6bede63fefd4424 server_cookie=c9da12dcf0b6fe4 in_seq=0 out_seq=0 2023-10-05T15:36:36.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.529+0000 7f59977fe700 10 client.15552 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.529+0000 7f59977fe700 1 -- 172.21.15.17:0/1485442644 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5647fe3d0dc0 con 0x5647fe49abb0 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59977fe700 10 client.15552 handle_command_reply: tid=0 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 client.15552 shutdown 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 msgr2=0x5647fe496590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe496590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f59b00062a0 tx=0x7f59b0099fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 shutdown_connections 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe49abb0 0x5647fe4996a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe496590 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe48f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1485442644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485b70 0x5647fe48f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 >> 172.21.15.17:0/1485442644 conn(0x5647fe3f9210 msgr2=0x5647fe47ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59977fe700 0 client.15552 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:36.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 shutdown_connections 2023-10-05T15:36:36.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 1 -- 172.21.15.17:0/1485442644 wait complete. 2023-10-05T15:36:36.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.530+0000 7f59d2134b80 20 client.15552 trim_cache size 0 max 16384 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.548+0000 7f59d2134b80 1 Processor -- start 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.548+0000 7f59d2134b80 1 -- start start 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.548+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485210 0x5647fe48dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.548+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485b70 0x5647fe496520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.548+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe4899b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59d2134b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe2588d0 con 0x5647fe486a10 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59d2134b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe47a2b0 con 0x5647fe485b70 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59d2134b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe3d3ed0 con 0x5647fe485210 2023-10-05T15:36:36.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe4899b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe4899b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35908/0 (socket says 172.21.15.17:35908) 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1248772359 learned_addr learned my addr 172.21.15.17:0/1248772359 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59affff700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485210 0x5647fe48dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1248772359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485210 msgr2=0x5647fe48dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59b7fff700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485b70 0x5647fe496520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485210 0x5647fe48dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1248772359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485b70 msgr2=0x5647fe496520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485b70 0x5647fe496520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 -- 172.21.15.17:0/1248772359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647fe229200 con 0x5647fe486a10 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59affff700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485210 0x5647fe48dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:36.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59b7fff700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485b70 0x5647fe496520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe4899b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f59b0095f70 tx=0x7f59b00b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a41c0379c604fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.549+0000 7f59aeffd700 1 -- 172.21.15.17:0/1248772359 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0095c20 con 0x5647fe486a10 2023-10-05T15:36:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59aeffd700 1 -- 172.21.15.17:0/1248772359 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59b000f040 con 0x5647fe486a10 2023-10-05T15:36:36.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59aeffd700 1 -- 172.21.15.17:0/1248772359 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b009dbc0 con 0x5647fe486a10 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 -- 172.21.15.17:0/1248772359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 msgr2=0x5647fe4899b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe4899b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f59b0095f70 tx=0x7f59b00b9040 comp rx=0 tx=0).stop 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 -- 172.21.15.17:0/1248772359 shutdown_connections 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe486a10 0x5647fe4899b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe485210 0x5647fe48dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1248772359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485b70 0x5647fe496520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 -- 172.21.15.17:0/1248772359 >> 172.21.15.17:0/1248772359 conn(0x5647fe3f9210 msgr2=0x5647fe4a3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 -- 172.21.15.17:0/1248772359 shutdown_connections 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.550+0000 7f59d2134b80 1 -- 172.21.15.17:0/1248772359 wait complete. 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 -- start start 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 Processor -- start 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe492430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe492970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe495990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe495ed0 con 0x5647fe485b70 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe496040 con 0x5647fe485210 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647fe496200 con 0x5647fe486a10 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59d2134b80 10 client.0 _ll_register_callbacks cb 0x7f59b00995d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.551+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe492970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe492970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35914/0 (socket says 172.21.15.17:35914) 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 -- 172.21.15.17:0/1868308213 learned_addr learned my addr 172.21.15.17:0/1868308213 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59affff700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe492430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe495990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 -- 172.21.15.17:0/1868308213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 msgr2=0x5647fe495990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe495990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 -- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 msgr2=0x5647fe492430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe492430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 -- 172.21.15.17:0/1868308213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647fe1ebc10 con 0x5647fe485b70 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59bcd9c700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe495990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59b7fff700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe492970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f59a0024000 tx=0x7f59a0009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ac3d52a52c427d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:36.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59977fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59977fe700 1 -- 172.21.15.17:0/1868308213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0005450 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59977fe700 1 -- 172.21.15.17:0/1868308213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f59a00055b0 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.552+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59a00044b0 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59977fe700 1 -- 172.21.15.17:0/1868308213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59a00046f0 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 10 client.15558 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5647fe201260 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59977fe700 1 -- 172.21.15.17:0/1868308213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59a00044b0 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59977fe700 1 -- 172.21.15.17:0/1868308213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f59a0031700 con 0x5647fe485b70 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 10 client.15558 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 10 client.15558 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 20 client.15558 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe4f2fa0 0x5647fe4ef320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 4 client.15558 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.553+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5647fe3d0ae0 con 0x5647fe4f2fa0 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.554+0000 7f59affff700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe4f2fa0 0x5647fe4ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.554+0000 7f59affff700 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe4f2fa0 0x5647fe4ef320 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450390c2461c6b77 server_cookie=a48e18da47cd72ff in_seq=0 out_seq=0 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.554+0000 7f59977fe700 10 client.15558 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.554+0000 7f59977fe700 1 -- 172.21.15.17:0/1868308213 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5647fe3d0ae0 con 0x5647fe4f2fa0 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.554+0000 7f59977fe700 10 client.15558 handle_command_reply: tid=0 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.554+0000 7f59d2134b80 1 client.15558 shutdown 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 msgr2=0x5647fe492970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe492970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f59a0024000 tx=0x7f59a0009770 comp rx=0 tx=0).stop 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 shutdown_connections 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5647fe4f2fa0 0x5647fe4ef320 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5647fe486a10 0x5647fe495990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5647fe485210 0x5647fe492430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 --2- 172.21.15.17:0/1868308213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5647fe485b70 0x5647fe492970 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 >> 172.21.15.17:0/1868308213 conn(0x5647fe3f9210 msgr2=0x5647fe48dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59977fe700 0 client.15558 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 shutdown_connections 2023-10-05T15:36:36.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 1 -- 172.21.15.17:0/1868308213 wait complete. 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59d2134b80 20 client.15558 trim_cache size 0 max 16384 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "6446904c-6393-11ee-8db5-212e2dc638e7", 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24593, 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-10-05T15:36:36.562 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 123.92796805499999, 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 27, 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 94, 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 90, 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 129.90183472699999 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59a40a1480 msgr2=0x7f59a40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59be7ff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59a40a1480 0x7f59a40a3940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f59b8100bb0 tx=0x7f59a0011720 comp rx=0 tx=0).stop 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 msgr2=0x7f59b81a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.555+0000 7f59be7ff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b81a0310 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c110 tx=0x7f59b000c420 comp rx=0 tx=0).stop 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 shutdown_connections 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f59a40a1480 0x7f59a40a3940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59b8102a30 0x7f59b81a0310 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59b8100e90 0x7f59b8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 --2- 172.21.15.17:0/116634024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59b8102070 0x7f59b81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 >> 172.21.15.17:0/116634024 conn(0x7f59b80fc430 msgr2=0x7f59b80fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 shutdown_connections 2023-10-05T15:36:36.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:36.556+0000 7f59be7ff700 1 -- 172.21.15.17:0/116634024 wait complete. 2023-10-05T15:36:36.575 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-05T15:36:36.586 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-05T15:36:36.586 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-05T15:36:36.586 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-10-05T15:36:36.586 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-05T15:36:36.587 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-10-05T15:36:36.587 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-10-05T15:36:36.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:36.587 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-05T15:36:36.631 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-05T15:36:36.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:36.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-05T15:36:36.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:36.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-05T15:36:36.865 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-05T15:36:36.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-05T15:36:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:36:37.894 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:37 smithi017 ceph-mon[129107]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:36:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:37 smithi167 ceph-mon[133366]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:36:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:37 smithi079 ceph-mon[132936]: pgmap v370: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:36:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.233+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/1566661464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48106f90 msgr2=0x7f1d48107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.233+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/1566661464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48106f90 0x7f1d48107370 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1d380099c0 tx=0x7f1d38009cd0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/1566661464 shutdown_connections 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/1566661464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d48101940 0x7f1d4810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/1566661464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48106f90 0x7f1d48107370 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/1566661464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d48100f80 0x7f1d48101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/1566661464 >> 172.21.15.17:0/1566661464 conn(0x7f1d480780a0 msgr2=0x7f1d480784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/1566661464 shutdown_connections 2023-10-05T15:36:39.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.234+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/1566661464 wait complete. 2023-10-05T15:36:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 Processor -- start 2023-10-05T15:36:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 -- start start 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 0x7f1d481990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d48101940 0x7f1d48199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d48106f90 0x7f1d4819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819e080 con 0x7f1d48100f80 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819e1f0 con 0x7f1d48101940 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.235+0000 7f1d4d1ee700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4819e3b0 con 0x7f1d48106f90 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 0x7f1d481990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 0x7f1d481990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35946/0 (socket says 172.21.15.17:35946) 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 -- 172.21.15.17:0/4267104122 learned_addr learned my addr 172.21.15.17:0/4267104122 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d4659c700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d48101940 0x7f1d48199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d4759e700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d48106f90 0x7f1d4819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 -- 172.21.15.17:0/4267104122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d48106f90 msgr2=0x7f1d4819da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d48106f90 0x7f1d4819da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 -- 172.21.15.17:0/4267104122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d48101940 msgr2=0x7f1d48199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d48101940 0x7f1d48199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 -- 172.21.15.17:0/4267104122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380095f0 con 0x7f1d48100f80 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.236+0000 7f1d46d9d700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 0x7f1d481990c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005910 tx=0x7f1d3800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.237+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3801d070 con 0x7f1d48100f80 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.237+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d380054e0 con 0x7f1d48100f80 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.237+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4819e630 con 0x7f1d48100f80 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.237+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004a70 con 0x7f1d48100f80 2023-10-05T15:36:39.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.237+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d481a5ef0 con 0x7f1d48100f80 2023-10-05T15:36:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.238+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4804ebb0 con 0x7f1d48100f80 2023-10-05T15:36:39.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.240+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1d3800fb80 con 0x7f1d48100f80 2023-10-05T15:36:39.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.241+0000 7f1d2ffff700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d300a1480 0x7f1d300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:39.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.241+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1d380ce330 con 0x7f1d48100f80 2023-10-05T15:36:39.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.242+0000 7f1d4659c700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d300a1480 0x7f1d300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:39.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.242+0000 7f1d4659c700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d300a1480 0x7f1d300a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d4819a6e0 tx=0x7f1d3c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:39.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.244+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d38097620 con 0x7f1d48100f80 2023-10-05T15:36:39.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.500+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d48110d50 con 0x7f1d48100f80 2023-10-05T15:36:39.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.500+0000 7f1d2ffff700 1 -- 172.21.15.17:0/4267104122 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1d380a1070 con 0x7f1d48100f80 2023-10-05T15:36:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-05T15:36:39.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d300a1480 msgr2=0x7f1d300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:39.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d300a1480 0x7f1d300a3940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d4819a6e0 tx=0x7f1d3c009260 comp rx=0 tx=0).stop 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 msgr2=0x7f1d481990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 0x7f1d481990c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1d38005910 tx=0x7f1d3800f690 comp rx=0 tx=0).stop 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 shutdown_connections 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1d300a1480 0x7f1d300a3940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d48106f90 0x7f1d4819da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d48100f80 0x7f1d481990c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 --2- 172.21.15.17:0/4267104122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d48101940 0x7f1d48199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 >> 172.21.15.17:0/4267104122 conn(0x7f1d480780a0 msgr2=0x7f1d4810c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 shutdown_connections 2023-10-05T15:36:39.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:39.503+0000 7f1d4d1ee700 1 -- 172.21.15.17:0/4267104122 wait complete. 2023-10-05T15:36:39.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:39 smithi017 ceph-mon[129107]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:36:39.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:39 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4267104122' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:36:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:39 smithi167 ceph-mon[133366]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:36:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:39 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4267104122' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:36:40.089 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-05T15:36:40.089 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-05T15:36:40.089 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-10-05T15:36:40.089 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-05T15:36:40.090 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-10-05T15:36:40.090 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-05T15:36:40.090 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-05T15:36:40.090 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-05T15:36:40.090 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-10-05T15:36:40.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.090 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-10-05T15:36:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:39 smithi079 ceph-mon[132936]: pgmap v371: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:36:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:39 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4267104122' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-05T15:36:40.135 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-05T15:36:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-05T15:36:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-05T15:36:40.136 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41417sec preferred_lft 41417sec 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-10-05T15:36:40.137 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-10-05T15:36:40.138 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-05T15:36:40.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.138 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:36:40.138 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:36:40.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2023-10-05T15:36:40.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2023-10-05T15:36:40.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2023-10-05T15:36:40.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-05T15:36:40.139 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:36:40.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.386 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-05T15:36:40.456 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-10-05T15:36:40.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.459 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-10-05T15:36:40.505 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-10-05T15:36:40.505 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-05T15:36:40.505 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-05T15:36:40.505 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-05T15:36:40.506 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-05T15:36:40.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.507 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:36:40.507 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:36:40.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-05T15:36:40.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-05T15:36:40.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-05T15:36:40.507 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:36:40.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.726 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-05T15:36:40.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.770 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-10-05T15:36:40.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:40.853 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:36:40.853 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:36:40.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--tmp-cephfs 2023-10-05T15:36:40.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-10-05T15:36:40.853 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:36:41.038 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-10-05T15:36:41.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:41.038 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:36:41.038 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:36:41.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-10-05T15:36:41.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-05T15:36:41.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-10-05T15:36:41.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-10-05T15:36:41.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-10-05T15:36:41.039 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:36:41.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:41.291 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-10-05T15:36:41.291 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-10-05T15:36:41.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-10-05T15:36:41.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2023-10-05T15:36:41.292 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-10-05T15:36:41.466 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-10-05T15:36:41.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:36:41.467 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /tmp/cephfs 2023-10-05T15:36:41.509 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/tmp/cephfs' 2023-10-05T15:36:41.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-05T15:36:41.510 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /tmp/cephfs 2023-10-05T15:36:41.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-05T15:36:41.704 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:36:41.749 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-05T15:36:41.749 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-05T15:36:41.749 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-05T15:36:41.749 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-05T15:36:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-05T15:36:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-05T15:36:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-05T15:36:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-05T15:36:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:36:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:36:41.751 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:36:41.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-05T15:36:41.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:36:41.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:36:41.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-05T15:36:41.752 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-05T15:36:41.752 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-05T15:36:41.753 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/844e2e1cf7cbbaadff459e8c490941f49791e984ab9d08c68fefadb92eb56fd5/merged 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f26d934ff165d2d8f08bc13a1bb380f64710008973b65cd20fd136d72d79941/merged 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2023-10-05T15:36:41.754 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e0f2eed055c9895a521f82801cf2a667bff17bc656e138c3379d6ed468d78133/merged 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9be3e5d6344e2e4a4cf3d94afe2d455f685263f059debc6b3aa60a8b03b95fbf/merged 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1841cc43b5c02ed336004a285bc3b0a941ae60fc17f1f076bc200b683fd80e36/merged 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/79af702143b594ecf321ba24f4f7a6f4196cc60e53ed84dee44474e932429553/merged 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4d13a7fedd1588db55c7a8851b2a139134edbea1a2f5fa3a5d66dd8a3a524ecb/merged 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d5a9a02959068cde6bb495591b6405f1e936ff1179479d8ec98147cdac325c72/merged 2023-10-05T15:36:41.755 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f031ec6604972aa69c006752d8c5a3c0b6ef564d927be013ae502379e546ecc/merged 2023-10-05T15:36:41.756 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/340d4b0b524319c56f65d01e28de1e6e20dd60a506598c7dfa05ab69641c71fe/merged 2023-10-05T15:36:41.756 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-05T15:36:41.756 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-05T15:36:41.756 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-05T15:36:41.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:41.757 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-05T15:36:41.841 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-05T15:36:41.841 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/bdad900e-df50-4874-b7b8-b1053796183f --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2023-10-05T15:36:41.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-10-05T15:36:41.944 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:41 smithi017 ceph-mon[129107]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:36:41.958 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2023-10-05T15:36:42.005 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2023-10-05T15:36:42.005 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2023-10-05T15:36:42.005 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2023-10-05T15:36:42.005 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2023-10-05T15:36:42.006 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2023-10-05T15:36:42.006 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2023-10-05T15:36:42.006 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2023-10-05T15:36:42.006 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2023-10-05T15:36:42.006 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/systemd 2023-10-05T15:36:42.006 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/perf_event 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/freezer 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/pids 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/devices 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/blkio 2023-10-05T15:36:42.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpuset 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/memory 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/hugetlb 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2023-10-05T15:36:42.008 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2023-10-05T15:36:42.009 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/844e2e1cf7cbbaadff459e8c490941f49791e984ab9d08c68fefadb92eb56fd5/merged 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f26d934ff165d2d8f08bc13a1bb380f64710008973b65cd20fd136d72d79941/merged 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2023-10-05T15:36:42.010 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/e0f2eed055c9895a521f82801cf2a667bff17bc656e138c3379d6ed468d78133/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9be3e5d6344e2e4a4cf3d94afe2d455f685263f059debc6b3aa60a8b03b95fbf/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/1841cc43b5c02ed336004a285bc3b0a941ae60fc17f1f076bc200b683fd80e36/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/79af702143b594ecf321ba24f4f7a6f4196cc60e53ed84dee44474e932429553/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4d13a7fedd1588db55c7a8851b2a139134edbea1a2f5fa3a5d66dd8a3a524ecb/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d5a9a02959068cde6bb495591b6405f1e936ff1179479d8ec98147cdac325c72/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9f031ec6604972aa69c006752d8c5a3c0b6ef564d927be013ae502379e546ecc/merged 2023-10-05T15:36:42.011 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/340d4b0b524319c56f65d01e28de1e6e20dd60a506598c7dfa05ab69641c71fe/merged 2023-10-05T15:36:42.012 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2023-10-05T15:36:42.012 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-05T15:36:42.012 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-05T15:36:42.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:42.013 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-10-05T15:36:42.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2023-10-05T15:36:42.060+0000 7f66571d55c0 -1 init, newargv = 0x5584c94ed4d0 newargc=17 2023-10-05T15:36:42.062 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[196675]: starting ceph client 2023-10-05T15:36:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:41 smithi167 ceph-mon[133366]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:36:42.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[196675]: starting fuse 2023-10-05T15:36:42.103 INFO:teuthology.orchestra.run.smithi017.stdout:121 2023-10-05T15:36:42.104 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-10-05T15:36:42.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2023-10-05T15:36:42.104 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2023-10-05T15:36:42.104 DEBUG:teuthology.orchestra.run.smithi017:> import re 2023-10-05T15:36:42.104 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/tmp/cephfs" 2023-10-05T15:36:42.105 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-05T15:36:42.106 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> return f 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> 2023-10-05T15:36:42.107 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2023-10-05T15:36:42.108 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-10-05T15:36:42.108 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:41 smithi079 ceph-mon[132936]: pgmap v372: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-10-05T15:36:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.196675.asok 2023-10-05T15:36:42.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-05T15:36:42.302 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.196675.asok 2023-10-05T15:36:42.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:42.302 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.196675.asok status 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "689b3d5ae1ed3e8efe9a65281cd9bd422749e95f", 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev)", 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/tmp/cephfs", 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "196675", 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/volumes/_nogroup/sv_0/bdad900e-df50-4874-b7b8-b1053796183f" 2023-10-05T15:36:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 15570, 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 15570 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-05T15:36:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3740032119 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3740032119 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.15570 192.168.0.1:0/3740032119", 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/3740032119", 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 5, 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 27, 2023-10-05T15:36:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 94, 2023-10-05T15:36:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2023-10-05T15:36:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2023-10-05T15:36:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2023-10-05T15:36:42.536 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:42.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:42.547 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2023-10-05T15:36:42.547 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /tmp/cephfs 2023-10-05T15:36:42.591 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2023-10-05T15:36:42.592 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-10-05T15:36:42.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:36:42.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /tmp/cephfs 2023-10-05T15:36:42.703 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-05T15:36:42.714 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-05T15:36:42.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 -- 172.21.15.17:0/977850719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102080 msgr2=0x7f9f50102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 --2- 172.21.15.17:0/977850719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102080 0x7f9f50102500 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009990 tx=0x7f9f44009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 -- 172.21.15.17:0/977850719 shutdown_connections 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 --2- 172.21.15.17:0/977850719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f50102a40 0x7f9f50109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 --2- 172.21.15.17:0/977850719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f50100ea0 0x7f9f501012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 --2- 172.21.15.17:0/977850719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102080 0x7f9f50102500 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:42.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 -- 172.21.15.17:0/977850719 >> 172.21.15.17:0/977850719 conn(0x7f9f500fc420 msgr2=0x7f9f500fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:42.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 -- 172.21.15.17:0/977850719 shutdown_connections 2023-10-05T15:36:42.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.960+0000 7f9f569ff700 1 -- 172.21.15.17:0/977850719 wait complete. 2023-10-05T15:36:42.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.961+0000 7f9f569ff700 1 Processor -- start 2023-10-05T15:36:42.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.961+0000 7f9f569ff700 1 -- start start 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.961+0000 7f9f569ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f50100ea0 0x7f9f50074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.961+0000 7f9f569ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f50102080 0x7f9f500732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f569ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 0x7f9f500737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f569ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50073f80 con 0x7f9f50102a40 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f569ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500740f0 con 0x7f9f50102080 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f569ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f501a0bc0 con 0x7f9f50100ea0 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 0x7f9f500737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 0x7f9f500737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35970/0 (socket says 172.21.15.17:35970) 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 -- 172.21.15.17:0/3743857938 learned_addr learned my addr 172.21.15.17:0/3743857938 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f4ffff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f50100ea0 0x7f9f50074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:42.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f4f7fe700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f50102080 0x7f9f500732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 -- 172.21.15.17:0/3743857938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f50100ea0 msgr2=0x7f9f50074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f50100ea0 0x7f9f50074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 -- 172.21.15.17:0/3743857938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f50102080 msgr2=0x7f9f500732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f50102080 0x7f9f500732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.962+0000 7f9f54f9c700 1 -- 172.21.15.17:0/3743857938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440095f0 con 0x7f9f50102a40 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.963+0000 7f9f54f9c700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 0x7f9f500737e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800ef30 tx=0x7f9f4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.963+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48018070 con 0x7f9f50102a40 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.963+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f501a0e40 con 0x7f9f50102a40 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.963+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f4800f040 con 0x7f9f50102a40 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.963+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800cbc0 con 0x7f9f50102a40 2023-10-05T15:36:42.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.963+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f501a1270 con 0x7f9f50102a40 2023-10-05T15:36:42.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.964+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5010c610 con 0x7f9f50102a40 2023-10-05T15:36:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.966+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9f4800cd80 con 0x7f9f50102a40 2023-10-05T15:36:42.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.968+0000 7f9f4d7fa700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9f380a14d0 0x7f9f380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:42.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.968+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9f480ccbc0 con 0x7f9f50102a40 2023-10-05T15:36:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.968+0000 7f9f4ffff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9f380a14d0 0x7f9f380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.969+0000 7f9f4ffff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9f380a14d0 0x7f9f380a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9f50101bf0 tx=0x7f9f40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:42.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:42.972+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f48095eb0 con 0x7f9f50102a40 2023-10-05T15:36:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.188+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f50107f10 con 0x7f9f50102a40 2023-10-05T15:36:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.189+0000 7f9f4d7fa700 1 -- 172.21.15.17:0/3743857938 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7f9f480994d0 con 0x7f9f50102a40 2023-10-05T15:36:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:43.192 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9f380a14d0 msgr2=0x7f9f380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9f380a14d0 0x7f9f380a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9f50101bf0 tx=0x7f9f40009260 comp rx=0 tx=0).stop 2023-10-05T15:36:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 msgr2=0x7f9f500737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 0x7f9f500737e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800ef30 tx=0x7f9f4800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 shutdown_connections 2023-10-05T15:36:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9f380a14d0 0x7f9f380a3990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f50102a40 0x7f9f500737e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f50100ea0 0x7f9f50074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 --2- 172.21.15.17:0/3743857938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f50102080 0x7f9f500732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 >> 172.21.15.17:0/3743857938 conn(0x7f9f500fc420 msgr2=0x7f9f500fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 shutdown_connections 2023-10-05T15:36:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.192+0000 7f9f569ff700 1 -- 172.21.15.17:0/3743857938 wait complete. 2023-10-05T15:36:43.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:36:43.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:36:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 -- 172.21.15.17:0/1902924811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898102080 msgr2=0x7f9898102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 --2- 172.21.15.17:0/1902924811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898102080 0x7f9898102500 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f988c009990 tx=0x7f988c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 -- 172.21.15.17:0/1902924811 shutdown_connections 2023-10-05T15:36:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 --2- 172.21.15.17:0/1902924811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9898102a40 0x7f9898109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 --2- 172.21.15.17:0/1902924811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9898100ea0 0x7f98981012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 --2- 172.21.15.17:0/1902924811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898102080 0x7f9898102500 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 -- 172.21.15.17:0/1902924811 >> 172.21.15.17:0/1902924811 conn(0x7f98980fc460 msgr2=0x7f98980fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 -- 172.21.15.17:0/1902924811 shutdown_connections 2023-10-05T15:36:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.417+0000 7f989d1ff700 1 -- 172.21.15.17:0/1902924811 wait complete. 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.418+0000 7f989d1ff700 1 Processor -- start 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.418+0000 7f989d1ff700 1 -- start start 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989d1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 0x7f9898074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989d1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9898102080 0x7f98980732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989d1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9898102a40 0x7f98980737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989d1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898073f80 con 0x7f9898100ea0 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989d1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980740f0 con 0x7f9898102a40 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989d1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98981a0bc0 con 0x7f9898102080 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 0x7f9898074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 0x7f9898074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35978/0 (socket says 172.21.15.17:35978) 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 -- 172.21.15.17:0/3568606182 learned_addr learned my addr 172.21.15.17:0/3568606182 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989659c700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9898102080 0x7f98980732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f989759e700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9898102a40 0x7f98980737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 -- 172.21.15.17:0/3568606182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9898102080 msgr2=0x7f98980732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9898102080 0x7f98980732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 -- 172.21.15.17:0/3568606182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9898102a40 msgr2=0x7f98980737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9898102a40 0x7f98980737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.419+0000 7f9896d9d700 1 -- 172.21.15.17:0/3568606182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0095f0 con 0x7f9898100ea0 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.420+0000 7f9896d9d700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 0x7f9898074c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f988800e970 tx=0x7f988800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.420+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888009790 con 0x7f9898100ea0 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.420+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f988800c7e0 con 0x7f9898100ea0 2023-10-05T15:36:43.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.420+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98981a0ea0 con 0x7f9898100ea0 2023-10-05T15:36:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.420+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888003bd0 con 0x7f9898100ea0 2023-10-05T15:36:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.420+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981a12d0 con 0x7f9898100ea0 2023-10-05T15:36:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.421+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9898107f90 con 0x7f9898100ea0 2023-10-05T15:36:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.423+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f988800c950 con 0x7f9898100ea0 2023-10-05T15:36:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.424+0000 7f987ffff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98800a1500 0x7f98800a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.425+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9888014070 con 0x7f9898100ea0 2023-10-05T15:36:43.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.425+0000 7f989659c700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98800a1500 0x7f98800a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.425+0000 7f989659c700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98800a1500 0x7f98800a39c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f988c0098e0 tx=0x7f988c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.426+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9888096610 con 0x7f9898100ea0 2023-10-05T15:36:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.641+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98980008d0 con 0x7f9898100ea0 2023-10-05T15:36:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.641+0000 7f987ffff700 1 -- 172.21.15.17:0/3568606182 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9888099c30 con 0x7f9898100ea0 2023-10-05T15:36:43.643 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:36:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.643+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98800a1500 msgr2=0x7f98800a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98800a1500 0x7f98800a39c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f988c0098e0 tx=0x7f988c00b260 comp rx=0 tx=0).stop 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 msgr2=0x7f9898074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 0x7f9898074c60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f988800e970 tx=0x7f988800ec80 comp rx=0 tx=0).stop 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 shutdown_connections 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98800a1500 0x7f98800a39c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9898102a40 0x7f98980737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9898100ea0 0x7f9898074c60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 --2- 172.21.15.17:0/3568606182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9898102080 0x7f98980732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 >> 172.21.15.17:0/3568606182 conn(0x7f98980fc460 msgr2=0x7f98980fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 shutdown_connections 2023-10-05T15:36:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.644+0000 7f989d1ff700 1 -- 172.21.15.17:0/3568606182 wait complete. 2023-10-05T15:36:43.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:43.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 -- 172.21.15.17:0/231014614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 msgr2=0x7f65d81024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/231014614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81024f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009990 tx=0x7f65c0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 -- 172.21.15.17:0/231014614 shutdown_connections 2023-10-05T15:36:43.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/231014614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8102a30 0x7f65d8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/231014614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d8100e90 0x7f65d81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/231014614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81024f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 -- 172.21.15.17:0/231014614 >> 172.21.15.17:0/231014614 conn(0x7f65d80fc430 msgr2=0x7f65d80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:43.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 -- 172.21.15.17:0/231014614 shutdown_connections 2023-10-05T15:36:43.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.868+0000 7f65dd5ff700 1 -- 172.21.15.17:0/231014614 wait complete. 2023-10-05T15:36:43.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 Processor -- start 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 -- start start 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8100e90 0x7f65d8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d8102a30 0x7f65d81a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d81a08e0 con 0x7f65d8102070 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d81a0a20 con 0x7f65d8102a30 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.869+0000 7f65dd5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d81a0bb0 con 0x7f65d8100e90 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54126/0 (socket says 172.21.15.17:54126) 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 -- 172.21.15.17:0/188175221 learned_addr learned my addr 172.21.15.17:0/188175221 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:43.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65d6ffd700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8100e90 0x7f65d8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65d77fe700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d8102a30 0x7f65d81a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 -- 172.21.15.17:0/188175221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8100e90 msgr2=0x7f65d8198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8100e90 0x7f65d8198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 -- 172.21.15.17:0/188175221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d8102a30 msgr2=0x7f65d81a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d8102a30 0x7f65d81a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 -- 172.21.15.17:0/188175221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00095f0 con 0x7f65d8102070 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65d6ffd700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8100e90 0x7f65d8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.870+0000 7f65cffff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81992a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f65c00098e0 tx=0x7f65c0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.871+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c001d070 con 0x7f65d8102070 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.871+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65c000f460 con 0x7f65d8102070 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.871+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d81a0e30 con 0x7f65d8102070 2023-10-05T15:36:43.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.871+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0021670 con 0x7f65d8102070 2023-10-05T15:36:43.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.871+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d81a11a0 con 0x7f65d8102070 2023-10-05T15:36:43.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.872+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d81933f0 con 0x7f65d8102070 2023-10-05T15:36:43.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.874+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f65c000f5d0 con 0x7f65d8102070 2023-10-05T15:36:43.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.875+0000 7f65d4ff9700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f65c40a1480 0x7f65c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:43.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.875+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f65c00ce580 con 0x7f65d8102070 2023-10-05T15:36:43.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.875+0000 7f65d6ffd700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f65c40a1480 0x7f65c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:43.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.876+0000 7f65d6ffd700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f65c40a1480 0x7f65c40a3940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f65d8101be0 tx=0x7f65c8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:43.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:43.877+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f65c0097870 con 0x7f65d8102070 2023-10-05T15:36:43.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:43 smithi017 ceph-mon[129107]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:43.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:43 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3743857938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:43 smithi167 ceph-mon[133366]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:43 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3743857938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.088+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65d802d020 con 0x7f65d8102070 2023-10-05T15:36:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.089+0000 7f65d4ff9700 1 -- 172.21.15.17:0/188175221 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65c009ae90 con 0x7f65d8102070 2023-10-05T15:36:44.090 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f65c40a1480 msgr2=0x7f65c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f65c40a1480 0x7f65c40a3940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f65d8101be0 tx=0x7f65c8009260 comp rx=0 tx=0).stop 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 msgr2=0x7f65d81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81992a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f65c00098e0 tx=0x7f65c0005ef0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 shutdown_connections 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f65c40a1480 0x7f65c40a3940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65d8102a30 0x7f65d81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65d8100e90 0x7f65d8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 --2- 172.21.15.17:0/188175221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65d8102070 0x7f65d81992a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 >> 172.21.15.17:0/188175221 conn(0x7f65d80fc430 msgr2=0x7f65d8107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 shutdown_connections 2023-10-05T15:36:44.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.091+0000 7f65dd5ff700 1 -- 172.21.15.17:0/188175221 wait complete. 2023-10-05T15:36:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:43 smithi079 ceph-mon[132936]: pgmap v373: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:36:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:43 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3743857938' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:44.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 -- 172.21.15.17:0/3965592323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8102080 msgr2=0x7f9fc8102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/3965592323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8102080 0x7f9fc8102500 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009990 tx=0x7f9fb8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 -- 172.21.15.17:0/3965592323 shutdown_connections 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/3965592323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 0x7f9fc8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/3965592323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fc8100ea0 0x7f9fc81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/3965592323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8102080 0x7f9fc8102500 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 -- 172.21.15.17:0/3965592323 >> 172.21.15.17:0/3965592323 conn(0x7f9fc80fc460 msgr2=0x7f9fc80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 -- 172.21.15.17:0/3965592323 shutdown_connections 2023-10-05T15:36:44.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.315+0000 7f9fcfbff700 1 -- 172.21.15.17:0/3965592323 wait complete. 2023-10-05T15:36:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.316+0000 7f9fcfbff700 1 Processor -- start 2023-10-05T15:36:44.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 -- start start 2023-10-05T15:36:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 0x7f9fc8196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fc8102080 0x7f9fc8197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 0x7f9fc819e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc819e660 con 0x7f9fc8100ea0 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc819e7a0 con 0x7f9fc8102080 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcfbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc819e930 con 0x7f9fc8102a40 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcd99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 0x7f9fc8196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcd99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 0x7f9fc8196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54146/0 (socket says 172.21.15.17:54146) 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.317+0000 7f9fcd99b700 1 -- 172.21.15.17:0/1867715280 learned_addr learned my addr 172.21.15.17:0/1867715280 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd19a700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fc8102080 0x7f9fc8197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fce19c700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 0x7f9fc819e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd99b700 1 -- 172.21.15.17:0/1867715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 msgr2=0x7f9fc819e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd99b700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 0x7f9fc819e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd99b700 1 -- 172.21.15.17:0/1867715280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fc8102080 msgr2=0x7f9fc8197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd99b700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fc8102080 0x7f9fc8197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd99b700 1 -- 172.21.15.17:0/1867715280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80095f0 con 0x7f9fc8100ea0 2023-10-05T15:36:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fce19c700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 0x7f9fc819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:44.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcd99b700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 0x7f9fc8196ae0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400d980 tx=0x7f9fc400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400bb60 con 0x7f9fc8100ea0 2023-10-05T15:36:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fc4007620 con 0x7f9fc8100ea0 2023-10-05T15:36:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400f3c0 con 0x7f9fc8100ea0 2023-10-05T15:36:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.318+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc819ec10 con 0x7f9fc8100ea0 2023-10-05T15:36:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.319+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc819f0d0 con 0x7f9fc8100ea0 2023-10-05T15:36:44.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.320+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc8107f00 con 0x7f9fc8100ea0 2023-10-05T15:36:44.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.321+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9fc4010460 con 0x7f9fc8100ea0 2023-10-05T15:36:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.323+0000 7f9fbeffd700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9fb40a1500 0x7f9fb40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.323+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9fc40cd380 con 0x7f9fc8100ea0 2023-10-05T15:36:44.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.323+0000 7f9fcd19a700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9fb40a1500 0x7f9fb40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.324+0000 7f9fcd19a700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9fb40a1500 0x7f9fb40a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800b5c0 tx=0x7f9fb8005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:44.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.327+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9fc40965e0 con 0x7f9fc8100ea0 2023-10-05T15:36:44.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.540+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fc802d020 con 0x7f9fc8100ea0 2023-10-05T15:36:44.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.540+0000 7f9fbeffd700 1 -- 172.21.15.17:0/1867715280 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fc4099c00 con 0x7f9fc8100ea0 2023-10-05T15:36:44.542 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:44.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9fb40a1500 msgr2=0x7f9fb40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9fb40a1500 0x7f9fb40a39c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800b5c0 tx=0x7f9fb8005fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 msgr2=0x7f9fc8196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 0x7f9fc8196ae0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400d980 tx=0x7f9fc400dd40 comp rx=0 tx=0).stop 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 shutdown_connections 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9fb40a1500 0x7f9fb40a39c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fc8102a40 0x7f9fc819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fc8100ea0 0x7f9fc8196ae0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 --2- 172.21.15.17:0/1867715280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fc8102080 0x7f9fc8197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 >> 172.21.15.17:0/1867715280 conn(0x7f9fc80fc460 msgr2=0x7f9fc80fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:44.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 shutdown_connections 2023-10-05T15:36:44.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.543+0000 7f9fcfbff700 1 -- 172.21.15.17:0/1867715280 wait complete. 2023-10-05T15:36:44.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.771+0000 7fd8729ff700 1 -- 172.21.15.17:0/3324440205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c108db0 msgr2=0x7fd86c10b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.771+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3324440205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c108db0 0x7fd86c10b240 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd86400b0a0 tx=0x7fd86400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 -- 172.21.15.17:0/3324440205 shutdown_connections 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3324440205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c108db0 0x7fd86c10b240 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3324440205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c074ef0 0x7fd86c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3324440205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86c073910 0x7fd86c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 -- 172.21.15.17:0/3324440205 >> 172.21.15.17:0/3324440205 conn(0x7fd86c0fc460 msgr2=0x7fd86c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:44.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 -- 172.21.15.17:0/3324440205 shutdown_connections 2023-10-05T15:36:44.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.772+0000 7fd8729ff700 1 -- 172.21.15.17:0/3324440205 wait complete. 2023-10-05T15:36:44.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 Processor -- start 2023-10-05T15:36:44.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 -- start start 2023-10-05T15:36:44.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86c073910 0x7fd86c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 0x7fd86c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c108db0 0x7fd86c1a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1a0970 con 0x7fd86c074ef0 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1a0ab0 con 0x7fd86c108db0 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd8729ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1a0c40 con 0x7fd86c073910 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd86b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 0x7fd86c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd86b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 0x7fd86c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54164/0 (socket says 172.21.15.17:54164) 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd86b7fe700 1 -- 172.21.15.17:0/3663471111 learned_addr learned my addr 172.21.15.17:0/3663471111 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd870f9c700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c108db0 0x7fd86c1a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.773+0000 7fd86bfff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86c073910 0x7fd86c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd86b7fe700 1 -- 172.21.15.17:0/3663471111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86c073910 msgr2=0x7fd86c198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd86b7fe700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86c073910 0x7fd86c198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd86b7fe700 1 -- 172.21.15.17:0/3663471111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c108db0 msgr2=0x7fd86c1a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd86b7fe700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c108db0 0x7fd86c1a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:44.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd86b7fe700 1 -- 172.21.15.17:0/3663471111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864009d00 con 0x7fd86c074ef0 2023-10-05T15:36:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd86b7fe700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 0x7fd86c199330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd86000d980 tx=0x7fd86000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860004020 con 0x7fd86c074ef0 2023-10-05T15:36:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd86000f690 con 0x7fd86c074ef0 2023-10-05T15:36:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600039e0 con 0x7fd86c074ef0 2023-10-05T15:36:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c1a0f20 con 0x7fd86c074ef0 2023-10-05T15:36:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.774+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c1a1350 con 0x7fd86c074ef0 2023-10-05T15:36:44.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.776+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c107460 con 0x7fd86c074ef0 2023-10-05T15:36:44.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.777+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd86000f800 con 0x7fd86c074ef0 2023-10-05T15:36:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.779+0000 7fd8697fa700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8540a1500 0x7fd8540a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.779+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd8600ccc40 con 0x7fd86c074ef0 2023-10-05T15:36:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.779+0000 7fd86bfff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8540a1500 0x7fd8540a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:44.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.780+0000 7fd86bfff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8540a1500 0x7fd8540a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd85c005950 tx=0x7fd85c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.783+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd860095ea0 con 0x7fd86c074ef0 2023-10-05T15:36:44.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:44 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3568606182' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:44.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:44 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/188175221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:44.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:44 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1867715280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.995+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd86c02d090 con 0x7fd86c074ef0 2023-10-05T15:36:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.996+0000 7fd8697fa700 1 -- 172.21.15.17:0/3663471111 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd8600994c0 con 0x7fd86c074ef0 2023-10-05T15:36:44.998 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8540a1500 msgr2=0x7fd8540a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8540a1500 0x7fd8540a39c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd85c005950 tx=0x7fd85c00b410 comp rx=0 tx=0).stop 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 msgr2=0x7fd86c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 0x7fd86c199330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd86000d980 tx=0x7fd86000dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 shutdown_connections 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd8540a1500 0x7fd8540a39c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c108db0 0x7fd86c1a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd86c073910 0x7fd86c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 --2- 172.21.15.17:0/3663471111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86c074ef0 0x7fd86c199330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.998+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 >> 172.21.15.17:0/3663471111 conn(0x7fd86c0fc460 msgr2=0x7fd86c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.999+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 shutdown_connections 2023-10-05T15:36:45.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:44.999+0000 7fd8729ff700 1 -- 172.21.15.17:0/3663471111 wait complete. 2023-10-05T15:36:45.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:44 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3568606182' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:44 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/188175221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:44 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1867715280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:44 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3568606182' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:44 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/188175221' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:44 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1867715280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.219+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2363600446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 msgr2=0x7f3dd0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.219+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2363600446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd0073340 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009990 tx=0x7f3dcc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.219+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2363600446 shutdown_connections 2023-10-05T15:36:45.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.219+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2363600446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd0108db0 0x7f3dd010b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.219+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2363600446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd0073340 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.219+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2363600446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dd0073910 0x7f3dd0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.220+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2363600446 >> 172.21.15.17:0/2363600446 conn(0x7f3dd00fc420 msgr2=0x7f3dd00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.220+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2363600446 shutdown_connections 2023-10-05T15:36:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.220+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2363600446 wait complete. 2023-10-05T15:36:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.221+0000 7f3dd7bff700 1 Processor -- start 2023-10-05T15:36:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.221+0000 7f3dd7bff700 1 -- start start 2023-10-05T15:36:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd7bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dd0073910 0x7f3dd0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd7bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd7bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd0108db0 0x7f3dd01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd7bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01a08e0 con 0x7f3dd0074ef0 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd7bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01a0a20 con 0x7f3dd0073910 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd7bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01a0bb0 con 0x7f3dd0108db0 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd01992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54182/0 (socket says 172.21.15.17:54182) 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 -- 172.21.15.17:0/2113340839 learned_addr learned my addr 172.21.15.17:0/2113340839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd599b700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dd0073910 0x7f3dd0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd619c700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd0108db0 0x7f3dd01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 -- 172.21.15.17:0/2113340839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd0108db0 msgr2=0x7f3dd01a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd0108db0 0x7f3dd01a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 -- 172.21.15.17:0/2113340839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dd0073910 msgr2=0x7f3dd0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dd0073910 0x7f3dd0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.222+0000 7f3dd519a700 1 -- 172.21.15.17:0/2113340839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0095f0 con 0x7f3dd0074ef0 2023-10-05T15:36:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.223+0000 7f3dd519a700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd01992a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000e970 tx=0x7f3dc000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.223+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0009790 con 0x7f3dd0074ef0 2023-10-05T15:36:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.223+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd01a0e90 con 0x7f3dd0074ef0 2023-10-05T15:36:45.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.223+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3dc000eec0 con 0x7f3dd0074ef0 2023-10-05T15:36:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.223+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0003c10 con 0x7f3dd0074ef0 2023-10-05T15:36:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.223+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd01a1310 con 0x7f3dd0074ef0 2023-10-05T15:36:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.224+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd0107460 con 0x7f3dd0074ef0 2023-10-05T15:36:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.226+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3dc0004870 con 0x7f3dd0074ef0 2023-10-05T15:36:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.227+0000 7f3dc6ffd700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3dbc0a14d0 0x7f3dbc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.228+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3dc0014070 con 0x7f3dd0074ef0 2023-10-05T15:36:45.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.228+0000 7f3dd599b700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3dbc0a14d0 0x7f3dbc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.228+0000 7f3dd599b700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3dbc0a14d0 0x7f3dbc0a3990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc006010 tx=0x7f3dcc00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:45.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.229+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3dc00966e0 con 0x7f3dd0074ef0 2023-10-05T15:36:45.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.441+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dd010e7e0 con 0x7f3dd0074ef0 2023-10-05T15:36:45.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.443+0000 7f3dc6ffd700 1 -- 172.21.15.17:0/2113340839 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7f3dc0099d00 con 0x7f3dd0074ef0 2023-10-05T15:36:45.445 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:45.445 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:45.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.445+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3dbc0a14d0 msgr2=0x7f3dbc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.445+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3dbc0a14d0 0x7f3dbc0a3990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc006010 tx=0x7f3dcc00b260 comp rx=0 tx=0).stop 2023-10-05T15:36:45.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.445+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 msgr2=0x7f3dd01992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.445+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd01992a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000e970 tx=0x7f3dc000ec80 comp rx=0 tx=0).stop 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 shutdown_connections 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3dbc0a14d0 0x7f3dbc0a3990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dd0108db0 0x7f3dd01a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3dd0073910 0x7f3dd0198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 --2- 172.21.15.17:0/2113340839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dd0074ef0 0x7f3dd01992a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 >> 172.21.15.17:0/2113340839 conn(0x7f3dd00fc420 msgr2=0x7f3dd00fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 shutdown_connections 2023-10-05T15:36:45.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.446+0000 7f3dd7bff700 1 -- 172.21.15.17:0/2113340839 wait complete. 2023-10-05T15:36:45.466 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:36:45.467 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:36:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 -- 172.21.15.17:0/3610936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c100ea0 msgr2=0x7f210c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 --2- 172.21.15.17:0/3610936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c100ea0 0x7f210c1012c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009990 tx=0x7f20fc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 -- 172.21.15.17:0/3610936733 shutdown_connections 2023-10-05T15:36:45.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 --2- 172.21.15.17:0/3610936733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c102a40 0x7f210c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 --2- 172.21.15.17:0/3610936733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c100ea0 0x7f210c1012c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 --2- 172.21.15.17:0/3610936733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102080 0x7f210c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 -- 172.21.15.17:0/3610936733 >> 172.21.15.17:0/3610936733 conn(0x7f210c0fc460 msgr2=0x7f210c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 -- 172.21.15.17:0/3610936733 shutdown_connections 2023-10-05T15:36:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.671+0000 7f2110fff700 1 -- 172.21.15.17:0/3610936733 wait complete. 2023-10-05T15:36:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.673+0000 7f2110fff700 1 Processor -- start 2023-10-05T15:36:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.673+0000 7f2110fff700 1 -- start start 2023-10-05T15:36:45.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.673+0000 7f2110fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 0x7f210c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.673+0000 7f2110fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102080 0x7f210c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f2110fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c102a40 0x7f210c1a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f2110fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c1a0870 con 0x7f210c100ea0 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f2110fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c1a09e0 con 0x7f210c102a40 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f2110fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c1a0ba0 con 0x7f210c102080 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 0x7f210c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 0x7f210c198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54198/0 (socket says 172.21.15.17:54198) 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 -- 172.21.15.17:0/2261590248 learned_addr learned my addr 172.21.15.17:0/2261590248 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f2109d9b700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102080 0x7f210c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 -- 172.21.15.17:0/2261590248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102080 msgr2=0x7f210c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102080 0x7f210c199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 -- 172.21.15.17:0/2261590248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c102a40 msgr2=0x7f210c1a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c102a40 0x7f210c1a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 -- 172.21.15.17:0/2261590248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0095f0 con 0x7f210c100ea0 2023-10-05T15:36:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.674+0000 7f210a59c700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 0x7f210c198d30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f20fc005f50 tx=0x7f20fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.675+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc01d070 con 0x7f210c100ea0 2023-10-05T15:36:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.675+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c1a0e20 con 0x7f210c100ea0 2023-10-05T15:36:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.675+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20fc00be50 con 0x7f210c100ea0 2023-10-05T15:36:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.675+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc005280 con 0x7f210c100ea0 2023-10-05T15:36:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.675+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210c1a1190 con 0x7f210c100ea0 2023-10-05T15:36:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.676+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210c1933b0 con 0x7f210c100ea0 2023-10-05T15:36:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.678+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f20fc0054a0 con 0x7f210c100ea0 2023-10-05T15:36:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.680+0000 7f20fb7fe700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f20f40a1500 0x7f20f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.680+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f20fc0ce330 con 0x7f210c100ea0 2023-10-05T15:36:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.680+0000 7f2109d9b700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f20f40a1500 0x7f20f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.681+0000 7f2109d9b700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f20f40a1500 0x7f20f40a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f210c100bc0 tx=0x7f2100009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:45.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.684+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f20fc05c100 con 0x7f210c100ea0 2023-10-05T15:36:45.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.894+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f210c02d020 con 0x7f210c100ea0 2023-10-05T15:36:45.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.895+0000 7f20fb7fe700 1 -- 172.21.15.17:0/2261590248 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20fc0a1070 con 0x7f210c100ea0 2023-10-05T15:36:45.897 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:36:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f20f40a1500 msgr2=0x7f20f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f20f40a1500 0x7f20f40a39c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f210c100bc0 tx=0x7f2100009260 comp rx=0 tx=0).stop 2023-10-05T15:36:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 msgr2=0x7f210c198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 0x7f210c198d30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f20fc005f50 tx=0x7f20fc0047c0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 shutdown_connections 2023-10-05T15:36:45.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f20f40a1500 0x7f20f40a39c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f210c102a40 0x7f210c1a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f210c100ea0 0x7f210c198d30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 --2- 172.21.15.17:0/2261590248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c102080 0x7f210c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 >> 172.21.15.17:0/2261590248 conn(0x7f210c0fc460 msgr2=0x7f210c107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.897+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 shutdown_connections 2023-10-05T15:36:45.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:45.898+0000 7f2110fff700 1 -- 172.21.15.17:0/2261590248 wait complete. 2023-10-05T15:36:45.915 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:45 smithi017 ceph-mon[129107]: pgmap v374: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-05T15:36:45.915 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3663471111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:45.915 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2113340839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:45.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:45 smithi167 ceph-mon[133366]: pgmap v374: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-05T15:36:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3663471111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2113340839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:45 smithi079 ceph-mon[132936]: pgmap v374: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2023-10-05T15:36:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3663471111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2113340839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 -- 172.21.15.17:0/2921920361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 msgr2=0x7fa7841012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 --2- 172.21.15.17:0/2921920361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa7841012c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa774009990 tx=0x7fa774009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 -- 172.21.15.17:0/2921920361 shutdown_connections 2023-10-05T15:36:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 --2- 172.21.15.17:0/2921920361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784102a40 0x7fa784109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 --2- 172.21.15.17:0/2921920361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa7841012c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 --2- 172.21.15.17:0/2921920361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa784102080 0x7fa784102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 -- 172.21.15.17:0/2921920361 >> 172.21.15.17:0/2921920361 conn(0x7fa7840fc460 msgr2=0x7fa7840fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 -- 172.21.15.17:0/2921920361 shutdown_connections 2023-10-05T15:36:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.121+0000 7fa788bff700 1 -- 172.21.15.17:0/2921920361 wait complete. 2023-10-05T15:36:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 Processor -- start 2023-10-05T15:36:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 -- start start 2023-10-05T15:36:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa784074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa784102080 0x7fa7840732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784102a40 0x7fa7840737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa784073f80 con 0x7fa784100ea0 2023-10-05T15:36:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840740f0 con 0x7fa784102080 2023-10-05T15:36:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa788bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7841a0c50 con 0x7fa784102a40 2023-10-05T15:36:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.122+0000 7fa78259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa784074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa784074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54212/0 (socket says 172.21.15.17:54212) 2023-10-05T15:36:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 -- 172.21.15.17:0/450105858 learned_addr learned my addr 172.21.15.17:0/450105858 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:46.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 -- 172.21.15.17:0/450105858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784102a40 msgr2=0x7fa7840737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784102a40 0x7fa7840737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 -- 172.21.15.17:0/450105858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa784102080 msgr2=0x7fa7840732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa784102080 0x7fa7840732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 -- 172.21.15.17:0/450105858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740095f0 con 0x7fa784100ea0 2023-10-05T15:36:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa78259c700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa784074c60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa7740098e0 tx=0x7fa774005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77401d070 con 0x7fa784100ea0 2023-10-05T15:36:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa77400beb0 con 0x7fa784100ea0 2023-10-05T15:36:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7841a0ed0 con 0x7fa784100ea0 2023-10-05T15:36:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.123+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774021410 con 0x7fa784100ea0 2023-10-05T15:36:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.124+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7841a1290 con 0x7fa784100ea0 2023-10-05T15:36:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.125+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa784108610 con 0x7fa784100ea0 2023-10-05T15:36:46.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.126+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa77400ba20 con 0x7fa784100ea0 2023-10-05T15:36:46.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.128+0000 7fa7737fe700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa76c0a1480 0x7fa76c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.128+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa7740ce5b0 con 0x7fa784100ea0 2023-10-05T15:36:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.128+0000 7fa781d9b700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa76c0a1480 0x7fa76c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.129+0000 7fa781d9b700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa76c0a1480 0x7fa76c0a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa778005fd0 tx=0x7fa778005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:46.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.130+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa7740978a0 con 0x7fa784100ea0 2023-10-05T15:36:46.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.344+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa78402cf70 con 0x7fa784100ea0 2023-10-05T15:36:46.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.344+0000 7fa7737fe700 1 -- 172.21.15.17:0/450105858 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa774097030 con 0x7fa784100ea0 2023-10-05T15:36:46.346 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa76c0a1480 msgr2=0x7fa76c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa76c0a1480 0x7fa76c0a3940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa778005fd0 tx=0x7fa778005f60 comp rx=0 tx=0).stop 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 msgr2=0x7fa784074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa784074c60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa7740098e0 tx=0x7fa774005ef0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 shutdown_connections 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa76c0a1480 0x7fa76c0a3940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa784102a40 0x7fa7840737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa784100ea0 0x7fa784074c60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 --2- 172.21.15.17:0/450105858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa784102080 0x7fa7840732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 >> 172.21.15.17:0/450105858 conn(0x7fa7840fc460 msgr2=0x7fa784105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:46.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 shutdown_connections 2023-10-05T15:36:46.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.347+0000 7fa788bff700 1 -- 172.21.15.17:0/450105858 wait complete. 2023-10-05T15:36:46.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:46.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.571+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/1933895010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 msgr2=0x7f8b18073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.571+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/1933895010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18073d90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8b00009990 tx=0x7f8b00009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/1933895010 shutdown_connections 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/1933895010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 0x7f8b1810b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/1933895010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b18074ef0 0x7f8b18073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/1933895010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18073d90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/1933895010 >> 172.21.15.17:0/1933895010 conn(0x7f8b180fc430 msgr2=0x7f8b180fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/1933895010 shutdown_connections 2023-10-05T15:36:46.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.572+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/1933895010 wait complete. 2023-10-05T15:36:46.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 Processor -- start 2023-10-05T15:36:46.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 -- start start 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b18074ef0 0x7f8b18199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 0x7f8b181a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181a08d0 con 0x7f8b18073910 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181a0a10 con 0x7f8b18074ef0 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b1d1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b181a0ba0 con 0x7f8b18108da0 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b0ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b0ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54232/0 (socket says 172.21.15.17:54232) 2023-10-05T15:36:46.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.573+0000 7f8b0ed9d700 1 -- 172.21.15.17:0/2281572016 learned_addr learned my addr 172.21.15.17:0/2281572016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b16d9d700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b18074ef0 0x7f8b18199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b1759e700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 0x7f8b181a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b0ed9d700 1 -- 172.21.15.17:0/2281572016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 msgr2=0x7f8b181a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b0ed9d700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 0x7f8b181a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b0ed9d700 1 -- 172.21.15.17:0/2281572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b18074ef0 msgr2=0x7f8b18199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b0ed9d700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b18074ef0 0x7f8b18199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b0ed9d700 1 -- 172.21.15.17:0/2281572016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b000095f0 con 0x7f8b18073910 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b1759e700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 0x7f8b181a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b0ed9d700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18198d50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800d980 tx=0x7f8b0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08004220 con 0x7f8b18073910 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b08007640 con 0x7f8b18073910 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b181a0e80 con 0x7f8b18073910 2023-10-05T15:36:46.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.574+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080055e0 con 0x7f8b18073910 2023-10-05T15:36:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.575+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b181a12b0 con 0x7f8b18073910 2023-10-05T15:36:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.576+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b18107450 con 0x7f8b18073910 2023-10-05T15:36:46.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.577+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8b08004750 con 0x7f8b18073910 2023-10-05T15:36:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.579+0000 7f8b14d99700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b040a1500 0x7f8b040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.579+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8b080ccef0 con 0x7f8b18073910 2023-10-05T15:36:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.579+0000 7f8b16d9d700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b040a1500 0x7f8b040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:46.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.580+0000 7f8b16d9d700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b040a1500 0x7f8b040a39c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b000098e0 tx=0x7f8b0000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.583+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8b08096150 con 0x7f8b18073910 2023-10-05T15:36:46.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.799+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b180008d0 con 0x7f8b18073910 2023-10-05T15:36:46.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.799+0000 7f8b14d99700 1 -- 172.21.15.17:0/2281572016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b08016020 con 0x7f8b18073910 2023-10-05T15:36:46.801 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b040a1500 msgr2=0x7f8b040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b040a1500 0x7f8b040a39c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b000098e0 tx=0x7f8b0000b260 comp rx=0 tx=0).stop 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 msgr2=0x7f8b18198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18198d50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8b0800d980 tx=0x7f8b0800dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 shutdown_connections 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b040a1500 0x7f8b040a39c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b18108da0 0x7f8b181a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b18073910 0x7f8b18198d50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 --2- 172.21.15.17:0/2281572016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b18074ef0 0x7f8b18199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:46.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 >> 172.21.15.17:0/2281572016 conn(0x7f8b180fc430 msgr2=0x7f8b180fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 shutdown_connections 2023-10-05T15:36:46.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:46.802+0000 7f8b1d1ff700 1 -- 172.21.15.17:0/2281572016 wait complete. 2023-10-05T15:36:46.822 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:46.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:46 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2261590248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:46.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:46 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/450105858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 -- 172.21.15.17:0/2238029703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c100e90 msgr2=0x7fd80c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 --2- 172.21.15.17:0/2238029703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c100e90 0x7fd80c1012b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009990 tx=0x7fd7fc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 -- 172.21.15.17:0/2238029703 shutdown_connections 2023-10-05T15:36:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 --2- 172.21.15.17:0/2238029703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c102a30 0x7fd80c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 --2- 172.21.15.17:0/2238029703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c100e90 0x7fd80c1012b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 --2- 172.21.15.17:0/2238029703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80c102070 0x7fd80c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 -- 172.21.15.17:0/2238029703 >> 172.21.15.17:0/2238029703 conn(0x7fd80c0fc430 msgr2=0x7fd80c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 -- 172.21.15.17:0/2238029703 shutdown_connections 2023-10-05T15:36:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.026+0000 7fd8123ff700 1 -- 172.21.15.17:0/2238029703 wait complete. 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.027+0000 7fd8123ff700 1 Processor -- start 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.027+0000 7fd8123ff700 1 -- start start 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd8123ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c100e90 0x7fd80c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd8123ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 0x7fd80c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd8123ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80c102a30 0x7fd80c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd8123ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c073f80 con 0x7fd80c102070 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd8123ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0740f0 con 0x7fd80c100e90 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd8123ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1a0c70 con 0x7fd80c102a30 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 0x7fd80c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 0x7fd80c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54240/0 (socket says 172.21.15.17:54240) 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 -- 172.21.15.17:0/3835438427 learned_addr learned my addr 172.21.15.17:0/3835438427 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80bfff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c100e90 0x7fd80c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 -- 172.21.15.17:0/3835438427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80c102a30 msgr2=0x7fd80c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80c102a30 0x7fd80c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 -- 172.21.15.17:0/3835438427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c100e90 msgr2=0x7fd80c074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c100e90 0x7fd80c074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.028+0000 7fd80b7fe700 1 -- 172.21.15.17:0/3835438427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0095f0 con 0x7fd80c102070 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.029+0000 7fd80b7fe700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 0x7fd80c0732a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd80000d980 tx=0x7fd80000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.029+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800004020 con 0x7fd80c102070 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.029+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd800009730 con 0x7fd80c102070 2023-10-05T15:36:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.029+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c1a0f50 con 0x7fd80c102070 2023-10-05T15:36:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.029+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003a00 con 0x7fd80c102070 2023-10-05T15:36:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.029+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c1a1480 con 0x7fd80c102070 2023-10-05T15:36:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.030+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c1081f0 con 0x7fd80c102070 2023-10-05T15:36:47.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.032+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd8000098a0 con 0x7fd80c102070 2023-10-05T15:36:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.033+0000 7fd8097fa700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd7f40a1500 0x7fd7f40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.034+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd8000ccd40 con 0x7fd80c102070 2023-10-05T15:36:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.034+0000 7fd80bfff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd7f40a1500 0x7fd7f40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.034+0000 7fd80bfff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd7f40a1500 0x7fd7f40a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00b5c0 tx=0x7fd7fc005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:47.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.038+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd800095fa0 con 0x7fd80c102070 2023-10-05T15:36:47.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:46 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2261590248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:46 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/450105858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:46 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2261590248' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:46 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/450105858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.248+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd80c0008d0 con 0x7fd80c102070 2023-10-05T15:36:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.249+0000 7fd8097fa700 1 -- 172.21.15.17:0/3835438427 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd8000995c0 con 0x7fd80c102070 2023-10-05T15:36:47.251 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd7f40a1500 msgr2=0x7fd7f40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd7f40a1500 0x7fd7f40a39c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00b5c0 tx=0x7fd7fc005fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 msgr2=0x7fd80c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 0x7fd80c0732a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd80000d980 tx=0x7fd80000dc90 comp rx=0 tx=0).stop 2023-10-05T15:36:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 shutdown_connections 2023-10-05T15:36:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd7f40a1500 0x7fd7f40a39c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80c102a30 0x7fd80c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd80c100e90 0x7fd80c074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 --2- 172.21.15.17:0/3835438427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd80c102070 0x7fd80c0732a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 >> 172.21.15.17:0/3835438427 conn(0x7fd80c0fc430 msgr2=0x7fd80c105330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 shutdown_connections 2023-10-05T15:36:47.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.251+0000 7fd8123ff700 1 -- 172.21.15.17:0/3835438427 wait complete. 2023-10-05T15:36:47.271 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-05T15:36:47.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:47.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.472+0000 7f40a4fff700 1 -- 172.21.15.17:0/2555204582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0100ea0 msgr2=0x7f40a01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.472+0000 7f40a4fff700 1 --2- 172.21.15.17:0/2555204582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0100ea0 0x7f40a01012c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4090009990 tx=0x7f4090009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 -- 172.21.15.17:0/2555204582 shutdown_connections 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 --2- 172.21.15.17:0/2555204582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 0x7f40a0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 --2- 172.21.15.17:0/2555204582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0100ea0 0x7f40a01012c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 --2- 172.21.15.17:0/2555204582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0102080 0x7f40a0102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 -- 172.21.15.17:0/2555204582 >> 172.21.15.17:0/2555204582 conn(0x7f40a00fc420 msgr2=0x7f40a00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 -- 172.21.15.17:0/2555204582 shutdown_connections 2023-10-05T15:36:47.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.473+0000 7f40a4fff700 1 -- 172.21.15.17:0/2555204582 wait complete. 2023-10-05T15:36:47.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 Processor -- start 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 -- start start 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 0x7f40a0074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 0x7f40a00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 0x7f40a00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0073f80 con 0x7f40a0102080 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00740f0 con 0x7f40a0100ea0 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f40a4fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a01a0ab0 con 0x7f40a0102a40 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f409dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 0x7f40a00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.474+0000 7f409e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 0x7f40a0074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 0x7f40a0074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45470/0 (socket says 172.21.15.17:45470) 2023-10-05T15:36:47.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 0x7f40a00732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54248/0 (socket says 172.21.15.17:54248) 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409e59c700 1 -- 172.21.15.17:0/1885191481 learned_addr learned my addr 172.21.15.17:0/1885191481 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409ed9d700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 0x7f40a00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 -- 172.21.15.17:0/1885191481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 msgr2=0x7f40a00737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 0x7f40a00737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 -- 172.21.15.17:0/1885191481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 msgr2=0x7f40a0074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 0x7f40a0074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 -- 172.21.15.17:0/1885191481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40900095f0 con 0x7f40a0102080 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409e59c700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 0x7f40a0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409ed9d700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 0x7f40a00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f409dd9b700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 0x7f40a00732a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f409400c940 tx=0x7f409400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:47.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094007aa0 con 0x7f40a0102080 2023-10-05T15:36:47.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a01a0d90 con 0x7f40a0102080 2023-10-05T15:36:47.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.475+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f409400ce90 con 0x7f40a0102080 2023-10-05T15:36:47.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.476+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400f450 con 0x7f40a0102080 2023-10-05T15:36:47.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.476+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a01a1210 con 0x7f40a0102080 2023-10-05T15:36:47.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.477+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a010c5c0 con 0x7f40a0102080 2023-10-05T15:36:47.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.479+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4094018480 con 0x7f40a0102080 2023-10-05T15:36:47.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.481+0000 7f408f7fe700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40880a14d0 0x7f40880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.481+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4094013070 con 0x7f40a0102080 2023-10-05T15:36:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.481+0000 7f409e59c700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40880a14d0 0x7f40880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.482+0000 7f409e59c700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40880a14d0 0x7f40880a3990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f409000b5c0 tx=0x7f4090005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:47.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.485+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4094096550 con 0x7f40a0102080 2023-10-05T15:36:47.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.744+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40a010c7a0 con 0x7f40a0102080 2023-10-05T15:36:47.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.745+0000 7f408f7fe700 1 -- 172.21.15.17:0/1885191481 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f4094018730 con 0x7f40a0102080 2023-10-05T15:36:47.747 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:47.747 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:47.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40880a14d0 msgr2=0x7f40880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40880a14d0 0x7f40880a3990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f409000b5c0 tx=0x7f4090005fb0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 msgr2=0x7f40a00732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 0x7f40a00732a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f409400c940 tx=0x7f409400cc50 comp rx=0 tx=0).stop 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 shutdown_connections 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40880a14d0 0x7f40880a3990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40a0102a40 0x7f40a00737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a0100ea0 0x7f40a0074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 --2- 172.21.15.17:0/1885191481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40a0102080 0x7f40a00732a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 >> 172.21.15.17:0/1885191481 conn(0x7f40a00fc420 msgr2=0x7f40a00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:47.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 shutdown_connections 2023-10-05T15:36:47.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.748+0000 7f40a4fff700 1 -- 172.21.15.17:0/1885191481 wait complete. 2023-10-05T15:36:47.751 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:47.768 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-05T15:36:47.768 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-05T15:36:47.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:36:47.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:47 smithi017 ceph-mon[129107]: pgmap v375: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-05T15:36:47.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:47 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2281572016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:47 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3835438427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.969+0000 7f35b03ff700 1 -- 172.21.15.17:0/1956861393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102a40 msgr2=0x7f35a8109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.969+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1956861393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102a40 0x7f35a8109360 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f35a000b0a0 tx=0x7f35a000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 -- 172.21.15.17:0/1956861393 shutdown_connections 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1956861393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102a40 0x7f35a8109360 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1956861393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a8100ea0 0x7f35a81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1956861393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35a8102080 0x7f35a8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 -- 172.21.15.17:0/1956861393 >> 172.21.15.17:0/1956861393 conn(0x7f35a80fc420 msgr2=0x7f35a80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 -- 172.21.15.17:0/1956861393 shutdown_connections 2023-10-05T15:36:47.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.970+0000 7f35b03ff700 1 -- 172.21.15.17:0/1956861393 wait complete. 2023-10-05T15:36:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 Processor -- start 2023-10-05T15:36:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 -- start start 2023-10-05T15:36:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a8100ea0 0x7f35a8074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 0x7f35a80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35a8102a40 0x7f35a80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8073f80 con 0x7f35a8102080 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80740f0 con 0x7f35a8100ea0 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35b03ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81a0b60 con 0x7f35a8102a40 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.971+0000 7f35ad99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 0x7f35a80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 0x7f35a80732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54266/0 (socket says 172.21.15.17:54266) 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 -- 172.21.15.17:0/1702381835 learned_addr learned my addr 172.21.15.17:0/1702381835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ae19b700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a8100ea0 0x7f35a8074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 -- 172.21.15.17:0/1702381835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35a8102a40 msgr2=0x7f35a80737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35a8102a40 0x7f35a80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 -- 172.21.15.17:0/1702381835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a8100ea0 msgr2=0x7f35a8074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a8100ea0 0x7f35a8074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:47.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 -- 172.21.15.17:0/1702381835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0009d00 con 0x7f35a8102080 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35ad99a700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 0x7f35a80732a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f359800c990 tx=0x7f359800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598007b00 con 0x7f35a8102080 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3598007c60 con 0x7f35a8102080 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.972+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a81a0e40 con 0x7f35a8102080 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.973+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598018660 con 0x7f35a8102080 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.973+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a81a1370 con 0x7f35a8102080 2023-10-05T15:36:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.974+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a81083b0 con 0x7f35a8102080 2023-10-05T15:36:47.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.976+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f359800f450 con 0x7f35a8102080 2023-10-05T15:36:47.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.978+0000 7f359f7fe700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35940a1550 0x7f35940a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:47.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.978+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f35980ccf90 con 0x7f35a8102080 2023-10-05T15:36:47.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.978+0000 7f35ae19b700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35940a1550 0x7f35940a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:47.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.979+0000 7f35ae19b700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35940a1550 0x7f35940a3a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35a8101bf0 tx=0x7f35a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:47.982+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35980961f0 con 0x7f35a8102080 2023-10-05T15:36:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:47 smithi167 ceph-mon[133366]: pgmap v375: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-05T15:36:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:47 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2281572016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:47 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3835438427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:47 smithi079 ceph-mon[132936]: pgmap v375: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2023-10-05T15:36:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:47 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2281572016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:47 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3835438427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.190+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35a802d2f0 con 0x7f35940a1550 2023-10-05T15:36:48.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.204+0000 7f359f7fe700 1 -- 172.21.15.17:0/1702381835 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426875 (secure 0 0 0) 0x7f35a802d2f0 con 0x7f35940a1550 2023-10-05T15:36:48.211 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35940a1550 msgr2=0x7f35940a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35940a1550 0x7f35940a3a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35a8101bf0 tx=0x7f35a4009260 comp rx=0 tx=0).stop 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 msgr2=0x7f35a80732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 0x7f35a80732a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f359800c990 tx=0x7f359800cca0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 shutdown_connections 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f35940a1550 0x7f35940a3a10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35a8102a40 0x7f35a80737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35a8100ea0 0x7f35a8074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 --2- 172.21.15.17:0/1702381835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35a8102080 0x7f35a80732a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 >> 172.21.15.17:0/1702381835 conn(0x7f35a80fc420 msgr2=0x7f35a81054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 shutdown_connections 2023-10-05T15:36:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.210+0000 7f35b03ff700 1 -- 172.21.15.17:0/1702381835 wait complete. 2023-10-05T15:36:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:36:48.230 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2023-10-05T15:36:46.614096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659535,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1185,"num_read_kb":716,"num_write":438,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1182672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336880,"kb_used_data":12672,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604944,"statfs":{"total":1151940427776,"available":1151595462656,"internally_reserved":0,"allocated":12976128,"data_stored":8229933,"data_compressed":392235,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003367"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650459+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:36:06.650459+0000","last_peered":"2023-10-05T15:36:06.650459+0000","last_clean":"2023-10-05T15:36:06.650459+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:36:06.650459+0000","last_undegraded":"2023-10-05T15:36:06.650459+0000","last_fullsized":"2023-10-05T15:36:06.650459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652225+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:36:06.652225+0000","last_peered":"2023-10-05T15:36:06.652225+0000","last_clean":"2023-10-05T15:36:06.652225+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:36:06.652225+0000","last_undegraded":"2023-10-05T15:36:06.652225+0000","last_fullsized":"2023-10-05T15:36:06.652225+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652543+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:36:06.652543+0000","last_peered":"2023-10-05T15:36:06.652543+0000","last_clean":"2023-10-05T15:36:06.652543+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:36:06.652543+0000","last_undegraded":"2023-10-05T15:36:06.652543+0000","last_fullsized":"2023-10-05T15:36:06.652543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650734+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:36:06.650734+0000","last_peered":"2023-10-05T15:36:06.650734+0000","last_clean":"2023-10-05T15:36:06.650734+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:36:06.650734+0000","last_undegraded":"2023-10-05T15:36:06.650734+0000","last_fullsized":"2023-10-05T15:36:06.650734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649404+0000","last_change":"2023-10-05T15:35:06.113534+0000","last_active":"2023-10-05T15:36:05.649404+0000","last_peered":"2023-10-05T15:36:05.649404+0000","last_clean":"2023-10-05T15:36:05.649404+0000","last_became_active":"2023-10-05T15:35:06.113092+0000","last_became_peered":"2023-10-05T15:35:06.113092+0000","last_unstale":"2023-10-05T15:36:05.649404+0000","last_undegraded":"2023-10-05T15:36:05.649404+0000","last_fullsized":"2023-10-05T15:36:05.649404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:35:36.334844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697331+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:36:05.697331+0000","last_peered":"2023-10-05T15:36:05.697331+0000","last_clean":"2023-10-05T15:36:05.697331+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:36:05.697331+0000","last_undegraded":"2023-10-05T15:36:05.697331+0000","last_fullsized":"2023-10-05T15:36:05.697331+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.652231+0000","last_change":"2023-10-05T15:35:05.781929+0000","last_active":"2023-10-05T15:36:05.652231+0000","last_peered":"2023-10-05T15:36:05.652231+0000","last_clean":"2023-10-05T15:36:05.652231+0000","last_became_active":"2023-10-05T15:35:05.781552+0000","last_became_peered":"2023-10-05T15:35:05.781552+0000","last_unstale":"2023-10-05T15:36:05.652231+0000","last_undegraded":"2023-10-05T15:36:05.652231+0000","last_fullsized":"2023-10-05T15:36:05.652231+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:28:34.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640086+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:36:05.640086+0000","last_peered":"2023-10-05T15:36:05.640086+0000","last_clean":"2023-10-05T15:36:05.640086+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:36:05.640086+0000","last_undegraded":"2023-10-05T15:36:05.640086+0000","last_fullsized":"2023-10-05T15:36:05.640086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645794+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:36:05.645794+0000","last_peered":"2023-10-05T15:36:05.645794+0000","last_clean":"2023-10-05T15:36:05.645794+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:36:05.645794+0000","last_undegraded":"2023-10-05T15:36:05.645794+0000","last_fullsized":"2023-10-05T15:36:05.645794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697739+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:36:05.697739+0000","last_peered":"2023-10-05T15:36:05.697739+0000","last_clean":"2023-10-05T15:36:05.697739+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:36:05.697739+0000","last_undegraded":"2023-10-05T15:36:05.697739+0000","last_fullsized":"2023-10-05T15:36:05.697739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649921+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:36:05.649921+0000","last_peered":"2023-10-05T15:36:05.649921+0000","last_clean":"2023-10-05T15:36:05.649921+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:36:05.649921+0000","last_undegraded":"2023-10-05T15:36:05.649921+0000","last_fullsized":"2023-10-05T15:36:05.649921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644823+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:36:05.644823+0000","last_peered":"2023-10-05T15:36:05.644823+0000","last_clean":"2023-10-05T15:36:05.644823+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:36:05.644823+0000","last_undegraded":"2023-10-05T15:36:05.644823+0000","last_fullsized":"2023-10-05T15:36:05.644823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649164+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:36:05.649164+0000","last_peered":"2023-10-05T15:36:05.649164+0000","last_clean":"2023-10-05T15:36:05.649164+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:36:05.649164+0000","last_undegraded":"2023-10-05T15:36:05.649164+0000","last_fullsized":"2023-10-05T15:36:05.649164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654427+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:36:05.654427+0000","last_peered":"2023-10-05T15:36:05.654427+0000","last_clean":"2023-10-05T15:36:05.654427+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:36:05.654427+0000","last_undegraded":"2023-10-05T15:36:05.654427+0000","last_fullsized":"2023-10-05T15:36:05.654427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654523+0000","last_change":"2023-10-05T15:35:05.959005+0000","last_active":"2023-10-05T15:36:05.654523+0000","last_peered":"2023-10-05T15:36:05.654523+0000","last_clean":"2023-10-05T15:36:05.654523+0000","last_became_active":"2023-10-05T15:35:05.958666+0000","last_became_peered":"2023-10-05T15:35:05.958666+0000","last_unstale":"2023-10-05T15:36:05.654523+0000","last_undegraded":"2023-10-05T15:36:05.654523+0000","last_fullsized":"2023-10-05T15:36:05.654523+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:58:50.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645612+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:36:05.645612+0000","last_peered":"2023-10-05T15:36:05.645612+0000","last_clean":"2023-10-05T15:36:05.645612+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:36:05.645612+0000","last_undegraded":"2023-10-05T15:36:05.645612+0000","last_fullsized":"2023-10-05T15:36:05.645612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654937+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:36:05.654937+0000","last_peered":"2023-10-05T15:36:05.654937+0000","last_clean":"2023-10-05T15:36:05.654937+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:36:05.654937+0000","last_undegraded":"2023-10-05T15:36:05.654937+0000","last_fullsized":"2023-10-05T15:36:05.654937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728355+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:36:05.728355+0000","last_peered":"2023-10-05T15:36:05.728355+0000","last_clean":"2023-10-05T15:36:05.728355+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:36:05.728355+0000","last_undegraded":"2023-10-05T15:36:05.728355+0000","last_fullsized":"2023-10-05T15:36:05.728355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653694+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:36:05.653694+0000","last_peered":"2023-10-05T15:36:05.653694+0000","last_clean":"2023-10-05T15:36:05.653694+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:36:05.653694+0000","last_undegraded":"2023-10-05T15:36:05.653694+0000","last_fullsized":"2023-10-05T15:36:05.653694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.652993+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:36:05.652993+0000","last_peered":"2023-10-05T15:36:05.652993+0000","last_clean":"2023-10-05T15:36:05.652993+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:36:05.652993+0000","last_undegraded":"2023-10-05T15:36:05.652993+0000","last_fullsized":"2023-10-05T15:36:05.652993+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"94'14","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.089972+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:36:42.089972+0000","last_peered":"2023-10-05T15:36:42.089972+0000","last_clean":"2023-10-05T15:36:42.089972+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:36:42.089972+0000","last_undegraded":"2023-10-05T15:36:42.089972+0000","last_fullsized":"2023-10-05T15:36:42.089972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646567+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:36:06.646567+0000","last_peered":"2023-10-05T15:36:06.646567+0000","last_clean":"2023-10-05T15:36:06.646567+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:36:06.646567+0000","last_undegraded":"2023-10-05T15:36:06.646567+0000","last_fullsized":"2023-10-05T15:36:06.646567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644070+0000","last_change":"2023-10-05T15:35:06.113477+0000","last_active":"2023-10-05T15:36:05.644070+0000","last_peered":"2023-10-05T15:36:05.644070+0000","last_clean":"2023-10-05T15:36:05.644070+0000","last_became_active":"2023-10-05T15:35:06.112876+0000","last_became_peered":"2023-10-05T15:35:06.112876+0000","last_unstale":"2023-10-05T15:36:05.644070+0000","last_undegraded":"2023-10-05T15:36:05.644070+0000","last_fullsized":"2023-10-05T15:36:05.644070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:41:51.762182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646620+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:36:06.646620+0000","last_peered":"2023-10-05T15:36:06.646620+0000","last_clean":"2023-10-05T15:36:06.646620+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:36:06.646620+0000","last_undegraded":"2023-10-05T15:36:06.646620+0000","last_fullsized":"2023-10-05T15:36:06.646620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652368+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:36:06.652368+0000","last_peered":"2023-10-05T15:36:06.652368+0000","last_clean":"2023-10-05T15:36:06.652368+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:36:06.652368+0000","last_undegraded":"2023-10-05T15:36:06.652368+0000","last_fullsized":"2023-10-05T15:36:06.652368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644457+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:36:05.644457+0000","last_peered":"2023-10-05T15:36:05.644457+0000","last_clean":"2023-10-05T15:36:05.644457+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:36:05.644457+0000","last_undegraded":"2023-10-05T15:36:05.644457+0000","last_fullsized":"2023-10-05T15:36:05.644457+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"92'12","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649997+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:36:05.649997+0000","last_peered":"2023-10-05T15:36:05.649997+0000","last_clean":"2023-10-05T15:36:05.649997+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:36:05.649997+0000","last_undegraded":"2023-10-05T15:36:05.649997+0000","last_fullsized":"2023-10-05T15:36:05.649997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645334+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:36:05.645334+0000","last_peered":"2023-10-05T15:36:05.645334+0000","last_clean":"2023-10-05T15:36:05.645334+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:36:05.645334+0000","last_undegraded":"2023-10-05T15:36:05.645334+0000","last_fullsized":"2023-10-05T15:36:05.645334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644195+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:36:05.644195+0000","last_peered":"2023-10-05T15:36:05.644195+0000","last_clean":"2023-10-05T15:36:05.644195+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:36:05.644195+0000","last_undegraded":"2023-10-05T15:36:05.644195+0000","last_fullsized":"2023-10-05T15:36:05.644195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649672+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:36:05.649672+0000","last_peered":"2023-10-05T15:36:05.649672+0000","last_clean":"2023-10-05T15:36:05.649672+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:36:05.649672+0000","last_undegraded":"2023-10-05T15:36:05.649672+0000","last_fullsized":"2023-10-05T15:36:05.649672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641892+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:36:05.641892+0000","last_peered":"2023-10-05T15:36:05.641892+0000","last_clean":"2023-10-05T15:36:05.641892+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:36:05.641892+0000","last_undegraded":"2023-10-05T15:36:05.641892+0000","last_fullsized":"2023-10-05T15:36:05.641892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653370+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:36:05.653370+0000","last_peered":"2023-10-05T15:36:05.653370+0000","last_clean":"2023-10-05T15:36:05.653370+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:36:05.653370+0000","last_undegraded":"2023-10-05T15:36:05.653370+0000","last_fullsized":"2023-10-05T15:36:05.653370+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"94'6","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.761095+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:36:42.761095+0000","last_peered":"2023-10-05T15:36:42.761095+0000","last_clean":"2023-10-05T15:36:42.761095+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:36:42.761095+0000","last_undegraded":"2023-10-05T15:36:42.761095+0000","last_fullsized":"2023-10-05T15:36:42.761095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649504+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:36:05.649504+0000","last_peered":"2023-10-05T15:36:05.649504+0000","last_clean":"2023-10-05T15:36:05.649504+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:36:05.649504+0000","last_undegraded":"2023-10-05T15:36:05.649504+0000","last_fullsized":"2023-10-05T15:36:05.649504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653607+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:36:05.653607+0000","last_peered":"2023-10-05T15:36:05.653607+0000","last_clean":"2023-10-05T15:36:05.653607+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:36:05.653607+0000","last_undegraded":"2023-10-05T15:36:05.653607+0000","last_fullsized":"2023-10-05T15:36:05.653607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697341+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:36:05.697341+0000","last_peered":"2023-10-05T15:36:05.697341+0000","last_clean":"2023-10-05T15:36:05.697341+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:36:05.697341+0000","last_undegraded":"2023-10-05T15:36:05.697341+0000","last_fullsized":"2023-10-05T15:36:05.697341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641698+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:36:05.641698+0000","last_peered":"2023-10-05T15:36:05.641698+0000","last_clean":"2023-10-05T15:36:05.641698+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:36:05.641698+0000","last_undegraded":"2023-10-05T15:36:05.641698+0000","last_fullsized":"2023-10-05T15:36:05.641698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650097+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:36:06.650097+0000","last_peered":"2023-10-05T15:36:06.650097+0000","last_clean":"2023-10-05T15:36:06.650097+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:36:06.650097+0000","last_undegraded":"2023-10-05T15:36:06.650097+0000","last_fullsized":"2023-10-05T15:36:06.650097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.648715+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:36:05.648715+0000","last_peered":"2023-10-05T15:36:05.648715+0000","last_clean":"2023-10-05T15:36:05.648715+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:36:05.648715+0000","last_undegraded":"2023-10-05T15:36:05.648715+0000","last_fullsized":"2023-10-05T15:36:05.648715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640274+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:36:05.640274+0000","last_peered":"2023-10-05T15:36:05.640274+0000","last_clean":"2023-10-05T15:36:05.640274+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:36:05.640274+0000","last_undegraded":"2023-10-05T15:36:05.640274+0000","last_fullsized":"2023-10-05T15:36:05.640274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652187+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:36:06.652187+0000","last_peered":"2023-10-05T15:36:06.652187+0000","last_clean":"2023-10-05T15:36:06.652187+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:36:06.652187+0000","last_undegraded":"2023-10-05T15:36:06.652187+0000","last_fullsized":"2023-10-05T15:36:06.652187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641155+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:36:05.641155+0000","last_peered":"2023-10-05T15:36:05.641155+0000","last_clean":"2023-10-05T15:36:05.641155+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:36:05.641155+0000","last_undegraded":"2023-10-05T15:36:05.641155+0000","last_fullsized":"2023-10-05T15:36:05.641155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728050+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:36:05.728050+0000","last_peered":"2023-10-05T15:36:05.728050+0000","last_clean":"2023-10-05T15:36:05.728050+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:36:05.728050+0000","last_undegraded":"2023-10-05T15:36:05.728050+0000","last_fullsized":"2023-10-05T15:36:05.728050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640597+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:36:05.640597+0000","last_peered":"2023-10-05T15:36:05.640597+0000","last_clean":"2023-10-05T15:36:05.640597+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:36:05.640597+0000","last_undegraded":"2023-10-05T15:36:05.640597+0000","last_fullsized":"2023-10-05T15:36:05.640597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"94'7","reported_seq":233,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.719740+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:36:43.719740+0000","last_peered":"2023-10-05T15:36:43.719740+0000","last_clean":"2023-10-05T15:36:43.719740+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:36:43.719740+0000","last_undegraded":"2023-10-05T15:36:43.719740+0000","last_fullsized":"2023-10-05T15:36:43.719740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.646440+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:36:05.646440+0000","last_peered":"2023-10-05T15:36:05.646440+0000","last_clean":"2023-10-05T15:36:05.646440+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:36:05.646440+0000","last_undegraded":"2023-10-05T15:36:05.646440+0000","last_fullsized":"2023-10-05T15:36:05.646440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.727918+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:36:05.727918+0000","last_peered":"2023-10-05T15:36:05.727918+0000","last_clean":"2023-10-05T15:36:05.727918+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:36:05.727918+0000","last_undegraded":"2023-10-05T15:36:05.727918+0000","last_fullsized":"2023-10-05T15:36:05.727918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.660645+0000","last_change":"2023-10-05T15:36:06.660645+0000","last_active":"2023-10-05T15:36:06.660645+0000","last_peered":"2023-10-05T15:36:06.660645+0000","last_clean":"2023-10-05T15:36:06.660645+0000","last_became_active":"2023-10-05T15:36:06.655841+0000","last_became_peered":"2023-10-05T15:36:06.655841+0000","last_unstale":"2023-10-05T15:36:06.660645+0000","last_undegraded":"2023-10-05T15:36:06.660645+0000","last_fullsized":"2023-10-05T15:36:06.660645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:38.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.655169+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:36:05.655169+0000","last_peered":"2023-10-05T15:36:05.655169+0000","last_clean":"2023-10-05T15:36:05.655169+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:36:05.655169+0000","last_undegraded":"2023-10-05T15:36:05.655169+0000","last_fullsized":"2023-10-05T15:36:05.655169+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644684+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:36:05.644684+0000","last_peered":"2023-10-05T15:36:05.644684+0000","last_clean":"2023-10-05T15:36:05.644684+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:36:05.644684+0000","last_undegraded":"2023-10-05T15:36:05.644684+0000","last_fullsized":"2023-10-05T15:36:05.644684+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642400+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:36:05.642400+0000","last_peered":"2023-10-05T15:36:05.642400+0000","last_clean":"2023-10-05T15:36:05.642400+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:36:05.642400+0000","last_undegraded":"2023-10-05T15:36:05.642400+0000","last_fullsized":"2023-10-05T15:36:05.642400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645442+0000","last_change":"2023-10-05T15:35:05.781201+0000","last_active":"2023-10-05T15:36:05.645442+0000","last_peered":"2023-10-05T15:36:05.645442+0000","last_clean":"2023-10-05T15:36:05.645442+0000","last_became_active":"2023-10-05T15:35:05.780760+0000","last_became_peered":"2023-10-05T15:35:05.780760+0000","last_unstale":"2023-10-05T15:36:05.645442+0000","last_undegraded":"2023-10-05T15:36:05.645442+0000","last_fullsized":"2023-10-05T15:36:05.645442+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:56:43.796707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.727962+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:36:05.727962+0000","last_peered":"2023-10-05T15:36:05.727962+0000","last_clean":"2023-10-05T15:36:05.727962+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:36:05.727962+0000","last_undegraded":"2023-10-05T15:36:05.727962+0000","last_fullsized":"2023-10-05T15:36:05.727962+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"94'38","reported_seq":273,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.775610+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:36:43.775610+0000","last_peered":"2023-10-05T15:36:43.775610+0000","last_clean":"2023-10-05T15:36:43.775610+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:36:43.775610+0000","last_undegraded":"2023-10-05T15:36:43.775610+0000","last_fullsized":"2023-10-05T15:36:43.775610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":214,"num_read_kb":166,"num_write":40,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649734+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:36:05.649734+0000","last_peered":"2023-10-05T15:36:05.649734+0000","last_clean":"2023-10-05T15:36:05.649734+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:36:05.649734+0000","last_undegraded":"2023-10-05T15:36:05.649734+0000","last_fullsized":"2023-10-05T15:36:05.649734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642307+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:36:05.642307+0000","last_peered":"2023-10-05T15:36:05.642307+0000","last_clean":"2023-10-05T15:36:05.642307+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:36:05.642307+0000","last_undegraded":"2023-10-05T15:36:05.642307+0000","last_fullsized":"2023-10-05T15:36:05.642307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653374+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:36:05.653374+0000","last_peered":"2023-10-05T15:36:05.653374+0000","last_clean":"2023-10-05T15:36:05.653374+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:36:05.653374+0000","last_undegraded":"2023-10-05T15:36:05.653374+0000","last_fullsized":"2023-10-05T15:36:05.653374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649038+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:36:05.649038+0000","last_peered":"2023-10-05T15:36:05.649038+0000","last_clean":"2023-10-05T15:36:05.649038+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:36:05.649038+0000","last_undegraded":"2023-10-05T15:36:05.649038+0000","last_fullsized":"2023-10-05T15:36:05.649038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654407+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:36:05.654407+0000","last_peered":"2023-10-05T15:36:05.654407+0000","last_clean":"2023-10-05T15:36:05.654407+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:36:05.654407+0000","last_undegraded":"2023-10-05T15:36:05.654407+0000","last_fullsized":"2023-10-05T15:36:05.654407+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641410+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:36:05.641410+0000","last_peered":"2023-10-05T15:36:05.641410+0000","last_clean":"2023-10-05T15:36:05.641410+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:36:05.641410+0000","last_undegraded":"2023-10-05T15:36:05.641410+0000","last_fullsized":"2023-10-05T15:36:05.641410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650681+0000","last_change":"2023-10-05T15:35:06.113316+0000","last_active":"2023-10-05T15:36:05.650681+0000","last_peered":"2023-10-05T15:36:05.650681+0000","last_clean":"2023-10-05T15:36:05.650681+0000","last_became_active":"2023-10-05T15:35:06.112866+0000","last_became_peered":"2023-10-05T15:35:06.112866+0000","last_unstale":"2023-10-05T15:36:05.650681+0000","last_undegraded":"2023-10-05T15:36:05.650681+0000","last_fullsized":"2023-10-05T15:36:05.650681+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:24:17.253672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728242+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:36:05.728242+0000","last_peered":"2023-10-05T15:36:05.728242+0000","last_clean":"2023-10-05T15:36:05.728242+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:36:05.728242+0000","last_undegraded":"2023-10-05T15:36:05.728242+0000","last_fullsized":"2023-10-05T15:36:05.728242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"94'6","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.784434+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:36:42.784434+0000","last_peered":"2023-10-05T15:36:42.784434+0000","last_clean":"2023-10-05T15:36:42.784434+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:36:42.784434+0000","last_undegraded":"2023-10-05T15:36:42.784434+0000","last_fullsized":"2023-10-05T15:36:42.784434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653551+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:36:05.653551+0000","last_peered":"2023-10-05T15:36:05.653551+0000","last_clean":"2023-10-05T15:36:05.653551+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:36:05.653551+0000","last_undegraded":"2023-10-05T15:36:05.653551+0000","last_fullsized":"2023-10-05T15:36:05.653551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649190+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:36:05.649190+0000","last_peered":"2023-10-05T15:36:05.649190+0000","last_clean":"2023-10-05T15:36:05.649190+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:36:05.649190+0000","last_undegraded":"2023-10-05T15:36:05.649190+0000","last_fullsized":"2023-10-05T15:36:05.649190+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.668184+0000","last_change":"2023-10-05T15:36:06.668184+0000","last_active":"2023-10-05T15:36:06.668184+0000","last_peered":"2023-10-05T15:36:06.668184+0000","last_clean":"2023-10-05T15:36:06.668184+0000","last_became_active":"2023-10-05T15:36:06.653648+0000","last_became_peered":"2023-10-05T15:36:06.653648+0000","last_unstale":"2023-10-05T15:36:06.668184+0000","last_undegraded":"2023-10-05T15:36:06.668184+0000","last_fullsized":"2023-10-05T15:36:06.668184+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:03:57.337078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641192+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:36:05.641192+0000","last_peered":"2023-10-05T15:36:05.641192+0000","last_clean":"2023-10-05T15:36:05.641192+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:36:05.641192+0000","last_undegraded":"2023-10-05T15:36:05.641192+0000","last_fullsized":"2023-10-05T15:36:05.641192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641091+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:36:05.641091+0000","last_peered":"2023-10-05T15:36:05.641091+0000","last_clean":"2023-10-05T15:36:05.641091+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:36:05.641091+0000","last_undegraded":"2023-10-05T15:36:05.641091+0000","last_fullsized":"2023-10-05T15:36:05.641091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649824+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:36:05.649824+0000","last_peered":"2023-10-05T15:36:05.649824+0000","last_clean":"2023-10-05T15:36:05.649824+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:36:05.649824+0000","last_undegraded":"2023-10-05T15:36:05.649824+0000","last_fullsized":"2023-10-05T15:36:05.649824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654740+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:36:05.654740+0000","last_peered":"2023-10-05T15:36:05.654740+0000","last_clean":"2023-10-05T15:36:05.654740+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:36:05.654740+0000","last_undegraded":"2023-10-05T15:36:05.654740+0000","last_fullsized":"2023-10-05T15:36:05.654740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653389+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:36:06.653389+0000","last_peered":"2023-10-05T15:36:06.653389+0000","last_clean":"2023-10-05T15:36:06.653389+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:36:06.653389+0000","last_undegraded":"2023-10-05T15:36:06.653389+0000","last_fullsized":"2023-10-05T15:36:06.653389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.660288+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:36:06.660288+0000","last_peered":"2023-10-05T15:36:06.660288+0000","last_clean":"2023-10-05T15:36:06.660288+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:36:06.660288+0000","last_undegraded":"2023-10-05T15:36:06.660288+0000","last_fullsized":"2023-10-05T15:36:06.660288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.648280+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:36:06.648280+0000","last_peered":"2023-10-05T15:36:06.648280+0000","last_clean":"2023-10-05T15:36:06.648280+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:36:06.648280+0000","last_undegraded":"2023-10-05T15:36:06.648280+0000","last_fullsized":"2023-10-05T15:36:06.648280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726378+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:36:06.726378+0000","last_peered":"2023-10-05T15:36:06.726378+0000","last_clean":"2023-10-05T15:36:06.726378+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:36:06.726378+0000","last_undegraded":"2023-10-05T15:36:06.726378+0000","last_fullsized":"2023-10-05T15:36:06.726378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"94'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.801229+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:36:43.801229+0000","last_peered":"2023-10-05T15:36:43.801229+0000","last_clean":"2023-10-05T15:36:43.801229+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:36:43.801229+0000","last_undegraded":"2023-10-05T15:36:43.801229+0000","last_fullsized":"2023-10-05T15:36:43.801229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647872+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:36:06.647872+0000","last_peered":"2023-10-05T15:36:06.647872+0000","last_clean":"2023-10-05T15:36:06.647872+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:36:06.647872+0000","last_undegraded":"2023-10-05T15:36:06.647872+0000","last_fullsized":"2023-10-05T15:36:06.647872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649310+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:36:05.649310+0000","last_peered":"2023-10-05T15:36:05.649310+0000","last_clean":"2023-10-05T15:36:05.649310+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:36:05.649310+0000","last_undegraded":"2023-10-05T15:36:05.649310+0000","last_fullsized":"2023-10-05T15:36:05.649310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.702149+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:36:06.702149+0000","last_peered":"2023-10-05T15:36:06.702149+0000","last_clean":"2023-10-05T15:36:06.702149+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:36:06.702149+0000","last_undegraded":"2023-10-05T15:36:06.702149+0000","last_fullsized":"2023-10-05T15:36:06.702149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.783720+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:36:42.783720+0000","last_peered":"2023-10-05T15:36:42.783720+0000","last_clean":"2023-10-05T15:36:42.783720+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:36:42.783720+0000","last_undegraded":"2023-10-05T15:36:42.783720+0000","last_fullsized":"2023-10-05T15:36:42.783720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652587+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:36:06.652587+0000","last_peered":"2023-10-05T15:36:06.652587+0000","last_clean":"2023-10-05T15:36:06.652587+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:36:06.652587+0000","last_undegraded":"2023-10-05T15:36:06.652587+0000","last_fullsized":"2023-10-05T15:36:06.652587+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646751+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:36:06.646751+0000","last_peered":"2023-10-05T15:36:06.646751+0000","last_clean":"2023-10-05T15:36:06.646751+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:36:06.646751+0000","last_undegraded":"2023-10-05T15:36:06.646751+0000","last_fullsized":"2023-10-05T15:36:06.646751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650638+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:36:06.650638+0000","last_peered":"2023-10-05T15:36:06.650638+0000","last_clean":"2023-10-05T15:36:06.650638+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:36:06.650638+0000","last_undegraded":"2023-10-05T15:36:06.650638+0000","last_fullsized":"2023-10-05T15:36:06.650638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.651666+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:36:05.651666+0000","last_peered":"2023-10-05T15:36:05.651666+0000","last_clean":"2023-10-05T15:36:05.651666+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:36:05.651666+0000","last_undegraded":"2023-10-05T15:36:05.651666+0000","last_fullsized":"2023-10-05T15:36:05.651666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642102+0000","last_change":"2023-10-05T15:35:06.112775+0000","last_active":"2023-10-05T15:36:05.642102+0000","last_peered":"2023-10-05T15:36:05.642102+0000","last_clean":"2023-10-05T15:36:05.642102+0000","last_became_active":"2023-10-05T15:35:06.112332+0000","last_became_peered":"2023-10-05T15:35:06.112332+0000","last_unstale":"2023-10-05T15:36:05.642102+0000","last_undegraded":"2023-10-05T15:36:05.642102+0000","last_fullsized":"2023-10-05T15:36:05.642102+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:22.225861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.725649+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:36:06.725649+0000","last_peered":"2023-10-05T15:36:06.725649+0000","last_clean":"2023-10-05T15:36:06.725649+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:36:06.725649+0000","last_undegraded":"2023-10-05T15:36:06.725649+0000","last_fullsized":"2023-10-05T15:36:06.725649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.651727+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:36:06.651727+0000","last_peered":"2023-10-05T15:36:06.651727+0000","last_clean":"2023-10-05T15:36:06.651727+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:36:06.651727+0000","last_undegraded":"2023-10-05T15:36:06.651727+0000","last_fullsized":"2023-10-05T15:36:06.651727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650553+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:36:06.650553+0000","last_peered":"2023-10-05T15:36:06.650553+0000","last_clean":"2023-10-05T15:36:06.650553+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:36:06.650553+0000","last_undegraded":"2023-10-05T15:36:06.650553+0000","last_fullsized":"2023-10-05T15:36:06.650553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653465+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:36:06.653465+0000","last_peered":"2023-10-05T15:36:06.653465+0000","last_clean":"2023-10-05T15:36:06.653465+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:36:06.653465+0000","last_undegraded":"2023-10-05T15:36:06.653465+0000","last_fullsized":"2023-10-05T15:36:06.653465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726457+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:36:06.726457+0000","last_peered":"2023-10-05T15:36:06.726457+0000","last_clean":"2023-10-05T15:36:06.726457+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:36:06.726457+0000","last_undegraded":"2023-10-05T15:36:06.726457+0000","last_fullsized":"2023-10-05T15:36:06.726457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646126+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:36:06.646126+0000","last_peered":"2023-10-05T15:36:06.646126+0000","last_clean":"2023-10-05T15:36:06.646126+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:36:06.646126+0000","last_undegraded":"2023-10-05T15:36:06.646126+0000","last_fullsized":"2023-10-05T15:36:06.646126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"94'11","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.661691+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:36:06.661691+0000","last_peered":"2023-10-05T15:36:06.661691+0000","last_clean":"2023-10-05T15:36:06.661691+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:36:06.661691+0000","last_undegraded":"2023-10-05T15:36:06.661691+0000","last_fullsized":"2023-10-05T15:36:06.661691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646703+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:36:06.646703+0000","last_peered":"2023-10-05T15:36:06.646703+0000","last_clean":"2023-10-05T15:36:06.646703+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:36:06.646703+0000","last_undegraded":"2023-10-05T15:36:06.646703+0000","last_fullsized":"2023-10-05T15:36:06.646703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647252+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:36:06.647252+0000","last_peered":"2023-10-05T15:36:06.647252+0000","last_clean":"2023-10-05T15:36:06.647252+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:36:06.647252+0000","last_undegraded":"2023-10-05T15:36:06.647252+0000","last_fullsized":"2023-10-05T15:36:06.647252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650907+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:36:06.650907+0000","last_peered":"2023-10-05T15:36:06.650907+0000","last_clean":"2023-10-05T15:36:06.650907+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:36:06.650907+0000","last_undegraded":"2023-10-05T15:36:06.650907+0000","last_fullsized":"2023-10-05T15:36:06.650907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652300+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:36:06.652300+0000","last_peered":"2023-10-05T15:36:06.652300+0000","last_clean":"2023-10-05T15:36:06.652300+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:36:06.652300+0000","last_undegraded":"2023-10-05T15:36:06.652300+0000","last_fullsized":"2023-10-05T15:36:06.652300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644476+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:36:05.644476+0000","last_peered":"2023-10-05T15:36:05.644476+0000","last_clean":"2023-10-05T15:36:05.644476+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:36:05.644476+0000","last_undegraded":"2023-10-05T15:36:05.644476+0000","last_fullsized":"2023-10-05T15:36:05.644476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653334+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:36:06.653334+0000","last_peered":"2023-10-05T15:36:06.653334+0000","last_clean":"2023-10-05T15:36:06.653334+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:36:06.653334+0000","last_undegraded":"2023-10-05T15:36:06.653334+0000","last_fullsized":"2023-10-05T15:36:06.653334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652806+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:36:06.652806+0000","last_peered":"2023-10-05T15:36:06.652806+0000","last_clean":"2023-10-05T15:36:06.652806+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:36:06.652806+0000","last_undegraded":"2023-10-05T15:36:06.652806+0000","last_fullsized":"2023-10-05T15:36:06.652806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728348+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:36:05.728348+0000","last_peered":"2023-10-05T15:36:05.728348+0000","last_clean":"2023-10-05T15:36:05.728348+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:36:05.728348+0000","last_undegraded":"2023-10-05T15:36:05.728348+0000","last_fullsized":"2023-10-05T15:36:05.728348+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646624+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:36:06.646624+0000","last_peered":"2023-10-05T15:36:06.646624+0000","last_clean":"2023-10-05T15:36:06.646624+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:36:06.646624+0000","last_undegraded":"2023-10-05T15:36:06.646624+0000","last_fullsized":"2023-10-05T15:36:06.646624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650732+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:36:06.650732+0000","last_peered":"2023-10-05T15:36:06.650732+0000","last_clean":"2023-10-05T15:36:06.650732+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:36:06.650732+0000","last_undegraded":"2023-10-05T15:36:06.650732+0000","last_fullsized":"2023-10-05T15:36:06.650732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644944+0000","last_change":"2023-10-05T15:35:05.959978+0000","last_active":"2023-10-05T15:36:05.644944+0000","last_peered":"2023-10-05T15:36:05.644944+0000","last_clean":"2023-10-05T15:36:05.644944+0000","last_became_active":"2023-10-05T15:35:05.954464+0000","last_became_peered":"2023-10-05T15:35:05.954464+0000","last_unstale":"2023-10-05T15:36:05.644944+0000","last_undegraded":"2023-10-05T15:36:05.644944+0000","last_fullsized":"2023-10-05T15:36:05.644944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:31:05.392741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"94'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.972865+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:36:43.972865+0000","last_peered":"2023-10-05T15:36:43.972865+0000","last_clean":"2023-10-05T15:36:43.972865+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:36:43.972865+0000","last_undegraded":"2023-10-05T15:36:43.972865+0000","last_fullsized":"2023-10-05T15:36:43.972865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640553+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:36:05.640553+0000","last_peered":"2023-10-05T15:36:05.640553+0000","last_clean":"2023-10-05T15:36:05.640553+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:36:05.640553+0000","last_undegraded":"2023-10-05T15:36:05.640553+0000","last_fullsized":"2023-10-05T15:36:05.640553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644332+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:36:05.644332+0000","last_peered":"2023-10-05T15:36:05.644332+0000","last_clean":"2023-10-05T15:36:05.644332+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:36:05.644332+0000","last_undegraded":"2023-10-05T15:36:05.644332+0000","last_fullsized":"2023-10-05T15:36:05.644332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.672176+0000","last_change":"2023-10-05T15:36:06.672176+0000","last_active":"2023-10-05T15:36:06.672176+0000","last_peered":"2023-10-05T15:36:06.672176+0000","last_clean":"2023-10-05T15:36:06.672176+0000","last_became_active":"2023-10-05T15:36:06.655828+0000","last_became_peered":"2023-10-05T15:36:06.655828+0000","last_unstale":"2023-10-05T15:36:06.672176+0000","last_undegraded":"2023-10-05T15:36:06.672176+0000","last_fullsized":"2023-10-05T15:36:06.672176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:47.789216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652240+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:36:06.652240+0000","last_peered":"2023-10-05T15:36:06.652240+0000","last_clean":"2023-10-05T15:36:06.652240+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:36:06.652240+0000","last_undegraded":"2023-10-05T15:36:06.652240+0000","last_fullsized":"2023-10-05T15:36:06.652240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.727430+0000","last_change":"2023-10-05T15:36:06.727430+0000","last_active":"2023-10-05T15:36:06.727430+0000","last_peered":"2023-10-05T15:36:06.727430+0000","last_clean":"2023-10-05T15:36:06.727430+0000","last_became_active":"2023-10-05T15:36:06.726961+0000","last_became_peered":"2023-10-05T15:36:06.726961+0000","last_unstale":"2023-10-05T15:36:06.727430+0000","last_undegraded":"2023-10-05T15:36:06.727430+0000","last_fullsized":"2023-10-05T15:36:06.727430+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:18:40.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"94'8","reported_seq":58,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.717571+0000","last_change":"2023-10-05T15:36:06.672116+0000","last_active":"2023-10-05T15:36:42.717571+0000","last_peered":"2023-10-05T15:36:42.717571+0000","last_clean":"2023-10-05T15:36:42.717571+0000","last_became_active":"2023-10-05T15:36:06.654419+0000","last_became_peered":"2023-10-05T15:36:06.654419+0000","last_unstale":"2023-10-05T15:36:42.717571+0000","last_undegraded":"2023-10-05T15:36:42.717571+0000","last_fullsized":"2023-10-05T15:36:42.717571+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:25:27.679173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2184,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1701,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650109+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:36:05.650109+0000","last_peered":"2023-10-05T15:36:05.650109+0000","last_clean":"2023-10-05T15:36:05.650109+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:36:05.650109+0000","last_undegraded":"2023-10-05T15:36:05.650109+0000","last_fullsized":"2023-10-05T15:36:05.650109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.655260+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:36:05.655260+0000","last_peered":"2023-10-05T15:36:05.655260+0000","last_clean":"2023-10-05T15:36:05.655260+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:36:05.655260+0000","last_undegraded":"2023-10-05T15:36:05.655260+0000","last_fullsized":"2023-10-05T15:36:05.655260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642051+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:36:05.642051+0000","last_peered":"2023-10-05T15:36:05.642051+0000","last_clean":"2023-10-05T15:36:05.642051+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:36:05.642051+0000","last_undegraded":"2023-10-05T15:36:05.642051+0000","last_fullsized":"2023-10-05T15:36:05.642051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650432+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:36:05.650432+0000","last_peered":"2023-10-05T15:36:05.650432+0000","last_clean":"2023-10-05T15:36:05.650432+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:36:05.650432+0000","last_undegraded":"2023-10-05T15:36:05.650432+0000","last_fullsized":"2023-10-05T15:36:05.650432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640975+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:36:05.640975+0000","last_peered":"2023-10-05T15:36:05.640975+0000","last_clean":"2023-10-05T15:36:05.640975+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:36:05.640975+0000","last_undegraded":"2023-10-05T15:36:05.640975+0000","last_fullsized":"2023-10-05T15:36:05.640975+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649262+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:36:05.649262+0000","last_peered":"2023-10-05T15:36:05.649262+0000","last_clean":"2023-10-05T15:36:05.649262+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:36:05.649262+0000","last_undegraded":"2023-10-05T15:36:05.649262+0000","last_fullsized":"2023-10-05T15:36:05.649262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650578+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:36:05.650578+0000","last_peered":"2023-10-05T15:36:05.650578+0000","last_clean":"2023-10-05T15:36:05.650578+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:36:05.650578+0000","last_undegraded":"2023-10-05T15:36:05.650578+0000","last_fullsized":"2023-10-05T15:36:05.650578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650835+0000","last_change":"2023-10-05T15:35:05.959167+0000","last_active":"2023-10-05T15:36:06.650835+0000","last_peered":"2023-10-05T15:36:06.650835+0000","last_clean":"2023-10-05T15:36:06.650835+0000","last_became_active":"2023-10-05T15:35:05.958674+0000","last_became_peered":"2023-10-05T15:35:05.958674+0000","last_unstale":"2023-10-05T15:36:06.650835+0000","last_undegraded":"2023-10-05T15:36:06.650835+0000","last_fullsized":"2023-10-05T15:36:06.650835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:55:03.244565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647420+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:36:06.647420+0000","last_peered":"2023-10-05T15:36:06.647420+0000","last_clean":"2023-10-05T15:36:06.647420+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:36:06.647420+0000","last_undegraded":"2023-10-05T15:36:06.647420+0000","last_fullsized":"2023-10-05T15:36:06.647420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647361+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:36:06.647361+0000","last_peered":"2023-10-05T15:36:06.647361+0000","last_clean":"2023-10-05T15:36:06.647361+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:36:06.647361+0000","last_undegraded":"2023-10-05T15:36:06.647361+0000","last_fullsized":"2023-10-05T15:36:06.647361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652910+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:36:06.652910+0000","last_peered":"2023-10-05T15:36:06.652910+0000","last_clean":"2023-10-05T15:36:06.652910+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:36:06.652910+0000","last_undegraded":"2023-10-05T15:36:06.652910+0000","last_fullsized":"2023-10-05T15:36:06.652910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726472+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:36:06.726472+0000","last_peered":"2023-10-05T15:36:06.726472+0000","last_clean":"2023-10-05T15:36:06.726472+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:36:06.726472+0000","last_undegraded":"2023-10-05T15:36:06.726472+0000","last_fullsized":"2023-10-05T15:36:06.726472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650294+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:36:06.650294+0000","last_peered":"2023-10-05T15:36:06.650294+0000","last_clean":"2023-10-05T15:36:06.650294+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:36:06.650294+0000","last_undegraded":"2023-10-05T15:36:06.650294+0000","last_fullsized":"2023-10-05T15:36:06.650294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.648388+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:36:06.648388+0000","last_peered":"2023-10-05T15:36:06.648388+0000","last_clean":"2023-10-05T15:36:06.648388+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:36:06.648388+0000","last_undegraded":"2023-10-05T15:36:06.648388+0000","last_fullsized":"2023-10-05T15:36:06.648388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646887+0000","last_change":"2023-10-05T15:35:06.113556+0000","last_active":"2023-10-05T15:36:06.646887+0000","last_peered":"2023-10-05T15:36:06.646887+0000","last_clean":"2023-10-05T15:36:06.646887+0000","last_became_active":"2023-10-05T15:35:06.113152+0000","last_became_peered":"2023-10-05T15:35:06.113152+0000","last_unstale":"2023-10-05T15:36:06.646887+0000","last_undegraded":"2023-10-05T15:36:06.646887+0000","last_fullsized":"2023-10-05T15:36:06.646887+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:48.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.702029+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:36:06.702029+0000","last_peered":"2023-10-05T15:36:06.702029+0000","last_clean":"2023-10-05T15:36:06.702029+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:36:06.702029+0000","last_undegraded":"2023-10-05T15:36:06.702029+0000","last_fullsized":"2023-10-05T15:36:06.702029+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640087+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:36:05.640087+0000","last_peered":"2023-10-05T15:36:05.640087+0000","last_clean":"2023-10-05T15:36:05.640087+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:36:05.640087+0000","last_undegraded":"2023-10-05T15:36:05.640087+0000","last_fullsized":"2023-10-05T15:36:05.640087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.646065+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:36:05.646065+0000","last_peered":"2023-10-05T15:36:05.646065+0000","last_clean":"2023-10-05T15:36:05.646065+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:36:05.646065+0000","last_undegraded":"2023-10-05T15:36:05.646065+0000","last_fullsized":"2023-10-05T15:36:05.646065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.648971+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:36:05.648971+0000","last_peered":"2023-10-05T15:36:05.648971+0000","last_clean":"2023-10-05T15:36:05.648971+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:36:05.648971+0000","last_undegraded":"2023-10-05T15:36:05.648971+0000","last_fullsized":"2023-10-05T15:36:05.648971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654872+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:36:05.654872+0000","last_peered":"2023-10-05T15:36:05.654872+0000","last_clean":"2023-10-05T15:36:05.654872+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:36:05.654872+0000","last_undegraded":"2023-10-05T15:36:05.654872+0000","last_fullsized":"2023-10-05T15:36:05.654872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68921,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1059,"num_read_kb":607,"num_write":255,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1813,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":524744,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.41499999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1040000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91800000000000004,"5min":1.038,"15min":1.038},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.034,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.81799999999999995},"min":{"1min":0.62,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90500000000000003,"5min":1.135,"15min":1.135},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.78400000000000003},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81699999999999995,"15min":0.84899999999999998},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1259999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.498,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.94299999999999995,"15min":0.92500000000000004},"min":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2370000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.095},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.69199999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0549999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.161,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.002}]},{"osd":9,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.341,"5min":1.722,"15min":1.722},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0049999999999999,"15min":0.999},"min":{"1min":0.78200000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2889999999999999,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.042}]},{"osd":10,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":0.94199999999999995},"min":{"1min":0.621,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.196,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.02},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91300000000000003,"15min":0.89500000000000002},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1439999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.92600000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612654,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1183744,"data_stored":1174718,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.65000000000000002,"15min":0.69999999999999996},"min":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.998,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.4039999999999999,"5min":6.4039999999999999,"15min":6.4039999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78000000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.75600000000000001,"15min":0.80000000000000004},"min":{"1min":0.441,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.87,"15min":0.90100000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.008,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88400000000000001,"15min":0.91700000000000004},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.94299999999999995,"15min":0.99199999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1519999999999999,"5min":1.264,"15min":1.264},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93799999999999994,"15min":0.96699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.752}]},{"osd":9,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.026,"15min":1.052},"min":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97099999999999997,"15min":0.996},"min":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":0.72799999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":0.94499999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.097,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.236},"last":0.85799999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":523548,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99399999999999999,"5min":1.343,"15min":1.343},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82599999999999996,"15min":0.83499999999999996},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.085,"5min":1.109,"15min":1.109},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.628}]},{"osd":3,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.71999999999999997,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0309999999999999,"5min":1.258,"15min":1.258},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76000000000000001,"15min":0.78300000000000003},"min":{"1min":0.46500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.054,"5min":1.391,"15min":1.391},"last":0.875}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.96699999999999997,"15min":1.0229999999999999},"min":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1359999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.872,"15min":0.90500000000000003},"min":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.109,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.84799999999999998}]}]},{"osd":8,"up_from":60,"seq":257698037815,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1048576,"data_stored":523814,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.155,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2250000000000001,"5min":1.431,"15min":1.431},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95499999999999996,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.878},{"interface":"front","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93000000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.496},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96599999999999997,"5min":1.04,"15min":1.04},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.004}]},{"osd":4,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.88100000000000001,"15min":0.91300000000000003},"min":{"1min":0.66200000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.109,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94199999999999995,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":0.94399999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.252,"15min":1.252},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.70999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.748}]},{"osd":7,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.73799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.96399999999999997},"min":{"1min":0.67000000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.046}]},{"osd":9,"last update":"Thu Oct 5 15:35:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.22,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.03,"15min":1.0329999999999999},"min":{"1min":0.81100000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3029999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.077}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97999999999999998,"15min":0.97899999999999998},"min":{"1min":0.71099999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1579999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.90300000000000002},"min":{"1min":0.79000000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.23,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.95899999999999996}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.63100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.169,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.72599999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0820000000000001,"5min":1.208,"15min":1.208},"last":1.016}]}]},{"osd":7,"up_from":52,"seq":223338299453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1121481,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.61599999999999999,"15min":0.53800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71899999999999997,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.65700000000000003,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.46999999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82199999999999995,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.438,"15min":0.438},"max":{"1min":1.0800000000000001,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.73199999999999998},"min":{"1min":0.46999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.423,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82599999999999996,"15min":0.76700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.3650000000000002,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.022,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94399999999999995,"5min":1.127,"15min":1.127},"last":0.876},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.89000000000000001,"15min":0.80900000000000005},"min":{"1min":0.622,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":8.609,"15min":8.609},"last":1.052}]},{"osd":6,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.88700000000000001,"15min":0.84499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.119,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.82699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1930000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.92500000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":0.872},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.115,"5min":6.5300000000000002,"15min":6.5300000000000002},"last":0.996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90800000000000003,"15min":0.90000000000000002},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1699999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0720000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89200000000000002,"15min":0.91800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0980000000000001,"5min":1.28,"15min":1.28},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.90200000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1379999999999999,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":1.095}]},{"osd":10,"last update":"Thu Oct 5 15:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.96499999999999997,"15min":1.014},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2529999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.032,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":1.123}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.3420000000000001,"15min":1.4099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.228,"5min":8.7249999999999996,"15min":8.7249999999999996},"last":1.145},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.228,"15min":1.284},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.159,"5min":6.6230000000000002,"15min":6.6230000000000002},"last":0.95199999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462979,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":519535,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.44},"min":{"1min":0.35499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.55200000000000005,"15min":0.49199999999999999},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.67800000000000005},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76400000000000001,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.67200000000000004,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.877}]},{"osd":5,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.80200000000000005},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.84599999999999997,"15min":0.79700000000000004},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.94199999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:36:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.82399999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.91100000000000003,"15min":0.89700000000000002},"min":{"1min":0.58599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.68400000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.02,"5min":0.98299999999999998,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.90200000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.751,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.98599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":580601,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68700000000000006,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35799999999999998},"max":{"1min":0.93799999999999994,"5min":6.391,"15min":6.391},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":1.083},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97699999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.752}]},{"osd":3,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.022,"5min":1.046,"15min":1.046},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.78300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4139999999999997,"5min":6.4139999999999997,"15min":6.4139999999999997},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.74199999999999999},"min":{"1min":0.61899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78800000000000003,"15min":0.754},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.052,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.71999999999999997},"min":{"1min":0.53400000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92400000000000004,"5min":1.538,"15min":1.538},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Oct 5 15:35:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85399999999999998,"5min":1.51,"15min":1.51},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93899999999999995,"5min":1.381,"15min":1.381},"last":0.76300000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81399999999999995,"15min":0.78100000000000003},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.79700000000000004},"min":{"1min":0.64700000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0429999999999999,"5min":1.625,"15min":1.625},"last":0.78300000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.93200000000000005,"15min":0.89100000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.091,"5min":1.282,"15min":1.282},"last":0.85699999999999998}]},{"osd":10,"last update":"Thu Oct 5 15:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.94399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0700000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1559999999999999,"5min":1.609,"15min":1.609},"last":0.877}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.002,"15min":1.01},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1850000000000001,"5min":1.256,"15min":1.256},"last":0.90100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":521522,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0329999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73599999999999999,"15min":0.66300000000000003},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":1.0900000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.70399999999999996,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.97799999999999998,"5min":1.026,"15min":1.026},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":1.325,"15min":1.325},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.044,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.016},{"interface":"front","average":{"1min":0.875,"5min":0.755,"15min":0.69699999999999995},"min":{"1min":0.60999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.754,"15min":0.72599999999999998},"min":{"1min":0.54100000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.70899999999999996},"min":{"1min":0.59499999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.69699999999999995},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96599999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90700000000000003,"5min":1.417,"15min":1.417},"last":0.752}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89500000000000002,"15min":0.92000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95199999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.871},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1160000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.86099999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:36:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0600000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.105,"5min":1.258,"15min":1.258},"last":0.83199999999999996}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0840000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.581,"15min":1.581},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1619999999999999,"5min":1.538,"15min":1.538},"last":0.88},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.78100000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.3069999999999999,"5min":1.51,"15min":1.51},"last":0.91500000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.78900000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.105,"5min":1.534,"15min":1.534},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92200000000000004,"15min":0.91500000000000004},"min":{"1min":0.71599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0920000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.97999999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":579651,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71499999999999997,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.40899999999999997,"15min":0.378},"max":{"1min":1.0920000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.38400000000000001},"max":{"1min":0.93500000000000005,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.161,"5min":1.244,"15min":1.244},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83999999999999997,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59399999999999997,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.92600000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.60899999999999999,"15min":0.53600000000000003},"min":{"1min":0.41499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98299999999999998,"5min":1.149,"15min":1.149},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79400000000000004,"15min":0.73599999999999999},"min":{"1min":0.68200000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.81100000000000005,"15min":0.752},"min":{"1min":0.61699999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95899999999999996,"15min":0.96699999999999997},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1419999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.048},{"interface":"front","average":{"1min":0.874,"5min":0.91500000000000004,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.72499999999999998,"15min":0.68500000000000005},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.1759999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.879,"5min":0.78200000000000003,"15min":0.74099999999999999},"min":{"1min":0.56399999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.167,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91700000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.78200000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.84599999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.68300000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.238,"5min":1.284,"15min":1.284},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.012,"5min":0.92500000000000004,"15min":0.89500000000000002},"min":{"1min":0.78300000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.101}]},{"osd":11,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2529999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0529999999999999,"15min":1.056},"min":{"1min":0.78900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.272,"5min":1.413,"15min":1.413},"last":1.0760000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149777,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":518760,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.41799999999999998},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48399999999999999,"15min":0.438},"min":{"1min":0.378,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72799999999999998,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99399999999999999,"5min":1.079,"15min":1.079},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68700000000000006,"15min":0.63500000000000001},"min":{"1min":0.54800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91400000000000003,"5min":1.097,"15min":1.097},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.70299999999999996},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":1.022,"5min":1.109,"15min":1.109},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.72599999999999998,"15min":0.70399999999999996},"min":{"1min":0.64800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.81799999999999995,"15min":0.77000000000000002},"min":{"1min":0.72999999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.1220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.872}]},{"osd":5,"last update":"Thu Oct 5 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Oct 5 15:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.52800000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1870000000000001,"5min":1.409,"15min":1.409},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Oct 5 15:35:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.163,"15min":1.163},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.878,"15min":0.88200000000000001},"min":{"1min":0.63900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.171,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.93700000000000006}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2210000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.755}]},{"osd":10,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.97899999999999998,"15min":0.995},"min":{"1min":0.77000000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2010000000000001,"5min":1.331,"15min":1.331},"last":0.92000000000000004}]},{"osd":11,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.83999999999999997},"min":{"1min":0.72899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.006,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.82699999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.0700000000000001,"5min":1.246,"15min":1.246},"last":0.89800000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888141,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":525793,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.157,"5min":1.526,"15min":1.526},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.77700000000000002,"15min":0.69299999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":2.0249999999999999,"5min":3.762,"15min":3.762},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.66200000000000003},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":8.9619999999999997,"15min":8.9619999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.093,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.82099999999999995,"15min":0.77400000000000002},"min":{"1min":0.59499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77700000000000002,"15min":0.71799999999999997},"min":{"1min":0.495,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.90500000000000003,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.23,"5min":8.6839999999999993,"15min":8.6839999999999993},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70899999999999996,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0049999999999999,"5min":1.659,"15min":1.659},"last":0.87},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.591,"15min":1.591},"last":0.83399999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:36:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80700000000000005,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.83699999999999997},"min":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.82099999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3220000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0329999999999999,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":6.3789999999999996,"5min":6.3789999999999996,"15min":6.3789999999999996},"last":0.88300000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.75800000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.0409999999999999,"15min":1.0049999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.996,"5min":0.97199999999999998,"15min":0.96799999999999997},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.80800000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724615,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":1115766,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":1.671,"15min":1.671},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.626},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71999999999999997,"15min":0.66200000000000003},"min":{"1min":0.53000000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0649999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.71399999999999997,"15min":0.66700000000000004},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.752}]},{"osd":2,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52300000000000002,"15min":0.48299999999999998},"min":{"1min":0.45600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75600000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.55700000000000005,"15min":0.497},"min":{"1min":0.45300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.67400000000000004},"min":{"1min":0.55400000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.012,"5min":1.097,"15min":1.097},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.70599999999999996},"min":{"1min":0.63300000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.76800000000000002,"15min":0.69999999999999996},"min":{"1min":0.57099999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.81499999999999995,"15min":0.76000000000000001},"min":{"1min":0.67200000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.81299999999999994,"15min":0.76400000000000001},"min":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:35:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83599999999999997,"15min":0.78000000000000003},"min":{"1min":0.66000000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.83599999999999997,"15min":0.78500000000000003},"min":{"1min":0.73899999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.95699999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.75600000000000001,"15min":0.71399999999999997},"min":{"1min":0.61799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2010000000000001,"5min":1.385,"15min":1.385},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.81200000000000006,"15min":0.76100000000000001},"min":{"1min":0.60499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0309999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.89200000000000002},"min":{"1min":0.67900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.85799999999999998},"min":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.089}]},{"osd":10,"last update":"Thu Oct 5 15:36:14 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.97199999999999998,"15min":0.93200000000000005},"min":{"1min":0.88800000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.109},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.90000000000000002},"min":{"1min":0.81699999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.2390000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.0089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:36:48.239 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:36:48.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.471+0000 7fc97e7ff700 1 -- 172.21.15.17:0/2818656871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978102080 msgr2=0x7fc978102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.471+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/2818656871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978102080 0x7fc978102500 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009990 tx=0x7fc96c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 -- 172.21.15.17:0/2818656871 shutdown_connections 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/2818656871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978102a40 0x7fc978109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/2818656871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc978100ea0 0x7fc9781012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/2818656871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978102080 0x7fc978102500 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 -- 172.21.15.17:0/2818656871 >> 172.21.15.17:0/2818656871 conn(0x7fc9780fc420 msgr2=0x7fc9780fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 -- 172.21.15.17:0/2818656871 shutdown_connections 2023-10-05T15:36:48.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.472+0000 7fc97e7ff700 1 -- 172.21.15.17:0/2818656871 wait complete. 2023-10-05T15:36:48.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 Processor -- start 2023-10-05T15:36:48.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 -- start start 2023-10-05T15:36:48.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 0x7fc978198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:48.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc978102080 0x7fc978199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978102a40 0x7fc9781a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781a0950 con 0x7fc978100ea0 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781a0a90 con 0x7fc978102a40 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.473+0000 7fc97e7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781a0c20 con 0x7fc978102080 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 0x7fc978198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 0x7fc978198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54278/0 (socket says 172.21.15.17:54278) 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 -- 172.21.15.17:0/3989038206 learned_addr learned my addr 172.21.15.17:0/3989038206 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc97cd9c700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978102a40 0x7fc9781a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc9777fe700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc978102080 0x7fc978199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 -- 172.21.15.17:0/3989038206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc978102080 msgr2=0x7fc978199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc978102080 0x7fc978199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 -- 172.21.15.17:0/3989038206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978102a40 msgr2=0x7fc9781a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978102a40 0x7fc9781a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 -- 172.21.15.17:0/3989038206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968009520 con 0x7fc978100ea0 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.474+0000 7fc977fff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 0x7fc978198dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc96800ea50 tx=0x7fc96800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.475+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96800cbd0 con 0x7fc978100ea0 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.475+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc96800cd30 con 0x7fc978100ea0 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.475+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968018680 con 0x7fc978100ea0 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.475+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c0095f0 con 0x7fc978100ea0 2023-10-05T15:36:48.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.475+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9781a11d0 con 0x7fc978100ea0 2023-10-05T15:36:48.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.476+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978193400 con 0x7fc978100ea0 2023-10-05T15:36:48.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.478+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc968010430 con 0x7fc978100ea0 2023-10-05T15:36:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.479+0000 7fc9757fa700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9600a1550 0x7fc9600a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.480+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc968014070 con 0x7fc978100ea0 2023-10-05T15:36:48.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.480+0000 7fc9777fe700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9600a1550 0x7fc9600a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:48.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.480+0000 7fc9777fe700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9600a1550 0x7fc9600a3a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc96c005910 tx=0x7fc96c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.483+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9680968c0 con 0x7fc978100ea0 2023-10-05T15:36:48.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.727+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc97802d390 con 0x7fc9600a1550 2023-10-05T15:36:48.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.740+0000 7fc9757fa700 1 -- 172.21.15.17:0/3989038206 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426975 (secure 0 0 0) 0x7fc97802d390 con 0x7fc9600a1550 2023-10-05T15:36:48.747 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9600a1550 msgr2=0x7fc9600a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9600a1550 0x7fc9600a3a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc96c005910 tx=0x7fc96c00b260 comp rx=0 tx=0).stop 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 msgr2=0x7fc978198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 0x7fc978198dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc96800ea50 tx=0x7fc96800ed60 comp rx=0 tx=0).stop 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 shutdown_connections 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc9600a1550 0x7fc9600a3a10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978102a40 0x7fc9781a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc978100ea0 0x7fc978198dd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 --2- 172.21.15.17:0/3989038206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc978102080 0x7fc978199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:48.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 >> 172.21.15.17:0/3989038206 conn(0x7fc9780fc420 msgr2=0x7fc978107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 shutdown_connections 2023-10-05T15:36:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:48.746+0000 7fc97e7ff700 1 -- 172.21.15.17:0/3989038206 wait complete. 2023-10-05T15:36:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:36:48.766 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2023-10-05T15:36:48.614784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659535,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1195,"num_read_kb":716,"num_write":440,"num_write_kb":3090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1182672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336872,"kb_used_data":12676,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604952,"statfs":{"total":1151940427776,"available":1151595470848,"internally_reserved":0,"allocated":12980224,"data_stored":8234253,"data_compressed":392235,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003523"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650459+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:36:06.650459+0000","last_peered":"2023-10-05T15:36:06.650459+0000","last_clean":"2023-10-05T15:36:06.650459+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:36:06.650459+0000","last_undegraded":"2023-10-05T15:36:06.650459+0000","last_fullsized":"2023-10-05T15:36:06.650459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652225+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:36:06.652225+0000","last_peered":"2023-10-05T15:36:06.652225+0000","last_clean":"2023-10-05T15:36:06.652225+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:36:06.652225+0000","last_undegraded":"2023-10-05T15:36:06.652225+0000","last_fullsized":"2023-10-05T15:36:06.652225+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652543+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:36:06.652543+0000","last_peered":"2023-10-05T15:36:06.652543+0000","last_clean":"2023-10-05T15:36:06.652543+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:36:06.652543+0000","last_undegraded":"2023-10-05T15:36:06.652543+0000","last_fullsized":"2023-10-05T15:36:06.652543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650734+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:36:06.650734+0000","last_peered":"2023-10-05T15:36:06.650734+0000","last_clean":"2023-10-05T15:36:06.650734+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:36:06.650734+0000","last_undegraded":"2023-10-05T15:36:06.650734+0000","last_fullsized":"2023-10-05T15:36:06.650734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649404+0000","last_change":"2023-10-05T15:35:06.113534+0000","last_active":"2023-10-05T15:36:05.649404+0000","last_peered":"2023-10-05T15:36:05.649404+0000","last_clean":"2023-10-05T15:36:05.649404+0000","last_became_active":"2023-10-05T15:35:06.113092+0000","last_became_peered":"2023-10-05T15:35:06.113092+0000","last_unstale":"2023-10-05T15:36:05.649404+0000","last_undegraded":"2023-10-05T15:36:05.649404+0000","last_fullsized":"2023-10-05T15:36:05.649404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:35:36.334844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697331+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:36:05.697331+0000","last_peered":"2023-10-05T15:36:05.697331+0000","last_clean":"2023-10-05T15:36:05.697331+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:36:05.697331+0000","last_undegraded":"2023-10-05T15:36:05.697331+0000","last_fullsized":"2023-10-05T15:36:05.697331+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.652231+0000","last_change":"2023-10-05T15:35:05.781929+0000","last_active":"2023-10-05T15:36:05.652231+0000","last_peered":"2023-10-05T15:36:05.652231+0000","last_clean":"2023-10-05T15:36:05.652231+0000","last_became_active":"2023-10-05T15:35:05.781552+0000","last_became_peered":"2023-10-05T15:35:05.781552+0000","last_unstale":"2023-10-05T15:36:05.652231+0000","last_undegraded":"2023-10-05T15:36:05.652231+0000","last_fullsized":"2023-10-05T15:36:05.652231+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:28:34.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640086+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:36:05.640086+0000","last_peered":"2023-10-05T15:36:05.640086+0000","last_clean":"2023-10-05T15:36:05.640086+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:36:05.640086+0000","last_undegraded":"2023-10-05T15:36:05.640086+0000","last_fullsized":"2023-10-05T15:36:05.640086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645794+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:36:05.645794+0000","last_peered":"2023-10-05T15:36:05.645794+0000","last_clean":"2023-10-05T15:36:05.645794+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:36:05.645794+0000","last_undegraded":"2023-10-05T15:36:05.645794+0000","last_fullsized":"2023-10-05T15:36:05.645794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697739+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:36:05.697739+0000","last_peered":"2023-10-05T15:36:05.697739+0000","last_clean":"2023-10-05T15:36:05.697739+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:36:05.697739+0000","last_undegraded":"2023-10-05T15:36:05.697739+0000","last_fullsized":"2023-10-05T15:36:05.697739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649921+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:36:05.649921+0000","last_peered":"2023-10-05T15:36:05.649921+0000","last_clean":"2023-10-05T15:36:05.649921+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:36:05.649921+0000","last_undegraded":"2023-10-05T15:36:05.649921+0000","last_fullsized":"2023-10-05T15:36:05.649921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644823+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:36:05.644823+0000","last_peered":"2023-10-05T15:36:05.644823+0000","last_clean":"2023-10-05T15:36:05.644823+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:36:05.644823+0000","last_undegraded":"2023-10-05T15:36:05.644823+0000","last_fullsized":"2023-10-05T15:36:05.644823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649164+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:36:05.649164+0000","last_peered":"2023-10-05T15:36:05.649164+0000","last_clean":"2023-10-05T15:36:05.649164+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:36:05.649164+0000","last_undegraded":"2023-10-05T15:36:05.649164+0000","last_fullsized":"2023-10-05T15:36:05.649164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654427+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:36:05.654427+0000","last_peered":"2023-10-05T15:36:05.654427+0000","last_clean":"2023-10-05T15:36:05.654427+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:36:05.654427+0000","last_undegraded":"2023-10-05T15:36:05.654427+0000","last_fullsized":"2023-10-05T15:36:05.654427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654523+0000","last_change":"2023-10-05T15:35:05.959005+0000","last_active":"2023-10-05T15:36:05.654523+0000","last_peered":"2023-10-05T15:36:05.654523+0000","last_clean":"2023-10-05T15:36:05.654523+0000","last_became_active":"2023-10-05T15:35:05.958666+0000","last_became_peered":"2023-10-05T15:35:05.958666+0000","last_unstale":"2023-10-05T15:36:05.654523+0000","last_undegraded":"2023-10-05T15:36:05.654523+0000","last_fullsized":"2023-10-05T15:36:05.654523+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:58:50.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645612+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:36:05.645612+0000","last_peered":"2023-10-05T15:36:05.645612+0000","last_clean":"2023-10-05T15:36:05.645612+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:36:05.645612+0000","last_undegraded":"2023-10-05T15:36:05.645612+0000","last_fullsized":"2023-10-05T15:36:05.645612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654937+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:36:05.654937+0000","last_peered":"2023-10-05T15:36:05.654937+0000","last_clean":"2023-10-05T15:36:05.654937+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:36:05.654937+0000","last_undegraded":"2023-10-05T15:36:05.654937+0000","last_fullsized":"2023-10-05T15:36:05.654937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728355+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:36:05.728355+0000","last_peered":"2023-10-05T15:36:05.728355+0000","last_clean":"2023-10-05T15:36:05.728355+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:36:05.728355+0000","last_undegraded":"2023-10-05T15:36:05.728355+0000","last_fullsized":"2023-10-05T15:36:05.728355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653694+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:36:05.653694+0000","last_peered":"2023-10-05T15:36:05.653694+0000","last_clean":"2023-10-05T15:36:05.653694+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:36:05.653694+0000","last_undegraded":"2023-10-05T15:36:05.653694+0000","last_fullsized":"2023-10-05T15:36:05.653694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.652993+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:36:05.652993+0000","last_peered":"2023-10-05T15:36:05.652993+0000","last_clean":"2023-10-05T15:36:05.652993+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:36:05.652993+0000","last_undegraded":"2023-10-05T15:36:05.652993+0000","last_fullsized":"2023-10-05T15:36:05.652993+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"94'14","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.089972+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:36:42.089972+0000","last_peered":"2023-10-05T15:36:42.089972+0000","last_clean":"2023-10-05T15:36:42.089972+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:36:42.089972+0000","last_undegraded":"2023-10-05T15:36:42.089972+0000","last_fullsized":"2023-10-05T15:36:42.089972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646567+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:36:06.646567+0000","last_peered":"2023-10-05T15:36:06.646567+0000","last_clean":"2023-10-05T15:36:06.646567+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:36:06.646567+0000","last_undegraded":"2023-10-05T15:36:06.646567+0000","last_fullsized":"2023-10-05T15:36:06.646567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644070+0000","last_change":"2023-10-05T15:35:06.113477+0000","last_active":"2023-10-05T15:36:05.644070+0000","last_peered":"2023-10-05T15:36:05.644070+0000","last_clean":"2023-10-05T15:36:05.644070+0000","last_became_active":"2023-10-05T15:35:06.112876+0000","last_became_peered":"2023-10-05T15:35:06.112876+0000","last_unstale":"2023-10-05T15:36:05.644070+0000","last_undegraded":"2023-10-05T15:36:05.644070+0000","last_fullsized":"2023-10-05T15:36:05.644070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:41:51.762182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646620+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:36:06.646620+0000","last_peered":"2023-10-05T15:36:06.646620+0000","last_clean":"2023-10-05T15:36:06.646620+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:36:06.646620+0000","last_undegraded":"2023-10-05T15:36:06.646620+0000","last_fullsized":"2023-10-05T15:36:06.646620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652368+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:36:06.652368+0000","last_peered":"2023-10-05T15:36:06.652368+0000","last_clean":"2023-10-05T15:36:06.652368+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:36:06.652368+0000","last_undegraded":"2023-10-05T15:36:06.652368+0000","last_fullsized":"2023-10-05T15:36:06.652368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644457+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:36:05.644457+0000","last_peered":"2023-10-05T15:36:05.644457+0000","last_clean":"2023-10-05T15:36:05.644457+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:36:05.644457+0000","last_undegraded":"2023-10-05T15:36:05.644457+0000","last_fullsized":"2023-10-05T15:36:05.644457+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"92'12","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649997+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:36:05.649997+0000","last_peered":"2023-10-05T15:36:05.649997+0000","last_clean":"2023-10-05T15:36:05.649997+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:36:05.649997+0000","last_undegraded":"2023-10-05T15:36:05.649997+0000","last_fullsized":"2023-10-05T15:36:05.649997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645334+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:36:05.645334+0000","last_peered":"2023-10-05T15:36:05.645334+0000","last_clean":"2023-10-05T15:36:05.645334+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:36:05.645334+0000","last_undegraded":"2023-10-05T15:36:05.645334+0000","last_fullsized":"2023-10-05T15:36:05.645334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644195+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:36:05.644195+0000","last_peered":"2023-10-05T15:36:05.644195+0000","last_clean":"2023-10-05T15:36:05.644195+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:36:05.644195+0000","last_undegraded":"2023-10-05T15:36:05.644195+0000","last_fullsized":"2023-10-05T15:36:05.644195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649672+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:36:05.649672+0000","last_peered":"2023-10-05T15:36:05.649672+0000","last_clean":"2023-10-05T15:36:05.649672+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:36:05.649672+0000","last_undegraded":"2023-10-05T15:36:05.649672+0000","last_fullsized":"2023-10-05T15:36:05.649672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641892+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:36:05.641892+0000","last_peered":"2023-10-05T15:36:05.641892+0000","last_clean":"2023-10-05T15:36:05.641892+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:36:05.641892+0000","last_undegraded":"2023-10-05T15:36:05.641892+0000","last_fullsized":"2023-10-05T15:36:05.641892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653370+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:36:05.653370+0000","last_peered":"2023-10-05T15:36:05.653370+0000","last_clean":"2023-10-05T15:36:05.653370+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:36:05.653370+0000","last_undegraded":"2023-10-05T15:36:05.653370+0000","last_fullsized":"2023-10-05T15:36:05.653370+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"94'6","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.761095+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:36:42.761095+0000","last_peered":"2023-10-05T15:36:42.761095+0000","last_clean":"2023-10-05T15:36:42.761095+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:36:42.761095+0000","last_undegraded":"2023-10-05T15:36:42.761095+0000","last_fullsized":"2023-10-05T15:36:42.761095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649504+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:36:05.649504+0000","last_peered":"2023-10-05T15:36:05.649504+0000","last_clean":"2023-10-05T15:36:05.649504+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:36:05.649504+0000","last_undegraded":"2023-10-05T15:36:05.649504+0000","last_fullsized":"2023-10-05T15:36:05.649504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653607+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:36:05.653607+0000","last_peered":"2023-10-05T15:36:05.653607+0000","last_clean":"2023-10-05T15:36:05.653607+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:36:05.653607+0000","last_undegraded":"2023-10-05T15:36:05.653607+0000","last_fullsized":"2023-10-05T15:36:05.653607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697341+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:36:05.697341+0000","last_peered":"2023-10-05T15:36:05.697341+0000","last_clean":"2023-10-05T15:36:05.697341+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:36:05.697341+0000","last_undegraded":"2023-10-05T15:36:05.697341+0000","last_fullsized":"2023-10-05T15:36:05.697341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641698+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:36:05.641698+0000","last_peered":"2023-10-05T15:36:05.641698+0000","last_clean":"2023-10-05T15:36:05.641698+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:36:05.641698+0000","last_undegraded":"2023-10-05T15:36:05.641698+0000","last_fullsized":"2023-10-05T15:36:05.641698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650097+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:36:06.650097+0000","last_peered":"2023-10-05T15:36:06.650097+0000","last_clean":"2023-10-05T15:36:06.650097+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:36:06.650097+0000","last_undegraded":"2023-10-05T15:36:06.650097+0000","last_fullsized":"2023-10-05T15:36:06.650097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.648715+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:36:05.648715+0000","last_peered":"2023-10-05T15:36:05.648715+0000","last_clean":"2023-10-05T15:36:05.648715+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:36:05.648715+0000","last_undegraded":"2023-10-05T15:36:05.648715+0000","last_fullsized":"2023-10-05T15:36:05.648715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640274+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:36:05.640274+0000","last_peered":"2023-10-05T15:36:05.640274+0000","last_clean":"2023-10-05T15:36:05.640274+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:36:05.640274+0000","last_undegraded":"2023-10-05T15:36:05.640274+0000","last_fullsized":"2023-10-05T15:36:05.640274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652187+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:36:06.652187+0000","last_peered":"2023-10-05T15:36:06.652187+0000","last_clean":"2023-10-05T15:36:06.652187+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:36:06.652187+0000","last_undegraded":"2023-10-05T15:36:06.652187+0000","last_fullsized":"2023-10-05T15:36:06.652187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641155+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:36:05.641155+0000","last_peered":"2023-10-05T15:36:05.641155+0000","last_clean":"2023-10-05T15:36:05.641155+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:36:05.641155+0000","last_undegraded":"2023-10-05T15:36:05.641155+0000","last_fullsized":"2023-10-05T15:36:05.641155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728050+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:36:05.728050+0000","last_peered":"2023-10-05T15:36:05.728050+0000","last_clean":"2023-10-05T15:36:05.728050+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:36:05.728050+0000","last_undegraded":"2023-10-05T15:36:05.728050+0000","last_fullsized":"2023-10-05T15:36:05.728050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640597+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:36:05.640597+0000","last_peered":"2023-10-05T15:36:05.640597+0000","last_clean":"2023-10-05T15:36:05.640597+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:36:05.640597+0000","last_undegraded":"2023-10-05T15:36:05.640597+0000","last_fullsized":"2023-10-05T15:36:05.640597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"94'7","reported_seq":233,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.719740+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:36:43.719740+0000","last_peered":"2023-10-05T15:36:43.719740+0000","last_clean":"2023-10-05T15:36:43.719740+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:36:43.719740+0000","last_undegraded":"2023-10-05T15:36:43.719740+0000","last_fullsized":"2023-10-05T15:36:43.719740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.646440+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:36:05.646440+0000","last_peered":"2023-10-05T15:36:05.646440+0000","last_clean":"2023-10-05T15:36:05.646440+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:36:05.646440+0000","last_undegraded":"2023-10-05T15:36:05.646440+0000","last_fullsized":"2023-10-05T15:36:05.646440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.727918+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:36:05.727918+0000","last_peered":"2023-10-05T15:36:05.727918+0000","last_clean":"2023-10-05T15:36:05.727918+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:36:05.727918+0000","last_undegraded":"2023-10-05T15:36:05.727918+0000","last_fullsized":"2023-10-05T15:36:05.727918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.660645+0000","last_change":"2023-10-05T15:36:06.660645+0000","last_active":"2023-10-05T15:36:06.660645+0000","last_peered":"2023-10-05T15:36:06.660645+0000","last_clean":"2023-10-05T15:36:06.660645+0000","last_became_active":"2023-10-05T15:36:06.655841+0000","last_became_peered":"2023-10-05T15:36:06.655841+0000","last_unstale":"2023-10-05T15:36:06.660645+0000","last_undegraded":"2023-10-05T15:36:06.660645+0000","last_fullsized":"2023-10-05T15:36:06.660645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:38.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.655169+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:36:05.655169+0000","last_peered":"2023-10-05T15:36:05.655169+0000","last_clean":"2023-10-05T15:36:05.655169+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:36:05.655169+0000","last_undegraded":"2023-10-05T15:36:05.655169+0000","last_fullsized":"2023-10-05T15:36:05.655169+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644684+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:36:05.644684+0000","last_peered":"2023-10-05T15:36:05.644684+0000","last_clean":"2023-10-05T15:36:05.644684+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:36:05.644684+0000","last_undegraded":"2023-10-05T15:36:05.644684+0000","last_fullsized":"2023-10-05T15:36:05.644684+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642400+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:36:05.642400+0000","last_peered":"2023-10-05T15:36:05.642400+0000","last_clean":"2023-10-05T15:36:05.642400+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:36:05.642400+0000","last_undegraded":"2023-10-05T15:36:05.642400+0000","last_fullsized":"2023-10-05T15:36:05.642400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645442+0000","last_change":"2023-10-05T15:35:05.781201+0000","last_active":"2023-10-05T15:36:05.645442+0000","last_peered":"2023-10-05T15:36:05.645442+0000","last_clean":"2023-10-05T15:36:05.645442+0000","last_became_active":"2023-10-05T15:35:05.780760+0000","last_became_peered":"2023-10-05T15:35:05.780760+0000","last_unstale":"2023-10-05T15:36:05.645442+0000","last_undegraded":"2023-10-05T15:36:05.645442+0000","last_fullsized":"2023-10-05T15:36:05.645442+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:56:43.796707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.727962+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:36:05.727962+0000","last_peered":"2023-10-05T15:36:05.727962+0000","last_clean":"2023-10-05T15:36:05.727962+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:36:05.727962+0000","last_undegraded":"2023-10-05T15:36:05.727962+0000","last_fullsized":"2023-10-05T15:36:05.727962+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"94'38","reported_seq":273,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.775610+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:36:43.775610+0000","last_peered":"2023-10-05T15:36:43.775610+0000","last_clean":"2023-10-05T15:36:43.775610+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:36:43.775610+0000","last_undegraded":"2023-10-05T15:36:43.775610+0000","last_fullsized":"2023-10-05T15:36:43.775610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":214,"num_read_kb":166,"num_write":40,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649734+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:36:05.649734+0000","last_peered":"2023-10-05T15:36:05.649734+0000","last_clean":"2023-10-05T15:36:05.649734+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:36:05.649734+0000","last_undegraded":"2023-10-05T15:36:05.649734+0000","last_fullsized":"2023-10-05T15:36:05.649734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642307+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:36:05.642307+0000","last_peered":"2023-10-05T15:36:05.642307+0000","last_clean":"2023-10-05T15:36:05.642307+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:36:05.642307+0000","last_undegraded":"2023-10-05T15:36:05.642307+0000","last_fullsized":"2023-10-05T15:36:05.642307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653374+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:36:05.653374+0000","last_peered":"2023-10-05T15:36:05.653374+0000","last_clean":"2023-10-05T15:36:05.653374+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:36:05.653374+0000","last_undegraded":"2023-10-05T15:36:05.653374+0000","last_fullsized":"2023-10-05T15:36:05.653374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649038+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:36:05.649038+0000","last_peered":"2023-10-05T15:36:05.649038+0000","last_clean":"2023-10-05T15:36:05.649038+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:36:05.649038+0000","last_undegraded":"2023-10-05T15:36:05.649038+0000","last_fullsized":"2023-10-05T15:36:05.649038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654407+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:36:05.654407+0000","last_peered":"2023-10-05T15:36:05.654407+0000","last_clean":"2023-10-05T15:36:05.654407+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:36:05.654407+0000","last_undegraded":"2023-10-05T15:36:05.654407+0000","last_fullsized":"2023-10-05T15:36:05.654407+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641410+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:36:05.641410+0000","last_peered":"2023-10-05T15:36:05.641410+0000","last_clean":"2023-10-05T15:36:05.641410+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:36:05.641410+0000","last_undegraded":"2023-10-05T15:36:05.641410+0000","last_fullsized":"2023-10-05T15:36:05.641410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650681+0000","last_change":"2023-10-05T15:35:06.113316+0000","last_active":"2023-10-05T15:36:05.650681+0000","last_peered":"2023-10-05T15:36:05.650681+0000","last_clean":"2023-10-05T15:36:05.650681+0000","last_became_active":"2023-10-05T15:35:06.112866+0000","last_became_peered":"2023-10-05T15:35:06.112866+0000","last_unstale":"2023-10-05T15:36:05.650681+0000","last_undegraded":"2023-10-05T15:36:05.650681+0000","last_fullsized":"2023-10-05T15:36:05.650681+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:24:17.253672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728242+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:36:05.728242+0000","last_peered":"2023-10-05T15:36:05.728242+0000","last_clean":"2023-10-05T15:36:05.728242+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:36:05.728242+0000","last_undegraded":"2023-10-05T15:36:05.728242+0000","last_fullsized":"2023-10-05T15:36:05.728242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"94'6","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:46.791383+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:36:46.791383+0000","last_peered":"2023-10-05T15:36:46.791383+0000","last_clean":"2023-10-05T15:36:46.791383+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:36:46.791383+0000","last_undegraded":"2023-10-05T15:36:46.791383+0000","last_fullsized":"2023-10-05T15:36:46.791383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653551+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:36:05.653551+0000","last_peered":"2023-10-05T15:36:05.653551+0000","last_clean":"2023-10-05T15:36:05.653551+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:36:05.653551+0000","last_undegraded":"2023-10-05T15:36:05.653551+0000","last_fullsized":"2023-10-05T15:36:05.653551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649190+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:36:05.649190+0000","last_peered":"2023-10-05T15:36:05.649190+0000","last_clean":"2023-10-05T15:36:05.649190+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:36:05.649190+0000","last_undegraded":"2023-10-05T15:36:05.649190+0000","last_fullsized":"2023-10-05T15:36:05.649190+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.668184+0000","last_change":"2023-10-05T15:36:06.668184+0000","last_active":"2023-10-05T15:36:06.668184+0000","last_peered":"2023-10-05T15:36:06.668184+0000","last_clean":"2023-10-05T15:36:06.668184+0000","last_became_active":"2023-10-05T15:36:06.653648+0000","last_became_peered":"2023-10-05T15:36:06.653648+0000","last_unstale":"2023-10-05T15:36:06.668184+0000","last_undegraded":"2023-10-05T15:36:06.668184+0000","last_fullsized":"2023-10-05T15:36:06.668184+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:03:57.337078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641192+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:36:05.641192+0000","last_peered":"2023-10-05T15:36:05.641192+0000","last_clean":"2023-10-05T15:36:05.641192+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:36:05.641192+0000","last_undegraded":"2023-10-05T15:36:05.641192+0000","last_fullsized":"2023-10-05T15:36:05.641192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641091+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:36:05.641091+0000","last_peered":"2023-10-05T15:36:05.641091+0000","last_clean":"2023-10-05T15:36:05.641091+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:36:05.641091+0000","last_undegraded":"2023-10-05T15:36:05.641091+0000","last_fullsized":"2023-10-05T15:36:05.641091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"94'3","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.199943+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:36:42.199943+0000","last_peered":"2023-10-05T15:36:42.199943+0000","last_clean":"2023-10-05T15:36:42.199943+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:36:42.199943+0000","last_undegraded":"2023-10-05T15:36:42.199943+0000","last_fullsized":"2023-10-05T15:36:42.199943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654740+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:36:05.654740+0000","last_peered":"2023-10-05T15:36:05.654740+0000","last_clean":"2023-10-05T15:36:05.654740+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:36:05.654740+0000","last_undegraded":"2023-10-05T15:36:05.654740+0000","last_fullsized":"2023-10-05T15:36:05.654740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653389+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:36:06.653389+0000","last_peered":"2023-10-05T15:36:06.653389+0000","last_clean":"2023-10-05T15:36:06.653389+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:36:06.653389+0000","last_undegraded":"2023-10-05T15:36:06.653389+0000","last_fullsized":"2023-10-05T15:36:06.653389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.660288+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:36:06.660288+0000","last_peered":"2023-10-05T15:36:06.660288+0000","last_clean":"2023-10-05T15:36:06.660288+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:36:06.660288+0000","last_undegraded":"2023-10-05T15:36:06.660288+0000","last_fullsized":"2023-10-05T15:36:06.660288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.648280+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:36:06.648280+0000","last_peered":"2023-10-05T15:36:06.648280+0000","last_clean":"2023-10-05T15:36:06.648280+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:36:06.648280+0000","last_undegraded":"2023-10-05T15:36:06.648280+0000","last_fullsized":"2023-10-05T15:36:06.648280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726378+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:36:06.726378+0000","last_peered":"2023-10-05T15:36:06.726378+0000","last_clean":"2023-10-05T15:36:06.726378+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:36:06.726378+0000","last_undegraded":"2023-10-05T15:36:06.726378+0000","last_fullsized":"2023-10-05T15:36:06.726378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"94'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.801229+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:36:43.801229+0000","last_peered":"2023-10-05T15:36:43.801229+0000","last_clean":"2023-10-05T15:36:43.801229+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:36:43.801229+0000","last_undegraded":"2023-10-05T15:36:43.801229+0000","last_fullsized":"2023-10-05T15:36:43.801229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647872+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:36:06.647872+0000","last_peered":"2023-10-05T15:36:06.647872+0000","last_clean":"2023-10-05T15:36:06.647872+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:36:06.647872+0000","last_undegraded":"2023-10-05T15:36:06.647872+0000","last_fullsized":"2023-10-05T15:36:06.647872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649310+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:36:05.649310+0000","last_peered":"2023-10-05T15:36:05.649310+0000","last_clean":"2023-10-05T15:36:05.649310+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:36:05.649310+0000","last_undegraded":"2023-10-05T15:36:05.649310+0000","last_fullsized":"2023-10-05T15:36:05.649310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.702149+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:36:06.702149+0000","last_peered":"2023-10-05T15:36:06.702149+0000","last_clean":"2023-10-05T15:36:06.702149+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:36:06.702149+0000","last_undegraded":"2023-10-05T15:36:06.702149+0000","last_fullsized":"2023-10-05T15:36:06.702149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.783720+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:36:42.783720+0000","last_peered":"2023-10-05T15:36:42.783720+0000","last_clean":"2023-10-05T15:36:42.783720+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:36:42.783720+0000","last_undegraded":"2023-10-05T15:36:42.783720+0000","last_fullsized":"2023-10-05T15:36:42.783720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652587+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:36:06.652587+0000","last_peered":"2023-10-05T15:36:06.652587+0000","last_clean":"2023-10-05T15:36:06.652587+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:36:06.652587+0000","last_undegraded":"2023-10-05T15:36:06.652587+0000","last_fullsized":"2023-10-05T15:36:06.652587+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646751+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:36:06.646751+0000","last_peered":"2023-10-05T15:36:06.646751+0000","last_clean":"2023-10-05T15:36:06.646751+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:36:06.646751+0000","last_undegraded":"2023-10-05T15:36:06.646751+0000","last_fullsized":"2023-10-05T15:36:06.646751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650638+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:36:06.650638+0000","last_peered":"2023-10-05T15:36:06.650638+0000","last_clean":"2023-10-05T15:36:06.650638+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:36:06.650638+0000","last_undegraded":"2023-10-05T15:36:06.650638+0000","last_fullsized":"2023-10-05T15:36:06.650638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.651666+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:36:05.651666+0000","last_peered":"2023-10-05T15:36:05.651666+0000","last_clean":"2023-10-05T15:36:05.651666+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:36:05.651666+0000","last_undegraded":"2023-10-05T15:36:05.651666+0000","last_fullsized":"2023-10-05T15:36:05.651666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642102+0000","last_change":"2023-10-05T15:35:06.112775+0000","last_active":"2023-10-05T15:36:05.642102+0000","last_peered":"2023-10-05T15:36:05.642102+0000","last_clean":"2023-10-05T15:36:05.642102+0000","last_became_active":"2023-10-05T15:35:06.112332+0000","last_became_peered":"2023-10-05T15:35:06.112332+0000","last_unstale":"2023-10-05T15:36:05.642102+0000","last_undegraded":"2023-10-05T15:36:05.642102+0000","last_fullsized":"2023-10-05T15:36:05.642102+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:22.225861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.725649+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:36:06.725649+0000","last_peered":"2023-10-05T15:36:06.725649+0000","last_clean":"2023-10-05T15:36:06.725649+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:36:06.725649+0000","last_undegraded":"2023-10-05T15:36:06.725649+0000","last_fullsized":"2023-10-05T15:36:06.725649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.651727+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:36:06.651727+0000","last_peered":"2023-10-05T15:36:06.651727+0000","last_clean":"2023-10-05T15:36:06.651727+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:36:06.651727+0000","last_undegraded":"2023-10-05T15:36:06.651727+0000","last_fullsized":"2023-10-05T15:36:06.651727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650553+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:36:06.650553+0000","last_peered":"2023-10-05T15:36:06.650553+0000","last_clean":"2023-10-05T15:36:06.650553+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:36:06.650553+0000","last_undegraded":"2023-10-05T15:36:06.650553+0000","last_fullsized":"2023-10-05T15:36:06.650553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653465+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:36:06.653465+0000","last_peered":"2023-10-05T15:36:06.653465+0000","last_clean":"2023-10-05T15:36:06.653465+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:36:06.653465+0000","last_undegraded":"2023-10-05T15:36:06.653465+0000","last_fullsized":"2023-10-05T15:36:06.653465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726457+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:36:06.726457+0000","last_peered":"2023-10-05T15:36:06.726457+0000","last_clean":"2023-10-05T15:36:06.726457+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:36:06.726457+0000","last_undegraded":"2023-10-05T15:36:06.726457+0000","last_fullsized":"2023-10-05T15:36:06.726457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646126+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:36:06.646126+0000","last_peered":"2023-10-05T15:36:06.646126+0000","last_clean":"2023-10-05T15:36:06.646126+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:36:06.646126+0000","last_undegraded":"2023-10-05T15:36:06.646126+0000","last_fullsized":"2023-10-05T15:36:06.646126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"94'11","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.661691+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:36:06.661691+0000","last_peered":"2023-10-05T15:36:06.661691+0000","last_clean":"2023-10-05T15:36:06.661691+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:36:06.661691+0000","last_undegraded":"2023-10-05T15:36:06.661691+0000","last_fullsized":"2023-10-05T15:36:06.661691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646703+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:36:06.646703+0000","last_peered":"2023-10-05T15:36:06.646703+0000","last_clean":"2023-10-05T15:36:06.646703+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:36:06.646703+0000","last_undegraded":"2023-10-05T15:36:06.646703+0000","last_fullsized":"2023-10-05T15:36:06.646703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647252+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:36:06.647252+0000","last_peered":"2023-10-05T15:36:06.647252+0000","last_clean":"2023-10-05T15:36:06.647252+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:36:06.647252+0000","last_undegraded":"2023-10-05T15:36:06.647252+0000","last_fullsized":"2023-10-05T15:36:06.647252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650907+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:36:06.650907+0000","last_peered":"2023-10-05T15:36:06.650907+0000","last_clean":"2023-10-05T15:36:06.650907+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:36:06.650907+0000","last_undegraded":"2023-10-05T15:36:06.650907+0000","last_fullsized":"2023-10-05T15:36:06.650907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652300+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:36:06.652300+0000","last_peered":"2023-10-05T15:36:06.652300+0000","last_clean":"2023-10-05T15:36:06.652300+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:36:06.652300+0000","last_undegraded":"2023-10-05T15:36:06.652300+0000","last_fullsized":"2023-10-05T15:36:06.652300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644476+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:36:05.644476+0000","last_peered":"2023-10-05T15:36:05.644476+0000","last_clean":"2023-10-05T15:36:05.644476+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:36:05.644476+0000","last_undegraded":"2023-10-05T15:36:05.644476+0000","last_fullsized":"2023-10-05T15:36:05.644476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653334+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:36:06.653334+0000","last_peered":"2023-10-05T15:36:06.653334+0000","last_clean":"2023-10-05T15:36:06.653334+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:36:06.653334+0000","last_undegraded":"2023-10-05T15:36:06.653334+0000","last_fullsized":"2023-10-05T15:36:06.653334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652806+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:36:06.652806+0000","last_peered":"2023-10-05T15:36:06.652806+0000","last_clean":"2023-10-05T15:36:06.652806+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:36:06.652806+0000","last_undegraded":"2023-10-05T15:36:06.652806+0000","last_fullsized":"2023-10-05T15:36:06.652806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728348+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:36:05.728348+0000","last_peered":"2023-10-05T15:36:05.728348+0000","last_clean":"2023-10-05T15:36:05.728348+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:36:05.728348+0000","last_undegraded":"2023-10-05T15:36:05.728348+0000","last_fullsized":"2023-10-05T15:36:05.728348+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646624+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:36:06.646624+0000","last_peered":"2023-10-05T15:36:06.646624+0000","last_clean":"2023-10-05T15:36:06.646624+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:36:06.646624+0000","last_undegraded":"2023-10-05T15:36:06.646624+0000","last_fullsized":"2023-10-05T15:36:06.646624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650732+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:36:06.650732+0000","last_peered":"2023-10-05T15:36:06.650732+0000","last_clean":"2023-10-05T15:36:06.650732+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:36:06.650732+0000","last_undegraded":"2023-10-05T15:36:06.650732+0000","last_fullsized":"2023-10-05T15:36:06.650732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644944+0000","last_change":"2023-10-05T15:35:05.959978+0000","last_active":"2023-10-05T15:36:05.644944+0000","last_peered":"2023-10-05T15:36:05.644944+0000","last_clean":"2023-10-05T15:36:05.644944+0000","last_became_active":"2023-10-05T15:35:05.954464+0000","last_became_peered":"2023-10-05T15:35:05.954464+0000","last_unstale":"2023-10-05T15:36:05.644944+0000","last_undegraded":"2023-10-05T15:36:05.644944+0000","last_fullsized":"2023-10-05T15:36:05.644944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:31:05.392741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"94'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.972865+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:36:43.972865+0000","last_peered":"2023-10-05T15:36:43.972865+0000","last_clean":"2023-10-05T15:36:43.972865+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:36:43.972865+0000","last_undegraded":"2023-10-05T15:36:43.972865+0000","last_fullsized":"2023-10-05T15:36:43.972865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646511+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:36:06.646511+0000","last_peered":"2023-10-05T15:36:06.646511+0000","last_clean":"2023-10-05T15:36:06.646511+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:36:06.646511+0000","last_undegraded":"2023-10-05T15:36:06.646511+0000","last_fullsized":"2023-10-05T15:36:06.646511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644332+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:36:05.644332+0000","last_peered":"2023-10-05T15:36:05.644332+0000","last_clean":"2023-10-05T15:36:05.644332+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:36:05.644332+0000","last_undegraded":"2023-10-05T15:36:05.644332+0000","last_fullsized":"2023-10-05T15:36:05.644332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.672176+0000","last_change":"2023-10-05T15:36:06.672176+0000","last_active":"2023-10-05T15:36:06.672176+0000","last_peered":"2023-10-05T15:36:06.672176+0000","last_clean":"2023-10-05T15:36:06.672176+0000","last_became_active":"2023-10-05T15:36:06.655828+0000","last_became_peered":"2023-10-05T15:36:06.655828+0000","last_unstale":"2023-10-05T15:36:06.672176+0000","last_undegraded":"2023-10-05T15:36:06.672176+0000","last_fullsized":"2023-10-05T15:36:06.672176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:47.789216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652240+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:36:06.652240+0000","last_peered":"2023-10-05T15:36:06.652240+0000","last_clean":"2023-10-05T15:36:06.652240+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:36:06.652240+0000","last_undegraded":"2023-10-05T15:36:06.652240+0000","last_fullsized":"2023-10-05T15:36:06.652240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.727984+0000","last_change":"2023-10-05T15:36:06.727430+0000","last_active":"2023-10-05T15:36:06.727984+0000","last_peered":"2023-10-05T15:36:06.727984+0000","last_clean":"2023-10-05T15:36:06.727984+0000","last_became_active":"2023-10-05T15:36:06.726961+0000","last_became_peered":"2023-10-05T15:36:06.726961+0000","last_unstale":"2023-10-05T15:36:06.727984+0000","last_undegraded":"2023-10-05T15:36:06.727984+0000","last_fullsized":"2023-10-05T15:36:06.727984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:18:40.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"94'8","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:46.725735+0000","last_change":"2023-10-05T15:36:06.672116+0000","last_active":"2023-10-05T15:36:46.725735+0000","last_peered":"2023-10-05T15:36:46.725735+0000","last_clean":"2023-10-05T15:36:46.725735+0000","last_became_active":"2023-10-05T15:36:06.654419+0000","last_became_peered":"2023-10-05T15:36:06.654419+0000","last_unstale":"2023-10-05T15:36:46.725735+0000","last_undegraded":"2023-10-05T15:36:46.725735+0000","last_fullsized":"2023-10-05T15:36:46.725735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:25:27.679173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2184,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1701,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650109+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:36:05.650109+0000","last_peered":"2023-10-05T15:36:05.650109+0000","last_clean":"2023-10-05T15:36:05.650109+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:36:05.650109+0000","last_undegraded":"2023-10-05T15:36:05.650109+0000","last_fullsized":"2023-10-05T15:36:05.650109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.655260+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:36:05.655260+0000","last_peered":"2023-10-05T15:36:05.655260+0000","last_clean":"2023-10-05T15:36:05.655260+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:36:05.655260+0000","last_undegraded":"2023-10-05T15:36:05.655260+0000","last_fullsized":"2023-10-05T15:36:05.655260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642051+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:36:05.642051+0000","last_peered":"2023-10-05T15:36:05.642051+0000","last_clean":"2023-10-05T15:36:05.642051+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:36:05.642051+0000","last_undegraded":"2023-10-05T15:36:05.642051+0000","last_fullsized":"2023-10-05T15:36:05.642051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650432+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:36:05.650432+0000","last_peered":"2023-10-05T15:36:05.650432+0000","last_clean":"2023-10-05T15:36:05.650432+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:36:05.650432+0000","last_undegraded":"2023-10-05T15:36:05.650432+0000","last_fullsized":"2023-10-05T15:36:05.650432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640975+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:36:05.640975+0000","last_peered":"2023-10-05T15:36:05.640975+0000","last_clean":"2023-10-05T15:36:05.640975+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:36:05.640975+0000","last_undegraded":"2023-10-05T15:36:05.640975+0000","last_fullsized":"2023-10-05T15:36:05.640975+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649262+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:36:05.649262+0000","last_peered":"2023-10-05T15:36:05.649262+0000","last_clean":"2023-10-05T15:36:05.649262+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:36:05.649262+0000","last_undegraded":"2023-10-05T15:36:05.649262+0000","last_fullsized":"2023-10-05T15:36:05.649262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650578+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:36:05.650578+0000","last_peered":"2023-10-05T15:36:05.650578+0000","last_clean":"2023-10-05T15:36:05.650578+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:36:05.650578+0000","last_undegraded":"2023-10-05T15:36:05.650578+0000","last_fullsized":"2023-10-05T15:36:05.650578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650835+0000","last_change":"2023-10-05T15:35:05.959167+0000","last_active":"2023-10-05T15:36:06.650835+0000","last_peered":"2023-10-05T15:36:06.650835+0000","last_clean":"2023-10-05T15:36:06.650835+0000","last_became_active":"2023-10-05T15:35:05.958674+0000","last_became_peered":"2023-10-05T15:35:05.958674+0000","last_unstale":"2023-10-05T15:36:06.650835+0000","last_undegraded":"2023-10-05T15:36:06.650835+0000","last_fullsized":"2023-10-05T15:36:06.650835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:55:03.244565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647420+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:36:06.647420+0000","last_peered":"2023-10-05T15:36:06.647420+0000","last_clean":"2023-10-05T15:36:06.647420+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:36:06.647420+0000","last_undegraded":"2023-10-05T15:36:06.647420+0000","last_fullsized":"2023-10-05T15:36:06.647420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647361+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:36:06.647361+0000","last_peered":"2023-10-05T15:36:06.647361+0000","last_clean":"2023-10-05T15:36:06.647361+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:36:06.647361+0000","last_undegraded":"2023-10-05T15:36:06.647361+0000","last_fullsized":"2023-10-05T15:36:06.647361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652910+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:36:06.652910+0000","last_peered":"2023-10-05T15:36:06.652910+0000","last_clean":"2023-10-05T15:36:06.652910+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:36:06.652910+0000","last_undegraded":"2023-10-05T15:36:06.652910+0000","last_fullsized":"2023-10-05T15:36:06.652910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726472+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:36:06.726472+0000","last_peered":"2023-10-05T15:36:06.726472+0000","last_clean":"2023-10-05T15:36:06.726472+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:36:06.726472+0000","last_undegraded":"2023-10-05T15:36:06.726472+0000","last_fullsized":"2023-10-05T15:36:06.726472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650294+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:36:06.650294+0000","last_peered":"2023-10-05T15:36:06.650294+0000","last_clean":"2023-10-05T15:36:06.650294+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:36:06.650294+0000","last_undegraded":"2023-10-05T15:36:06.650294+0000","last_fullsized":"2023-10-05T15:36:06.650294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.648388+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:36:06.648388+0000","last_peered":"2023-10-05T15:36:06.648388+0000","last_clean":"2023-10-05T15:36:06.648388+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:36:06.648388+0000","last_undegraded":"2023-10-05T15:36:06.648388+0000","last_fullsized":"2023-10-05T15:36:06.648388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646887+0000","last_change":"2023-10-05T15:35:06.113556+0000","last_active":"2023-10-05T15:36:06.646887+0000","last_peered":"2023-10-05T15:36:06.646887+0000","last_clean":"2023-10-05T15:36:06.646887+0000","last_became_active":"2023-10-05T15:35:06.113152+0000","last_became_peered":"2023-10-05T15:35:06.113152+0000","last_unstale":"2023-10-05T15:36:06.646887+0000","last_undegraded":"2023-10-05T15:36:06.646887+0000","last_fullsized":"2023-10-05T15:36:06.646887+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:48.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.702029+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:36:06.702029+0000","last_peered":"2023-10-05T15:36:06.702029+0000","last_clean":"2023-10-05T15:36:06.702029+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:36:06.702029+0000","last_undegraded":"2023-10-05T15:36:06.702029+0000","last_fullsized":"2023-10-05T15:36:06.702029+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646304+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:36:06.646304+0000","last_peered":"2023-10-05T15:36:06.646304+0000","last_clean":"2023-10-05T15:36:06.646304+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:36:06.646304+0000","last_undegraded":"2023-10-05T15:36:06.646304+0000","last_fullsized":"2023-10-05T15:36:06.646304+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653783+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:36:06.653783+0000","last_peered":"2023-10-05T15:36:06.653783+0000","last_clean":"2023-10-05T15:36:06.653783+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:36:06.653783+0000","last_undegraded":"2023-10-05T15:36:06.653783+0000","last_fullsized":"2023-10-05T15:36:06.653783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.648971+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:36:05.648971+0000","last_peered":"2023-10-05T15:36:05.648971+0000","last_clean":"2023-10-05T15:36:05.648971+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:36:05.648971+0000","last_undegraded":"2023-10-05T15:36:05.648971+0000","last_fullsized":"2023-10-05T15:36:05.648971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654872+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:36:05.654872+0000","last_peered":"2023-10-05T15:36:05.654872+0000","last_clean":"2023-10-05T15:36:05.654872+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:36:05.654872+0000","last_undegraded":"2023-10-05T15:36:05.654872+0000","last_fullsized":"2023-10-05T15:36:05.654872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68921,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1069,"num_read_kb":607,"num_write":257,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1813,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":211083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":524744,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.41499999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1040000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91800000000000004,"5min":1.038,"15min":1.038},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.034,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.81799999999999995},"min":{"1min":0.62,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90500000000000003,"5min":1.135,"15min":1.135},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.78400000000000003},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81699999999999995,"15min":0.84899999999999998},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1259999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.498,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.94299999999999995,"15min":0.92500000000000004},"min":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2370000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.095},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.69199999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0549999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.161,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.002}]},{"osd":9,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.341,"5min":1.722,"15min":1.722},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0049999999999999,"15min":0.999},"min":{"1min":0.78200000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2889999999999999,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.042}]},{"osd":10,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":0.94199999999999995},"min":{"1min":0.621,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.196,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.02},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91300000000000003,"15min":0.89500000000000002},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1439999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.92600000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612654,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1183744,"data_stored":1174718,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.65000000000000002,"15min":0.69999999999999996},"min":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.998,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.4039999999999999,"5min":6.4039999999999999,"15min":6.4039999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78000000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.75600000000000001,"15min":0.80000000000000004},"min":{"1min":0.441,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.87,"15min":0.90100000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.008,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88400000000000001,"15min":0.91700000000000004},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.94299999999999995,"15min":0.99199999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1519999999999999,"5min":1.264,"15min":1.264},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93799999999999994,"15min":0.96699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.752}]},{"osd":9,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.026,"15min":1.052},"min":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97099999999999997,"15min":0.996},"min":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":0.72799999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":0.94499999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.097,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.236},"last":0.85799999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":523548,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99399999999999999,"5min":1.343,"15min":1.343},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82599999999999996,"15min":0.83499999999999996},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.085,"5min":1.109,"15min":1.109},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.628}]},{"osd":3,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.71999999999999997,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0309999999999999,"5min":1.258,"15min":1.258},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76000000000000001,"15min":0.78300000000000003},"min":{"1min":0.46500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.054,"5min":1.391,"15min":1.391},"last":0.875}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.96699999999999997,"15min":1.0229999999999999},"min":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1359999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.872,"15min":0.90500000000000003},"min":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.109,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.84799999999999998}]}]},{"osd":8,"up_from":60,"seq":257698037816,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":523814,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.155,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.629},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2250000000000001,"5min":1.431,"15min":1.431},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95499999999999996,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93000000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96599999999999997,"5min":1.04,"15min":1.04},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.004}]},{"osd":4,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.88100000000000001,"15min":0.91300000000000003},"min":{"1min":0.66200000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.109,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94199999999999995,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":0.94399999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.252,"15min":1.252},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.70999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.73799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.873},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.96399999999999997},"min":{"1min":0.67000000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.93999999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.22,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.046},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.03,"15min":1.0329999999999999},"min":{"1min":0.81100000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3029999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0700000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97999999999999998,"15min":0.97899999999999998},"min":{"1min":0.71099999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1579999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.90300000000000002},"min":{"1min":0.79000000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.23,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.89300000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.63100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.169,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.72599999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0820000000000001,"5min":1.208,"15min":1.208},"last":0.96199999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1121481,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.61599999999999999,"15min":0.53800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71899999999999997,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.65700000000000003,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.46999999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82199999999999995,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.438,"15min":0.438},"max":{"1min":1.0800000000000001,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.73199999999999998},"min":{"1min":0.46999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.423,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82599999999999996,"15min":0.76700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.3650000000000002,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.022,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94399999999999995,"5min":1.127,"15min":1.127},"last":0.876},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.89000000000000001,"15min":0.80900000000000005},"min":{"1min":0.622,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":8.609,"15min":8.609},"last":1.052}]},{"osd":6,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.88700000000000001,"15min":0.84499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.119,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.82699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1930000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.92500000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":0.872},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.115,"5min":6.5300000000000002,"15min":6.5300000000000002},"last":0.996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90800000000000003,"15min":0.90000000000000002},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1699999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0720000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89200000000000002,"15min":0.91800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0980000000000001,"5min":1.28,"15min":1.28},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.90200000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1379999999999999,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":1.095}]},{"osd":10,"last update":"Thu Oct 5 15:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.96499999999999997,"15min":1.014},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2529999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.032,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":1.123}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.3420000000000001,"15min":1.4099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.228,"5min":8.7249999999999996,"15min":8.7249999999999996},"last":1.145},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.228,"15min":1.284},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.159,"5min":6.6230000000000002,"15min":6.6230000000000002},"last":0.95199999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462979,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":519535,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.44},"min":{"1min":0.35499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.55200000000000005,"15min":0.49199999999999999},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.67800000000000005},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76400000000000001,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.67200000000000004,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.877}]},{"osd":5,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.80200000000000005},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.84599999999999997,"15min":0.79700000000000004},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.94199999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:36:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.82399999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.91100000000000003,"15min":0.89700000000000002},"min":{"1min":0.58599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.68400000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.02,"5min":0.98299999999999998,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.90200000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.751,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.98599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":584921,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68700000000000006,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35799999999999998},"max":{"1min":0.93799999999999994,"5min":6.391,"15min":6.391},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":1.083},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97699999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.022,"5min":1.046,"15min":1.046},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.78300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4139999999999997,"5min":6.4139999999999997,"15min":6.4139999999999997},"last":0.504}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.74199999999999999},"min":{"1min":0.61899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78800000000000003,"15min":0.754},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.052,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.71999999999999997},"min":{"1min":0.53400000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92400000000000004,"5min":1.538,"15min":1.538},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:35:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85399999999999998,"5min":1.51,"15min":1.51},"last":0.745},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93899999999999995,"5min":1.381,"15min":1.381},"last":0.93200000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81399999999999995,"15min":0.78100000000000003},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.79700000000000004},"min":{"1min":0.64700000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0429999999999999,"5min":1.625,"15min":1.625},"last":0.80600000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.93200000000000005,"15min":0.89100000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.091,"5min":1.282,"15min":1.282},"last":0.84399999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.94399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0700000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1559999999999999,"5min":1.609,"15min":1.609},"last":1.004}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.002,"15min":1.01},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1850000000000001,"5min":1.256,"15min":1.256},"last":1.0469999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":521522,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0329999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73599999999999999,"15min":0.66300000000000003},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":1.0900000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.70399999999999996,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.97799999999999998,"5min":1.026,"15min":1.026},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.432},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":1.325,"15min":1.325},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.0760000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.754,"15min":0.72599999999999998},"min":{"1min":0.54100000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.70899999999999996},"min":{"1min":0.59499999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.69699999999999995},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96599999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90700000000000003,"5min":1.417,"15min":1.417},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89500000000000002,"15min":0.92000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95199999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1160000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.0029999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:36:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0600000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.105,"5min":1.258,"15min":1.258},"last":0.91200000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0840000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.581,"15min":1.581},"last":0.88400000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1619999999999999,"5min":1.538,"15min":1.538},"last":0.874},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.78100000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.3069999999999999,"5min":1.51,"15min":1.51},"last":1.0649999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.78900000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.105,"5min":1.534,"15min":1.534},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92200000000000004,"15min":0.91500000000000004},"min":{"1min":0.71599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0920000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.94099999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":579651,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71499999999999997,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.40899999999999997,"15min":0.378},"max":{"1min":1.0920000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.38400000000000001},"max":{"1min":0.93500000000000005,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.161,"5min":1.244,"15min":1.244},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83999999999999997,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59399999999999997,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.92600000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.60899999999999999,"15min":0.53600000000000003},"min":{"1min":0.41499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98299999999999998,"5min":1.149,"15min":1.149},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79400000000000004,"15min":0.73599999999999999},"min":{"1min":0.68200000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.81100000000000005,"15min":0.752},"min":{"1min":0.61699999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95899999999999996,"15min":0.96699999999999997},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1419999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.048},{"interface":"front","average":{"1min":0.874,"5min":0.91500000000000004,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.72499999999999998,"15min":0.68500000000000005},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.1759999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.879,"5min":0.78200000000000003,"15min":0.74099999999999999},"min":{"1min":0.56399999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.167,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91700000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.78200000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.84599999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.68300000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.238,"5min":1.284,"15min":1.284},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.012,"5min":0.92500000000000004,"15min":0.89500000000000002},"min":{"1min":0.78300000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.101}]},{"osd":11,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2529999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0529999999999999,"15min":1.056},"min":{"1min":0.78900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.272,"5min":1.413,"15min":1.413},"last":1.0760000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149778,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":518760,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.41799999999999998},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48399999999999999,"15min":0.438},"min":{"1min":0.378,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72799999999999998,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99399999999999999,"5min":1.079,"15min":1.079},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68700000000000006,"15min":0.63500000000000001},"min":{"1min":0.54800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91400000000000003,"5min":1.097,"15min":1.097},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.70299999999999996},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":1.022,"5min":1.109,"15min":1.109},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Oct 5 15:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.74199999999999999,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94899999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83299999999999996,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.76300000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91900000000000004,"5min":1.409,"15min":1.409},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Oct 5 15:35:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.163,"15min":1.163},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.878,"15min":0.88200000000000001},"min":{"1min":0.63900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.171,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.94599999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2210000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.97899999999999998,"15min":0.995},"min":{"1min":0.77000000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2010000000000001,"5min":1.331,"15min":1.331},"last":0.98699999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.83999999999999997},"min":{"1min":0.72899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.006,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.82699999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.0700000000000001,"5min":1.246,"15min":1.246},"last":0.92600000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888142,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":525793,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.157,"5min":1.526,"15min":1.526},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.77700000000000002,"15min":0.69299999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":2.0249999999999999,"5min":3.762,"15min":3.762},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.66200000000000003},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":8.9619999999999997,"15min":8.9619999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.093,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.82099999999999995,"15min":0.77400000000000002},"min":{"1min":0.59499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77700000000000002,"15min":0.71799999999999997},"min":{"1min":0.495,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.90500000000000003,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.23,"5min":8.6839999999999993,"15min":8.6839999999999993},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70899999999999996,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0049999999999999,"5min":1.659,"15min":1.659},"last":0.87},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.591,"15min":1.591},"last":0.83399999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:36:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80700000000000005,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.83699999999999997},"min":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.82099999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3220000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0329999999999999,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":6.3789999999999996,"5min":6.3789999999999996,"15min":6.3789999999999996},"last":0.88300000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.75800000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.0409999999999999,"15min":1.0049999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.996,"5min":0.97199999999999998,"15min":0.96799999999999997},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.80800000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724615,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":1115766,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":1.671,"15min":1.671},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.626},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71999999999999997,"15min":0.66200000000000003},"min":{"1min":0.53000000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0649999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.71399999999999997,"15min":0.66700000000000004},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.752}]},{"osd":2,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52300000000000002,"15min":0.48299999999999998},"min":{"1min":0.45600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75600000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.55700000000000005,"15min":0.497},"min":{"1min":0.45300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.67400000000000004},"min":{"1min":0.55400000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.012,"5min":1.097,"15min":1.097},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.70599999999999996},"min":{"1min":0.63300000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.76800000000000002,"15min":0.69999999999999996},"min":{"1min":0.57099999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.81499999999999995,"15min":0.76000000000000001},"min":{"1min":0.67200000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.81299999999999994,"15min":0.76400000000000001},"min":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:35:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83599999999999997,"15min":0.78000000000000003},"min":{"1min":0.66000000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.83599999999999997,"15min":0.78500000000000003},"min":{"1min":0.73899999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.95699999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.75600000000000001,"15min":0.71399999999999997},"min":{"1min":0.61799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2010000000000001,"5min":1.385,"15min":1.385},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.81200000000000006,"15min":0.76100000000000001},"min":{"1min":0.60499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0309999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.89200000000000002},"min":{"1min":0.67900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.85799999999999998},"min":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.089}]},{"osd":10,"last update":"Thu Oct 5 15:36:14 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.97199999999999998,"15min":0.93200000000000005},"min":{"1min":0.88800000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.109},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.90000000000000002},"min":{"1min":0.81699999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.2390000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.0089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:36:48.776 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-05T15:36:48.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T15:36:48.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:48 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1885191481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:49.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 -- 172.21.15.17:0/1091783675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878100ea0 msgr2=0x7ff8781012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/1091783675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878100ea0 0x7ff8781012c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff868009990 tx=0x7ff868009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 -- 172.21.15.17:0/1091783675 shutdown_connections 2023-10-05T15:36:49.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/1091783675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff878102a40 0x7ff878109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/1091783675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878100ea0 0x7ff8781012c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/1091783675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff878102080 0x7ff878102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 -- 172.21.15.17:0/1091783675 >> 172.21.15.17:0/1091783675 conn(0x7ff8780fc420 msgr2=0x7ff8780fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:49.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 -- 172.21.15.17:0/1091783675 shutdown_connections 2023-10-05T15:36:49.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.007+0000 7ff87d7ff700 1 -- 172.21.15.17:0/1091783675 wait complete. 2023-10-05T15:36:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.008+0000 7ff87d7ff700 1 Processor -- start 2023-10-05T15:36:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.008+0000 7ff87d7ff700 1 -- start start 2023-10-05T15:36:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff87d7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff878100ea0 0x7ff878196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff87d7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff878102080 0x7ff878197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff87d7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 0x7ff87819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff87d7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87819e680 con 0x7ff878102a40 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff87d7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87819e7c0 con 0x7ff878100ea0 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff87d7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87819e950 con 0x7ff878102080 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff8777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 0x7ff87819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff8777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 0x7ff87819e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54294/0 (socket says 172.21.15.17:54294) 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff8777fe700 1 -- 172.21.15.17:0/115498610 learned_addr learned my addr 172.21.15.17:0/115498610 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff876ffd700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff878100ea0 0x7ff878196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.009+0000 7ff8767fc700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff878102080 0x7ff878197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff8777fe700 1 -- 172.21.15.17:0/115498610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff878102080 msgr2=0x7ff878197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff8777fe700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff878102080 0x7ff878197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff8777fe700 1 -- 172.21.15.17:0/115498610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff878100ea0 msgr2=0x7ff878196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff8777fe700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff878100ea0 0x7ff878196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff8777fe700 1 -- 172.21.15.17:0/115498610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680095f0 con 0x7ff878102a40 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff8777fe700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 0x7ff87819e0b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff870007ee0 tx=0x7ff87000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870017070 con 0x7ff878102a40 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff87000f040 con 0x7ff878102a40 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87819ec30 con 0x7ff878102a40 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870005570 con 0x7ff878102a40 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.010+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87819f140 con 0x7ff878102a40 2023-10-05T15:36:49.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.011+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87810c610 con 0x7ff878102a40 2023-10-05T15:36:49.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.013+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff87000db20 con 0x7ff878102a40 2023-10-05T15:36:49.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.015+0000 7ff85ffff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8600a1550 0x7ff8600a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.015+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff8700cc820 con 0x7ff878102a40 2023-10-05T15:36:49.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.015+0000 7ff876ffd700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8600a1550 0x7ff8600a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.015+0000 7ff876ffd700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8600a1550 0x7ff8600a3a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff868006010 tx=0x7ff8680058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:49.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.019+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff870095a80 con 0x7ff878102a40 2023-10-05T15:36:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:48 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1885191481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:49.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:48 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1885191481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.224+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 --> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8780612f0 con 0x7ff8600a1550 2023-10-05T15:36:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.238+0000 7ff85ffff700 1 -- 172.21.15.17:0/115498610 <== mgr.14150 v2:172.21.15.17:6800/1244004544 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+426975 (secure 0 0 0) 0x7ff8780612f0 con 0x7ff8600a1550 2023-10-05T15:36:49.245 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.242+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8600a1550 msgr2=0x7ff8600a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.242+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8600a1550 0x7ff8600a3a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff868006010 tx=0x7ff8680058e0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.242+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 msgr2=0x7ff87819e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.242+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 0x7ff87819e0b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff870007ee0 tx=0x7ff87000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 shutdown_connections 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8600a1550 0x7ff8600a3a10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff878102a40 0x7ff87819e0b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff878100ea0 0x7ff878196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 --2- 172.21.15.17:0/115498610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff878102080 0x7ff878197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 >> 172.21.15.17:0/115498610 conn(0x7ff8780fc420 msgr2=0x7ff8780fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 shutdown_connections 2023-10-05T15:36:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.243+0000 7ff87d7ff700 1 -- 172.21.15.17:0/115498610 wait complete. 2023-10-05T15:36:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-10-05T15:36:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2023-10-05T15:36:48.614784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659535,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1195,"num_read_kb":716,"num_write":440,"num_write_kb":3090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1182672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336872,"kb_used_data":12676,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604952,"statfs":{"total":1151940427776,"available":1151595470848,"internally_reserved":0,"allocated":12980224,"data_stored":8234253,"data_compressed":392235,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003523"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650459+0000","last_change":"2023-10-05T15:34:32.609789+0000","last_active":"2023-10-05T15:36:06.650459+0000","last_peered":"2023-10-05T15:36:06.650459+0000","last_clean":"2023-10-05T15:36:06.650459+0000","last_became_active":"2023-10-05T15:34:32.609252+0000","last_became_peered":"2023-10-05T15:34:32.609252+0000","last_unstale":"2023-10-05T15:36:06.650459+0000","last_undegraded":"2023-10-05T15:36:06.650459+0000","last_fullsized":"2023-10-05T15:36:06.650459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:18:22.302596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652225+0000","last_change":"2023-10-05T15:34:32.611665+0000","last_active":"2023-10-05T15:36:06.652225+0000","last_peered":"2023-10-05T15:36:06.652225+0000","last_clean":"2023-10-05T15:36:06.652225+0000","last_became_active":"2023-10-05T15:34:32.611361+0000","last_became_peered":"2023-10-05T15:34:32.611361+0000","last_unstale":"2023-10-05T15:36:06.652225+0000","last_undegraded":"2023-10-05T15:36:06.652225+0000","last_fullsized":"2023-10-05T15:36:06.652225+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:55:24.584999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652543+0000","last_change":"2023-10-05T15:34:32.609156+0000","last_active":"2023-10-05T15:36:06.652543+0000","last_peered":"2023-10-05T15:36:06.652543+0000","last_clean":"2023-10-05T15:36:06.652543+0000","last_became_active":"2023-10-05T15:34:32.608826+0000","last_became_peered":"2023-10-05T15:34:32.608826+0000","last_unstale":"2023-10-05T15:36:06.652543+0000","last_undegraded":"2023-10-05T15:36:06.652543+0000","last_fullsized":"2023-10-05T15:36:06.652543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:47:06.682307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650734+0000","last_change":"2023-10-05T15:34:32.609596+0000","last_active":"2023-10-05T15:36:06.650734+0000","last_peered":"2023-10-05T15:36:06.650734+0000","last_clean":"2023-10-05T15:36:06.650734+0000","last_became_active":"2023-10-05T15:34:32.609259+0000","last_became_peered":"2023-10-05T15:34:32.609259+0000","last_unstale":"2023-10-05T15:36:06.650734+0000","last_undegraded":"2023-10-05T15:36:06.650734+0000","last_fullsized":"2023-10-05T15:36:06.650734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:53:01.664012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649404+0000","last_change":"2023-10-05T15:35:06.113534+0000","last_active":"2023-10-05T15:36:05.649404+0000","last_peered":"2023-10-05T15:36:05.649404+0000","last_clean":"2023-10-05T15:36:05.649404+0000","last_became_active":"2023-10-05T15:35:06.113092+0000","last_became_peered":"2023-10-05T15:35:06.113092+0000","last_unstale":"2023-10-05T15:36:05.649404+0000","last_undegraded":"2023-10-05T15:36:05.649404+0000","last_fullsized":"2023-10-05T15:36:05.649404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:35:36.334844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697331+0000","last_change":"2023-10-05T15:34:32.609525+0000","last_active":"2023-10-05T15:36:05.697331+0000","last_peered":"2023-10-05T15:36:05.697331+0000","last_clean":"2023-10-05T15:36:05.697331+0000","last_became_active":"2023-10-05T15:34:32.609223+0000","last_became_peered":"2023-10-05T15:34:32.609223+0000","last_unstale":"2023-10-05T15:36:05.697331+0000","last_undegraded":"2023-10-05T15:36:05.697331+0000","last_fullsized":"2023-10-05T15:36:05.697331+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:49:03.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.652231+0000","last_change":"2023-10-05T15:35:05.781929+0000","last_active":"2023-10-05T15:36:05.652231+0000","last_peered":"2023-10-05T15:36:05.652231+0000","last_clean":"2023-10-05T15:36:05.652231+0000","last_became_active":"2023-10-05T15:35:05.781552+0000","last_became_peered":"2023-10-05T15:35:05.781552+0000","last_unstale":"2023-10-05T15:36:05.652231+0000","last_undegraded":"2023-10-05T15:36:05.652231+0000","last_fullsized":"2023-10-05T15:36:05.652231+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:28:34.881492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640086+0000","last_change":"2023-10-05T15:34:32.606285+0000","last_active":"2023-10-05T15:36:05.640086+0000","last_peered":"2023-10-05T15:36:05.640086+0000","last_clean":"2023-10-05T15:36:05.640086+0000","last_became_active":"2023-10-05T15:34:32.605510+0000","last_became_peered":"2023-10-05T15:34:32.605510+0000","last_unstale":"2023-10-05T15:36:05.640086+0000","last_undegraded":"2023-10-05T15:36:05.640086+0000","last_fullsized":"2023-10-05T15:36:05.640086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:19:33.474233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645794+0000","last_change":"2023-10-05T15:34:32.608158+0000","last_active":"2023-10-05T15:36:05.645794+0000","last_peered":"2023-10-05T15:36:05.645794+0000","last_clean":"2023-10-05T15:36:05.645794+0000","last_became_active":"2023-10-05T15:34:32.607837+0000","last_became_peered":"2023-10-05T15:34:32.607837+0000","last_unstale":"2023-10-05T15:36:05.645794+0000","last_undegraded":"2023-10-05T15:36:05.645794+0000","last_fullsized":"2023-10-05T15:36:05.645794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:08:01.316684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":36,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697739+0000","last_change":"2023-10-05T15:34:32.610425+0000","last_active":"2023-10-05T15:36:05.697739+0000","last_peered":"2023-10-05T15:36:05.697739+0000","last_clean":"2023-10-05T15:36:05.697739+0000","last_became_active":"2023-10-05T15:34:32.610001+0000","last_became_peered":"2023-10-05T15:34:32.610001+0000","last_unstale":"2023-10-05T15:36:05.697739+0000","last_undegraded":"2023-10-05T15:36:05.697739+0000","last_fullsized":"2023-10-05T15:36:05.697739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:55.297788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649921+0000","last_change":"2023-10-05T15:34:32.608522+0000","last_active":"2023-10-05T15:36:05.649921+0000","last_peered":"2023-10-05T15:36:05.649921+0000","last_clean":"2023-10-05T15:36:05.649921+0000","last_became_active":"2023-10-05T15:34:32.608184+0000","last_became_peered":"2023-10-05T15:34:32.608184+0000","last_unstale":"2023-10-05T15:36:05.649921+0000","last_undegraded":"2023-10-05T15:36:05.649921+0000","last_fullsized":"2023-10-05T15:36:05.649921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:54:47.982918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644823+0000","last_change":"2023-10-05T15:34:32.610889+0000","last_active":"2023-10-05T15:36:05.644823+0000","last_peered":"2023-10-05T15:36:05.644823+0000","last_clean":"2023-10-05T15:36:05.644823+0000","last_became_active":"2023-10-05T15:34:32.610435+0000","last_became_peered":"2023-10-05T15:34:32.610435+0000","last_unstale":"2023-10-05T15:36:05.644823+0000","last_undegraded":"2023-10-05T15:36:05.644823+0000","last_fullsized":"2023-10-05T15:36:05.644823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.189454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649164+0000","last_change":"2023-10-05T15:34:32.608223+0000","last_active":"2023-10-05T15:36:05.649164+0000","last_peered":"2023-10-05T15:36:05.649164+0000","last_clean":"2023-10-05T15:36:05.649164+0000","last_became_active":"2023-10-05T15:34:32.607803+0000","last_became_peered":"2023-10-05T15:34:32.607803+0000","last_unstale":"2023-10-05T15:36:05.649164+0000","last_undegraded":"2023-10-05T15:36:05.649164+0000","last_fullsized":"2023-10-05T15:36:05.649164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:17:03.558855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654427+0000","last_change":"2023-10-05T15:34:32.611029+0000","last_active":"2023-10-05T15:36:05.654427+0000","last_peered":"2023-10-05T15:36:05.654427+0000","last_clean":"2023-10-05T15:36:05.654427+0000","last_became_active":"2023-10-05T15:34:32.610693+0000","last_became_peered":"2023-10-05T15:34:32.610693+0000","last_unstale":"2023-10-05T15:36:05.654427+0000","last_undegraded":"2023-10-05T15:36:05.654427+0000","last_fullsized":"2023-10-05T15:36:05.654427+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:03:51.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654523+0000","last_change":"2023-10-05T15:35:05.959005+0000","last_active":"2023-10-05T15:36:05.654523+0000","last_peered":"2023-10-05T15:36:05.654523+0000","last_clean":"2023-10-05T15:36:05.654523+0000","last_became_active":"2023-10-05T15:35:05.958666+0000","last_became_peered":"2023-10-05T15:35:05.958666+0000","last_unstale":"2023-10-05T15:36:05.654523+0000","last_undegraded":"2023-10-05T15:36:05.654523+0000","last_fullsized":"2023-10-05T15:36:05.654523+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:58:50.913842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645612+0000","last_change":"2023-10-05T15:34:32.605134+0000","last_active":"2023-10-05T15:36:05.645612+0000","last_peered":"2023-10-05T15:36:05.645612+0000","last_clean":"2023-10-05T15:36:05.645612+0000","last_became_active":"2023-10-05T15:34:32.604153+0000","last_became_peered":"2023-10-05T15:34:32.604153+0000","last_unstale":"2023-10-05T15:36:05.645612+0000","last_undegraded":"2023-10-05T15:36:05.645612+0000","last_fullsized":"2023-10-05T15:36:05.645612+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:33.713093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654937+0000","last_change":"2023-10-05T15:34:32.613981+0000","last_active":"2023-10-05T15:36:05.654937+0000","last_peered":"2023-10-05T15:36:05.654937+0000","last_clean":"2023-10-05T15:36:05.654937+0000","last_became_active":"2023-10-05T15:34:32.613660+0000","last_became_peered":"2023-10-05T15:34:32.613660+0000","last_unstale":"2023-10-05T15:36:05.654937+0000","last_undegraded":"2023-10-05T15:36:05.654937+0000","last_fullsized":"2023-10-05T15:36:05.654937+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:44:17.244959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728355+0000","last_change":"2023-10-05T15:34:32.609674+0000","last_active":"2023-10-05T15:36:05.728355+0000","last_peered":"2023-10-05T15:36:05.728355+0000","last_clean":"2023-10-05T15:36:05.728355+0000","last_became_active":"2023-10-05T15:34:32.609166+0000","last_became_peered":"2023-10-05T15:34:32.609166+0000","last_unstale":"2023-10-05T15:36:05.728355+0000","last_undegraded":"2023-10-05T15:36:05.728355+0000","last_fullsized":"2023-10-05T15:36:05.728355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:45:13.449859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653694+0000","last_change":"2023-10-05T15:34:32.594001+0000","last_active":"2023-10-05T15:36:05.653694+0000","last_peered":"2023-10-05T15:36:05.653694+0000","last_clean":"2023-10-05T15:36:05.653694+0000","last_became_active":"2023-10-05T15:34:32.593656+0000","last_became_peered":"2023-10-05T15:34:32.593656+0000","last_unstale":"2023-10-05T15:36:05.653694+0000","last_undegraded":"2023-10-05T15:36:05.653694+0000","last_fullsized":"2023-10-05T15:36:05.653694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:39:28.664165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.652993+0000","last_change":"2023-10-05T15:34:36.662154+0000","last_active":"2023-10-05T15:36:05.652993+0000","last_peered":"2023-10-05T15:36:05.652993+0000","last_clean":"2023-10-05T15:36:05.652993+0000","last_became_active":"2023-10-05T15:34:36.661760+0000","last_became_peered":"2023-10-05T15:34:36.661760+0000","last_unstale":"2023-10-05T15:36:05.652993+0000","last_undegraded":"2023-10-05T15:36:05.652993+0000","last_fullsized":"2023-10-05T15:36:05.652993+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:49:55.577508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"94'14","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.089972+0000","last_change":"2023-10-05T15:34:31.611551+0000","last_active":"2023-10-05T15:36:42.089972+0000","last_peered":"2023-10-05T15:36:42.089972+0000","last_clean":"2023-10-05T15:36:42.089972+0000","last_became_active":"2023-10-05T15:34:31.611264+0000","last_became_peered":"2023-10-05T15:34:31.611264+0000","last_unstale":"2023-10-05T15:36:42.089972+0000","last_undegraded":"2023-10-05T15:36:42.089972+0000","last_fullsized":"2023-10-05T15:36:42.089972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:33:55.519686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646567+0000","last_change":"2023-10-05T15:34:32.610391+0000","last_active":"2023-10-05T15:36:06.646567+0000","last_peered":"2023-10-05T15:36:06.646567+0000","last_clean":"2023-10-05T15:36:06.646567+0000","last_became_active":"2023-10-05T15:34:32.609979+0000","last_became_peered":"2023-10-05T15:34:32.609979+0000","last_unstale":"2023-10-05T15:36:06.646567+0000","last_undegraded":"2023-10-05T15:36:06.646567+0000","last_fullsized":"2023-10-05T15:36:06.646567+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:44:11.964142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644070+0000","last_change":"2023-10-05T15:35:06.113477+0000","last_active":"2023-10-05T15:36:05.644070+0000","last_peered":"2023-10-05T15:36:05.644070+0000","last_clean":"2023-10-05T15:36:05.644070+0000","last_became_active":"2023-10-05T15:35:06.112876+0000","last_became_peered":"2023-10-05T15:35:06.112876+0000","last_unstale":"2023-10-05T15:36:05.644070+0000","last_undegraded":"2023-10-05T15:36:05.644070+0000","last_fullsized":"2023-10-05T15:36:05.644070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:41:51.762182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646620+0000","last_change":"2023-10-05T15:34:31.614845+0000","last_active":"2023-10-05T15:36:06.646620+0000","last_peered":"2023-10-05T15:36:06.646620+0000","last_clean":"2023-10-05T15:36:06.646620+0000","last_became_active":"2023-10-05T15:34:31.614211+0000","last_became_peered":"2023-10-05T15:34:31.614211+0000","last_unstale":"2023-10-05T15:36:06.646620+0000","last_undegraded":"2023-10-05T15:36:06.646620+0000","last_fullsized":"2023-10-05T15:36:06.646620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:27.945988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652368+0000","last_change":"2023-10-05T15:34:32.611106+0000","last_active":"2023-10-05T15:36:06.652368+0000","last_peered":"2023-10-05T15:36:06.652368+0000","last_clean":"2023-10-05T15:36:06.652368+0000","last_became_active":"2023-10-05T15:34:32.610720+0000","last_became_peered":"2023-10-05T15:34:32.610720+0000","last_unstale":"2023-10-05T15:36:06.652368+0000","last_undegraded":"2023-10-05T15:36:06.652368+0000","last_fullsized":"2023-10-05T15:36:06.652368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:23:25.842467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644457+0000","last_change":"2023-10-05T15:34:36.661531+0000","last_active":"2023-10-05T15:36:05.644457+0000","last_peered":"2023-10-05T15:36:05.644457+0000","last_clean":"2023-10-05T15:36:05.644457+0000","last_became_active":"2023-10-05T15:34:36.661078+0000","last_became_peered":"2023-10-05T15:34:36.661078+0000","last_unstale":"2023-10-05T15:36:05.644457+0000","last_undegraded":"2023-10-05T15:36:05.644457+0000","last_fullsized":"2023-10-05T15:36:05.644457+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:44:43.533388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"92'12","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649997+0000","last_change":"2023-10-05T15:34:31.608390+0000","last_active":"2023-10-05T15:36:05.649997+0000","last_peered":"2023-10-05T15:36:05.649997+0000","last_clean":"2023-10-05T15:36:05.649997+0000","last_became_active":"2023-10-05T15:34:31.607921+0000","last_became_peered":"2023-10-05T15:34:31.607921+0000","last_unstale":"2023-10-05T15:36:05.649997+0000","last_undegraded":"2023-10-05T15:36:05.649997+0000","last_fullsized":"2023-10-05T15:36:05.649997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:26:38.058921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645334+0000","last_change":"2023-10-05T15:34:32.618130+0000","last_active":"2023-10-05T15:36:05.645334+0000","last_peered":"2023-10-05T15:36:05.645334+0000","last_clean":"2023-10-05T15:36:05.645334+0000","last_became_active":"2023-10-05T15:34:32.617809+0000","last_became_peered":"2023-10-05T15:34:32.617809+0000","last_unstale":"2023-10-05T15:36:05.645334+0000","last_undegraded":"2023-10-05T15:36:05.645334+0000","last_fullsized":"2023-10-05T15:36:05.645334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:48:10.641712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644195+0000","last_change":"2023-10-05T15:34:36.664956+0000","last_active":"2023-10-05T15:36:05.644195+0000","last_peered":"2023-10-05T15:36:05.644195+0000","last_clean":"2023-10-05T15:36:05.644195+0000","last_became_active":"2023-10-05T15:34:36.664625+0000","last_became_peered":"2023-10-05T15:34:36.664625+0000","last_unstale":"2023-10-05T15:36:05.644195+0000","last_undegraded":"2023-10-05T15:36:05.644195+0000","last_fullsized":"2023-10-05T15:36:05.644195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:20.801645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649672+0000","last_change":"2023-10-05T15:34:31.598374+0000","last_active":"2023-10-05T15:36:05.649672+0000","last_peered":"2023-10-05T15:36:05.649672+0000","last_clean":"2023-10-05T15:36:05.649672+0000","last_became_active":"2023-10-05T15:34:31.597983+0000","last_became_peered":"2023-10-05T15:34:31.597983+0000","last_unstale":"2023-10-05T15:36:05.649672+0000","last_undegraded":"2023-10-05T15:36:05.649672+0000","last_fullsized":"2023-10-05T15:36:05.649672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:57:28.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":35,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641892+0000","last_change":"2023-10-05T15:34:32.611362+0000","last_active":"2023-10-05T15:36:05.641892+0000","last_peered":"2023-10-05T15:36:05.641892+0000","last_clean":"2023-10-05T15:36:05.641892+0000","last_became_active":"2023-10-05T15:34:32.611031+0000","last_became_peered":"2023-10-05T15:34:32.611031+0000","last_unstale":"2023-10-05T15:36:05.641892+0000","last_undegraded":"2023-10-05T15:36:05.641892+0000","last_fullsized":"2023-10-05T15:36:05.641892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:10.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653370+0000","last_change":"2023-10-05T15:34:36.657035+0000","last_active":"2023-10-05T15:36:05.653370+0000","last_peered":"2023-10-05T15:36:05.653370+0000","last_clean":"2023-10-05T15:36:05.653370+0000","last_became_active":"2023-10-05T15:34:36.656618+0000","last_became_peered":"2023-10-05T15:34:36.656618+0000","last_unstale":"2023-10-05T15:36:05.653370+0000","last_undegraded":"2023-10-05T15:36:05.653370+0000","last_fullsized":"2023-10-05T15:36:05.653370+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:12:53.904665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"94'6","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.761095+0000","last_change":"2023-10-05T15:34:31.606156+0000","last_active":"2023-10-05T15:36:42.761095+0000","last_peered":"2023-10-05T15:36:42.761095+0000","last_clean":"2023-10-05T15:36:42.761095+0000","last_became_active":"2023-10-05T15:34:31.605644+0000","last_became_peered":"2023-10-05T15:34:31.605644+0000","last_unstale":"2023-10-05T15:36:42.761095+0000","last_undegraded":"2023-10-05T15:36:42.761095+0000","last_fullsized":"2023-10-05T15:36:42.761095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:18.077874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649504+0000","last_change":"2023-10-05T15:34:32.610705+0000","last_active":"2023-10-05T15:36:05.649504+0000","last_peered":"2023-10-05T15:36:05.649504+0000","last_clean":"2023-10-05T15:36:05.649504+0000","last_became_active":"2023-10-05T15:34:32.610363+0000","last_became_peered":"2023-10-05T15:34:32.610363+0000","last_unstale":"2023-10-05T15:36:05.649504+0000","last_undegraded":"2023-10-05T15:36:05.649504+0000","last_fullsized":"2023-10-05T15:36:05.649504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:29:23.326542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653607+0000","last_change":"2023-10-05T15:34:36.669539+0000","last_active":"2023-10-05T15:36:05.653607+0000","last_peered":"2023-10-05T15:36:05.653607+0000","last_clean":"2023-10-05T15:36:05.653607+0000","last_became_active":"2023-10-05T15:34:36.669127+0000","last_became_peered":"2023-10-05T15:34:36.669127+0000","last_unstale":"2023-10-05T15:36:05.653607+0000","last_undegraded":"2023-10-05T15:36:05.653607+0000","last_fullsized":"2023-10-05T15:36:05.653607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:26:36.054459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.697341+0000","last_change":"2023-10-05T15:34:31.609491+0000","last_active":"2023-10-05T15:36:05.697341+0000","last_peered":"2023-10-05T15:36:05.697341+0000","last_clean":"2023-10-05T15:36:05.697341+0000","last_became_active":"2023-10-05T15:34:31.609166+0000","last_became_peered":"2023-10-05T15:34:31.609166+0000","last_unstale":"2023-10-05T15:36:05.697341+0000","last_undegraded":"2023-10-05T15:36:05.697341+0000","last_fullsized":"2023-10-05T15:36:05.697341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:02.352068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641698+0000","last_change":"2023-10-05T15:34:32.606044+0000","last_active":"2023-10-05T15:36:05.641698+0000","last_peered":"2023-10-05T15:36:05.641698+0000","last_clean":"2023-10-05T15:36:05.641698+0000","last_became_active":"2023-10-05T15:34:32.605640+0000","last_became_peered":"2023-10-05T15:34:32.605640+0000","last_unstale":"2023-10-05T15:36:05.641698+0000","last_undegraded":"2023-10-05T15:36:05.641698+0000","last_fullsized":"2023-10-05T15:36:05.641698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:19:05.287653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650097+0000","last_change":"2023-10-05T15:34:36.673558+0000","last_active":"2023-10-05T15:36:06.650097+0000","last_peered":"2023-10-05T15:36:06.650097+0000","last_clean":"2023-10-05T15:36:06.650097+0000","last_became_active":"2023-10-05T15:34:36.673133+0000","last_became_peered":"2023-10-05T15:34:36.673133+0000","last_unstale":"2023-10-05T15:36:06.650097+0000","last_undegraded":"2023-10-05T15:36:06.650097+0000","last_fullsized":"2023-10-05T15:36:06.650097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:37:34.842902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.648715+0000","last_change":"2023-10-05T15:34:31.603911+0000","last_active":"2023-10-05T15:36:05.648715+0000","last_peered":"2023-10-05T15:36:05.648715+0000","last_clean":"2023-10-05T15:36:05.648715+0000","last_became_active":"2023-10-05T15:34:31.603495+0000","last_became_peered":"2023-10-05T15:34:31.603495+0000","last_unstale":"2023-10-05T15:36:05.648715+0000","last_undegraded":"2023-10-05T15:36:05.648715+0000","last_fullsized":"2023-10-05T15:36:05.648715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:16:19.486109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640274+0000","last_change":"2023-10-05T15:34:32.606454+0000","last_active":"2023-10-05T15:36:05.640274+0000","last_peered":"2023-10-05T15:36:05.640274+0000","last_clean":"2023-10-05T15:36:05.640274+0000","last_became_active":"2023-10-05T15:34:32.605966+0000","last_became_peered":"2023-10-05T15:34:32.605966+0000","last_unstale":"2023-10-05T15:36:05.640274+0000","last_undegraded":"2023-10-05T15:36:05.640274+0000","last_fullsized":"2023-10-05T15:36:05.640274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:24:11.078973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652187+0000","last_change":"2023-10-05T15:34:36.674687+0000","last_active":"2023-10-05T15:36:06.652187+0000","last_peered":"2023-10-05T15:36:06.652187+0000","last_clean":"2023-10-05T15:36:06.652187+0000","last_became_active":"2023-10-05T15:34:36.674247+0000","last_became_peered":"2023-10-05T15:34:36.674247+0000","last_unstale":"2023-10-05T15:36:06.652187+0000","last_undegraded":"2023-10-05T15:36:06.652187+0000","last_fullsized":"2023-10-05T15:36:06.652187+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:32.567665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641155+0000","last_change":"2023-10-05T15:34:31.601239+0000","last_active":"2023-10-05T15:36:05.641155+0000","last_peered":"2023-10-05T15:36:05.641155+0000","last_clean":"2023-10-05T15:36:05.641155+0000","last_became_active":"2023-10-05T15:34:31.600922+0000","last_became_peered":"2023-10-05T15:34:31.600922+0000","last_unstale":"2023-10-05T15:36:05.641155+0000","last_undegraded":"2023-10-05T15:36:05.641155+0000","last_fullsized":"2023-10-05T15:36:05.641155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:01:23.387954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728050+0000","last_change":"2023-10-05T15:34:32.609229+0000","last_active":"2023-10-05T15:36:05.728050+0000","last_peered":"2023-10-05T15:36:05.728050+0000","last_clean":"2023-10-05T15:36:05.728050+0000","last_became_active":"2023-10-05T15:34:32.608893+0000","last_became_peered":"2023-10-05T15:34:32.608893+0000","last_unstale":"2023-10-05T15:36:05.728050+0000","last_undegraded":"2023-10-05T15:36:05.728050+0000","last_fullsized":"2023-10-05T15:36:05.728050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:36:31.731652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640597+0000","last_change":"2023-10-05T15:34:36.661695+0000","last_active":"2023-10-05T15:36:05.640597+0000","last_peered":"2023-10-05T15:36:05.640597+0000","last_clean":"2023-10-05T15:36:05.640597+0000","last_became_active":"2023-10-05T15:34:36.661220+0000","last_became_peered":"2023-10-05T15:34:36.661220+0000","last_unstale":"2023-10-05T15:36:05.640597+0000","last_undegraded":"2023-10-05T15:36:05.640597+0000","last_fullsized":"2023-10-05T15:36:05.640597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:20:40.018950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"94'7","reported_seq":233,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.719740+0000","last_change":"2023-10-05T15:34:31.604291+0000","last_active":"2023-10-05T15:36:43.719740+0000","last_peered":"2023-10-05T15:36:43.719740+0000","last_clean":"2023-10-05T15:36:43.719740+0000","last_became_active":"2023-10-05T15:34:31.603897+0000","last_became_peered":"2023-10-05T15:34:31.603897+0000","last_unstale":"2023-10-05T15:36:43.719740+0000","last_undegraded":"2023-10-05T15:36:43.719740+0000","last_fullsized":"2023-10-05T15:36:43.719740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:22:25.759649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":205,"num_read_kb":205,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.646440+0000","last_change":"2023-10-05T15:34:32.612221+0000","last_active":"2023-10-05T15:36:05.646440+0000","last_peered":"2023-10-05T15:36:05.646440+0000","last_clean":"2023-10-05T15:36:05.646440+0000","last_became_active":"2023-10-05T15:34:32.611805+0000","last_became_peered":"2023-10-05T15:34:32.611805+0000","last_unstale":"2023-10-05T15:36:05.646440+0000","last_undegraded":"2023-10-05T15:36:05.646440+0000","last_fullsized":"2023-10-05T15:36:05.646440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:41:20.678237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.727918+0000","last_change":"2023-10-05T15:34:36.677803+0000","last_active":"2023-10-05T15:36:05.727918+0000","last_peered":"2023-10-05T15:36:05.727918+0000","last_clean":"2023-10-05T15:36:05.727918+0000","last_became_active":"2023-10-05T15:34:36.677372+0000","last_became_peered":"2023-10-05T15:34:36.677372+0000","last_unstale":"2023-10-05T15:36:05.727918+0000","last_undegraded":"2023-10-05T15:36:05.727918+0000","last_fullsized":"2023-10-05T15:36:05.727918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:04:59.687453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":39,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.660645+0000","last_change":"2023-10-05T15:36:06.660645+0000","last_active":"2023-10-05T15:36:06.660645+0000","last_peered":"2023-10-05T15:36:06.660645+0000","last_clean":"2023-10-05T15:36:06.660645+0000","last_became_active":"2023-10-05T15:36:06.655841+0000","last_became_peered":"2023-10-05T15:36:06.655841+0000","last_unstale":"2023-10-05T15:36:06.660645+0000","last_undegraded":"2023-10-05T15:36:06.660645+0000","last_fullsized":"2023-10-05T15:36:06.660645+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:47:38.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.655169+0000","last_change":"2023-10-05T15:34:32.614523+0000","last_active":"2023-10-05T15:36:05.655169+0000","last_peered":"2023-10-05T15:36:05.655169+0000","last_clean":"2023-10-05T15:36:05.655169+0000","last_became_active":"2023-10-05T15:34:32.613652+0000","last_became_peered":"2023-10-05T15:34:32.613652+0000","last_unstale":"2023-10-05T15:36:05.655169+0000","last_undegraded":"2023-10-05T15:36:05.655169+0000","last_fullsized":"2023-10-05T15:36:05.655169+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:15.505246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644684+0000","last_change":"2023-10-05T15:34:36.666420+0000","last_active":"2023-10-05T15:36:05.644684+0000","last_peered":"2023-10-05T15:36:05.644684+0000","last_clean":"2023-10-05T15:36:05.644684+0000","last_became_active":"2023-10-05T15:34:36.666005+0000","last_became_peered":"2023-10-05T15:34:36.666005+0000","last_unstale":"2023-10-05T15:36:05.644684+0000","last_undegraded":"2023-10-05T15:36:05.644684+0000","last_fullsized":"2023-10-05T15:36:05.644684+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:43:41.516113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642400+0000","last_change":"2023-10-05T15:34:31.616183+0000","last_active":"2023-10-05T15:36:05.642400+0000","last_peered":"2023-10-05T15:36:05.642400+0000","last_clean":"2023-10-05T15:36:05.642400+0000","last_became_active":"2023-10-05T15:34:31.615767+0000","last_became_peered":"2023-10-05T15:34:31.615767+0000","last_unstale":"2023-10-05T15:36:05.642400+0000","last_undegraded":"2023-10-05T15:36:05.642400+0000","last_fullsized":"2023-10-05T15:36:05.642400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:56:52.467048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.645442+0000","last_change":"2023-10-05T15:35:05.781201+0000","last_active":"2023-10-05T15:36:05.645442+0000","last_peered":"2023-10-05T15:36:05.645442+0000","last_clean":"2023-10-05T15:36:05.645442+0000","last_became_active":"2023-10-05T15:35:05.780760+0000","last_became_peered":"2023-10-05T15:35:05.780760+0000","last_unstale":"2023-10-05T15:36:05.645442+0000","last_undegraded":"2023-10-05T15:36:05.645442+0000","last_fullsized":"2023-10-05T15:36:05.645442+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:56:43.796707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.727962+0000","last_change":"2023-10-05T15:34:36.665298+0000","last_active":"2023-10-05T15:36:05.727962+0000","last_peered":"2023-10-05T15:36:05.727962+0000","last_clean":"2023-10-05T15:36:05.727962+0000","last_became_active":"2023-10-05T15:34:36.664804+0000","last_became_peered":"2023-10-05T15:34:36.664804+0000","last_unstale":"2023-10-05T15:36:05.727962+0000","last_undegraded":"2023-10-05T15:36:05.727962+0000","last_fullsized":"2023-10-05T15:36:05.727962+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:21:24.179106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"94'38","reported_seq":273,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.775610+0000","last_change":"2023-10-05T15:34:31.610600+0000","last_active":"2023-10-05T15:36:43.775610+0000","last_peered":"2023-10-05T15:36:43.775610+0000","last_clean":"2023-10-05T15:36:43.775610+0000","last_became_active":"2023-10-05T15:34:31.610276+0000","last_became_peered":"2023-10-05T15:34:31.610276+0000","last_unstale":"2023-10-05T15:36:43.775610+0000","last_undegraded":"2023-10-05T15:36:43.775610+0000","last_fullsized":"2023-10-05T15:36:43.775610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:14.500141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60036,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":214,"num_read_kb":166,"num_write":40,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649734+0000","last_change":"2023-10-05T15:34:32.605848+0000","last_active":"2023-10-05T15:36:05.649734+0000","last_peered":"2023-10-05T15:36:05.649734+0000","last_clean":"2023-10-05T15:36:05.649734+0000","last_became_active":"2023-10-05T15:34:32.605548+0000","last_became_peered":"2023-10-05T15:34:32.605548+0000","last_unstale":"2023-10-05T15:36:05.649734+0000","last_undegraded":"2023-10-05T15:36:05.649734+0000","last_fullsized":"2023-10-05T15:36:05.649734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:52:19.144070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642307+0000","last_change":"2023-10-05T15:34:36.672157+0000","last_active":"2023-10-05T15:36:05.642307+0000","last_peered":"2023-10-05T15:36:05.642307+0000","last_clean":"2023-10-05T15:36:05.642307+0000","last_became_active":"2023-10-05T15:34:36.671781+0000","last_became_peered":"2023-10-05T15:34:36.671781+0000","last_unstale":"2023-10-05T15:36:05.642307+0000","last_undegraded":"2023-10-05T15:36:05.642307+0000","last_fullsized":"2023-10-05T15:36:05.642307+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:51:48.544525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653374+0000","last_change":"2023-10-05T15:34:31.608183+0000","last_active":"2023-10-05T15:36:05.653374+0000","last_peered":"2023-10-05T15:36:05.653374+0000","last_clean":"2023-10-05T15:36:05.653374+0000","last_became_active":"2023-10-05T15:34:31.607811+0000","last_became_peered":"2023-10-05T15:34:31.607811+0000","last_unstale":"2023-10-05T15:36:05.653374+0000","last_undegraded":"2023-10-05T15:36:05.653374+0000","last_fullsized":"2023-10-05T15:36:05.653374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:12.438112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649038+0000","last_change":"2023-10-05T15:34:32.603159+0000","last_active":"2023-10-05T15:36:05.649038+0000","last_peered":"2023-10-05T15:36:05.649038+0000","last_clean":"2023-10-05T15:36:05.649038+0000","last_became_active":"2023-10-05T15:34:32.602672+0000","last_became_peered":"2023-10-05T15:34:32.602672+0000","last_unstale":"2023-10-05T15:36:05.649038+0000","last_undegraded":"2023-10-05T15:36:05.649038+0000","last_fullsized":"2023-10-05T15:36:05.649038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:31.348992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654407+0000","last_change":"2023-10-05T15:34:36.669817+0000","last_active":"2023-10-05T15:36:05.654407+0000","last_peered":"2023-10-05T15:36:05.654407+0000","last_clean":"2023-10-05T15:36:05.654407+0000","last_became_active":"2023-10-05T15:34:36.669035+0000","last_became_peered":"2023-10-05T15:34:36.669035+0000","last_unstale":"2023-10-05T15:36:05.654407+0000","last_undegraded":"2023-10-05T15:36:05.654407+0000","last_fullsized":"2023-10-05T15:36:05.654407+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:07:07.156940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641410+0000","last_change":"2023-10-05T15:34:31.602083+0000","last_active":"2023-10-05T15:36:05.641410+0000","last_peered":"2023-10-05T15:36:05.641410+0000","last_clean":"2023-10-05T15:36:05.641410+0000","last_became_active":"2023-10-05T15:34:31.601674+0000","last_became_peered":"2023-10-05T15:34:31.601674+0000","last_unstale":"2023-10-05T15:36:05.641410+0000","last_undegraded":"2023-10-05T15:36:05.641410+0000","last_fullsized":"2023-10-05T15:36:05.641410+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:31:46.759197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650681+0000","last_change":"2023-10-05T15:35:06.113316+0000","last_active":"2023-10-05T15:36:05.650681+0000","last_peered":"2023-10-05T15:36:05.650681+0000","last_clean":"2023-10-05T15:36:05.650681+0000","last_became_active":"2023-10-05T15:35:06.112866+0000","last_became_peered":"2023-10-05T15:35:06.112866+0000","last_unstale":"2023-10-05T15:36:05.650681+0000","last_undegraded":"2023-10-05T15:36:05.650681+0000","last_fullsized":"2023-10-05T15:36:05.650681+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:24:17.253672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728242+0000","last_change":"2023-10-05T15:34:36.678344+0000","last_active":"2023-10-05T15:36:05.728242+0000","last_peered":"2023-10-05T15:36:05.728242+0000","last_clean":"2023-10-05T15:36:05.728242+0000","last_became_active":"2023-10-05T15:34:36.677899+0000","last_became_peered":"2023-10-05T15:34:36.677899+0000","last_unstale":"2023-10-05T15:36:05.728242+0000","last_undegraded":"2023-10-05T15:36:05.728242+0000","last_fullsized":"2023-10-05T15:36:05.728242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:49:54.743212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"94'6","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:46.791383+0000","last_change":"2023-10-05T15:34:31.604382+0000","last_active":"2023-10-05T15:36:46.791383+0000","last_peered":"2023-10-05T15:36:46.791383+0000","last_clean":"2023-10-05T15:36:46.791383+0000","last_became_active":"2023-10-05T15:34:31.603981+0000","last_became_peered":"2023-10-05T15:34:31.603981+0000","last_unstale":"2023-10-05T15:36:46.791383+0000","last_undegraded":"2023-10-05T15:36:46.791383+0000","last_fullsized":"2023-10-05T15:36:46.791383+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:28.917412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.653551+0000","last_change":"2023-10-05T15:34:32.616317+0000","last_active":"2023-10-05T15:36:05.653551+0000","last_peered":"2023-10-05T15:36:05.653551+0000","last_clean":"2023-10-05T15:36:05.653551+0000","last_became_active":"2023-10-05T15:34:32.616005+0000","last_became_peered":"2023-10-05T15:34:32.616005+0000","last_unstale":"2023-10-05T15:36:05.653551+0000","last_undegraded":"2023-10-05T15:36:05.653551+0000","last_fullsized":"2023-10-05T15:36:05.653551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:25:15.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649190+0000","last_change":"2023-10-05T15:34:36.676308+0000","last_active":"2023-10-05T15:36:05.649190+0000","last_peered":"2023-10-05T15:36:05.649190+0000","last_clean":"2023-10-05T15:36:05.649190+0000","last_became_active":"2023-10-05T15:34:36.675965+0000","last_became_peered":"2023-10-05T15:34:36.675965+0000","last_unstale":"2023-10-05T15:36:05.649190+0000","last_undegraded":"2023-10-05T15:36:05.649190+0000","last_fullsized":"2023-10-05T15:36:05.649190+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:50:30.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.668184+0000","last_change":"2023-10-05T15:36:06.668184+0000","last_active":"2023-10-05T15:36:06.668184+0000","last_peered":"2023-10-05T15:36:06.668184+0000","last_clean":"2023-10-05T15:36:06.668184+0000","last_became_active":"2023-10-05T15:36:06.653648+0000","last_became_peered":"2023-10-05T15:36:06.653648+0000","last_unstale":"2023-10-05T15:36:06.668184+0000","last_undegraded":"2023-10-05T15:36:06.668184+0000","last_fullsized":"2023-10-05T15:36:06.668184+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:03:57.337078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641192+0000","last_change":"2023-10-05T15:34:32.606143+0000","last_active":"2023-10-05T15:36:05.641192+0000","last_peered":"2023-10-05T15:36:05.641192+0000","last_clean":"2023-10-05T15:36:05.641192+0000","last_became_active":"2023-10-05T15:34:32.605546+0000","last_became_peered":"2023-10-05T15:34:32.605546+0000","last_unstale":"2023-10-05T15:36:05.641192+0000","last_undegraded":"2023-10-05T15:36:05.641192+0000","last_fullsized":"2023-10-05T15:36:05.641192+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:51:43.000238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.641091+0000","last_change":"2023-10-05T15:34:36.663528+0000","last_active":"2023-10-05T15:36:05.641091+0000","last_peered":"2023-10-05T15:36:05.641091+0000","last_clean":"2023-10-05T15:36:05.641091+0000","last_became_active":"2023-10-05T15:34:36.663079+0000","last_became_peered":"2023-10-05T15:34:36.663079+0000","last_unstale":"2023-10-05T15:36:05.641091+0000","last_undegraded":"2023-10-05T15:36:05.641091+0000","last_fullsized":"2023-10-05T15:36:05.641091+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:26:33.535659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"94'3","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.199943+0000","last_change":"2023-10-05T15:34:31.594491+0000","last_active":"2023-10-05T15:36:42.199943+0000","last_peered":"2023-10-05T15:36:42.199943+0000","last_clean":"2023-10-05T15:36:42.199943+0000","last_became_active":"2023-10-05T15:34:31.593919+0000","last_became_peered":"2023-10-05T15:34:31.593919+0000","last_unstale":"2023-10-05T15:36:42.199943+0000","last_undegraded":"2023-10-05T15:36:42.199943+0000","last_fullsized":"2023-10-05T15:36:42.199943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:56:54.258514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654740+0000","last_change":"2023-10-05T15:34:32.611063+0000","last_active":"2023-10-05T15:36:05.654740+0000","last_peered":"2023-10-05T15:36:05.654740+0000","last_clean":"2023-10-05T15:36:05.654740+0000","last_became_active":"2023-10-05T15:34:32.610707+0000","last_became_peered":"2023-10-05T15:34:32.610707+0000","last_unstale":"2023-10-05T15:36:05.654740+0000","last_undegraded":"2023-10-05T15:36:05.654740+0000","last_fullsized":"2023-10-05T15:36:05.654740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:12:10.332086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653389+0000","last_change":"2023-10-05T15:34:36.858035+0000","last_active":"2023-10-05T15:36:06.653389+0000","last_peered":"2023-10-05T15:36:06.653389+0000","last_clean":"2023-10-05T15:36:06.653389+0000","last_became_active":"2023-10-05T15:34:36.857358+0000","last_became_peered":"2023-10-05T15:34:36.857358+0000","last_unstale":"2023-10-05T15:36:06.653389+0000","last_undegraded":"2023-10-05T15:36:06.653389+0000","last_fullsized":"2023-10-05T15:36:06.653389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:33.832416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.660288+0000","last_change":"2023-10-05T15:34:31.612306+0000","last_active":"2023-10-05T15:36:06.660288+0000","last_peered":"2023-10-05T15:36:06.660288+0000","last_clean":"2023-10-05T15:36:06.660288+0000","last_became_active":"2023-10-05T15:34:31.611971+0000","last_became_peered":"2023-10-05T15:34:31.611971+0000","last_unstale":"2023-10-05T15:36:06.660288+0000","last_undegraded":"2023-10-05T15:36:06.660288+0000","last_fullsized":"2023-10-05T15:36:06.660288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:25:13.596744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.648280+0000","last_change":"2023-10-05T15:34:32.604595+0000","last_active":"2023-10-05T15:36:06.648280+0000","last_peered":"2023-10-05T15:36:06.648280+0000","last_clean":"2023-10-05T15:36:06.648280+0000","last_became_active":"2023-10-05T15:34:32.604290+0000","last_became_peered":"2023-10-05T15:34:32.604290+0000","last_unstale":"2023-10-05T15:36:06.648280+0000","last_undegraded":"2023-10-05T15:36:06.648280+0000","last_fullsized":"2023-10-05T15:36:06.648280+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:35:13.295346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726378+0000","last_change":"2023-10-05T15:34:36.679168+0000","last_active":"2023-10-05T15:36:06.726378+0000","last_peered":"2023-10-05T15:36:06.726378+0000","last_clean":"2023-10-05T15:36:06.726378+0000","last_became_active":"2023-10-05T15:34:36.678710+0000","last_became_peered":"2023-10-05T15:34:36.678710+0000","last_unstale":"2023-10-05T15:36:06.726378+0000","last_undegraded":"2023-10-05T15:36:06.726378+0000","last_fullsized":"2023-10-05T15:36:06.726378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:59:57.418300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"94'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.801229+0000","last_change":"2023-10-05T15:34:31.609406+0000","last_active":"2023-10-05T15:36:43.801229+0000","last_peered":"2023-10-05T15:36:43.801229+0000","last_clean":"2023-10-05T15:36:43.801229+0000","last_became_active":"2023-10-05T15:34:31.608995+0000","last_became_peered":"2023-10-05T15:34:31.608995+0000","last_unstale":"2023-10-05T15:36:43.801229+0000","last_undegraded":"2023-10-05T15:36:43.801229+0000","last_fullsized":"2023-10-05T15:36:43.801229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:52:04.314090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647872+0000","last_change":"2023-10-05T15:34:32.609515+0000","last_active":"2023-10-05T15:36:06.647872+0000","last_peered":"2023-10-05T15:36:06.647872+0000","last_clean":"2023-10-05T15:36:06.647872+0000","last_became_active":"2023-10-05T15:34:32.609218+0000","last_became_peered":"2023-10-05T15:34:32.609218+0000","last_unstale":"2023-10-05T15:36:06.647872+0000","last_undegraded":"2023-10-05T15:36:06.647872+0000","last_fullsized":"2023-10-05T15:36:06.647872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:43:35.000299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649310+0000","last_change":"2023-10-05T15:34:36.858437+0000","last_active":"2023-10-05T15:36:05.649310+0000","last_peered":"2023-10-05T15:36:05.649310+0000","last_clean":"2023-10-05T15:36:05.649310+0000","last_became_active":"2023-10-05T15:34:36.857961+0000","last_became_peered":"2023-10-05T15:34:36.857961+0000","last_unstale":"2023-10-05T15:36:05.649310+0000","last_undegraded":"2023-10-05T15:36:05.649310+0000","last_fullsized":"2023-10-05T15:36:05.649310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:13:25.632620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.702149+0000","last_change":"2023-10-05T15:34:32.606799+0000","last_active":"2023-10-05T15:36:06.702149+0000","last_peered":"2023-10-05T15:36:06.702149+0000","last_clean":"2023-10-05T15:36:06.702149+0000","last_became_active":"2023-10-05T15:34:32.606498+0000","last_became_peered":"2023-10-05T15:34:32.606498+0000","last_unstale":"2023-10-05T15:36:06.702149+0000","last_undegraded":"2023-10-05T15:36:06.702149+0000","last_fullsized":"2023-10-05T15:36:06.702149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:12:58.510112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:42.783720+0000","last_change":"2023-10-05T15:34:31.611832+0000","last_active":"2023-10-05T15:36:42.783720+0000","last_peered":"2023-10-05T15:36:42.783720+0000","last_clean":"2023-10-05T15:36:42.783720+0000","last_became_active":"2023-10-05T15:34:31.611481+0000","last_became_peered":"2023-10-05T15:34:31.611481+0000","last_unstale":"2023-10-05T15:36:42.783720+0000","last_undegraded":"2023-10-05T15:36:42.783720+0000","last_fullsized":"2023-10-05T15:36:42.783720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:33:42.134731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652587+0000","last_change":"2023-10-05T15:34:36.676281+0000","last_active":"2023-10-05T15:36:06.652587+0000","last_peered":"2023-10-05T15:36:06.652587+0000","last_clean":"2023-10-05T15:36:06.652587+0000","last_became_active":"2023-10-05T15:34:36.675803+0000","last_became_peered":"2023-10-05T15:34:36.675803+0000","last_unstale":"2023-10-05T15:36:06.652587+0000","last_undegraded":"2023-10-05T15:36:06.652587+0000","last_fullsized":"2023-10-05T15:36:06.652587+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:50:24.764402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646751+0000","last_change":"2023-10-05T15:34:32.611163+0000","last_active":"2023-10-05T15:36:06.646751+0000","last_peered":"2023-10-05T15:36:06.646751+0000","last_clean":"2023-10-05T15:36:06.646751+0000","last_became_active":"2023-10-05T15:34:32.610819+0000","last_became_peered":"2023-10-05T15:34:32.610819+0000","last_unstale":"2023-10-05T15:36:06.646751+0000","last_undegraded":"2023-10-05T15:36:06.646751+0000","last_fullsized":"2023-10-05T15:36:06.646751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:57:33.983647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650638+0000","last_change":"2023-10-05T15:34:31.602383+0000","last_active":"2023-10-05T15:36:06.650638+0000","last_peered":"2023-10-05T15:36:06.650638+0000","last_clean":"2023-10-05T15:36:06.650638+0000","last_became_active":"2023-10-05T15:34:31.601696+0000","last_became_peered":"2023-10-05T15:34:31.601696+0000","last_unstale":"2023-10-05T15:36:06.650638+0000","last_undegraded":"2023-10-05T15:36:06.650638+0000","last_fullsized":"2023-10-05T15:36:06.650638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:21.903995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":319,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.651666+0000","last_change":"2023-10-05T15:33:13.239194+0000","last_active":"2023-10-05T15:36:05.651666+0000","last_peered":"2023-10-05T15:36:05.651666+0000","last_clean":"2023-10-05T15:36:05.651666+0000","last_became_active":"2023-10-05T15:33:13.238720+0000","last_became_peered":"2023-10-05T15:33:13.238720+0000","last_unstale":"2023-10-05T15:36:05.651666+0000","last_undegraded":"2023-10-05T15:36:05.651666+0000","last_fullsized":"2023-10-05T15:36:05.651666+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:29:41.137405+0000","last_clean_scrub_stamp":"2023-10-05T15:29:41.137405+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:47:51.704041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642102+0000","last_change":"2023-10-05T15:35:06.112775+0000","last_active":"2023-10-05T15:36:05.642102+0000","last_peered":"2023-10-05T15:36:05.642102+0000","last_clean":"2023-10-05T15:36:05.642102+0000","last_became_active":"2023-10-05T15:35:06.112332+0000","last_became_peered":"2023-10-05T15:35:06.112332+0000","last_unstale":"2023-10-05T15:36:05.642102+0000","last_undegraded":"2023-10-05T15:36:05.642102+0000","last_fullsized":"2023-10-05T15:36:05.642102+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:04:22.225861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.725649+0000","last_change":"2023-10-05T15:34:32.604981+0000","last_active":"2023-10-05T15:36:06.725649+0000","last_peered":"2023-10-05T15:36:06.725649+0000","last_clean":"2023-10-05T15:36:06.725649+0000","last_became_active":"2023-10-05T15:34:32.604628+0000","last_became_peered":"2023-10-05T15:34:32.604628+0000","last_unstale":"2023-10-05T15:36:06.725649+0000","last_undegraded":"2023-10-05T15:36:06.725649+0000","last_fullsized":"2023-10-05T15:36:06.725649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:25:42.285670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.651727+0000","last_change":"2023-10-05T15:34:31.606545+0000","last_active":"2023-10-05T15:36:06.651727+0000","last_peered":"2023-10-05T15:36:06.651727+0000","last_clean":"2023-10-05T15:36:06.651727+0000","last_became_active":"2023-10-05T15:34:31.606237+0000","last_became_peered":"2023-10-05T15:34:31.606237+0000","last_unstale":"2023-10-05T15:36:06.651727+0000","last_undegraded":"2023-10-05T15:36:06.651727+0000","last_fullsized":"2023-10-05T15:36:06.651727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:06:09.609156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650553+0000","last_change":"2023-10-05T15:34:36.674199+0000","last_active":"2023-10-05T15:36:06.650553+0000","last_peered":"2023-10-05T15:36:06.650553+0000","last_clean":"2023-10-05T15:36:06.650553+0000","last_became_active":"2023-10-05T15:34:36.673752+0000","last_became_peered":"2023-10-05T15:34:36.673752+0000","last_unstale":"2023-10-05T15:36:06.650553+0000","last_undegraded":"2023-10-05T15:36:06.650553+0000","last_fullsized":"2023-10-05T15:36:06.650553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:02:07.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653465+0000","last_change":"2023-10-05T15:34:31.616088+0000","last_active":"2023-10-05T15:36:06.653465+0000","last_peered":"2023-10-05T15:36:06.653465+0000","last_clean":"2023-10-05T15:36:06.653465+0000","last_became_active":"2023-10-05T15:34:31.615658+0000","last_became_peered":"2023-10-05T15:34:31.615658+0000","last_unstale":"2023-10-05T15:36:06.653465+0000","last_undegraded":"2023-10-05T15:36:06.653465+0000","last_fullsized":"2023-10-05T15:36:06.653465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:53:32.652253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726457+0000","last_change":"2023-10-05T15:34:32.607562+0000","last_active":"2023-10-05T15:36:06.726457+0000","last_peered":"2023-10-05T15:36:06.726457+0000","last_clean":"2023-10-05T15:36:06.726457+0000","last_became_active":"2023-10-05T15:34:32.607267+0000","last_became_peered":"2023-10-05T15:34:32.607267+0000","last_unstale":"2023-10-05T15:36:06.726457+0000","last_undegraded":"2023-10-05T15:36:06.726457+0000","last_fullsized":"2023-10-05T15:36:06.726457+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:34:41.003833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646126+0000","last_change":"2023-10-05T15:34:36.857716+0000","last_active":"2023-10-05T15:36:06.646126+0000","last_peered":"2023-10-05T15:36:06.646126+0000","last_clean":"2023-10-05T15:36:06.646126+0000","last_became_active":"2023-10-05T15:34:36.857049+0000","last_became_peered":"2023-10-05T15:34:36.857049+0000","last_unstale":"2023-10-05T15:36:06.646126+0000","last_undegraded":"2023-10-05T15:36:06.646126+0000","last_fullsized":"2023-10-05T15:36:06.646126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:04:57.451808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"94'11","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.661691+0000","last_change":"2023-10-05T15:34:31.610996+0000","last_active":"2023-10-05T15:36:06.661691+0000","last_peered":"2023-10-05T15:36:06.661691+0000","last_clean":"2023-10-05T15:36:06.661691+0000","last_became_active":"2023-10-05T15:34:31.610524+0000","last_became_peered":"2023-10-05T15:34:31.610524+0000","last_unstale":"2023-10-05T15:36:06.661691+0000","last_undegraded":"2023-10-05T15:36:06.661691+0000","last_fullsized":"2023-10-05T15:36:06.661691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:40:48.456098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646703+0000","last_change":"2023-10-05T15:34:32.606160+0000","last_active":"2023-10-05T15:36:06.646703+0000","last_peered":"2023-10-05T15:36:06.646703+0000","last_clean":"2023-10-05T15:36:06.646703+0000","last_became_active":"2023-10-05T15:34:32.605721+0000","last_became_peered":"2023-10-05T15:34:32.605721+0000","last_unstale":"2023-10-05T15:36:06.646703+0000","last_undegraded":"2023-10-05T15:36:06.646703+0000","last_fullsized":"2023-10-05T15:36:06.646703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:45:09.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647252+0000","last_change":"2023-10-05T15:34:36.654942+0000","last_active":"2023-10-05T15:36:06.647252+0000","last_peered":"2023-10-05T15:36:06.647252+0000","last_clean":"2023-10-05T15:36:06.647252+0000","last_became_active":"2023-10-05T15:34:36.654505+0000","last_became_peered":"2023-10-05T15:34:36.654505+0000","last_unstale":"2023-10-05T15:36:06.647252+0000","last_undegraded":"2023-10-05T15:36:06.647252+0000","last_fullsized":"2023-10-05T15:36:06.647252+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:03:38.363445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650907+0000","last_change":"2023-10-05T15:34:31.610580+0000","last_active":"2023-10-05T15:36:06.650907+0000","last_peered":"2023-10-05T15:36:06.650907+0000","last_clean":"2023-10-05T15:36:06.650907+0000","last_became_active":"2023-10-05T15:34:31.610250+0000","last_became_peered":"2023-10-05T15:34:31.610250+0000","last_unstale":"2023-10-05T15:36:06.650907+0000","last_undegraded":"2023-10-05T15:36:06.650907+0000","last_fullsized":"2023-10-05T15:36:06.650907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:17:22.217962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652300+0000","last_change":"2023-10-05T15:34:32.614036+0000","last_active":"2023-10-05T15:36:06.652300+0000","last_peered":"2023-10-05T15:36:06.652300+0000","last_clean":"2023-10-05T15:36:06.652300+0000","last_became_active":"2023-10-05T15:34:32.613650+0000","last_became_peered":"2023-10-05T15:34:32.613650+0000","last_unstale":"2023-10-05T15:36:06.652300+0000","last_undegraded":"2023-10-05T15:36:06.652300+0000","last_fullsized":"2023-10-05T15:36:06.652300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:06:42.921135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644476+0000","last_change":"2023-10-05T15:34:36.859269+0000","last_active":"2023-10-05T15:36:05.644476+0000","last_peered":"2023-10-05T15:36:05.644476+0000","last_clean":"2023-10-05T15:36:05.644476+0000","last_became_active":"2023-10-05T15:34:36.858343+0000","last_became_peered":"2023-10-05T15:34:36.858343+0000","last_unstale":"2023-10-05T15:36:05.644476+0000","last_undegraded":"2023-10-05T15:36:05.644476+0000","last_fullsized":"2023-10-05T15:36:05.644476+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:34:07.964070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":24,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653334+0000","last_change":"2023-10-05T15:34:31.607379+0000","last_active":"2023-10-05T15:36:06.653334+0000","last_peered":"2023-10-05T15:36:06.653334+0000","last_clean":"2023-10-05T15:36:06.653334+0000","last_became_active":"2023-10-05T15:34:31.607039+0000","last_became_peered":"2023-10-05T15:34:31.607039+0000","last_unstale":"2023-10-05T15:36:06.653334+0000","last_undegraded":"2023-10-05T15:36:06.653334+0000","last_fullsized":"2023-10-05T15:36:06.653334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:52:39.908165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":23,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652806+0000","last_change":"2023-10-05T15:34:32.606870+0000","last_active":"2023-10-05T15:36:06.652806+0000","last_peered":"2023-10-05T15:36:06.652806+0000","last_clean":"2023-10-05T15:36:06.652806+0000","last_became_active":"2023-10-05T15:34:32.606548+0000","last_became_peered":"2023-10-05T15:34:32.606548+0000","last_unstale":"2023-10-05T15:36:06.652806+0000","last_undegraded":"2023-10-05T15:36:06.652806+0000","last_fullsized":"2023-10-05T15:36:06.652806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:16:11.956240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.728348+0000","last_change":"2023-10-05T15:34:36.676192+0000","last_active":"2023-10-05T15:36:05.728348+0000","last_peered":"2023-10-05T15:36:05.728348+0000","last_clean":"2023-10-05T15:36:05.728348+0000","last_became_active":"2023-10-05T15:34:36.675770+0000","last_became_peered":"2023-10-05T15:34:36.675770+0000","last_unstale":"2023-10-05T15:36:05.728348+0000","last_undegraded":"2023-10-05T15:36:05.728348+0000","last_fullsized":"2023-10-05T15:36:05.728348+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:57:05.184601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646624+0000","last_change":"2023-10-05T15:34:31.608090+0000","last_active":"2023-10-05T15:36:06.646624+0000","last_peered":"2023-10-05T15:36:06.646624+0000","last_clean":"2023-10-05T15:36:06.646624+0000","last_became_active":"2023-10-05T15:34:31.607521+0000","last_became_peered":"2023-10-05T15:34:31.607521+0000","last_unstale":"2023-10-05T15:36:06.646624+0000","last_undegraded":"2023-10-05T15:36:06.646624+0000","last_fullsized":"2023-10-05T15:36:06.646624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:09:42.804066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":30,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650732+0000","last_change":"2023-10-05T15:34:32.608314+0000","last_active":"2023-10-05T15:36:06.650732+0000","last_peered":"2023-10-05T15:36:06.650732+0000","last_clean":"2023-10-05T15:36:06.650732+0000","last_became_active":"2023-10-05T15:34:32.607989+0000","last_became_peered":"2023-10-05T15:34:32.607989+0000","last_unstale":"2023-10-05T15:36:06.650732+0000","last_undegraded":"2023-10-05T15:36:06.650732+0000","last_fullsized":"2023-10-05T15:36:06.650732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:24:35.240949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644944+0000","last_change":"2023-10-05T15:35:05.959978+0000","last_active":"2023-10-05T15:36:05.644944+0000","last_peered":"2023-10-05T15:36:05.644944+0000","last_clean":"2023-10-05T15:36:05.644944+0000","last_became_active":"2023-10-05T15:35:05.954464+0000","last_became_peered":"2023-10-05T15:35:05.954464+0000","last_unstale":"2023-10-05T15:36:05.644944+0000","last_undegraded":"2023-10-05T15:36:05.644944+0000","last_fullsized":"2023-10-05T15:36:05.644944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:31:05.392741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"94'4","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:43.972865+0000","last_change":"2023-10-05T15:34:31.611129+0000","last_active":"2023-10-05T15:36:43.972865+0000","last_peered":"2023-10-05T15:36:43.972865+0000","last_clean":"2023-10-05T15:36:43.972865+0000","last_became_active":"2023-10-05T15:34:31.610712+0000","last_became_peered":"2023-10-05T15:34:31.610712+0000","last_unstale":"2023-10-05T15:36:43.972865+0000","last_undegraded":"2023-10-05T15:36:43.972865+0000","last_fullsized":"2023-10-05T15:36:43.972865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:58:40.634630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646511+0000","last_change":"2023-10-05T15:34:32.600585+0000","last_active":"2023-10-05T15:36:06.646511+0000","last_peered":"2023-10-05T15:36:06.646511+0000","last_clean":"2023-10-05T15:36:06.646511+0000","last_became_active":"2023-10-05T15:34:32.600222+0000","last_became_peered":"2023-10-05T15:34:32.600222+0000","last_unstale":"2023-10-05T15:36:06.646511+0000","last_undegraded":"2023-10-05T15:36:06.646511+0000","last_fullsized":"2023-10-05T15:36:06.646511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:57.801602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.644332+0000","last_change":"2023-10-05T15:34:36.857802+0000","last_active":"2023-10-05T15:36:05.644332+0000","last_peered":"2023-10-05T15:36:05.644332+0000","last_clean":"2023-10-05T15:36:05.644332+0000","last_became_active":"2023-10-05T15:34:36.857351+0000","last_became_peered":"2023-10-05T15:34:36.857351+0000","last_unstale":"2023-10-05T15:36:05.644332+0000","last_undegraded":"2023-10-05T15:36:05.644332+0000","last_fullsized":"2023-10-05T15:36:05.644332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:13.377928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.672176+0000","last_change":"2023-10-05T15:36:06.672176+0000","last_active":"2023-10-05T15:36:06.672176+0000","last_peered":"2023-10-05T15:36:06.672176+0000","last_clean":"2023-10-05T15:36:06.672176+0000","last_became_active":"2023-10-05T15:36:06.655828+0000","last_became_peered":"2023-10-05T15:36:06.655828+0000","last_unstale":"2023-10-05T15:36:06.672176+0000","last_undegraded":"2023-10-05T15:36:06.672176+0000","last_fullsized":"2023-10-05T15:36:06.672176+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:44:47.789216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":26,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652240+0000","last_change":"2023-10-05T15:34:32.604315+0000","last_active":"2023-10-05T15:36:06.652240+0000","last_peered":"2023-10-05T15:36:06.652240+0000","last_clean":"2023-10-05T15:36:06.652240+0000","last_became_active":"2023-10-05T15:34:32.603915+0000","last_became_peered":"2023-10-05T15:34:32.603915+0000","last_unstale":"2023-10-05T15:36:06.652240+0000","last_undegraded":"2023-10-05T15:36:06.652240+0000","last_fullsized":"2023-10-05T15:36:06.652240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:43.447446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.727984+0000","last_change":"2023-10-05T15:36:06.727430+0000","last_active":"2023-10-05T15:36:06.727984+0000","last_peered":"2023-10-05T15:36:06.727984+0000","last_clean":"2023-10-05T15:36:06.727984+0000","last_became_active":"2023-10-05T15:36:06.726961+0000","last_became_peered":"2023-10-05T15:36:06.726961+0000","last_unstale":"2023-10-05T15:36:06.727984+0000","last_undegraded":"2023-10-05T15:36:06.727984+0000","last_fullsized":"2023-10-05T15:36:06.727984+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:18:40.759607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"94'8","reported_seq":63,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:46.725735+0000","last_change":"2023-10-05T15:36:06.672116+0000","last_active":"2023-10-05T15:36:46.725735+0000","last_peered":"2023-10-05T15:36:46.725735+0000","last_clean":"2023-10-05T15:36:46.725735+0000","last_became_active":"2023-10-05T15:36:06.654419+0000","last_became_peered":"2023-10-05T15:36:06.654419+0000","last_unstale":"2023-10-05T15:36:46.725735+0000","last_undegraded":"2023-10-05T15:36:46.725735+0000","last_fullsized":"2023-10-05T15:36:46.725735+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:25:27.679173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2184,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1701,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650109+0000","last_change":"2023-10-05T15:34:32.607667+0000","last_active":"2023-10-05T15:36:05.650109+0000","last_peered":"2023-10-05T15:36:05.650109+0000","last_clean":"2023-10-05T15:36:05.650109+0000","last_became_active":"2023-10-05T15:34:32.607006+0000","last_became_peered":"2023-10-05T15:34:32.607006+0000","last_unstale":"2023-10-05T15:36:05.650109+0000","last_undegraded":"2023-10-05T15:36:05.650109+0000","last_fullsized":"2023-10-05T15:36:05.650109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:02.076401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.655260+0000","last_change":"2023-10-05T15:34:36.680665+0000","last_active":"2023-10-05T15:36:05.655260+0000","last_peered":"2023-10-05T15:36:05.655260+0000","last_clean":"2023-10-05T15:36:05.655260+0000","last_became_active":"2023-10-05T15:34:36.680119+0000","last_became_peered":"2023-10-05T15:34:36.680119+0000","last_unstale":"2023-10-05T15:36:05.655260+0000","last_undegraded":"2023-10-05T15:36:05.655260+0000","last_fullsized":"2023-10-05T15:36:05.655260+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:10:36.213281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.642051+0000","last_change":"2023-10-05T15:34:31.600418+0000","last_active":"2023-10-05T15:36:05.642051+0000","last_peered":"2023-10-05T15:36:05.642051+0000","last_clean":"2023-10-05T15:36:05.642051+0000","last_became_active":"2023-10-05T15:34:31.600049+0000","last_became_peered":"2023-10-05T15:34:31.600049+0000","last_unstale":"2023-10-05T15:36:05.642051+0000","last_undegraded":"2023-10-05T15:36:05.642051+0000","last_fullsized":"2023-10-05T15:36:05.642051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:15:48.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650432+0000","last_change":"2023-10-05T15:34:32.610922+0000","last_active":"2023-10-05T15:36:05.650432+0000","last_peered":"2023-10-05T15:36:05.650432+0000","last_clean":"2023-10-05T15:36:05.650432+0000","last_became_active":"2023-10-05T15:34:32.610590+0000","last_became_peered":"2023-10-05T15:34:32.610590+0000","last_unstale":"2023-10-05T15:36:05.650432+0000","last_undegraded":"2023-10-05T15:36:05.650432+0000","last_fullsized":"2023-10-05T15:36:05.650432+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:55:39.433821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.640975+0000","last_change":"2023-10-05T15:34:36.656856+0000","last_active":"2023-10-05T15:36:05.640975+0000","last_peered":"2023-10-05T15:36:05.640975+0000","last_clean":"2023-10-05T15:36:05.640975+0000","last_became_active":"2023-10-05T15:34:36.656468+0000","last_became_peered":"2023-10-05T15:34:36.656468+0000","last_unstale":"2023-10-05T15:36:05.640975+0000","last_undegraded":"2023-10-05T15:36:05.640975+0000","last_fullsized":"2023-10-05T15:36:05.640975+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:35.638068+0000","last_clean_scrub_stamp":"2023-10-05T15:34:35.638068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:28:24.546367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":26,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.649262+0000","last_change":"2023-10-05T15:34:31.613821+0000","last_active":"2023-10-05T15:36:05.649262+0000","last_peered":"2023-10-05T15:36:05.649262+0000","last_clean":"2023-10-05T15:36:05.649262+0000","last_became_active":"2023-10-05T15:34:31.613444+0000","last_became_peered":"2023-10-05T15:34:31.613444+0000","last_unstale":"2023-10-05T15:36:05.649262+0000","last_undegraded":"2023-10-05T15:36:05.649262+0000","last_fullsized":"2023-10-05T15:36:05.649262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:30.557539+0000","last_clean_scrub_stamp":"2023-10-05T15:34:30.557539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:01:10.843364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":29,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.650578+0000","last_change":"2023-10-05T15:34:32.607951+0000","last_active":"2023-10-05T15:36:05.650578+0000","last_peered":"2023-10-05T15:36:05.650578+0000","last_clean":"2023-10-05T15:36:05.650578+0000","last_became_active":"2023-10-05T15:34:32.607610+0000","last_became_peered":"2023-10-05T15:34:32.607610+0000","last_unstale":"2023-10-05T15:36:05.650578+0000","last_undegraded":"2023-10-05T15:36:05.650578+0000","last_fullsized":"2023-10-05T15:36:05.650578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:49:00.193687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":38,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650835+0000","last_change":"2023-10-05T15:35:05.959167+0000","last_active":"2023-10-05T15:36:06.650835+0000","last_peered":"2023-10-05T15:36:06.650835+0000","last_clean":"2023-10-05T15:36:06.650835+0000","last_became_active":"2023-10-05T15:35:05.958674+0000","last_became_peered":"2023-10-05T15:35:05.958674+0000","last_unstale":"2023-10-05T15:36:06.650835+0000","last_undegraded":"2023-10-05T15:36:06.650835+0000","last_fullsized":"2023-10-05T15:36:06.650835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:55:03.244565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":33,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647420+0000","last_change":"2023-10-05T15:34:32.609280+0000","last_active":"2023-10-05T15:36:06.647420+0000","last_peered":"2023-10-05T15:36:06.647420+0000","last_clean":"2023-10-05T15:36:06.647420+0000","last_became_active":"2023-10-05T15:34:32.608960+0000","last_became_peered":"2023-10-05T15:34:32.608960+0000","last_unstale":"2023-10-05T15:36:06.647420+0000","last_undegraded":"2023-10-05T15:36:06.647420+0000","last_fullsized":"2023-10-05T15:36:06.647420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:33:34.409590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.647361+0000","last_change":"2023-10-05T15:34:32.600087+0000","last_active":"2023-10-05T15:36:06.647361+0000","last_peered":"2023-10-05T15:36:06.647361+0000","last_clean":"2023-10-05T15:36:06.647361+0000","last_became_active":"2023-10-05T15:34:32.599737+0000","last_became_peered":"2023-10-05T15:34:32.599737+0000","last_unstale":"2023-10-05T15:36:06.647361+0000","last_undegraded":"2023-10-05T15:36:06.647361+0000","last_fullsized":"2023-10-05T15:36:06.647361+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:11:50.870088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":28,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.652910+0000","last_change":"2023-10-05T15:34:32.606784+0000","last_active":"2023-10-05T15:36:06.652910+0000","last_peered":"2023-10-05T15:36:06.652910+0000","last_clean":"2023-10-05T15:36:06.652910+0000","last_became_active":"2023-10-05T15:34:32.606233+0000","last_became_peered":"2023-10-05T15:34:32.606233+0000","last_unstale":"2023-10-05T15:36:06.652910+0000","last_undegraded":"2023-10-05T15:36:06.652910+0000","last_fullsized":"2023-10-05T15:36:06.652910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:33:02.535589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":25,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.726472+0000","last_change":"2023-10-05T15:34:32.604987+0000","last_active":"2023-10-05T15:36:06.726472+0000","last_peered":"2023-10-05T15:36:06.726472+0000","last_clean":"2023-10-05T15:36:06.726472+0000","last_became_active":"2023-10-05T15:34:32.604607+0000","last_became_peered":"2023-10-05T15:34:32.604607+0000","last_unstale":"2023-10-05T15:36:06.726472+0000","last_undegraded":"2023-10-05T15:36:06.726472+0000","last_fullsized":"2023-10-05T15:36:06.726472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:57:04.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.650294+0000","last_change":"2023-10-05T15:34:32.613746+0000","last_active":"2023-10-05T15:36:06.650294+0000","last_peered":"2023-10-05T15:36:06.650294+0000","last_clean":"2023-10-05T15:36:06.650294+0000","last_became_active":"2023-10-05T15:34:32.613436+0000","last_became_peered":"2023-10-05T15:34:32.613436+0000","last_unstale":"2023-10-05T15:36:06.650294+0000","last_undegraded":"2023-10-05T15:36:06.650294+0000","last_fullsized":"2023-10-05T15:36:06.650294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:53:20.800200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":36,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.648388+0000","last_change":"2023-10-05T15:34:32.604478+0000","last_active":"2023-10-05T15:36:06.648388+0000","last_peered":"2023-10-05T15:36:06.648388+0000","last_clean":"2023-10-05T15:36:06.648388+0000","last_became_active":"2023-10-05T15:34:32.604152+0000","last_became_peered":"2023-10-05T15:34:32.604152+0000","last_unstale":"2023-10-05T15:36:06.648388+0000","last_undegraded":"2023-10-05T15:36:06.648388+0000","last_fullsized":"2023-10-05T15:36:06.648388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:48:14.586037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646887+0000","last_change":"2023-10-05T15:35:06.113556+0000","last_active":"2023-10-05T15:36:06.646887+0000","last_peered":"2023-10-05T15:36:06.646887+0000","last_clean":"2023-10-05T15:36:06.646887+0000","last_became_active":"2023-10-05T15:35:06.113152+0000","last_became_peered":"2023-10-05T15:35:06.113152+0000","last_unstale":"2023-10-05T15:36:06.646887+0000","last_undegraded":"2023-10-05T15:36:06.646887+0000","last_fullsized":"2023-10-05T15:36:06.646887+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:44:48.069689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":27,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.702029+0000","last_change":"2023-10-05T15:34:32.605691+0000","last_active":"2023-10-05T15:36:06.702029+0000","last_peered":"2023-10-05T15:36:06.702029+0000","last_clean":"2023-10-05T15:36:06.702029+0000","last_became_active":"2023-10-05T15:34:32.605357+0000","last_became_peered":"2023-10-05T15:34:32.605357+0000","last_unstale":"2023-10-05T15:36:06.702029+0000","last_undegraded":"2023-10-05T15:36:06.702029+0000","last_fullsized":"2023-10-05T15:36:06.702029+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:36:44.181906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":29,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.646304+0000","last_change":"2023-10-05T15:34:32.606169+0000","last_active":"2023-10-05T15:36:06.646304+0000","last_peered":"2023-10-05T15:36:06.646304+0000","last_clean":"2023-10-05T15:36:06.646304+0000","last_became_active":"2023-10-05T15:34:32.605760+0000","last_became_peered":"2023-10-05T15:34:32.605760+0000","last_unstale":"2023-10-05T15:36:06.646304+0000","last_undegraded":"2023-10-05T15:36:06.646304+0000","last_fullsized":"2023-10-05T15:36:06.646304+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:19:43.037676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":31,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-10-05T15:36:06.653783+0000","last_change":"2023-10-05T15:34:32.605565+0000","last_active":"2023-10-05T15:36:06.653783+0000","last_peered":"2023-10-05T15:36:06.653783+0000","last_clean":"2023-10-05T15:36:06.653783+0000","last_became_active":"2023-10-05T15:34:32.605290+0000","last_became_peered":"2023-10-05T15:34:32.605290+0000","last_unstale":"2023-10-05T15:36:06.653783+0000","last_undegraded":"2023-10-05T15:36:06.653783+0000","last_fullsized":"2023-10-05T15:36:06.653783+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:09:18.779872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.648971+0000","last_change":"2023-10-05T15:34:32.602073+0000","last_active":"2023-10-05T15:36:05.648971+0000","last_peered":"2023-10-05T15:36:05.648971+0000","last_clean":"2023-10-05T15:36:05.648971+0000","last_became_active":"2023-10-05T15:34:32.601751+0000","last_became_peered":"2023-10-05T15:34:32.601751+0000","last_unstale":"2023-10-05T15:36:05.648971+0000","last_undegraded":"2023-10-05T15:36:05.648971+0000","last_fullsized":"2023-10-05T15:36:05.648971+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T00:06:53.018587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":28,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-10-05T15:36:05.654872+0000","last_change":"2023-10-05T15:34:32.611736+0000","last_active":"2023-10-05T15:36:05.654872+0000","last_peered":"2023-10-05T15:36:05.654872+0000","last_clean":"2023-10-05T15:36:05.654872+0000","last_became_active":"2023-10-05T15:34:32.611452+0000","last_became_peered":"2023-10-05T15:34:32.611452+0000","last_unstale":"2023-10-05T15:36:05.654872+0000","last_undegraded":"2023-10-05T15:36:05.654872+0000","last_fullsized":"2023-10-05T15:36:05.654872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T15:34:31.576284+0000","last_clean_scrub_stamp":"2023-10-05T15:34:31.576284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:18:13.681450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284653,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68921,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1069,"num_read_kb":607,"num_write":257,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1813,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":211083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351017,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":524744,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66400000000000003,"15min":0.67200000000000004},"min":{"1min":0.41499999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1040000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91800000000000004,"5min":1.038,"15min":1.038},"last":0.80800000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.034,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84099999999999997,"15min":0.81799999999999995},"min":{"1min":0.62,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.167,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.52400000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90500000000000003,"5min":1.135,"15min":1.135},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.80200000000000005,"15min":0.78400000000000003},"min":{"1min":0.65300000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81699999999999995,"15min":0.84899999999999998},"min":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1259999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.498,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.94299999999999995,"15min":0.92500000000000004},"min":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.2370000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.095},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.69199999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1579999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.0549999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.161,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.002}]},{"osd":9,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.341,"5min":1.722,"15min":1.722},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0049999999999999,"15min":0.999},"min":{"1min":0.78200000000000003,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.2889999999999999,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.042}]},{"osd":10,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":0.94199999999999995},"min":{"1min":0.621,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.196,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.02},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.91300000000000003,"15min":0.89500000000000002},"min":{"1min":0.69099999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1439999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.92600000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612654,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1183744,"data_stored":1174718,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58899999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.36399999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.65000000000000002,"15min":0.69999999999999996},"min":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88100000000000001,"5min":1.145,"15min":1.145},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.77,"5min":1.77,"15min":1.77},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.80400000000000005},"min":{"1min":0.50600000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.998,"5min":1.085,"15min":1.085},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.42499999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.4039999999999999,"5min":6.4039999999999999,"15min":6.4039999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78000000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.75600000000000001,"15min":0.80000000000000004},"min":{"1min":0.441,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89000000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.87,"15min":0.90100000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.008,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.88400000000000001,"15min":0.91700000000000004},"min":{"1min":0.57499999999999996,"5min":0.503,"15min":0.503},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.9369999999999998,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:34:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.5},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.94299999999999995,"15min":0.99199999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1519999999999999,"5min":1.264,"15min":1.264},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93799999999999994,"15min":0.96699999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.752}]},{"osd":9,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.026,"15min":1.052},"min":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.97099999999999997,"15min":0.996},"min":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":0.72799999999999998}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.92700000000000005,"15min":0.94499999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.097,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":0.93400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1259999999999999,"5min":1.236,"15min":1.236},"last":0.85799999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":523548,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55600000000000005,"15min":0.57799999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.125,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.75700000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":0.83599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99399999999999999,"5min":1.343,"15min":1.343},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82599999999999996,"15min":0.83499999999999996},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.085,"5min":1.109,"15min":1.109},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72199999999999998,"15min":0.70899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.628}]},{"osd":3,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.71999999999999997,"15min":0.76100000000000001},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0309999999999999,"5min":1.258,"15min":1.258},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76000000000000001,"15min":0.78300000000000003},"min":{"1min":0.46500000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81299999999999994,"15min":0.83199999999999996},"min":{"1min":0.57099999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.99099999999999999,"5min":1.089,"15min":1.089},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79700000000000004,"15min":0.79500000000000004},"min":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.054,"5min":1.391,"15min":1.391},"last":0.875}]},{"osd":6,"last update":"Thu Oct 5 15:33:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":3.8300000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.98199999999999998,"15min":1.0129999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Oct 5 15:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.89000000000000001,"15min":0.91600000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.94799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1020000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.96699999999999997,"15min":1.0229999999999999},"min":{"1min":0.56899999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1359999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.872,"15min":0.90500000000000003},"min":{"1min":0.61599999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.109,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.84799999999999998}]}]},{"osd":8,"up_from":60,"seq":257698037816,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":523814,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71499999999999997,"15min":0.73899999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.155,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.629},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2250000000000001,"5min":1.431,"15min":1.431},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.76400000000000001,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95499999999999996,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.47499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.02,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.622,"15min":0.61399999999999999},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93000000000000005,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.96599999999999997,"5min":1.04,"15min":1.04},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73399999999999999,"15min":0.74099999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":1.091,"15min":1.091},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.151,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.004}]},{"osd":4,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82499999999999996,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.88100000000000001,"15min":0.91300000000000003},"min":{"1min":0.66200000000000003,"5min":0.502,"15min":0.502},"max":{"1min":1.109,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.93600000000000005,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94199999999999995,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91300000000000003,"15min":0.94399999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.252,"15min":1.252},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.70999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3180000000000001,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.94499999999999995,"15min":0.96099999999999997},"min":{"1min":0.73799999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.873},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.91800000000000004,"15min":0.96399999999999997},"min":{"1min":0.67000000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.194,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.93999999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.97299999999999998,"15min":0.97199999999999998},"min":{"1min":0.72599999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.22,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.046},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.03,"15min":1.0329999999999999},"min":{"1min":0.81100000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.3029999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0700000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.97999999999999998,"15min":0.97899999999999998},"min":{"1min":0.71099999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.1579999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.90300000000000002},"min":{"1min":0.79000000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.23,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.89300000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0029999999999999,"15min":1.0129999999999999},"min":{"1min":0.63100000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.169,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.006},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.98599999999999999,"15min":0.99299999999999999},"min":{"1min":0.72599999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.0820000000000001,"5min":1.208,"15min":1.208},"last":0.96199999999999997}]}]},{"osd":7,"up_from":52,"seq":223338299453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1121481,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.379}]},{"osd":1,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.61599999999999999,"15min":0.53800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71899999999999997,"5min":8.5749999999999993,"15min":8.5749999999999993},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.65700000000000003,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":7.9950000000000001,"15min":7.9950000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.46999999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0389999999999999,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82199999999999995,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.438,"15min":0.438},"max":{"1min":1.0800000000000001,"5min":8.2840000000000007,"15min":8.2840000000000007},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.84399999999999997,"15min":0.73199999999999998},"min":{"1min":0.46999999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.423,"5min":8.5370000000000008,"15min":8.5370000000000008},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82599999999999996,"15min":0.76700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.3650000000000002,"5min":6.3289999999999997,"15min":6.3289999999999997},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.753,"15min":0.67900000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.022,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80500000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94399999999999995,"5min":1.127,"15min":1.127},"last":0.876},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.89000000000000001,"15min":0.80900000000000005},"min":{"1min":0.622,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":8.609,"15min":8.609},"last":1.052}]},{"osd":6,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.88700000000000001,"15min":0.84499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.119,"5min":6.4699999999999998,"15min":6.4699999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.81599999999999995,"15min":0.82699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1930000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.92500000000000004}]},{"osd":8,"last update":"Thu Oct 5 15:36:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.92500000000000004,"15min":0.872},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.115,"5min":6.5300000000000002,"15min":6.5300000000000002},"last":0.996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.90800000000000003,"15min":0.90000000000000002},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.1699999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.0720000000000001}]},{"osd":9,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89200000000000002,"15min":0.91800000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0980000000000001,"5min":1.28,"15min":1.28},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.90200000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1379999999999999,"5min":8.3219999999999992,"15min":8.3219999999999992},"last":1.095}]},{"osd":10,"last update":"Thu Oct 5 15:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.96499999999999997,"15min":1.014},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2529999999999999,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.032,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.194,"5min":8.4990000000000006,"15min":8.4990000000000006},"last":1.123}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.3420000000000001,"15min":1.4099999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.228,"5min":8.7249999999999996,"15min":8.7249999999999996},"last":1.145},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.228,"15min":1.284},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.159,"5min":6.6230000000000002,"15min":6.6230000000000002},"last":0.95199999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462979,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":519535,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.49199999999999999,"15min":0.44},"min":{"1min":0.35499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.55200000000000005,"15min":0.49199999999999999},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.74399999999999999,"15min":0.67800000000000005},"min":{"1min":0.55500000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.76400000000000001,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.503,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.67200000000000004,"15min":0.625},"min":{"1min":0.41199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.77600000000000002,"15min":0.74099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.877}]},{"osd":5,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81599999999999995,"15min":0.80200000000000005},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.86699999999999999,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.84599999999999997,"15min":0.79700000000000004},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.83699999999999997,"15min":0.82099999999999995},"min":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.94199999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:36:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.86599999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":0.82399999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.92300000000000004,"15min":0.91600000000000004},"min":{"1min":0.624,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":2.9830000000000001,"5min":2.9830000000000001,"15min":2.9830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.91100000000000003,"15min":0.89700000000000002},"min":{"1min":0.58599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.68400000000000005}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.96099999999999997,"15min":0.95899999999999996},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.02,"5min":0.98299999999999998,"15min":0.97299999999999998},"min":{"1min":0.63200000000000001,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":0.90200000000000002}]},{"osd":11,"last update":"Thu Oct 5 15:36:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0309999999999999,"15min":1.0349999999999999},"min":{"1min":0.751,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.476,"5min":2.476,"15min":2.476},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.98599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":584921,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.68700000000000006,"15min":0.59899999999999998},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35799999999999998},"max":{"1min":0.93799999999999994,"5min":6.391,"15min":6.391},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.58099999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.34999999999999998},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":1.083},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67700000000000005,"15min":0.60699999999999998},"min":{"1min":0.45900000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94399999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.68899999999999995,"15min":0.60499999999999998},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97699999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Oct 5 15:36:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68100000000000005,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.022,"5min":1.046,"15min":1.046},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.78300000000000003,"15min":0.68200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4139999999999997,"5min":6.4139999999999997,"15min":6.4139999999999997},"last":0.504}]},{"osd":4,"last update":"Thu Oct 5 15:34:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56499999999999995,"15min":0.53100000000000003},"min":{"1min":0.436,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":1.72,"15min":1.72},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.637,"15min":1.637},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.74199999999999999},"min":{"1min":0.61899999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78800000000000003,"15min":0.754},"min":{"1min":0.54900000000000004,"5min":0.499,"15min":0.499},"max":{"1min":1.052,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.71999999999999997},"min":{"1min":0.53400000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92400000000000004,"5min":1.538,"15min":1.538},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Oct 5 15:35:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70199999999999996,"15min":0.67600000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.85399999999999998,"5min":1.51,"15min":1.51},"last":0.745},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93899999999999995,"5min":1.381,"15min":1.381},"last":0.93200000000000005}]},{"osd":8,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81399999999999995,"15min":0.78100000000000003},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1359999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.79700000000000004},"min":{"1min":0.64700000000000002,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0429999999999999,"5min":1.625,"15min":1.625},"last":0.80600000000000005}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":0.93200000000000005,"15min":0.89100000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":6.0750000000000002,"5min":6.0750000000000002,"15min":6.0750000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.091,"5min":1.282,"15min":1.282},"last":0.84399999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.94399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0700000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1559999999999999,"5min":1.609,"15min":1.609},"last":1.004}]},{"osd":11,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.93899999999999995,"15min":0.93600000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.002,"15min":1.01},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1850000000000001,"5min":1.256,"15min":1.256},"last":1.0469999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":521522,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 5 15:36:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65200000000000002,"15min":0.59599999999999997},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69399999999999995,"15min":0.623},"min":{"1min":0.44700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.0329999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Oct 5 15:35:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.73599999999999999,"15min":0.66300000000000003},"min":{"1min":0.50600000000000001,"5min":0.436,"15min":0.42899999999999999},"max":{"1min":1.0900000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.70399999999999996,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.97799999999999998,"5min":1.026,"15min":1.026},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.432},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.70399999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92300000000000004,"5min":1.325,"15min":1.325},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Oct 5 15:36:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66600000000000004,"15min":0.68000000000000005},"min":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.016,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.45400000000000001,"15min":0.44600000000000001},"max":{"1min":1.0760000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Oct 5 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.754,"15min":0.72599999999999998},"min":{"1min":0.54100000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.70899999999999996},"min":{"1min":0.59499999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70799999999999996,"15min":0.69699999999999995},"min":{"1min":0.497,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96599999999999997,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72199999999999998,"15min":0.70599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90700000000000003,"5min":1.417,"15min":1.417},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.89500000000000002,"15min":0.92000000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95199999999999996,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.96299999999999997,"15min":0.98499999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.1160000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.0029999999999999}]},{"osd":8,"last update":"Thu Oct 5 15:36:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0600000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.105,"5min":1.258,"15min":1.258},"last":0.91200000000000003}]},{"osd":9,"last update":"Thu Oct 5 15:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.90100000000000002,"15min":0.89700000000000002},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0840000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.88800000000000001,"15min":0.88},"min":{"1min":0.60199999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.4259999999999999,"5min":1.581,"15min":1.581},"last":0.88400000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:16 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85399999999999998,"15min":0.84399999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1619999999999999,"5min":1.538,"15min":1.538},"last":0.874},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.97799999999999998,"15min":0.96399999999999997},"min":{"1min":0.78100000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.3069999999999999,"5min":1.51,"15min":1.51},"last":1.0649999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.78900000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.105,"5min":1.534,"15min":1.534},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.92200000000000004,"15min":0.91500000000000004},"min":{"1min":0.71599999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.0920000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.94099999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":579651,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58999999999999997,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.95699999999999996,"5min":1.036,"15min":1.036},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.69499999999999995,"15min":0.63100000000000001},"min":{"1min":0.47799999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.71499999999999997,"15min":0.64700000000000002},"min":{"1min":0.48999999999999999,"5min":0.40899999999999997,"15min":0.378},"max":{"1min":1.0920000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Oct 5 15:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.59599999999999997},"min":{"1min":0.45300000000000001,"5min":0.40699999999999997,"15min":0.38400000000000001},"max":{"1min":0.93500000000000005,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69499999999999995,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.161,"5min":1.244,"15min":1.244},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.83999999999999997,"15min":0.84999999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0329999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.59399999999999997,"15min":0.52400000000000002},"min":{"1min":0.41599999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.92600000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.60899999999999999,"15min":0.53600000000000003},"min":{"1min":0.41499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.98299999999999998,"5min":1.149,"15min":1.149},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.79400000000000004,"15min":0.73599999999999999},"min":{"1min":0.68200000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.81100000000000005,"15min":0.752},"min":{"1min":0.61699999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Oct 5 15:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.95899999999999996,"15min":0.96699999999999997},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1419999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.048},{"interface":"front","average":{"1min":0.874,"5min":0.91500000000000004,"15min":0.92200000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.212,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90700000000000003}]},{"osd":8,"last update":"Thu Oct 5 15:36:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.72499999999999998,"15min":0.68500000000000005},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.1759999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.879,"5min":0.78200000000000003,"15min":0.74099999999999999},"min":{"1min":0.56399999999999995,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.167,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91700000000000004}]},{"osd":9,"last update":"Thu Oct 5 15:35:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.90500000000000003,"15min":0.89300000000000002},"min":{"1min":0.78200000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.84599999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.878,"15min":0.85699999999999998},"min":{"1min":0.68300000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.238,"5min":1.284,"15min":1.284},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.012,"5min":0.92500000000000004,"15min":0.89500000000000002},"min":{"1min":0.78300000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.101}]},{"osd":11,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.92100000000000004,"15min":0.91600000000000004},"min":{"1min":0.628,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2529999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0529999999999999,"15min":1.056},"min":{"1min":0.78900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.272,"5min":1.413,"15min":1.413},"last":1.0760000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149778,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1048576,"data_stored":518760,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.41799999999999998},"min":{"1min":0.36099999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.48399999999999999,"15min":0.438},"min":{"1min":0.378,"5min":0.314,"15min":0.29399999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72799999999999998,"15min":0.66000000000000003},"min":{"1min":0.52400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.99399999999999999,"5min":1.079,"15min":1.079},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68700000000000006,"15min":0.63500000000000001},"min":{"1min":0.54800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91400000000000003,"5min":1.097,"15min":1.097},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.77000000000000002,"15min":0.70299999999999996},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":1.022,"5min":1.109,"15min":1.109},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Oct 5 15:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.74199999999999999,"15min":0.70999999999999996},"min":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94899999999999995,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83299999999999996,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Oct 5 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81399999999999995,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0580000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Oct 5 15:36:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.48699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.76300000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91900000000000004,"5min":1.409,"15min":1.409},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Oct 5 15:35:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.163,"15min":1.163},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.878,"15min":0.88200000000000001},"min":{"1min":0.63900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.171,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.94599999999999995}]},{"osd":8,"last update":"Thu Oct 5 15:34:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.751,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.284,"5min":1.431,"15min":1.431},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.71299999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.91900000000000004},"min":{"1min":0.55200000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.2210000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Oct 5 15:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.88600000000000001},"min":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.97899999999999998,"15min":0.995},"min":{"1min":0.77000000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2010000000000001,"5min":1.331,"15min":1.331},"last":0.98699999999999999}]},{"osd":11,"last update":"Thu Oct 5 15:36:36 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.83999999999999997},"min":{"1min":0.72899999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.006,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97799999999999998,"15min":0.98399999999999999},"min":{"1min":0.82699999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.0700000000000001,"5min":1.246,"15min":1.246},"last":0.92600000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888142,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1052672,"data_stored":525793,"data_compressed":23637,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:33:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.60999999999999999,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.45000000000000001},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.157,"5min":1.526,"15min":1.526},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.77700000000000002,"15min":0.69299999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.377},"max":{"1min":2.0249999999999999,"5min":3.762,"15min":3.762},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.79000000000000004,"15min":0.66200000000000003},"min":{"1min":0.51400000000000001,"5min":0.435,"15min":0.40100000000000002},"max":{"1min":0.92000000000000004,"5min":8.9619999999999997,"15min":8.9619999999999997},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Oct 5 15:36:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.81799999999999995,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.093,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.82099999999999995,"15min":0.77400000000000002},"min":{"1min":0.59499999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.95799999999999996}]},{"osd":6,"last update":"Thu Oct 5 15:36:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77700000000000002,"15min":0.71799999999999997},"min":{"1min":0.495,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.90500000000000003,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.23,"5min":8.6839999999999993,"15min":8.6839999999999993},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Oct 5 15:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70899999999999996,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0049999999999999,"5min":1.659,"15min":1.659},"last":0.87},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.591,"15min":1.591},"last":0.83399999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:36:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.80700000000000005,"15min":0.76900000000000002},"min":{"1min":0.56299999999999994,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.83699999999999997},"min":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.82099999999999995}]},{"osd":9,"last update":"Thu Oct 5 15:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93700000000000006,"15min":0.97299999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3220000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.0329999999999999,"15min":0.99099999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":6.3789999999999996,"5min":6.3789999999999996,"15min":6.3789999999999996},"last":0.88300000000000001}]},{"osd":10,"last update":"Thu Oct 5 15:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.86699999999999999,"15min":0.89400000000000002},"min":{"1min":0.55100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":0.75800000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.0409999999999999,"15min":1.0049999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.996,"5min":0.97199999999999998,"15min":0.96799999999999997},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.80800000000000005}]}]},{"osd":5,"up_from":39,"seq":167503724615,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1114112,"data_stored":1115766,"data_compressed":59834,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":1.671,"15min":1.671},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.626},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.71999999999999997,"15min":0.66200000000000003},"min":{"1min":0.53000000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0649999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.71399999999999997,"15min":0.66700000000000004},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.752}]},{"osd":2,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52300000000000002,"15min":0.48299999999999998},"min":{"1min":0.45600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.75600000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.55700000000000005,"15min":0.497},"min":{"1min":0.45300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.54200000000000004,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92800000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.67400000000000004},"min":{"1min":0.55400000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.012,"5min":1.097,"15min":1.097},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Oct 5 15:36:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.76100000000000001,"15min":0.70599999999999996},"min":{"1min":0.63300000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.76800000000000002,"15min":0.69999999999999996},"min":{"1min":0.57099999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Oct 5 15:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.81499999999999995,"15min":0.76000000000000001},"min":{"1min":0.67200000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.81299999999999994,"15min":0.76400000000000001},"min":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Oct 5 15:35:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.83599999999999997,"15min":0.78000000000000003},"min":{"1min":0.66000000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.83599999999999997,"15min":0.78500000000000003},"min":{"1min":0.73899999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.95699999999999996}]},{"osd":8,"last update":"Thu Oct 5 15:36:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.75600000000000001,"15min":0.71399999999999997},"min":{"1min":0.61799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2010000000000001,"5min":1.385,"15min":1.385},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.81200000000000006,"15min":0.76100000000000001},"min":{"1min":0.60499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.0309999999999999}]},{"osd":9,"last update":"Thu Oct 5 15:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.89200000000000002},"min":{"1min":0.67900000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.878,"15min":0.85799999999999998},"min":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.089}]},{"osd":10,"last update":"Thu Oct 5 15:36:14 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":0.97199999999999998,"15min":0.93200000000000005},"min":{"1min":0.88800000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.109},{"interface":"front","average":{"1min":1.0609999999999999,"5min":0.93799999999999994,"15min":0.90000000000000002},"min":{"1min":0.81699999999999995,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.2390000000000001}]},{"osd":11,"last update":"Thu Oct 5 15:36:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":1.0089999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34556,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36197,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T15:36:49.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 -- 172.21.15.17:0/3395264693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 msgr2=0x7fdce81012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 --2- 172.21.15.17:0/3395264693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce81012c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009990 tx=0x7fdcd8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 -- 172.21.15.17:0/3395264693 shutdown_connections 2023-10-05T15:36:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 --2- 172.21.15.17:0/3395264693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce8102a40 0x7fdce8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 --2- 172.21.15.17:0/3395264693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce81012c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 --2- 172.21.15.17:0/3395264693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102080 0x7fdce8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 -- 172.21.15.17:0/3395264693 >> 172.21.15.17:0/3395264693 conn(0x7fdce80fc420 msgr2=0x7fdce80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 -- 172.21.15.17:0/3395264693 shutdown_connections 2023-10-05T15:36:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.506+0000 7fdced7ff700 1 -- 172.21.15.17:0/3395264693 wait complete. 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.507+0000 7fdced7ff700 1 Processor -- start 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.507+0000 7fdced7ff700 1 -- start start 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdced7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdced7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce8102080 0x7fdce81991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdced7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102a40 0x7fdce81a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdced7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81a07e0 con 0x7fdce8100ea0 2023-10-05T15:36:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdced7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81a0950 con 0x7fdce8102a40 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdced7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81a0b10 con 0x7fdce8102080 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce8198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54320/0 (socket says 172.21.15.17:54320) 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 -- 172.21.15.17:0/2725724312 learned_addr learned my addr 172.21.15.17:0/2725724312 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce67fc700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce8102080 0x7fdce81991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce77fe700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102a40 0x7fdce81a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 -- 172.21.15.17:0/2725724312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce8102080 msgr2=0x7fdce81991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce8102080 0x7fdce81991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 -- 172.21.15.17:0/2725724312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102a40 msgr2=0x7fdce81a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102a40 0x7fdce81a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 -- 172.21.15.17:0/2725724312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd80095f0 con 0x7fdce8100ea0 2023-10-05T15:36:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce77fe700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102a40 0x7fdce81a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.508+0000 7fdce6ffd700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce8198c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8005740 tx=0x7fdcd8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.509+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd801d070 con 0x7fdce8100ea0 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.509+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce81a0d90 con 0x7fdce8100ea0 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.509+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdcd8004220 con 0x7fdce8100ea0 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.509+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8022dd0 con 0x7fdce8100ea0 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.509+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce81a11b0 con 0x7fdce8100ea0 2023-10-05T15:36:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.510+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8193400 con 0x7fdce8100ea0 2023-10-05T15:36:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.512+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdcd8003d90 con 0x7fdce8100ea0 2023-10-05T15:36:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.513+0000 7fdccffff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdcd00a14d0 0x7fdcd00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.514+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdcd80ce750 con 0x7fdce8100ea0 2023-10-05T15:36:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.514+0000 7fdce67fc700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdcd00a14d0 0x7fdcd00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.514+0000 7fdce67fc700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdcd00a14d0 0x7fdcd00a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005fd0 tx=0x7fdcdc005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:49.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.517+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdcd8097ad0 con 0x7fdce8100ea0 2023-10-05T15:36:49.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.732+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdce810c800 con 0x7fdce8100ea0 2023-10-05T15:36:49.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.734+0000 7fdccffff700 1 -- 172.21.15.17:0/2725724312 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7fdcd809b0f0 con 0x7fdce8100ea0 2023-10-05T15:36:49.736 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:49.736 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.736+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdcd00a14d0 msgr2=0x7fdcd00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.736+0000 7fdced7ff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdcd00a14d0 0x7fdcd00a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005fd0 tx=0x7fdcdc005e50 comp rx=0 tx=0).stop 2023-10-05T15:36:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 msgr2=0x7fdce8198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce8198c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8005740 tx=0x7fdcd8005770 comp rx=0 tx=0).stop 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 shutdown_connections 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdcd00a14d0 0x7fdcd00a3990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce8102a40 0x7fdce81a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdce8100ea0 0x7fdce8198c70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 --2- 172.21.15.17:0/2725724312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce8102080 0x7fdce81991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 >> 172.21.15.17:0/2725724312 conn(0x7fdce80fc420 msgr2=0x7fdce81079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 shutdown_connections 2023-10-05T15:36:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.737+0000 7fdced7ff700 1 -- 172.21.15.17:0/2725724312 wait complete. 2023-10-05T15:36:49.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:36:49.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:36:49.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:49 smithi017 ceph-mon[129107]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:49.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:49 smithi017 ceph-mon[129107]: pgmap v376: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-05T15:36:49.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:49 smithi017 ceph-mon[129107]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.961+0000 7ff29adff700 1 -- 172.21.15.17:0/2511460130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 msgr2=0x7ff2941024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.961+0000 7ff29adff700 1 --2- 172.21.15.17:0/2511460130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 0x7ff2941024f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2800098f0 tx=0x7ff280009c00 comp rx=0 tx=0).stop 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 -- 172.21.15.17:0/2511460130 shutdown_connections 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 --2- 172.21.15.17:0/2511460130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff294102a30 0x7ff294109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 --2- 172.21.15.17:0/2511460130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294100e90 0x7ff2941012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 --2- 172.21.15.17:0/2511460130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 0x7ff2941024f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 -- 172.21.15.17:0/2511460130 >> 172.21.15.17:0/2511460130 conn(0x7ff2940fc430 msgr2=0x7ff2940fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 -- 172.21.15.17:0/2511460130 shutdown_connections 2023-10-05T15:36:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.962+0000 7ff29adff700 1 -- 172.21.15.17:0/2511460130 wait complete. 2023-10-05T15:36:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.963+0000 7ff29adff700 1 Processor -- start 2023-10-05T15:36:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 -- start start 2023-10-05T15:36:49.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff294100e90 0x7ff294198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 0x7ff294199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 0x7ff2941a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941a0960 con 0x7ff294102a30 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941a0aa0 con 0x7ff294102070 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29adff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941a0c30 con 0x7ff294100e90 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 0x7ff2941a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 0x7ff2941a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54342/0 (socket says 172.21.15.17:54342) 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff29939c700 1 -- 172.21.15.17:0/948788499 learned_addr learned my addr 172.21.15.17:0/948788499 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.964+0000 7ff298b9b700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff294100e90 0x7ff294198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff293fff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 0x7ff294199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29939c700 1 -- 172.21.15.17:0/948788499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff294100e90 msgr2=0x7ff294198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29939c700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff294100e90 0x7ff294198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29939c700 1 -- 172.21.15.17:0/948788499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 msgr2=0x7ff294199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29939c700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 0x7ff294199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29939c700 1 -- 172.21.15.17:0/948788499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280009520 con 0x7ff294102a30 2023-10-05T15:36:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29939c700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 0x7ff2941a0390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff28c007ee0 tx=0x7ff28c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c017070 con 0x7ff294102a30 2023-10-05T15:36:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2941a0f10 con 0x7ff294102a30 2023-10-05T15:36:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff28c00f040 con 0x7ff294102a30 2023-10-05T15:36:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.965+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c005710 con 0x7ff294102a30 2023-10-05T15:36:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.966+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2941a1340 con 0x7ff294102a30 2023-10-05T15:36:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.966+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2941933f0 con 0x7ff294102a30 2023-10-05T15:36:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.968+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff28c005870 con 0x7ff294102a30 2023-10-05T15:36:49.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.970+0000 7ff291ffb700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2840a1480 0x7ff2840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:49.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.970+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff28c0cc7f0 con 0x7ff294102a30 2023-10-05T15:36:49.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.970+0000 7ff298b9b700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2840a1480 0x7ff2840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:49.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.971+0000 7ff298b9b700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2840a1480 0x7ff2840a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff294101be0 tx=0x7ff288009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:49.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:49.974+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff28c095a50 con 0x7ff294102a30 2023-10-05T15:36:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:49 smithi167 ceph-mon[133366]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:49 smithi167 ceph-mon[133366]: pgmap v376: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-05T15:36:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:49 smithi167 ceph-mon[133366]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:49 smithi079 ceph-mon[132936]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:49 smithi079 ceph-mon[132936]: pgmap v376: 129 pgs: 129 active+clean; 644 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-05T15:36:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:49 smithi079 ceph-mon[132936]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:50.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.183+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff29402d270 con 0x7ff294102a30 2023-10-05T15:36:50.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.183+0000 7ff291ffb700 1 -- 172.21.15.17:0/948788499 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff28c099070 con 0x7ff294102a30 2023-10-05T15:36:50.186 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2840a1480 msgr2=0x7ff2840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2840a1480 0x7ff2840a3940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff294101be0 tx=0x7ff288009310 comp rx=0 tx=0).stop 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 msgr2=0x7ff2941a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 0x7ff2941a0390 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff28c007ee0 tx=0x7ff28c00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 shutdown_connections 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2840a1480 0x7ff2840a3940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff294102a30 0x7ff2941a0390 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff294100e90 0x7ff294198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 --2- 172.21.15.17:0/948788499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff294102070 0x7ff294199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 >> 172.21.15.17:0/948788499 conn(0x7ff2940fc430 msgr2=0x7ff294107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:50.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 shutdown_connections 2023-10-05T15:36:50.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.186+0000 7ff29adff700 1 -- 172.21.15.17:0/948788499 wait complete. 2023-10-05T15:36:50.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 -- 172.21.15.17:0/2545456730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878108de0 msgr2=0x7f187810b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 --2- 172.21.15.17:0/2545456730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878108de0 0x7f187810b270 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f187000b0a0 tx=0x7f187000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 -- 172.21.15.17:0/2545456730 shutdown_connections 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 --2- 172.21.15.17:0/2545456730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878108de0 0x7f187810b270 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 --2- 172.21.15.17:0/2545456730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878074e70 0x7f18780732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 --2- 172.21.15.17:0/2545456730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1878073890 0x7f1878073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 -- 172.21.15.17:0/2545456730 >> 172.21.15.17:0/2545456730 conn(0x7f18780fc460 msgr2=0x7f18780fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 -- 172.21.15.17:0/2545456730 shutdown_connections 2023-10-05T15:36:50.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.410+0000 7f187dfff700 1 -- 172.21.15.17:0/2545456730 wait complete. 2023-10-05T15:36:50.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.411+0000 7f187dfff700 1 Processor -- start 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.411+0000 7f187dfff700 1 -- start start 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f187dfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 0x7f1878198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f187dfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1878074e70 0x7f1878199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f187dfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878108de0 0x7f18781a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f187dfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781a0960 con 0x7f1878073890 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f187dfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781a0aa0 con 0x7f1878074e70 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f187dfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781a0c30 con 0x7f1878108de0 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 0x7f1878198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 0x7f1878198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54372/0 (socket says 172.21.15.17:54372) 2023-10-05T15:36:50.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 -- 172.21.15.17:0/582152482 learned_addr learned my addr 172.21.15.17:0/582152482 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f186ffff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1878074e70 0x7f1878199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f1877fff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878108de0 0x7f18781a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 -- 172.21.15.17:0/582152482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878108de0 msgr2=0x7f18781a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878108de0 0x7f18781a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 -- 172.21.15.17:0/582152482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1878074e70 msgr2=0x7f1878199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1878074e70 0x7f1878199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f18777fe700 1 -- 172.21.15.17:0/582152482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868009520 con 0x7f1878073890 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.412+0000 7f1877fff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878108de0 0x7f18781a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.413+0000 7f18777fe700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 0x7f1878198de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f186800eb30 tx=0x7f186800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.413+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868009880 con 0x7f1878073890 2023-10-05T15:36:50.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.413+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1870009d00 con 0x7f1878073890 2023-10-05T15:36:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.413+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18680044b0 con 0x7f1878073890 2023-10-05T15:36:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.413+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868003df0 con 0x7f1878073890 2023-10-05T15:36:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.413+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18781a11d0 con 0x7f1878073890 2023-10-05T15:36:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.414+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18781074e0 con 0x7f1878073890 2023-10-05T15:36:50.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.416+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1868003f50 con 0x7f1878073890 2023-10-05T15:36:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.418+0000 7f18757fa700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18640a1480 0x7f18640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.418+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1868014070 con 0x7f1878073890 2023-10-05T15:36:50.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.418+0000 7f186ffff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18640a1480 0x7f18640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.419+0000 7f186ffff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18640a1480 0x7f18640a3940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1860009c60 tx=0x7f1860009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:50.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.421+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1868096730 con 0x7f1878073890 2023-10-05T15:36:50.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.647+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f187802d020 con 0x7f1878073890 2023-10-05T15:36:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.647+0000 7f18757fa700 1 -- 172.21.15.17:0/582152482 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1868099d50 con 0x7f1878073890 2023-10-05T15:36:50.650 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.650+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18640a1480 msgr2=0x7f18640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.650+0000 7f187dfff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18640a1480 0x7f18640a3940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1860009c60 tx=0x7f1860009260 comp rx=0 tx=0).stop 2023-10-05T15:36:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.650+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 msgr2=0x7f1878198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.650+0000 7f187dfff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 0x7f1878198de0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f186800eb30 tx=0x7f186800ee40 comp rx=0 tx=0).stop 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 shutdown_connections 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f18640a1480 0x7f18640a3940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1878108de0 0x7f18781a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1878073890 0x7f1878198de0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 --2- 172.21.15.17:0/582152482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1878074e70 0x7f1878199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 >> 172.21.15.17:0/582152482 conn(0x7f18780fc460 msgr2=0x7f18780fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 shutdown_connections 2023-10-05T15:36:50.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.651+0000 7f187dfff700 1 -- 172.21.15.17:0/582152482 wait complete. 2023-10-05T15:36:50.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:36:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.888+0000 7f1bb5fff700 1 -- 172.21.15.17:0/317008404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb00ff730 msgr2=0x7f1bb00ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.888+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/317008404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb00ff730 0x7f1bb00ffb50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009990 tx=0x7f1ba0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.888+0000 7f1bb5fff700 1 -- 172.21.15.17:0/317008404 shutdown_connections 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.888+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/317008404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.888+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/317008404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb00ff730 0x7f1bb00ffb50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.888+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/317008404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb0100090 0x7f1bb0100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.889+0000 7f1bb5fff700 1 -- 172.21.15.17:0/317008404 >> 172.21.15.17:0/317008404 conn(0x7f1bb00fb330 msgr2=0x7f1bb00fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.889+0000 7f1bb5fff700 1 -- 172.21.15.17:0/317008404 shutdown_connections 2023-10-05T15:36:50.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.889+0000 7f1bb5fff700 1 -- 172.21.15.17:0/317008404 wait complete. 2023-10-05T15:36:50.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.890+0000 7f1bb5fff700 1 Processor -- start 2023-10-05T15:36:50.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.890+0000 7f1bb5fff700 1 -- start start 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.890+0000 7f1bb5fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 0x7f1bb0198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.890+0000 7f1bb5fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb0100090 0x7f1bb0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.890+0000 7f1bb5fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1bb5fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb01a0830 con 0x7f1bb0100090 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1bb5fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb01a09a0 con 0x7f1bb0100a50 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1bb5fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb01a0b60 con 0x7f1bb00ff730 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baeffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb0100090 0x7f1bb0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baf7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 0x7f1bb0198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb01a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45588/0 (socket says 172.21.15.17:45588) 2023-10-05T15:36:50.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baeffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb0100090 0x7f1bb0199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54396/0 (socket says 172.21.15.17:54396) 2023-10-05T15:36:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baf7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 0x7f1bb0198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50954/0 (socket says 172.21.15.17:50954) 2023-10-05T15:36:50.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 -- 172.21.15.17:0/3670739613 learned_addr learned my addr 172.21.15.17:0/3670739613 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 -- 172.21.15.17:0/3670739613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 msgr2=0x7f1bb0198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 0x7f1bb0198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 -- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb0100090 msgr2=0x7f1bb0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb0100090 0x7f1bb0199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baffff700 1 -- 172.21.15.17:0/3670739613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00095f0 con 0x7f1bb0100a50 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.891+0000 7f1baf7fe700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 0x7f1bb0198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.892+0000 7f1baffff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb01a0260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800ef30 tx=0x7f1ba800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.892+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8018070 con 0x7f1bb0100a50 2023-10-05T15:36:50.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.892+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb01a0de0 con 0x7f1bb0100a50 2023-10-05T15:36:50.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.892+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ba800f040 con 0x7f1bb0100a50 2023-10-05T15:36:50.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.892+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800cbc0 con 0x7f1bb0100a50 2023-10-05T15:36:50.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.892+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb01a11b0 con 0x7f1bb0100a50 2023-10-05T15:36:50.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.893+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb010a510 con 0x7f1bb0100a50 2023-10-05T15:36:50.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.895+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1ba8003a00 con 0x7f1bb0100a50 2023-10-05T15:36:50.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.896+0000 7f1bacff9700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1b980a1480 0x7f1b980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:50.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.897+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1ba80ccbf0 con 0x7f1bb0100a50 2023-10-05T15:36:50.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.897+0000 7f1baf7fe700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1b980a1480 0x7f1b980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:50.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.897+0000 7f1baf7fe700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1b980a1480 0x7f1b980a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00059d0 tx=0x7f1ba0005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:50.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:50.900+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ba8095ee0 con 0x7f1bb0100a50 2023-10-05T15:36:50.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:50 smithi017 ceph-mon[129107]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:50.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2725724312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/948788499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:50 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:36:50.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:50 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/582152482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:50 smithi167 ceph-mon[133366]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:50 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2725724312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:51.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:50 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/948788499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:51.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:50 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:36:51.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:50 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/582152482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:50 smithi079 ceph-mon[132936]: from='client.15654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-05T15:36:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:50 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2725724312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:51.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:50 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/948788499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:36:51.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:50 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:36:51.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:50 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/582152482' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:36:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.133+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1bb002cf70 con 0x7f1bb0100a50 2023-10-05T15:36:51.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.134+0000 7f1bacff9700 1 -- 172.21.15.17:0/3670739613 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ba8003cb0 con 0x7f1bb0100a50 2023-10-05T15:36:51.136 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:36:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1b980a1480 msgr2=0x7f1b980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1b980a1480 0x7f1b980a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00059d0 tx=0x7f1ba0005960 comp rx=0 tx=0).stop 2023-10-05T15:36:51.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 msgr2=0x7f1bb01a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb01a0260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800ef30 tx=0x7f1ba800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 shutdown_connections 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1b980a1480 0x7f1b980a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bb0100a50 0x7f1bb01a0260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bb00ff730 0x7f1bb0198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 --2- 172.21.15.17:0/3670739613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1bb0100090 0x7f1bb0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 >> 172.21.15.17:0/3670739613 conn(0x7f1bb00fb330 msgr2=0x7f1bb00fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.136+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 shutdown_connections 2023-10-05T15:36:51.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.137+0000 7f1bb5fff700 1 -- 172.21.15.17:0/3670739613 wait complete. 2023-10-05T15:36:51.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.373+0000 7f4e2fbff700 1 -- 172.21.15.17:0/3066408884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102070 msgr2=0x7f4e281024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.373+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/3066408884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102070 0x7f4e281024f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009990 tx=0x7f4e18009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 -- 172.21.15.17:0/3066408884 shutdown_connections 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/3066408884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102a30 0x7f4e28109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/3066408884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e281012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/3066408884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102070 0x7f4e281024f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 -- 172.21.15.17:0/3066408884 >> 172.21.15.17:0/3066408884 conn(0x7f4e280fc430 msgr2=0x7f4e280fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 -- 172.21.15.17:0/3066408884 shutdown_connections 2023-10-05T15:36:51.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.374+0000 7f4e2fbff700 1 -- 172.21.15.17:0/3066408884 wait complete. 2023-10-05T15:36:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 Processor -- start 2023-10-05T15:36:51.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 -- start start 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e28198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102070 0x7f4e28199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102a30 0x7f4e281a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281a08d0 con 0x7f4e28102a30 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281a0a10 con 0x7f4e28102070 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.375+0000 7f4e2fbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281a0ba0 con 0x7f4e28100e90 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2d99b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e28198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102a30 0x7f4e281a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2d99b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e28198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50978/0 (socket says 172.21.15.17:50978) 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2d99b700 1 -- 172.21.15.17:0/1159502255 learned_addr learned my addr 172.21.15.17:0/1159502255 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:51.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 -- 172.21.15.17:0/1159502255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 msgr2=0x7f4e28198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e28198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 -- 172.21.15.17:0/1159502255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102070 msgr2=0x7f4e28199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2d19a700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102070 0x7f4e28199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102070 0x7f4e28199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 -- 172.21.15.17:0/1159502255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180095f0 con 0x7f4e28102a30 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2d99b700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e28198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2d19a700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102070 0x7f4e28199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.376+0000 7f4e2e19c700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102a30 0x7f4e281a0300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000efc0 tx=0x7f4e2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.377+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20018070 con 0x7f4e28102a30 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.377+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e2000f040 con 0x7f4e28102a30 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.377+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e281a0e20 con 0x7f4e28102a30 2023-10-05T15:36:51.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.377+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000cc50 con 0x7f4e28102a30 2023-10-05T15:36:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.377+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e281a12a0 con 0x7f4e28102a30 2023-10-05T15:36:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.378+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e281933f0 con 0x7f4e28102a30 2023-10-05T15:36:51.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.380+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4e20003a00 con 0x7f4e28102a30 2023-10-05T15:36:51.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.381+0000 7f4e1effd700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e140a1500 0x7f4e140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.381+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4e200cd590 con 0x7f4e28102a30 2023-10-05T15:36:51.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.382+0000 7f4e2d99b700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e140a1500 0x7f4e140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.383+0000 7f4e2d99b700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e140a1500 0x7f4e140a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e24005950 tx=0x7f4e24009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:51.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.384+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4e20096880 con 0x7f4e28102a30 2023-10-05T15:36:51.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.604+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4e280008d0 con 0x7f4e28102a30 2023-10-05T15:36:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.605+0000 7f4e1effd700 1 -- 172.21.15.17:0/1159502255 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4e20099ea0 con 0x7f4e28102a30 2023-10-05T15:36:51.608 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:36:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e140a1500 msgr2=0x7f4e140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e140a1500 0x7f4e140a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4e24005950 tx=0x7f4e24009260 comp rx=0 tx=0).stop 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102a30 msgr2=0x7f4e281a0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102a30 0x7f4e281a0300 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000efc0 tx=0x7f4e2000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 shutdown_connections 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4e140a1500 0x7f4e140a39c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e28102a30 0x7f4e281a0300 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e28100e90 0x7f4e28198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 --2- 172.21.15.17:0/1159502255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e28102070 0x7f4e28199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 >> 172.21.15.17:0/1159502255 conn(0x7f4e280fc430 msgr2=0x7f4e28107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 shutdown_connections 2023-10-05T15:36:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.608+0000 7f4e2fbff700 1 -- 172.21.15.17:0/1159502255 wait complete. 2023-10-05T15:36:51.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 -- 172.21.15.17:0/2895969565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 msgr2=0x7f1630102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 --2- 172.21.15.17:0/2895969565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f1630102500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1620009990 tx=0x7f1620009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 -- 172.21.15.17:0/2895969565 shutdown_connections 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 --2- 172.21.15.17:0/2895969565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1630102a40 0x7f1630109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 --2- 172.21.15.17:0/2895969565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1630100ea0 0x7f16301012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 --2- 172.21.15.17:0/2895969565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f1630102500 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 -- 172.21.15.17:0/2895969565 >> 172.21.15.17:0/2895969565 conn(0x7f16300fc420 msgr2=0x7f16300fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 -- 172.21.15.17:0/2895969565 shutdown_connections 2023-10-05T15:36:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.840+0000 7f16373ff700 1 -- 172.21.15.17:0/2895969565 wait complete. 2023-10-05T15:36:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 Processor -- start 2023-10-05T15:36:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 -- start start 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1630100ea0 0x7f1630074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f16300732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1630102a40 0x7f16300737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1630073f80 con 0x7f1630102080 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16300740f0 con 0x7f1630102a40 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.842+0000 7f16373ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16301a0bc0 con 0x7f1630100ea0 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f16300732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163599c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1630102a40 0x7f16300737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f16300732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54440/0 (socket says 172.21.15.17:54440) 2023-10-05T15:36:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 -- 172.21.15.17:0/3592272000 learned_addr learned my addr 172.21.15.17:0/3592272000 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163519b700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1630100ea0 0x7f1630074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 -- 172.21.15.17:0/3592272000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1630100ea0 msgr2=0x7f1630074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1630100ea0 0x7f1630074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 -- 172.21.15.17:0/3592272000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1630102a40 msgr2=0x7f16300737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1630102a40 0x7f16300737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 -- 172.21.15.17:0/3592272000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200095f0 con 0x7f1630102080 2023-10-05T15:36:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.843+0000 7f163499a700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f16300732a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f16200059d0 tx=0x7f1620003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.844+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162001d070 con 0x7f1630102080 2023-10-05T15:36:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.844+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f162000bd70 con 0x7f1630102080 2023-10-05T15:36:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.844+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16301a0e40 con 0x7f1630102080 2023-10-05T15:36:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.844+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620022cb0 con 0x7f1630102080 2023-10-05T15:36:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.844+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16301a1200 con 0x7f1630102080 2023-10-05T15:36:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.845+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163010c5c0 con 0x7f1630102080 2023-10-05T15:36:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.847+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1620022470 con 0x7f1630102080 2023-10-05T15:36:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.848+0000 7f16267fc700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f161c0a1550 0x7f161c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.848+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f16200ce670 con 0x7f1630102080 2023-10-05T15:36:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.849+0000 7f163519b700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f161c0a1550 0x7f161c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.849+0000 7f163519b700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f161c0a1550 0x7f161c0a3a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f162c005950 tx=0x7f162c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:51.853+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1620097960 con 0x7f1630102080 2023-10-05T15:36:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:51 smithi017 ceph-mon[129107]: pgmap v377: 129 pgs: 129 active+clean; 648 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2023-10-05T15:36:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:51 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3670739613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:51 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1159502255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:51 smithi167 ceph-mon[133366]: pgmap v377: 129 pgs: 129 active+clean; 648 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2023-10-05T15:36:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3670739613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:51 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1159502255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:51 smithi079 ceph-mon[132936]: pgmap v377: 129 pgs: 129 active+clean; 648 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2023-10-05T15:36:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:51 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3670739613' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:36:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:51 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1159502255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:36:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.137+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1630107f00 con 0x7f1630102080 2023-10-05T15:36:52.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.138+0000 7f16267fc700 1 -- 172.21.15.17:0/3592272000 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f162009af80 con 0x7f1630102080 2023-10-05T15:36:52.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:52.141 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:36:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f161c0a1550 msgr2=0x7f161c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f161c0a1550 0x7f161c0a3a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f162c005950 tx=0x7f162c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 msgr2=0x7f16300732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f16300732a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f16200059d0 tx=0x7f1620003a50 comp rx=0 tx=0).stop 2023-10-05T15:36:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 shutdown_connections 2023-10-05T15:36:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f161c0a1550 0x7f161c0a3a10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1630102a40 0x7f16300737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1630100ea0 0x7f1630074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 --2- 172.21.15.17:0/3592272000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1630102080 0x7f16300732a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 >> 172.21.15.17:0/3592272000 conn(0x7f16300fc420 msgr2=0x7f16300fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.141+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 shutdown_connections 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.142+0000 7f16373ff700 1 -- 172.21.15.17:0/3592272000 wait complete. 2023-10-05T15:36:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:36:52.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:36:52.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.369+0000 7f4b1dbff700 1 -- 172.21.15.17:0/3103173407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18106ba0 msgr2=0x7f4b18109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.369+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/3103173407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18106ba0 0x7f4b18109010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000b0a0 tx=0x7f4b1000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 -- 172.21.15.17:0/3103173407 shutdown_connections 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/3103173407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18106ba0 0x7f4b18109010 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/3103173407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18101940 0x7f4b18103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/3103173407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b18104270 0x7f4b18106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 -- 172.21.15.17:0/3103173407 >> 172.21.15.17:0/3103173407 conn(0x7f4b180fb310 msgr2=0x7f4b180fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 -- 172.21.15.17:0/3103173407 shutdown_connections 2023-10-05T15:36:52.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.370+0000 7f4b1dbff700 1 -- 172.21.15.17:0/3103173407 wait complete. 2023-10-05T15:36:52.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 Processor -- start 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 -- start start 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 0x7f4b18198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b18104270 0x7f4b181992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18106ba0 0x7f4b181a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181a08e0 con 0x7f4b18101940 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181a0a50 con 0x7f4b18104270 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.371+0000 7f4b1dbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181a0c10 con 0x7f4b18106ba0 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 0x7f4b18198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 0x7f4b18198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54468/0 (socket says 172.21.15.17:54468) 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 -- 172.21.15.17:0/1624524165 learned_addr learned my addr 172.21.15.17:0/1624524165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b16ffd700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b18104270 0x7f4b181992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b17fff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18106ba0 0x7f4b181a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 -- 172.21.15.17:0/1624524165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18106ba0 msgr2=0x7f4b181a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18106ba0 0x7f4b181a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 -- 172.21.15.17:0/1624524165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b18104270 msgr2=0x7f4b181992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b18104270 0x7f4b181992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 -- 172.21.15.17:0/1624524165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009d00 con 0x7f4b18101940 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b17fff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18106ba0 0x7f4b181a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.372+0000 7f4b177fe700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 0x7f4b18198da0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800e9a0 tx=0x7f4b0800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.373+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08009790 con 0x7f4b18101940 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.373+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0800cbd0 con 0x7f4b18101940 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.373+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08018680 con 0x7f4b18101940 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.373+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b181a0ef0 con 0x7f4b18101940 2023-10-05T15:36:52.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.373+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b181a1310 con 0x7f4b18101940 2023-10-05T15:36:52.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.374+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b18108720 con 0x7f4b18101940 2023-10-05T15:36:52.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.377+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4b0800cd40 con 0x7f4b18101940 2023-10-05T15:36:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.380+0000 7f4b14ff9700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b000a1550 0x7f4b000a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.380+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4b08014070 con 0x7f4b18101940 2023-10-05T15:36:52.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.380+0000 7f4b16ffd700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b000a1550 0x7f4b000a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.381+0000 7f4b16ffd700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b000a1550 0x7f4b000a3a10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c007be0 tx=0x7f4b0c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.384+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4b08096500 con 0x7f4b18101940 2023-10-05T15:36:52.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.604+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b1810c550 con 0x7f4b18101940 2023-10-05T15:36:52.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.606+0000 7f4b14ff9700 1 -- 172.21.15.17:0/1624524165 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7f4b08099b20 con 0x7f4b18101940 2023-10-05T15:36:52.609 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:36:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b000a1550 msgr2=0x7f4b000a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b000a1550 0x7f4b000a3a10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c007be0 tx=0x7f4b0c0073d0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 msgr2=0x7f4b18198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 0x7f4b18198da0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800e9a0 tx=0x7f4b0800ecb0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 shutdown_connections 2023-10-05T15:36:52.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b000a1550 0x7f4b000a3a10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b18106ba0 0x7f4b181a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b18101940 0x7f4b18198da0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 --2- 172.21.15.17:0/1624524165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b18104270 0x7f4b181992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 >> 172.21.15.17:0/1624524165 conn(0x7f4b180fb310 msgr2=0x7f4b180fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 shutdown_connections 2023-10-05T15:36:52.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.608+0000 7f4b1dbff700 1 -- 172.21.15.17:0/1624524165 wait complete. 2023-10-05T15:36:52.632 DEBUG:tasks.fwd_scrub:Yielding 2023-10-05T15:36:52.632 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-05T15:36:52.642 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:36:52.642 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-05T15:36:52.642 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-05T15:36:52.643 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:36:52.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:36:52.647 INFO:teuthology.run_tasks:Running task exec... 2023-10-05T15:36:52.656 INFO:teuthology.task.exec:Executing custom commands... 2023-10-05T15:36:52.656 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:36:52.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-10-05T15:36:52.777 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2023-10-05T15:36:52.826 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem Size Used Avail Use% Mounted on 2023-10-05T15:36:52.826 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-fuse 1.1T 332M 1.1T 1% /tmp/cephfs 2023-10-05T15:36:52.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-10-05T15:36:52.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.883+0000 7f70271ff700 1 -- 172.21.15.17:0/867784117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020074ef0 msgr2=0x7f7020073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.883+0000 7f70271ff700 1 --2- 172.21.15.17:0/867784117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020074ef0 0x7f7020073340 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7014009990 tx=0x7f7014009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 -- 172.21.15.17:0/867784117 shutdown_connections 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 --2- 172.21.15.17:0/867784117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f702010d4c0 0x7f702010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 --2- 172.21.15.17:0/867784117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020074ef0 0x7f7020073340 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 --2- 172.21.15.17:0/867784117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020073910 0x7f7020073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 -- 172.21.15.17:0/867784117 >> 172.21.15.17:0/867784117 conn(0x7f70200fc460 msgr2=0x7f70200fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 -- 172.21.15.17:0/867784117 shutdown_connections 2023-10-05T15:36:52.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.884+0000 7f70271ff700 1 -- 172.21.15.17:0/867784117 wait complete. 2023-10-05T15:36:52.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 Processor -- start 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 -- start start 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7020073910 0x7f702019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 0x7f702019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702010d4c0 0x7f70201a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201a4ce0 con 0x7f702010d4c0 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201a4e20 con 0x7f7020074ef0 2023-10-05T15:36:52.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f70271ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201a4fb0 con 0x7f7020073910 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.885+0000 7f702579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702010d4c0 0x7f70201a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 0x7f702019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7020073910 0x7f702019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f702579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702010d4c0 0x7f70201a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54492/0 (socket says 172.21.15.17:54492) 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f702579c700 1 -- 172.21.15.17:0/1643821839 learned_addr learned my addr 172.21.15.17:0/1643821839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7020073910 0x7f702019d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:51012/0 (socket says 172.21.15.17:51012) 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 0x7f702019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45664/0 (socket says 172.21.15.17:45664) 2023-10-05T15:36:52.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 -- 172.21.15.17:0/1643821839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7020073910 msgr2=0x7f702019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7020073910 0x7f702019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 -- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702010d4c0 msgr2=0x7f70201a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702010d4c0 0x7f70201a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 -- 172.21.15.17:0/1643821839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140095f0 con 0x7f7020074ef0 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701ffff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 0x7f702019d6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f700c00e9c0 tx=0x7f700c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.886+0000 7f701dffb700 1 -- 172.21.15.17:0/1643821839 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c004220 con 0x7f7020074ef0 2023-10-05T15:36:52.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.887+0000 7f701dffb700 1 -- 172.21.15.17:0/1643821839 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f700c004380 con 0x7f7020074ef0 2023-10-05T15:36:52.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.887+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70201a5290 con 0x7f7020074ef0 2023-10-05T15:36:52.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.887+0000 7f701dffb700 1 -- 172.21.15.17:0/1643821839 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c003b40 con 0x7f7020074ef0 2023-10-05T15:36:52.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.887+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70201a57a0 con 0x7f7020074ef0 2023-10-05T15:36:52.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.892+0000 7f701dffb700 1 -- 172.21.15.17:0/1643821839 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f700c003ca0 con 0x7f7020074ef0 2023-10-05T15:36:52.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.892+0000 7f703abbdb80 1 Processor -- start 2023-10-05T15:36:52.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 -- start start 2023-10-05T15:36:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c40700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 0x564f89c41500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c41f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89ba84e0 con 0x564f89c41ae0 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89b99ca0 con 0x564f89c402e0 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f703abbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89b975c0 con 0x564f89c40c40 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.893+0000 7f701dffb700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70100a1480 0x7f70100a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 0x564f89c41500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 0x564f89c41500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:51020/0 (socket says 172.21.15.17:51020) 2023-10-05T15:36:52.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 -- 172.21.15.17:0/3280332016 learned_addr learned my addr 172.21.15.17:0/3280332016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:52.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f701dffb700 1 -- 172.21.15.17:0/1643821839 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f700c014070 con 0x7f7020074ef0 2023-10-05T15:36:52.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f702579c700 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c40700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f701ffff700 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c41f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f702579c700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70100a1480 0x7f70100a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 -- 172.21.15.17:0/3280332016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 msgr2=0x564f89c40700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c40700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 -- 172.21.15.17:0/3280332016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 msgr2=0x564f89c41f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c41f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 -- 172.21.15.17:0/3280332016 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f899bde60 con 0x564f89c40c40 2023-10-05T15:36:52.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.894+0000 7f7024f9b700 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 0x564f89c41500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7014009990 tx=0x7f7014005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd4fe4309b033c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.895+0000 7f702579c700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70100a1480 0x7f70100a3940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7018007ca0 tx=0x7f70180091b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.895+0000 7f700affd700 1 -- 172.21.15.17:0/3280332016 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701401d070 con 0x564f89c40c40 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.895+0000 7f700affd700 1 -- 172.21.15.17:0/3280332016 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701401e040 con 0x564f89c40c40 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.895+0000 7f700affd700 1 -- 172.21.15.17:0/3280332016 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701400b710 con 0x564f89c40c40 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 -- 172.21.15.17:0/3280332016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 msgr2=0x564f89c41500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 0x564f89c41500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7014009990 tx=0x7f7014005f00 comp rx=0 tx=0).stop 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 -- 172.21.15.17:0/3280332016 shutdown_connections 2023-10-05T15:36:52.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c41f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c40700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 --2- 172.21.15.17:0/3280332016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c40c40 0x564f89c41500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 -- 172.21.15.17:0/3280332016 >> 172.21.15.17:0/3280332016 conn(0x564f89bb42e0 msgr2=0x564f89c3b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 -- 172.21.15.17:0/3280332016 shutdown_connections 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.896+0000 7f703abbdb80 1 -- 172.21.15.17:0/3280332016 wait complete. 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.897+0000 7f703abbdb80 1 -- start start 2023-10-05T15:36:52.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.897+0000 7f703abbdb80 1 Processor -- start 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.897+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 0x564f89c49fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c40c40 0x564f89c4a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c51550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f703abbdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89b92eb0 con 0x564f89c41ae0 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f703abbdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89b2f790 con 0x564f89c40c40 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f703abbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89b2f430 con 0x564f89c402e0 2023-10-05T15:36:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f703abbdb80 10 client.0 _ll_register_callbacks cb 0x564f8998c880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 0x564f89c49fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 0x564f89c49fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:51024/0 (socket says 172.21.15.17:51024) 2023-10-05T15:36:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f7024f9b700 1 -- 172.21.15.17:0/2967132991 learned_addr learned my addr 172.21.15.17:0/2967132991 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f702579c700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c51550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f701ffff700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c40c40 0x564f89c4a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f701ffff700 1 -- 172.21.15.17:0/2967132991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 msgr2=0x564f89c49fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f701ffff700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 0x564f89c49fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f701ffff700 1 -- 172.21.15.17:0/2967132991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 msgr2=0x564f89c51550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f701ffff700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c51550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f701ffff700 1 -- 172.21.15.17:0/2967132991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020110260 con 0x564f89c40c40 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.898+0000 7f7024f9b700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 0x564f89c49fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f701ffff700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c40c40 0x564f89c4a510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f700c00f010 tx=0x7f700c004570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf02aa9d944b4e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f6ffffff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:36:52.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f6ffffff700 1 -- 172.21.15.17:0/2967132991 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c09e170 con 0x564f89c40c40 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f89c32f90 con 0x564f89c40c40 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f6ffffff700 1 -- 172.21.15.17:0/2967132991 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f700c09a210 con 0x564f89c40c40 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f6ffffff700 1 -- 172.21.15.17:0/2967132991 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f700c09e360 con 0x564f89c40c40 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f703abbdb80 10 client.25511 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.899+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564f899a6ce0 con 0x564f89c40c40 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f6ffffff700 1 -- 172.21.15.17:0/2967132991 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f89c32f90 con 0x564f89c40c40 2023-10-05T15:36:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f6ffffff700 1 -- 172.21.15.17:0/2967132991 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f700c0a2110 con 0x564f89c40c40 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f703abbdb80 10 client.25511 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f703abbdb80 10 client.25511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f703abbdb80 20 client.25511 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f703abbdb80 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89c55d40 0x564f89c58160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f703abbdb80 4 client.25511 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f89b8be90 con 0x564f89c55d40 2023-10-05T15:36:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.900+0000 7f7024f9b700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89c55d40 0x564f89c58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.901+0000 7f7024f9b700 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89c55d40 0x564f89c58160 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb4a0045a1b4d25 server_cookie=8628660673e52689 in_seq=0 out_seq=0 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.901+0000 7f6ffffff700 10 client.25511 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f6ffffff700 1 -- 172.21.15.17:0/2967132991 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f89b8be90 con 0x564f89c55d40 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f6ffffff700 10 client.25511 handle_command_reply: tid=0 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 client.25511 shutdown 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c40c40 msgr2=0x564f89c4a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c40c40 0x564f89c4a510 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f700c00f010 tx=0x7f700c004570 comp rx=0 tx=0).stop 2023-10-05T15:36:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 shutdown_connections 2023-10-05T15:36:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89c55d40 0x564f89c58160 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c41ae0 0x564f89c51550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c402e0 0x564f89c49fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f6ffffff700 0 client.25511 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 --2- 172.21.15.17:0/2967132991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c40c40 0x564f89c4a510 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 >> 172.21.15.17:0/2967132991 conn(0x564f89bb42e0 msgr2=0x564f89c3afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.902+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 shutdown_connections 2023-10-05T15:36:52.912 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:52 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3592272000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:52.913 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:52 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1624524165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:52.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.903+0000 7f703abbdb80 1 -- 172.21.15.17:0/2967132991 wait complete. 2023-10-05T15:36:52.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.903+0000 7f703abbdb80 20 client.25511 trim_cache size 0 max 16384 2023-10-05T15:36:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 Processor -- start 2023-10-05T15:36:52.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 -- start start 2023-10-05T15:36:52.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c47e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89c51510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89a139a0 con 0x564f89c40c40 2023-10-05T15:36:52.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89c55bb0 con 0x564f89c402e0 2023-10-05T15:36:52.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f703abbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89c47ca0 con 0x564f89c41ae0 2023-10-05T15:36:52.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f701ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c47e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f7024f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c47e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45696/0 (socket says 172.21.15.17:45696) 2023-10-05T15:36:52.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.922+0000 7f7024f9b700 1 -- 172.21.15.17:0/796352164 learned_addr learned my addr 172.21.15.17:0/796352164 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f702579c700 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89c51510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f7024f9b700 1 -- 172.21.15.17:0/796352164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 msgr2=0x564f89c51510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f7024f9b700 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89c51510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f7024f9b700 1 -- 172.21.15.17:0/796352164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 msgr2=0x564f89c483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f7024f9b700 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f7024f9b700 1 -- 172.21.15.17:0/796352164 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f899e42d0 con 0x564f89c402e0 2023-10-05T15:36:52.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f7024f9b700 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c47e70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70140098e0 tx=0x7f701401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5168064c434c51b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f700b7fe700 1 -- 172.21.15.17:0/796352164 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701401d040 con 0x564f89c402e0 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f700b7fe700 1 -- 172.21.15.17:0/796352164 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7014034ca0 con 0x564f89c402e0 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.923+0000 7f700b7fe700 1 -- 172.21.15.17:0/796352164 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014005660 con 0x564f89c402e0 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 -- 172.21.15.17:0/796352164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 msgr2=0x564f89c47e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c47e70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70140098e0 tx=0x7f701401a040 comp rx=0 tx=0).stop 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 -- 172.21.15.17:0/796352164 shutdown_connections 2023-10-05T15:36:52.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89c51510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c47e70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 --2- 172.21.15.17:0/796352164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 -- 172.21.15.17:0/796352164 >> 172.21.15.17:0/796352164 conn(0x564f89bb42e0 msgr2=0x564f89c3afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 -- 172.21.15.17:0/796352164 shutdown_connections 2023-10-05T15:36:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.924+0000 7f703abbdb80 1 -- 172.21.15.17:0/796352164 wait complete. 2023-10-05T15:36:52.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 -- start start 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 Processor -- start 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c4dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c4e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89ca9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89c51530 con 0x564f89c40c40 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89c516a0 con 0x564f89c402e0 2023-10-05T15:36:52.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f89c51860 con 0x564f89c41ae0 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.925+0000 7f703abbdb80 10 client.0 _ll_register_callbacks cb 0x7f700c099d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c4e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c4e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54530/0 (socket says 172.21.15.17:54530) 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 -- 172.21.15.17:0/1941064774 learned_addr learned my addr 172.21.15.17:0/1941064774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f702579c700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89ca9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f7024f9b700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c4dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 -- 172.21.15.17:0/1941064774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 msgr2=0x564f89ca9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89ca9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 -- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 msgr2=0x564f89c4dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:52.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c4dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.926+0000 7f701ffff700 1 -- 172.21.15.17:0/1941064774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f899bde60 con 0x564f89c40c40 2023-10-05T15:36:52.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f701ffff700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c4e510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f700c09a1a0 tx=0x7f700c0caa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0571eb0cde7df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:52.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f6ffffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f6ffffff700 1 -- 172.21.15.17:0/1941064774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c0b8400 con 0x564f89c40c40 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f701401e040 con 0x564f89c40c40 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f6ffffff700 1 -- 172.21.15.17:0/1941064774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f700c09a210 con 0x564f89c40c40 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f6ffffff700 1 -- 172.21.15.17:0/1941064774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f700c09e170 con 0x564f89c40c40 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f703abbdb80 10 client.15714 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564f899bc330 con 0x564f89c40c40 2023-10-05T15:36:52.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f6ffffff700 1 -- 172.21.15.17:0/1941064774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701401e040 con 0x564f89c40c40 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.927+0000 7f6ffffff700 1 -- 172.21.15.17:0/1941064774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f700c099170 con 0x564f89c40c40 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f703abbdb80 10 client.15714 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f703abbdb80 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f703abbdb80 20 client.15714 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f703abbdb80 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89cab210 0x564f89cad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f703abbdb80 4 client.15714 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:36:52.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564f89b8bbb0 con 0x564f89cab210 2023-10-05T15:36:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.928+0000 7f7024f9b700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89cab210 0x564f89cad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.929+0000 7f7024f9b700 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89cab210 0x564f89cad600 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc4de3b24a0bfe09 server_cookie=f35205e64ebe73da in_seq=0 out_seq=0 2023-10-05T15:36:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.929+0000 7f6ffffff700 10 client.15714 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.929+0000 7f6ffffff700 1 -- 172.21.15.17:0/1941064774 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564f89b8bbb0 con 0x564f89cab210 2023-10-05T15:36:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.929+0000 7f6ffffff700 10 client.15714 handle_command_reply: tid=0 2023-10-05T15:36:52.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 client.15714 shutdown 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 msgr2=0x564f89c4e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c4e510 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f700c09a1a0 tx=0x7f700c0caa60 comp rx=0 tx=0).stop 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 shutdown_connections 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564f89cab210 0x564f89cad600 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564f89c41ae0 0x564f89ca9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564f89c402e0 0x564f89c4dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 --2- 172.21.15.17:0/1941064774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564f89c40c40 0x564f89c4e510 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 >> 172.21.15.17:0/1941064774 conn(0x564f89bb42e0 msgr2=0x564f89c49fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f6ffffff700 0 client.15714 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 shutdown_connections 2023-10-05T15:36:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 1 -- 172.21.15.17:0/1941064774 wait complete. 2023-10-05T15:36:52.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.930+0000 7f703abbdb80 20 client.15714 trim_cache size 0 max 16384 2023-10-05T15:36:52.942 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-10-05T15:36:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "589deab9-7d60-4b53-a0cc-398426b490b2", 2023-10-05T15:36:52.942 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-10-05T15:36:52.942 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70100a1480 msgr2=0x7f70100a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70100a1480 0x7f70100a3940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7018007ca0 tx=0x7f70180091b0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 msgr2=0x7f702019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 0x7f702019d6a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f700c00e9c0 tx=0x7f700c00ecd0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 shutdown_connections 2023-10-05T15:36:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f70100a1480 0x7f70100a3940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702010d4c0 0x7f70201a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7020073910 0x7f702019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 --2- 172.21.15.17:0/1643821839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020074ef0 0x7f702019d6a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:52.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.931+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 >> 172.21.15.17:0/1643821839 conn(0x7f70200fc460 msgr2=0x7f70200fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:52.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.932+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 shutdown_connections 2023-10-05T15:36:52.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:52.932+0000 7f70271ff700 1 -- 172.21.15.17:0/1643821839 wait complete. 2023-10-05T15:36:52.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:36:52.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-10-05T15:36:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:52 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3592272000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:52 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1624524165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:52 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3592272000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:36:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:52 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1624524165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:36:53.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-10-05T15:36:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.177+0000 7fd9acbff700 1 -- 172.21.15.17:0/1489549219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 msgr2=0x7fd9a8106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.177+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1489549219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8106660 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009990 tx=0x7fd99c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 -- 172.21.15.17:0/1489549219 shutdown_connections 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1489549219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8106ba0 0x7fd9a8109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1489549219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8101940 0x7fd9a8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1489549219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8106660 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 -- 172.21.15.17:0/1489549219 >> 172.21.15.17:0/1489549219 conn(0x7fd9a80fb330 msgr2=0x7fd9a80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 -- 172.21.15.17:0/1489549219 shutdown_connections 2023-10-05T15:36:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.178+0000 7fd9acbff700 1 -- 172.21.15.17:0/1489549219 wait complete. 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 Processor -- start 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 -- start start 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8101940 0x7fd9a8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8106ba0 0x7fd9a81a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81a0880 con 0x7fd9a8104270 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81a09f0 con 0x7fd9a8101940 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9acbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81a0bb0 con 0x7fd9a8106ba0 2023-10-05T15:36:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.179+0000 7fd9a5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54540/0 (socket says 172.21.15.17:54540) 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/1556895415 learned_addr learned my addr 172.21.15.17:0/1556895415 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a659c700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8101940 0x7fd9a8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8106ba0 0x7fd9a81a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/1556895415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8106ba0 msgr2=0x7fd9a81a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8106ba0 0x7fd9a81a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/1556895415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8101940 msgr2=0x7fd9a8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8101940 0x7fd9a8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/1556895415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99c0095f0 con 0x7fd9a8104270 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a659c700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8101940 0x7fd9a8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8106ba0 0x7fd9a81a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:36:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.180+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8199280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd99c005910 tx=0x7fd99c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.181+0000 7fd9977fe700 1 -- 172.21.15.17:0/1556895415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c01d070 con 0x7fd9a8104270 2023-10-05T15:36:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.181+0000 7fd9977fe700 1 -- 172.21.15.17:0/1556895415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd99c00be70 con 0x7fd9a8104270 2023-10-05T15:36:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.181+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a81a0e30 con 0x7fd9a8104270 2023-10-05T15:36:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.181+0000 7fd9977fe700 1 -- 172.21.15.17:0/1556895415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c022ea0 con 0x7fd9a8104270 2023-10-05T15:36:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.181+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a81a11a0 con 0x7fd9a8104270 2023-10-05T15:36:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.185+0000 7fd9977fe700 1 -- 172.21.15.17:0/1556895415 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd99c022670 con 0x7fd9a8104270 2023-10-05T15:36:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.186+0000 7fd9c048db80 1 Processor -- start 2023-10-05T15:36:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.186+0000 7fd9c048db80 1 -- start start 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9c048db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac42a460 con 0x5643ac4c2bc0 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9c048db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac41bc20 con 0x5643ac4c2260 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9c048db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac419540 con 0x5643ac4c3a60 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a5d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45752/0 (socket says 172.21.15.17:45752) 2023-10-05T15:36:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 -- 172.21.15.17:0/2243275497 learned_addr learned my addr 172.21.15.17:0/2243275497 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 -- 172.21.15.17:0/2243275497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 msgr2=0x5643ac4c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 -- 172.21.15.17:0/2243275497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 msgr2=0x5643ac4c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.187+0000 7fd9a6d9d700 1 -- 172.21.15.17:0/2243275497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643ac23fde0 con 0x5643ac4c2260 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd9977fe700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9900a1480 0x7fd9900a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd9977fe700 1 -- 172.21.15.17:0/1556895415 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd99c0ce4a0 con 0x7fd9a8104270 2023-10-05T15:36:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4c2680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009440 tx=0x7fd9a0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fafb584aaad9ba43 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd9a659c700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9900a1480 0x7fd9900a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd994ff9700 1 -- 172.21.15.17:0/2243275497 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000e070 con 0x5643ac4c2260 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd994ff9700 1 -- 172.21.15.17:0/2243275497 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9a000f040 con 0x5643ac4c2260 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.188+0000 7fd994ff9700 1 -- 172.21.15.17:0/2243275497 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0015b50 con 0x5643ac4c2260 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 -- 172.21.15.17:0/2243275497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 msgr2=0x5643ac4c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4c2680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009440 tx=0x7fd9a0009920 comp rx=0 tx=0).stop 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9a659c700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9900a1480 0x7fd9900a3940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9980097c0 tx=0x7fd998009750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 -- 172.21.15.17:0/2243275497 shutdown_connections 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4c2680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2243275497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 -- 172.21.15.17:0/2243275497 >> 172.21.15.17:0/2243275497 conn(0x5643ac436260 msgr2=0x5643ac4bd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.189+0000 7fd9c048db80 1 -- 172.21.15.17:0/2243275497 shutdown_connections 2023-10-05T15:36:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.190+0000 7fd9c048db80 1 -- 172.21.15.17:0/2243275497 wait complete. 2023-10-05T15:36:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.190+0000 7fd9c048db80 1 -- start start 2023-10-05T15:36:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.190+0000 7fd9c048db80 1 Processor -- start 2023-10-05T15:36:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c2bc0 0x5643ac4cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c3a60 0x5643ac4d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac414e30 con 0x5643ac4c3a60 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac3b1710 con 0x5643ac4c2260 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac3b13b0 con 0x5643ac4c2bc0 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9c048db80 10 client.0 _ll_register_callbacks cb 0x5643ac20e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45754/0 (socket says 172.21.15.17:45754) 2023-10-05T15:36:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9a659c700 1 -- 172.21.15.17:0/2516201547 learned_addr learned my addr 172.21.15.17:0/2516201547 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.191+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c3a60 0x5643ac4d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c2bc0 0x5643ac4cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a659c700 1 -- 172.21.15.17:0/2516201547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c2bc0 msgr2=0x5643ac4cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a659c700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c2bc0 0x5643ac4cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a659c700 1 -- 172.21.15.17:0/2516201547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c3a60 msgr2=0x5643ac4d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a659c700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c3a60 0x5643ac4d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a659c700 1 -- 172.21.15.17:0/2516201547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a81a11a0 con 0x5643ac4c2260 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c2bc0 0x5643ac4cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c3a60 0x5643ac4d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd9a659c700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4cc050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd99800fd70 tx=0x7fd998009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da9c2fa51dae8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.192+0000 7fd98dffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:36:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd98dffb700 1 -- 172.21.15.17:0/2516201547 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99800eb50 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd98dffb700 1 -- 172.21.15.17:0/2516201547 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd99800ecb0 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643ac4b4f10 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd98dffb700 1 -- 172.21.15.17:0/2516201547 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd99800ee70 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd9c048db80 10 client.25529 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fd9a00090f0 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd98dffb700 1 -- 172.21.15.17:0/2516201547 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5643ac4b4f10 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd98dffb700 1 -- 172.21.15.17:0/2516201547 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd998024020 con 0x5643ac4c2260 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd9c048db80 10 client.25529 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.193+0000 7fd9c048db80 10 client.25529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.194+0000 7fd9c048db80 20 client.25529 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.194+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac4d7e90 0x5643ac4da2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.194+0000 7fd9c048db80 4 client.25529 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:36:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.194+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643ac40de10 con 0x5643ac4d7e90 2023-10-05T15:36:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.194+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac4d7e90 0x5643ac4da2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.195+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac4d7e90 0x5643ac4da2b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac32318975f53ed server_cookie=85b0cb369d19f5ee in_seq=0 out_seq=0 2023-10-05T15:36:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.195+0000 7fd98dffb700 10 client.25529 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.195+0000 7fd98dffb700 1 -- 172.21.15.17:0/2516201547 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5643ac40de10 con 0x5643ac4d7e90 2023-10-05T15:36:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.195+0000 7fd98dffb700 10 client.25529 handle_command_reply: tid=0 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.195+0000 7fd9c048db80 1 client.25529 shutdown 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 msgr2=0x5643ac4cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4cc050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd99800fd70 tx=0x7fd998009260 comp rx=0 tx=0).stop 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 shutdown_connections 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac4d7e90 0x5643ac4da2b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c3a60 0x5643ac4d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4cc050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd98dffb700 0 client.25529 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2516201547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c2bc0 0x5643ac4cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 >> 172.21.15.17:0/2516201547 conn(0x5643ac436260 msgr2=0x5643ac4bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 shutdown_connections 2023-10-05T15:36:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 1 -- 172.21.15.17:0/2516201547 wait complete. 2023-10-05T15:36:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.196+0000 7fd9c048db80 20 client.25529 trim_cache size 0 max 16384 2023-10-05T15:36:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.214+0000 7fd9c048db80 1 Processor -- start 2023-10-05T15:36:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 -- start start 2023-10-05T15:36:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2260 0x5643ac4cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac295920 con 0x5643ac4c2260 2023-10-05T15:36:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac4c2fa0 con 0x5643ac4c2bc0 2023-10-05T15:36:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9c048db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac4cb500 con 0x5643ac4c3a60 2023-10-05T15:36:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2260 0x5643ac4cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9a5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9a5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45764/0 (socket says 172.21.15.17:45764) 2023-10-05T15:36:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/2351374570 learned_addr learned my addr 172.21.15.17:0/2351374570 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:53.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.215+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/2351374570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 msgr2=0x5643ac4c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/2351374570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2260 msgr2=0x5643ac4cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2260 0x5643ac4cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9a5d9b700 1 -- 172.21.15.17:0/2351374570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643ac228c60 con 0x5643ac4c2bc0 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d3590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0cbf70 tx=0x7fd99c0d1f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09d4b8c6b243300 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9957fa700 1 -- 172.21.15.17:0/2351374570 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0977f0 con 0x5643ac4c2bc0 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9957fa700 1 -- 172.21.15.17:0/2351374570 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd99c09b280 con 0x5643ac4c2bc0 2023-10-05T15:36:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.216+0000 7fd9957fa700 1 -- 172.21.15.17:0/2351374570 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c09b4b0 con 0x5643ac4c2bc0 2023-10-05T15:36:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 -- 172.21.15.17:0/2351374570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 msgr2=0x5643ac4d3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d3590 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0cbf70 tx=0x7fd99c0d1f40 comp rx=0 tx=0).stop 2023-10-05T15:36:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 -- 172.21.15.17:0/2351374570 shutdown_connections 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2260 0x5643ac4cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 --2- 172.21.15.17:0/2351374570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d3590 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 -- 172.21.15.17:0/2351374570 >> 172.21.15.17:0/2351374570 conn(0x5643ac436260 msgr2=0x5643ac4dec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 -- 172.21.15.17:0/2351374570 shutdown_connections 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.217+0000 7fd9c048db80 1 -- 172.21.15.17:0/2351374570 wait complete. 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.218+0000 7fd9c048db80 1 -- start start 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.218+0000 7fd9c048db80 1 Processor -- start 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac4d2d40 con 0x5643ac4c2bc0 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac4d2eb0 con 0x5643ac4c2260 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643ac4d3070 con 0x5643ac4c3a60 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9c048db80 10 client.0 _ll_register_callbacks cb 0x7fd99800f950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45768/0 (socket says 172.21.15.17:45768) 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 -- 172.21.15.17:0/117783184 learned_addr learned my addr 172.21.15.17:0/117783184 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a6d9d700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 -- 172.21.15.17:0/117783184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 msgr2=0x5643ac4d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 -- 172.21.15.17:0/117783184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 msgr2=0x5643ac4d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.219+0000 7fd9a659c700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd9a659c700 1 -- 172.21.15.17:0/117783184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a81a0e30 con 0x5643ac4c2260 2023-10-05T15:36:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd9a659c700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4d12b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd998016040 tx=0x7fd998026d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98fde0d623a77a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:36:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd98dffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd98dffb700 1 -- 172.21.15.17:0/117783184 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998005c80 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9a000f040 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd98dffb700 1 -- 172.21.15.17:0/117783184 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd998026890 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd98dffb700 1 -- 172.21.15.17:0/117783184 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd99800ec30 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd9c048db80 10 client.25535 fetch_fsmap learned FSMap version 27 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.220+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5643ac266250 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd98dffb700 1 -- 172.21.15.17:0/117783184 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9a000f040 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd98dffb700 1 -- 172.21.15.17:0/117783184 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd99800e3b0 con 0x5643ac4c2260 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9c048db80 10 client.25535 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:36:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9c048db80 10 client.25535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9c048db80 20 client.25535 populate_metadata read hostname 'smithi017' 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9c048db80 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac52cbc0 0x5643ac52efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9c048db80 4 client.25535 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5643ac40db30 con 0x5643ac52cbc0 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.221+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac52cbc0 0x5643ac52efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9a5d9b700 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac52cbc0 0x5643ac52efe0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f65c318e64060d88 server_cookie=1a6182c30619f214 in_seq=0 out_seq=0 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd98dffb700 10 client.25535 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd98dffb700 1 -- 172.21.15.17:0/117783184 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5643ac40db30 con 0x5643ac52cbc0 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd98dffb700 10 client.25535 handle_command_reply: tid=0 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 client.25535 shutdown 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 msgr2=0x5643ac4d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4d12b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd998016040 tx=0x7fd998026d70 comp rx=0 tx=0).stop 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 shutdown_connections 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643ac52cbc0 0x5643ac52efe0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643ac4c3a60 0x5643ac4d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643ac4c2260 0x5643ac4d12b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd98dffb700 0 client.25535 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.222+0000 7fd9c048db80 1 --2- 172.21.15.17:0/117783184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643ac4c2bc0 0x5643ac4d17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.223+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 >> 172.21.15.17:0/117783184 conn(0x5643ac436260 msgr2=0x5643ac4cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.223+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 shutdown_connections 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.223+0000 7fd9c048db80 1 -- 172.21.15.17:0/117783184 wait complete. 2023-10-05T15:36:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.223+0000 7fd9c048db80 20 client.25535 trim_cache size 0 max 16384 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "589deab9-7d60-4b53-a0cc-398426b490b2": { 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "589deab9-7d60-4b53-a0cc-398426b490b2", 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:36:53.230 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:36:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9900a1480 msgr2=0x7fd9900a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9900a1480 0x7fd9900a3940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9980097c0 tx=0x7fd998009750 comp rx=0 tx=0).stop 2023-10-05T15:36:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 msgr2=0x7fd9a8199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:36:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8199280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd99c005910 tx=0x7fd99c005740 comp rx=0 tx=0).stop 2023-10-05T15:36:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 shutdown_connections 2023-10-05T15:36:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9900a1480 0x7fd9900a3940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9a8106ba0 0x7fd9a81a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9a8101940 0x7fd9a8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 --2- 172.21.15.17:0/1556895415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9a8104270 0x7fd9a8199280 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:36:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 >> 172.21.15.17:0/1556895415 conn(0x7fd9a80fb330 msgr2=0x7fd9a81025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:36:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 shutdown_connections 2023-10-05T15:36:53.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:36:53.224+0000 7fd9acbff700 1 -- 172.21.15.17:0/1556895415 wait complete. 2023-10-05T15:36:53.247 INFO:tasks.cephfs.filesystem:scrub status for tag:589deab9-7d60-4b53-a0cc-398426b490b2 - {'path': '/', 'tag': '589deab9-7d60-4b53-a0cc-398426b490b2', 'options': 'recursive,force'} 2023-10-05T15:36:53.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:53 smithi017 ceph-mon[129107]: pgmap v378: 129 pgs: 129 active+clean; 648 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2023-10-05T15:36:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:53 smithi167 ceph-mon[133366]: pgmap v378: 129 pgs: 129 active+clean; 648 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2023-10-05T15:36:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:53 smithi079 ceph-mon[132936]: pgmap v378: 129 pgs: 129 active+clean; 648 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2023-10-05T15:36:54.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: scrub queued for path: / 2023-10-05T15:36:54.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:54.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:54 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: scrub queued for path: / 2023-10-05T15:36:55.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:54 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: scrub queued for path: / 2023-10-05T15:36:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:36:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:36:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:36:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:54 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:55.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:55 smithi017 ceph-mon[129107]: pgmap v379: 129 pgs: 129 active+clean; 656 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-10-05T15:36:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:36:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:36:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:55 smithi167 ceph-mon[133366]: pgmap v379: 129 pgs: 129 active+clean; 656 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-10-05T15:36:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:36:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:36:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:55 smithi079 ceph-mon[132936]: pgmap v379: 129 pgs: 129 active+clean; 656 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-10-05T15:36:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:36:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:36:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:36:56.675 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-10-05T15:36:56.775 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-10-05T15:36:56.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-10-05T15:36:56.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 .. 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 data 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:36:56.990 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2023-10-05T15:36:56.991 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:36:56.991 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:36:56.991 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 .. 2023-10-05T15:36:56.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-10-05T15:36:57.117 INFO:teuthology.orchestra.run.smithi017.stdout:[Service] 2023-10-05T15:36:57.117 INFO:teuthology.orchestra.run.smithi017.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-10-05T15:36:57.117 INFO:teuthology.orchestra.run.smithi017.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-10-05T15:36:57.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-10-05T15:36:57.321 INFO:teuthology.orchestra.run.smithi017.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-10-05T15:36:57.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:57 smithi017 ceph-mon[129107]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-05T15:36:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:57 smithi167 ceph-mon[133366]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-05T15:36:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:57 smithi079 ceph-mon[132936]: pgmap v380: 129 pgs: 129 active+clean; 656 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-05T15:36:59.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:36:59 smithi017 ceph-mon[129107]: pgmap v381: 129 pgs: 129 active+clean; 706 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2023-10-05T15:37:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:36:59 smithi167 ceph-mon[133366]: pgmap v381: 129 pgs: 129 active+clean; 706 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2023-10-05T15:37:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:36:59 smithi079 ceph-mon[132936]: pgmap v381: 129 pgs: 129 active+clean; 706 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2023-10-05T15:37:01.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:01 smithi017 ceph-mon[129107]: pgmap v382: 129 pgs: 129 active+clean; 18 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-10-05T15:37:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:01 smithi167 ceph-mon[133366]: pgmap v382: 129 pgs: 129 active+clean; 18 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-10-05T15:37:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:01 smithi079 ceph-mon[132936]: pgmap v382: 129 pgs: 129 active+clean; 18 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.4 MiB/s wr, 18 op/s 2023-10-05T15:37:03.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:03 smithi017 ceph-mon[129107]: pgmap v383: 129 pgs: 129 active+clean; 19 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 MiB/s wr, 18 op/s 2023-10-05T15:37:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:03 smithi167 ceph-mon[133366]: pgmap v383: 129 pgs: 129 active+clean; 19 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 MiB/s wr, 18 op/s 2023-10-05T15:37:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:03 smithi079 ceph-mon[132936]: pgmap v383: 129 pgs: 129 active+clean; 19 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.5 MiB/s wr, 18 op/s 2023-10-05T15:37:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 -- 172.21.15.17:0/3938963424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 msgr2=0x7f6ddc102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3938963424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc102510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009990 tx=0x7f6dd0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 -- 172.21.15.17:0/3938963424 shutdown_connections 2023-10-05T15:37:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3938963424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ddc102a50 0x7f6ddc109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3938963424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ddc100eb0 0x7f6ddc1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3938963424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc102510 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 -- 172.21.15.17:0/3938963424 >> 172.21.15.17:0/3938963424 conn(0x7f6ddc0fc430 msgr2=0x7f6ddc0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 -- 172.21.15.17:0/3938963424 shutdown_connections 2023-10-05T15:37:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.914+0000 7f6de19ff700 1 -- 172.21.15.17:0/3938963424 wait complete. 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.915+0000 7f6de19ff700 1 Processor -- start 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.915+0000 7f6de19ff700 1 -- start start 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6de19ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ddc100eb0 0x7f6ddc196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6de19ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6de19ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ddc102a50 0x7f6ddc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6de19ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1986f0 con 0x7f6ddc102090 2023-10-05T15:37:05.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6de19ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc198860 con 0x7f6ddc102a50 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6de19ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc198a20 con 0x7f6ddc100eb0 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc1972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33174/0 (socket says 172.21.15.17:33174) 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3853257265 learned_addr learned my addr 172.21.15.17:0/3853257265 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ddc100eb0 0x7f6ddc196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ddc102a50 0x7f6ddc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3853257265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ddc100eb0 msgr2=0x7f6ddc196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ddc100eb0 0x7f6ddc196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3853257265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ddc102a50 msgr2=0x7f6ddc197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ddc102a50 0x7f6ddc197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.916+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3853257265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00095f0 con 0x7f6ddc102090 2023-10-05T15:37:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.917+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc1972b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0005910 tx=0x7f6dd0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.917+0000 7f6de09fd700 1 -- 172.21.15.17:0/3853257265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd001d070 con 0x7f6ddc102090 2023-10-05T15:37:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.917+0000 7f6de09fd700 1 -- 172.21.15.17:0/3853257265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dd000be30 con 0x7f6ddc102090 2023-10-05T15:37:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.917+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc198ca0 con 0x7f6ddc102090 2023-10-05T15:37:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.917+0000 7f6de09fd700 1 -- 172.21.15.17:0/3853257265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0022dd0 con 0x7f6ddc102090 2023-10-05T15:37:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.917+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc19f420 con 0x7f6ddc102090 2023-10-05T15:37:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.922+0000 7f6de09fd700 1 -- 172.21.15.17:0/3853257265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6dd0022570 con 0x7f6ddc102090 2023-10-05T15:37:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 Processor -- start 2023-10-05T15:37:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 -- start start 2023-10-05T15:37:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c40316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6de09fd700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6dc40a1500 0x7f6dc40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c4032860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4039630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3f95400 con 0x55b6c40312d0 2023-10-05T15:37:05.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3f86bc0 con 0x55b6c4032da0 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6df5336b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3f844e0 con 0x55b6c40323e0 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.923+0000 7f6de09fd700 1 -- 172.21.15.17:0/3853257265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6dd00ce490 con 0x7f6ddc102090 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6ddaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c40316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c4032860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6dc40a1500 0x7f6dc40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c4032860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:47738/0 (socket says 172.21.15.17:47738) 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 -- 172.21.15.17:0/1163717318 learned_addr learned my addr 172.21.15.17:0/1163717318 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4039630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 -- 172.21.15.17:0/1163717318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 msgr2=0x55b6c4039630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4039630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 -- 172.21.15.17:0/1163717318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 msgr2=0x55b6c40316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c40316f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 -- 172.21.15.17:0/1163717318 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c3daad80 con 0x55b6c40323e0 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c40316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6dc40a1500 0x7f6dc40a39c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4007730 tx=0x7f6dd4007a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.924+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c4032860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0098030 tx=0x7f6dd0004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab1b2fba5f71b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6dc1ffb700 1 -- 172.21.15.17:0/1163717318 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00b41d0 con 0x55b6c40323e0 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6dc1ffb700 1 -- 172.21.15.17:0/1163717318 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dd00b3ff0 con 0x55b6c40323e0 2023-10-05T15:37:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6dc1ffb700 1 -- 172.21.15.17:0/1163717318 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00a38c0 con 0x55b6c40323e0 2023-10-05T15:37:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 -- 172.21.15.17:0/1163717318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 msgr2=0x55b6c4032860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c4032860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0098030 tx=0x7f6dd0004320 comp rx=0 tx=0).stop 2023-10-05T15:37:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 -- 172.21.15.17:0/1163717318 shutdown_connections 2023-10-05T15:37:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4039630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c40316f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 --2- 172.21.15.17:0/1163717318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c4032860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.925+0000 7f6df5336b80 1 -- 172.21.15.17:0/1163717318 >> 172.21.15.17:0/1163717318 conn(0x55b6c3fa1200 msgr2=0x55b6c4027bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.926+0000 7f6df5336b80 1 -- 172.21.15.17:0/1163717318 shutdown_connections 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.926+0000 7f6df5336b80 1 -- 172.21.15.17:0/1163717318 wait complete. 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.926+0000 7f6df5336b80 1 -- start start 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.926+0000 7f6df5336b80 1 Processor -- start 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c403b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4042230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3f7fdd0 con 0x55b6c40312d0 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3f1c6b0 con 0x55b6c4032da0 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3f1c350 con 0x55b6c40323e0 2023-10-05T15:37:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6df5336b80 10 client.0 _ll_register_callbacks cb 0x55b6c3d797a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6ddaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6ddaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c403acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33204/0 (socket says 172.21.15.17:33204) 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6ddaffd700 1 -- 172.21.15.17:0/452865739 learned_addr learned my addr 172.21.15.17:0/452865739 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4042230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c403b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6ddaffd700 1 -- 172.21.15.17:0/452865739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 msgr2=0x55b6c403b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.927+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c403b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6ddaffd700 1 -- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 msgr2=0x55b6c4042230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4042230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6ddaffd700 1 -- 172.21.15.17:0/452865739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc0098e0 con 0x55b6c40312d0 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4042230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c403acb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc012980 tx=0x7f6dcc012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84e31a8ea0733ce server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6dbaffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6dbaffd700 1 -- 172.21.15.17:0/452865739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc017070 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6c401fd50 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6dbaffd700 1 -- 172.21.15.17:0/452865739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6dcc004030 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6dbaffd700 1 -- 172.21.15.17:0/452865739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dcc0041f0 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6df5336b80 10 client.15741 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.928+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f6ddc19f420 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6dbaffd700 1 -- 172.21.15.17:0/452865739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b6c401fd50 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6dbaffd700 1 -- 172.21.15.17:0/452865739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6dcc00f670 con 0x55b6c40312d0 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6df5336b80 10 client.15741 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6df5336b80 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6df5336b80 20 client.15741 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6df5336b80 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c4046b10 0x55b6c4048f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6df5336b80 4 client.15741 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.929+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6c3f78db0 con 0x55b6c4046b10 2023-10-05T15:37:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.930+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c4046b10 0x55b6c4048f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.930+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c4046b10 0x55b6c4048f30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=331d927f68844f16 server_cookie=dd77b45e45e9f27a in_seq=0 out_seq=0 2023-10-05T15:37:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.930+0000 7f6dbaffd700 10 client.15741 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6dbaffd700 1 -- 172.21.15.17:0/452865739 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b6c3f78db0 con 0x55b6c4046b10 2023-10-05T15:37:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6dbaffd700 10 client.15741 handle_command_reply: tid=0 2023-10-05T15:37:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 client.15741 shutdown 2023-10-05T15:37:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 msgr2=0x55b6c403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c403acb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc012980 tx=0x7f6dcc012c90 comp rx=0 tx=0).stop 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 shutdown_connections 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c4046b10 0x55b6c4048f30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c4032da0 0x55b6c4042230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6dbaffd700 0 client.15741 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40312d0 0x55b6c403acb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 --2- 172.21.15.17:0/452865739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c403b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 >> 172.21.15.17:0/452865739 conn(0x55b6c3fa1200 msgr2=0x55b6c4027250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 shutdown_connections 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 1 -- 172.21.15.17:0/452865739 wait complete. 2023-10-05T15:37:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.931+0000 7f6df5336b80 20 client.15741 trim_cache size 0 max 16384 2023-10-05T15:37:05.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:05 smithi017 ceph-mon[129107]: pgmap v384: 129 pgs: 129 active+clean; 24 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 2.2 MiB/s wr, 47 op/s 2023-10-05T15:37:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 Processor -- start 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 -- start start 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c4032800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c40421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 0x55b6c4035b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c3e008c0 con 0x55b6c4032da0 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c4038e20 con 0x55b6c40312d0 2023-10-05T15:37:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6df5336b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c4036710 con 0x55b6c40323e0 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6ddb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 0x55b6c4035b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6ddb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 0x55b6c4035b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33218/0 (socket says 172.21.15.17:33218) 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.947+0000 7f6ddb7fe700 1 -- 172.21.15.17:0/203055096 learned_addr learned my addr 172.21.15.17:0/203055096 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c4032800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c40421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddb7fe700 1 -- 172.21.15.17:0/203055096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 msgr2=0x55b6c40421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c40421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddb7fe700 1 -- 172.21.15.17:0/203055096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 msgr2=0x55b6c4032800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c4032800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddb7fe700 1 -- 172.21.15.17:0/203055096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c3d93c00 con 0x55b6c4032da0 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c40421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 0x55b6c4035b80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009ef0 tx=0x7f6dd401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a53f091906819e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.948+0000 7f6dc27fc700 1 -- 172.21.15.17:0/203055096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400e050 con 0x55b6c4032da0 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6dc27fc700 1 -- 172.21.15.17:0/203055096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dd400f040 con 0x55b6c4032da0 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6dc27fc700 1 -- 172.21.15.17:0/203055096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4019450 con 0x55b6c4032da0 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 -- 172.21.15.17:0/203055096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 msgr2=0x55b6c4035b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 0x55b6c4035b80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009ef0 tx=0x7f6dd401d000 comp rx=0 tx=0).stop 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 -- 172.21.15.17:0/203055096 shutdown_connections 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c4032da0 0x55b6c4035b80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c4032800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 --2- 172.21.15.17:0/203055096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c40323e0 0x55b6c40421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 -- 172.21.15.17:0/203055096 >> 172.21.15.17:0/203055096 conn(0x55b6c3fa1200 msgr2=0x55b6c404d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 -- 172.21.15.17:0/203055096 shutdown_connections 2023-10-05T15:37:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.949+0000 7f6df5336b80 1 -- 172.21.15.17:0/203055096 wait complete. 2023-10-05T15:37:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 -- start start 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 Processor -- start 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c403f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 0x55b6c403ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c4032da0 0x55b6c4040f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c4041450 con 0x55b6c40323e0 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c40415c0 con 0x55b6c40312d0 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c4041780 con 0x55b6c4032da0 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.950+0000 7f6df5336b80 10 client.0 _ll_register_callbacks cb 0x7f6dcc012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 0x55b6c403ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 0x55b6c403ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33230/0 (socket says 172.21.15.17:33230) 2023-10-05T15:37:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3035584575 learned_addr learned my addr 172.21.15.17:0/3035584575 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c403f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6ddb7fe700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c4032da0 0x55b6c4040f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3035584575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c4032da0 msgr2=0x55b6c4040f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c4032da0 0x55b6c4040f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 msgr2=0x55b6c403f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c403f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 -- 172.21.15.17:0/3035584575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4021040 con 0x55b6c40323e0 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c403f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dda7fc700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 0x55b6c403ff00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0097ac0 tx=0x7f6dd00972d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a610162c3c01a43f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.951+0000 7f6dbaffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6dbaffd700 1 -- 172.21.15.17:0/3035584575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd009bcc0 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6dd00b3ff0 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6dbaffd700 1 -- 172.21.15.17:0/3035584575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6dd00a38c0 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6dbaffd700 1 -- 172.21.15.17:0/3035584575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dd0099960 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 10 client.15747 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b6c3dd11f0 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6dbaffd700 1 -- 172.21.15.17:0/3035584575 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dd00b3ff0 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6dbaffd700 1 -- 172.21.15.17:0/3035584575 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6dd009b820 con 0x55b6c40323e0 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 20 client.15747 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c409af30 0x55b6c409d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 4 client.15747 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:37:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.952+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b6c3f78ad0 con 0x55b6c409af30 2023-10-05T15:37:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.953+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c409af30 0x55b6c409d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.953+0000 7f6ddaffd700 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c409af30 0x55b6c409d350 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebd10a4ca2b5e3a3 server_cookie=f3c5d82a34d207f9 in_seq=0 out_seq=0 2023-10-05T15:37:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:05.953+0000 7f6dbaffd700 10 client.15747 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:06.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:05 smithi167 ceph-mon[133366]: pgmap v384: 129 pgs: 129 active+clean; 24 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 2.2 MiB/s wr, 47 op/s 2023-10-05T15:37:06.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:05 smithi079 ceph-mon[132936]: pgmap v384: 129 pgs: 129 active+clean; 24 MiB data, 337 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 2.2 MiB/s wr, 47 op/s 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.265+0000 7f6dbaffd700 1 -- 172.21.15.17:0/3035584575 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b6c3f78ad0 con 0x55b6c409af30 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.265+0000 7f6dbaffd700 10 client.15747 handle_command_reply: tid=0 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.265+0000 7f6df5336b80 1 client.15747 shutdown 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 msgr2=0x55b6c403ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 0x55b6c403ff00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0097ac0 tx=0x7f6dd00972d0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 shutdown_connections 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b6c409af30 0x55b6c409d350 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6c4032da0 0x55b6c4040f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b6c40312d0 0x55b6c403f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 --2- 172.21.15.17:0/3035584575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6c40323e0 0x55b6c403ff00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 >> 172.21.15.17:0/3035584575 conn(0x55b6c3fa1200 msgr2=0x55b6c4035b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6dbaffd700 0 client.15747 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 shutdown_connections 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 1 -- 172.21.15.17:0/3035584575 wait complete. 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.266+0000 7f6df5336b80 20 client.15747 trim_cache size 0 max 16384 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6dc40a1500 msgr2=0x7f6dc40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6dc40a1500 0x7f6dc40a39c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4007730 tx=0x7f6dd4007a40 comp rx=0 tx=0).stop 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 msgr2=0x7f6ddc1972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc1972b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0005910 tx=0x7f6dd0005740 comp rx=0 tx=0).stop 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 shutdown_connections 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6dc40a1500 0x7f6dc40a39c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ddc102a50 0x7f6ddc197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ddc100eb0 0x7f6ddc196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 --2- 172.21.15.17:0/3853257265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ddc102090 0x7f6ddc1972b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 >> 172.21.15.17:0/3853257265 conn(0x7f6ddc0fc430 msgr2=0x7f6ddc0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 shutdown_connections 2023-10-05T15:37:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:06.267+0000 7f6de19ff700 1 -- 172.21.15.17:0/3853257265 wait complete. 2023-10-05T15:37:07.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:07 smithi017 ceph-mon[129107]: pgmap v385: 129 pgs: 129 active+clean; 26 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 67 op/s 2023-10-05T15:37:07.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:07 smithi017 ceph-mon[129107]: scrub summary: idle 2023-10-05T15:37:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:07 smithi167 ceph-mon[133366]: pgmap v385: 129 pgs: 129 active+clean; 26 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 67 op/s 2023-10-05T15:37:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:07 smithi167 ceph-mon[133366]: scrub summary: idle 2023-10-05T15:37:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:07 smithi079 ceph-mon[132936]: pgmap v385: 129 pgs: 129 active+clean; 26 MiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 67 op/s 2023-10-05T15:37:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:07 smithi079 ceph-mon[132936]: scrub summary: idle 2023-10-05T15:37:09.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:09 smithi017 ceph-mon[129107]: pgmap v386: 129 pgs: 129 active+clean; 30 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2023-10-05T15:37:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:09 smithi167 ceph-mon[133366]: pgmap v386: 129 pgs: 129 active+clean; 30 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2023-10-05T15:37:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:09 smithi079 ceph-mon[132936]: pgmap v386: 129 pgs: 129 active+clean; 30 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2023-10-05T15:37:11.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:11 smithi017 ceph-mon[129107]: pgmap v387: 129 pgs: 129 active+clean; 36 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 4.1 MiB/s wr, 248 op/s 2023-10-05T15:37:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:11 smithi167 ceph-mon[133366]: pgmap v387: 129 pgs: 129 active+clean; 36 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 4.1 MiB/s wr, 248 op/s 2023-10-05T15:37:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:11 smithi079 ceph-mon[132936]: pgmap v387: 129 pgs: 129 active+clean; 36 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 4.1 MiB/s wr, 248 op/s 2023-10-05T15:37:13.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:13 smithi017 ceph-mon[129107]: pgmap v388: 129 pgs: 129 active+clean; 37 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 2.7 MiB/s wr, 243 op/s 2023-10-05T15:37:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:13 smithi167 ceph-mon[133366]: pgmap v388: 129 pgs: 129 active+clean; 37 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 2.7 MiB/s wr, 243 op/s 2023-10-05T15:37:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:13 smithi079 ceph-mon[132936]: pgmap v388: 129 pgs: 129 active+clean; 37 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 2.7 MiB/s wr, 243 op/s 2023-10-05T15:37:15.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:15 smithi017 ceph-mon[129107]: pgmap v389: 129 pgs: 129 active+clean; 43 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 3.3 MiB/s wr, 264 op/s 2023-10-05T15:37:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:15 smithi167 ceph-mon[133366]: pgmap v389: 129 pgs: 129 active+clean; 43 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 3.3 MiB/s wr, 264 op/s 2023-10-05T15:37:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:15 smithi079 ceph-mon[132936]: pgmap v389: 129 pgs: 129 active+clean; 43 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 3.3 MiB/s wr, 264 op/s 2023-10-05T15:37:17.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:17 smithi017 ceph-mon[129107]: pgmap v390: 129 pgs: 129 active+clean; 43 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 2.6 MiB/s wr, 238 op/s 2023-10-05T15:37:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:17 smithi167 ceph-mon[133366]: pgmap v390: 129 pgs: 129 active+clean; 43 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 2.6 MiB/s wr, 238 op/s 2023-10-05T15:37:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:17 smithi079 ceph-mon[132936]: pgmap v390: 129 pgs: 129 active+clean; 43 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 2.6 MiB/s wr, 238 op/s 2023-10-05T15:37:18.672 INFO:teuthology.orchestra.run.smithi017.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-10-05T15:37:18.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-05T15:37:19.428 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2023-10-05T15:37:19.428 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-10-05T15:37:19.428 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:36 . 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:36 .. 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 data 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:total 40 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 . 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:36 .. 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Oct 5 15:37 base 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Oct 5 15:37 global 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 log 2023-10-05T15:37:19.429 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_commit_ts 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_dynshmem 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 5 15:36 pg_hba.conf 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 5 15:36 pg_ident.conf 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:37 pg_logical 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 pg_multixact 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 pg_notify 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_replslot 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_serial 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_snapshots 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_stat 2023-10-05T15:37:19.430 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_stat_tmp 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 pg_subtrans 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_tblspc 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_twophase 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:36 PG_VERSION 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:36 pg_wal 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 pg_xact 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 5 15:36 postgresql.auto.conf 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 5 15:36 postgresql.conf 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base: 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-10-05T15:37:19.431 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Oct 5 15:37 . 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 1 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 12346 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 12347 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 . 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Oct 5 15:37 .. 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 112 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 113 2023-10-05T15:37:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:37 12182 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12182_fsm 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12182_vm 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12184 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12186 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12187_fsm 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187_vm 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12189 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12191 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12192_fsm 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192_vm 2023-10-05T15:37:19.433 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12194 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12196 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12197_fsm 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197_vm 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12199 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12201 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12202_fsm 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202_vm 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12204 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12206 2023-10-05T15:37:19.434 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12207_fsm 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207_vm 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12209 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12211 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12212 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12214 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12216 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 5 15:37 1247 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1247_fsm 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1247_vm 2023-10-05T15:37:19.435 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 5 15:37 1249 2023-10-05T15:37:19.436 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1249_fsm 2023-10-05T15:37:19.436 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1249_vm 2023-10-05T15:37:19.436 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 5 15:37 1255 2023-10-05T15:37:19.436 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1255_fsm 2023-10-05T15:37:19.436 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1255_vm 2023-10-05T15:37:19.436 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 5 15:37 1259 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1259_fsm 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1259_vm 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 1417 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417_vm 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 1418 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418_vm 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 174 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 175 2023-10-05T15:37:19.437 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2187 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2224 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224_vm 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2328 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328_vm 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2336 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336_vm 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2337 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2600 2023-10-05T15:37:19.438 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2600_fsm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2600_vm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2601_fsm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601_vm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2602 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2602_fsm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2602_vm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2603 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2603_fsm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2603_vm 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2604 2023-10-05T15:37:19.439 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604_vm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2605 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2605_fsm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2605_vm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2606_fsm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606_vm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607_fsm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2607_vm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 5 15:37 2608 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2608_fsm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2608_vm 2023-10-05T15:37:19.440 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 5 15:37 2609 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2609_fsm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2609_vm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610_fsm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2610_vm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2611 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611_vm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2612_fsm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612_vm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2613 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613_vm 2023-10-05T15:37:19.441 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2615_fsm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615_vm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616_fsm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2616_vm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:37 2617 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2617_fsm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2617_vm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 5 15:37 2618 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2618_fsm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2618_vm 2023-10-05T15:37:19.442 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 5 15:37 2619 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2619_fsm 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2619_vm 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2620 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620_vm 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2650 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2651 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2652 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2653 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2654 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2655 2023-10-05T15:37:19.443 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2656 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2657 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:37 2658 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2659 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2660 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2661 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2662 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2663 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2664 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2665 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2666 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2667 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2668 2023-10-05T15:37:19.444 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2669 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2670 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 5 15:37 2673 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 5 15:37 2674 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 5 15:37 2675 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2678 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2679 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2680 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2681 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2682 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2683 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2684 2023-10-05T15:37:19.445 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2685 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2686 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2687 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2688 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2689 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2690 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 5 15:37 2691 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2692 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2693 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2696 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2699 2023-10-05T15:37:19.446 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2701 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2702 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2703 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2704 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2753 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2753_fsm 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2753_vm 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2754 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2755 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2756 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2757 2023-10-05T15:37:19.447 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2830 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830_vm 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2831 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2832 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832_vm 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2833 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2834 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834_vm 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2835 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2836 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836_vm 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2837 2023-10-05T15:37:19.448 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 5 15:37 2838 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2838_fsm 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2838_vm 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2839 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840_fsm 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2840_vm 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2841 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2995 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995_vm 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2996 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079 2023-10-05T15:37:19.449 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3079_fsm 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079_vm 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3080 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3081 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3085 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3118 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118_vm 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3119 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3164 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3256 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256_vm 2023-10-05T15:37:19.450 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3257 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3258 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3350 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350_vm 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3351 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3379 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3380 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3381 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381_vm 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3394 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3394_fsm 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3394_vm 2023-10-05T15:37:19.451 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3395 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3439 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439_vm 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3440 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 3455 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3456 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3456_fsm 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3456_vm 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3466 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466_vm 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3467 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3468 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3501 2023-10-05T15:37:19.452 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501_vm 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3502 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3503 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3534 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3541_fsm 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541_vm 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3542 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3574 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3575 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3576 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576_vm 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3596 2023-10-05T15:37:19.453 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596_vm 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3597 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3598 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598_vm 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3599 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3600_fsm 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600_vm 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3601_fsm 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601_vm 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602 2023-10-05T15:37:19.454 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3602_fsm 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.434+0000 7f54f3bff700 1 -- 172.21.15.17:0/3041131058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 msgr2=0x7f54ec0732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.434+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3041131058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec0732c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009990 tx=0x7f54e8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 -- 172.21.15.17:0/3041131058 shutdown_connections 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3041131058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec108e20 0x7f54ec10b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3041131058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec0732c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3041131058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54ec073890 0x7f54ec073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 -- 172.21.15.17:0/3041131058 >> 172.21.15.17:0/3041131058 conn(0x7f54ec0fc480 msgr2=0x7f54ec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 -- 172.21.15.17:0/3041131058 shutdown_connections 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.435+0000 7f54f3bff700 1 -- 172.21.15.17:0/3041131058 wait complete. 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.436+0000 7f54f3bff700 1 Processor -- start 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.436+0000 7f54f3bff700 1 -- start start 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f3bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 0x7f54ec198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f3bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f3bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54ec108e20 0x7f54ec19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f3bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec19a850 con 0x7f54ec073890 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f3bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec19a9c0 con 0x7f54ec074e70 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f3bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec19ab80 con 0x7f54ec108e20 2023-10-05T15:37:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 0x7f54ec198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 0x7f54ec198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36198/0 (socket says 172.21.15.17:36198) 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 -- 172.21.15.17:0/3019795022 learned_addr learned my addr 172.21.15.17:0/3019795022 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f219c700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54ec108e20 0x7f54ec19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f119a700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 -- 172.21.15.17:0/3019795022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54ec108e20 msgr2=0x7f54ec19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54ec108e20 0x7f54ec19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 -- 172.21.15.17:0/3019795022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 msgr2=0x7f54ec1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f199b700 1 -- 172.21.15.17:0/3019795022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80095f0 con 0x7f54ec073890 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.437+0000 7f54f119a700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.438+0000 7f54f199b700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 0x7f54ec198e60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f54e80098e0 tx=0x7f54e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.438+0000 7f54e2ffd700 1 -- 172.21.15.17:0/3019795022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e801d070 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.438+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec19ae00 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.438+0000 7f54e2ffd700 1 -- 172.21.15.17:0/3019795022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54e800be30 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.438+0000 7f54e2ffd700 1 -- 172.21.15.17:0/3019795022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e8022e20 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.438+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec1a1570 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.442+0000 7f54e2ffd700 1 -- 172.21.15.17:0/3019795022 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f54e8022470 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.444+0000 7f55074dcb80 1 Processor -- start 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.444+0000 7f55074dcb80 1 -- start start 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.444+0000 7f54e2ffd700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d80a1480 0x7f54d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54e2ffd700 1 -- 172.21.15.17:0/3019795022 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54e80ce680 con 0x7f54ec073890 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819134b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819134c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x558191353220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f55074dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581912b3400 con 0x55819134bfd0 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f55074dcb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581912a4bc0 con 0x55819134c990 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f55074dcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581912a24e0 con 0x55819134aec0 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54f219c700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d80a1480 0x7f54d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54f219c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x558191353220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54f219c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x558191353220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36052/0 (socket says 172.21.15.17:36052) 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54f219c700 1 -- 172.21.15.17:0/1471100359 learned_addr learned my addr 172.21.15.17:0/1471100359 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54f119a700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819134c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.445+0000 7f54f199b700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819134b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f199b700 1 -- 172.21.15.17:0/1471100359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 msgr2=0x558191353220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f199b700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x558191353220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f199b700 1 -- 172.21.15.17:0/1471100359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 msgr2=0x55819134c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f199b700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819134c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f199b700 1 -- 172.21.15.17:0/1471100359 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581910c8d80 con 0x55819134aec0 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f219c700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x558191353220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f119a700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819134c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f219c700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d80a1480 0x7f54d80a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54e4013e00 tx=0x7f54e4013530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54f199b700 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819134b2e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54e8097b30 tx=0x7f54e8005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9fb0b9a1984eaa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54d7fff700 1 -- 172.21.15.17:0/1471100359 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80860f0 con 0x55819134aec0 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54d7fff700 1 -- 172.21.15.17:0/1471100359 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54e809bd30 con 0x55819134aec0 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.446+0000 7f54d7fff700 1 -- 172.21.15.17:0/1471100359 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80ce340 con 0x55819134aec0 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 -- 172.21.15.17:0/1471100359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 msgr2=0x55819134b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819134b2e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54e8097b30 tx=0x7f54e8005a00 comp rx=0 tx=0).stop 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 -- 172.21.15.17:0/1471100359 shutdown_connections 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x558191353220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819134b2e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1471100359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819134c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 -- 172.21.15.17:0/1471100359 >> 172.21.15.17:0/1471100359 conn(0x5581912bf200 msgr2=0x558191345bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 -- 172.21.15.17:0/1471100359 shutdown_connections 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.447+0000 7f55074dcb80 1 -- 172.21.15.17:0/1471100359 wait complete. 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.448+0000 7f55074dcb80 1 -- start start 2023-10-05T15:37:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.448+0000 7f55074dcb80 1 Processor -- start 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x558191354880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x558191354dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55819129ddd0 con 0x55819134bfd0 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55819123a6b0 con 0x55819134c990 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55819123a350 con 0x55819134aec0 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f55074dcb80 10 client.0 _ll_register_callbacks cb 0x5581910977a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:19.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x558191354dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x558191354dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36228/0 (socket says 172.21.15.17:36228) 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f119a700 1 -- 172.21.15.17:0/2501710093 learned_addr learned my addr 172.21.15.17:0/2501710093 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f199b700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x558191354880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f219c700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f199b700 1 -- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 msgr2=0x55819135be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f199b700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f199b700 1 -- 172.21.15.17:0/2501710093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 msgr2=0x558191354dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f199b700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x558191354dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.449+0000 7f54f199b700 1 -- 172.21.15.17:0/2501710093 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc0098f0 con 0x55819134aec0 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f54f199b700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x558191354880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55819134ac60 tx=0x7f54e8022720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d402fcf150501c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f54d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:19.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f54d57fa700 1 -- 172.21.15.17:0/2501710093 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80860f0 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f54d57fa700 1 -- 172.21.15.17:0/2501710093 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54e809ab20 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55819133dd50 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f54d57fa700 1 -- 172.21.15.17:0/2501710093 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54e809ace0 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f55074dcb80 10 client.25546 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f54e401abe0 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.450+0000 7f54d57fa700 1 -- 172.21.15.17:0/2501710093 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55819133dd50 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f54d57fa700 1 -- 172.21.15.17:0/2501710093 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54e8097420 con 0x55819134aec0 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f55074dcb80 10 client.25546 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f55074dcb80 10 client.25546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f55074dcb80 20 client.25546 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558191360130 0x558191362520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f55074dcb80 4 client.25546 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558191296db0 con 0x558191360130 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.451+0000 7f54f119a700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558191360130 0x558191362520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.452+0000 7f54f119a700 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558191360130 0x558191362520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4410924a27dbc42 server_cookie=d276b0d912d19219 in_seq=0 out_seq=0 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.452+0000 7f54d57fa700 10 client.25546 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.452+0000 7f54d57fa700 1 -- 172.21.15.17:0/2501710093 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558191296db0 con 0x558191360130 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f54d57fa700 10 client.25546 handle_command_reply: tid=0 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 client.25546 shutdown 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 msgr2=0x558191354880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x558191354880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55819134ac60 tx=0x7f54e8022720 comp rx=0 tx=0).stop 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 shutdown_connections 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558191360130 0x558191362520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x558191354880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2501710093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x558191354dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f54d57fa700 0 client.25546 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 >> 172.21.15.17:0/2501710093 conn(0x5581912bf200 msgr2=0x558191345250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 shutdown_connections 2023-10-05T15:37:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 1 -- 172.21.15.17:0/2501710093 wait complete. 2023-10-05T15:37:19.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.453+0000 7f55074dcb80 20 client.25546 trim_cache size 0 max 16384 2023-10-05T15:37:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.473+0000 7f55074dcb80 1 Processor -- start 2023-10-05T15:37:19.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.473+0000 7f55074dcb80 1 -- start start 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.473+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134aec0 0x558191354d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134bfd0 0x55819135bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134c990 0x558191352cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f55074dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55819111e8c0 con 0x55819134c990 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f55074dcb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558191296de0 con 0x55819134aec0 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f55074dcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558191355280 con 0x55819134bfd0 2023-10-05T15:37:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134c990 0x558191352cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134c990 0x558191352cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36236/0 (socket says 172.21.15.17:36236) 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f219c700 1 -- 172.21.15.17:0/1177192553 learned_addr learned my addr 172.21.15.17:0/1177192553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f119a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134bfd0 0x55819135bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f199b700 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134aec0 0x558191354d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f119a700 1 -- 172.21.15.17:0/1177192553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134aec0 msgr2=0x558191354d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f119a700 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134aec0 0x558191354d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f119a700 1 -- 172.21.15.17:0/1177192553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134c990 msgr2=0x558191352cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f119a700 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134c990 0x558191352cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f119a700 1 -- 172.21.15.17:0/1177192553 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec1a1570 con 0x55819134bfd0 2023-10-05T15:37:19.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.474+0000 7f54f199b700 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134aec0 0x558191354d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.475+0000 7f54f119a700 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134bfd0 0x55819135bdc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54e80cbd80 tx=0x7f54dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95108bbd8e4cc1b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.475+0000 7f54e0bff700 1 -- 172.21.15.17:0/1177192553 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc018040 con 0x55819134bfd0 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.475+0000 7f54e0bff700 1 -- 172.21.15.17:0/1177192553 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54dc021070 con 0x55819134bfd0 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.475+0000 7f54e0bff700 1 -- 172.21.15.17:0/1177192553 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc012450 con 0x55819134bfd0 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 -- 172.21.15.17:0/1177192553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134bfd0 msgr2=0x55819135bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134bfd0 0x55819135bdc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f54e80cbd80 tx=0x7f54dc004750 comp rx=0 tx=0).stop 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 -- 172.21.15.17:0/1177192553 shutdown_connections 2023-10-05T15:37:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134c990 0x558191352cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134aec0 0x558191354d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 --2- 172.21.15.17:0/1177192553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134bfd0 0x55819135bdc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 -- 172.21.15.17:0/1177192553 >> 172.21.15.17:0/1177192553 conn(0x5581912bf200 msgr2=0x558191354630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 -- 172.21.15.17:0/1177192553 shutdown_connections 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 -- 172.21.15.17:0/1177192553 wait complete. 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 -- start start 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.476+0000 7f55074dcb80 1 Processor -- start 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819135a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819135aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55819135c190 con 0x55819134bfd0 2023-10-05T15:37:19.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581913b3f20 con 0x55819134c990 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581913b4060 con 0x55819134aec0 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f55074dcb80 10 client.0 _ll_register_callbacks cb 0x7f54dc009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f54f119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819135aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f54f119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819135aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36238/0 (socket says 172.21.15.17:36238) 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.477+0000 7f54f119a700 1 -- 172.21.15.17:0/2112050566 learned_addr learned my addr 172.21.15.17:0/2112050566 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f219c700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f199b700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819135a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f119a700 1 -- 172.21.15.17:0/2112050566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 msgr2=0x55819135a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f119a700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819135a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f119a700 1 -- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 msgr2=0x55819135af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f119a700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f119a700 1 -- 172.21.15.17:0/2112050566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e401abe0 con 0x55819134bfd0 2023-10-05T15:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f219c700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54f119a700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819135aa50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f54dc000c00 tx=0x7f54dc009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1922e5ba21e52a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.478+0000 7f54d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f54d57fa700 1 -- 172.21.15.17:0/2112050566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc018070 con 0x55819134bfd0 2023-10-05T15:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54e809bd30 con 0x55819134bfd0 2023-10-05T15:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f54d57fa700 1 -- 172.21.15.17:0/2112050566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54dc003680 con 0x55819134bfd0 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f54d57fa700 1 -- 172.21.15.17:0/2112050566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54dc01d5b0 con 0x55819134bfd0 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 10 client.15765 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f54dc009e40 con 0x55819134bfd0 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f54d57fa700 1 -- 172.21.15.17:0/2112050566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54e809bd30 con 0x55819134bfd0 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f54d57fa700 1 -- 172.21.15.17:0/2112050566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54dc012450 con 0x55819134bfd0 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 10 client.15765 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 20 client.15765 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5581913b5950 0x5581913b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 4 client.15765 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.479+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558191296ad0 con 0x5581913b5950 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.480+0000 7f54f199b700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5581913b5950 0x5581913b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.480+0000 7f54f199b700 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5581913b5950 0x5581913b7d70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e24ce2aec25f6c7 server_cookie=b32a1ab555d95def in_seq=0 out_seq=0 2023-10-05T15:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.480+0000 7f54d57fa700 10 client.15765 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f54d57fa700 1 -- 172.21.15.17:0/2112050566 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558191296ad0 con 0x5581913b5950 2023-10-05T15:37:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f54d57fa700 10 client.15765 handle_command_reply: tid=0 2023-10-05T15:37:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 client.15765 shutdown 2023-10-05T15:37:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 msgr2=0x55819135aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819135aa50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f54dc000c00 tx=0x7f54dc009c90 comp rx=0 tx=0).stop 2023-10-05T15:37:19.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 shutdown_connections 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5581913b5950 0x5581913b7d70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55819134c990 0x55819135af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55819134aec0 0x55819135a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f54d57fa700 0 client.15765 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 --2- 172.21.15.17:0/2112050566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55819134bfd0 0x55819135aa50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 >> 172.21.15.17:0/2112050566 conn(0x5581912bf200 msgr2=0x558191345250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 shutdown_connections 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.670+0000 7f55074dcb80 1 -- 172.21.15.17:0/2112050566 wait complete. 2023-10-05T15:37:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f55074dcb80 20 client.15765 trim_cache size 0 max 16384 2023-10-05T15:37:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:37:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:37:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:37:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:37:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d80a1480 msgr2=0x7f54d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d80a1480 0x7f54d80a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54e4013e00 tx=0x7f54e4013530 comp rx=0 tx=0).stop 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 msgr2=0x7f54ec198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 0x7f54ec198e60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f54e80098e0 tx=0x7f54e8004730 comp rx=0 tx=0).stop 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 shutdown_connections 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54d80a1480 0x7f54d80a3940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54ec108e20 0x7f54ec19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54ec073890 0x7f54ec198e60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 --2- 172.21.15.17:0/3019795022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ec074e70 0x7f54ec1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.671+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 >> 172.21.15.17:0/3019795022 conn(0x7f54ec0fc480 msgr2=0x7f54ec0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.672+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 shutdown_connections 2023-10-05T15:37:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:19.672+0000 7f54f3bff700 1 -- 172.21.15.17:0/3019795022 wait complete. 2023-10-05T15:37:19.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:19 smithi017 ceph-mon[129107]: pgmap v391: 129 pgs: 129 active+clean; 43 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 2.3 MiB/s wr, 216 op/s 2023-10-05T15:37:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:19 smithi167 ceph-mon[133366]: pgmap v391: 129 pgs: 129 active+clean; 43 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 2.3 MiB/s wr, 216 op/s 2023-10-05T15:37:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:19 smithi079 ceph-mon[132936]: pgmap v391: 129 pgs: 129 active+clean; 43 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 2.3 MiB/s wr, 216 op/s 2023-10-05T15:37:20.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602_vm 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3603 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3603_fsm 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3603_vm 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3604 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3605 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3606 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3607 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3608 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 3609 2023-10-05T15:37:20.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3712 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3764_fsm 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764_vm 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3766 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3767 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3997 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 5002 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 548 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 549 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6102 2023-10-05T15:37:20.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102_vm 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6104 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104_vm 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6106 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106_vm 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6110 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6111 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6112 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6113 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6117 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 826 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826_vm 2023-10-05T15:37:20.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 827 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 828 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:37 PG_VERSION 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 . 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Oct 5 15:37 .. 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 112 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 113 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:37 12182 2023-10-05T15:37:20.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12182_fsm 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12182_vm 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12184 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12186 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12187_fsm 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187_vm 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12189 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12191 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192 2023-10-05T15:37:20.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12192_fsm 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192_vm 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12194 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12196 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12197_fsm 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197_vm 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12199 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12201 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12202_fsm 2023-10-05T15:37:20.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202_vm 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12204 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12206 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12207_fsm 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207_vm 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12209 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12211 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12212 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12214 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12216 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 5 15:37 1247 2023-10-05T15:37:20.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1247_fsm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1247_vm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 5 15:37 1249 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1249_fsm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1249_vm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 5 15:37 1255 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1255_fsm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1255_vm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 5 15:37 1259 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1259_fsm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1259_vm 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417 2023-10-05T15:37:20.165 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417_vm 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418_vm 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 174 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 175 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2187 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224_vm 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328_vm 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336 2023-10-05T15:37:20.166 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336_vm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2337 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2600 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2600_fsm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2600_vm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2601_fsm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601_vm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2602 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2602_fsm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2602_vm 2023-10-05T15:37:20.167 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2603 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2603_fsm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2603_vm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604_vm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2605 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2605_fsm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2605_vm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2606_fsm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606_vm 2023-10-05T15:37:20.168 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607_fsm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2607_vm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 5 15:37 2608 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2608_fsm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2608_vm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 5 15:37 2609 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2609_fsm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2609_vm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610_fsm 2023-10-05T15:37:20.169 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2610_vm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611_vm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2612_fsm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612_vm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613_vm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2615_fsm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615_vm 2023-10-05T15:37:20.170 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616_fsm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2616_vm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:37 2617 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2617_fsm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2617_vm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 5 15:37 2618 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2618_fsm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2618_vm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 5 15:37 2619 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2619_fsm 2023-10-05T15:37:20.171 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2619_vm 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620_vm 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2650 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2651 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2652 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2653 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2654 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2655 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2656 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2657 2023-10-05T15:37:20.172 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:37 2658 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2659 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2660 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2661 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2662 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2663 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2664 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2665 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2666 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2667 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2668 2023-10-05T15:37:20.173 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2669 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2670 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 5 15:37 2673 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 5 15:37 2674 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 5 15:37 2675 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2678 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2679 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2680 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2681 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2682 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2683 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2684 2023-10-05T15:37:20.174 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2685 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2686 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2687 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2688 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2689 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2690 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 5 15:37 2691 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2692 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2693 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2696 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2699 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2701 2023-10-05T15:37:20.175 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2702 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2703 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2704 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2753 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2753_fsm 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2753_vm 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2754 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2755 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2756 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2757 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830 2023-10-05T15:37:20.176 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830_vm 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2831 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832_vm 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2833 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834_vm 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2835 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836_vm 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2837 2023-10-05T15:37:20.177 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 5 15:37 2838 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2838_fsm 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2838_vm 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2839 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840_fsm 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2840_vm 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2841 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995_vm 2023-10-05T15:37:20.178 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2996 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3079_fsm 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079_vm 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3080 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3081 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3085 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118_vm 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3119 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3164 2023-10-05T15:37:20.179 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256_vm 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3257 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3258 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350_vm 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3351 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3379 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3380 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381_vm 2023-10-05T15:37:20.180 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3394 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3394_fsm 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3394_vm 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3395 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439_vm 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3440 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 3455 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3456 2023-10-05T15:37:20.181 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3456_fsm 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3456_vm 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466_vm 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3467 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3468 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501_vm 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3502 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3503 2023-10-05T15:37:20.182 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3534 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3541_fsm 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541_vm 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3542 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3574 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3575 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576_vm 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596_vm 2023-10-05T15:37:20.183 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3597 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598_vm 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3599 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3600_fsm 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600_vm 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3601_fsm 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601_vm 2023-10-05T15:37:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3602_fsm 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602_vm 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3603 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3603_fsm 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3603_vm 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3604 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3605 2023-10-05T15:37:20.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3606 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3607 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3608 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 3609 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3712 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3764_fsm 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764_vm 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3766 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3767 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3997 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 5002 2023-10-05T15:37:20.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 548 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 549 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102_vm 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104_vm 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106_vm 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6110 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6111 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6112 2023-10-05T15:37:20.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6113 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6117 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826_vm 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 827 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 828 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:37 PG_VERSION 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-10-05T15:37:20.754 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 . 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Oct 5 15:37 .. 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 112 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 113 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:37 12182 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12182_fsm 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12182_vm 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12184 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12186 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12187_fsm 2023-10-05T15:37:20.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187_vm 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12189 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12191 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12192_fsm 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192_vm 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12194 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12196 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12197_fsm 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197_vm 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12199 2023-10-05T15:37:20.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12201 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12202_fsm 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202_vm 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12204 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12206 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12207_fsm 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207_vm 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12209 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12211 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12212 2023-10-05T15:37:20.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12214 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12216 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 5 15:37 1247 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1247_fsm 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1247_vm 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 5 15:37 1249 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1249_fsm 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1249_vm 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 5 15:37 1255 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1255_fsm 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1255_vm 2023-10-05T15:37:20.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 5 15:37 1259 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1259_fsm 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1259_vm 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417_vm 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418_vm 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 174 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 175 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2187 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224_vm 2023-10-05T15:37:20.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328_vm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336_vm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2337 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2600 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2600_fsm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2600_vm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2601_fsm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601_vm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2602 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2602_fsm 2023-10-05T15:37:20.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2602_vm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2603 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2603_fsm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2603_vm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604_vm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2605 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2605_fsm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2605_vm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2606_fsm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606_vm 2023-10-05T15:37:20.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607_fsm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2607_vm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 5 15:37 2608 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2608_fsm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2608_vm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 5 15:37 2609 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2609_fsm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2609_vm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610_fsm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2610_vm 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611 2023-10-05T15:37:20.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611_vm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2612_fsm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612_vm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613_vm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2615_fsm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615_vm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616_fsm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2616_vm 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:37 2617 2023-10-05T15:37:20.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2617_fsm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2617_vm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 5 15:37 2618 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2618_fsm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2618_vm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 5 15:37 2619 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2619_fsm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2619_vm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620_vm 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2650 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2651 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2652 2023-10-05T15:37:20.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2653 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2654 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2655 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2656 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2657 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:37 2658 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2659 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2660 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2661 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2662 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2663 2023-10-05T15:37:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2664 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2665 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2666 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2667 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2668 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2669 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2670 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 5 15:37 2673 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 5 15:37 2674 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 5 15:37 2675 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2678 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2679 2023-10-05T15:37:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2680 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2681 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2682 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2683 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2684 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2685 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2686 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2687 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2688 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2689 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2690 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 5 15:37 2691 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2692 2023-10-05T15:37:20.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2693 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2696 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2699 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2701 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2702 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2703 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2704 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2753 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2753_fsm 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2753_vm 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2754 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2755 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2756 2023-10-05T15:37:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2757 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830_vm 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2831 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832_vm 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2833 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834_vm 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2835 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836_vm 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2837 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 5 15:37 2838 2023-10-05T15:37:20.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2838_fsm 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2838_vm 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2839 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840_fsm 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2840_vm 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2841 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995_vm 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2996 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079 2023-10-05T15:37:20.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3079_fsm 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079_vm 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3080 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3081 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3085 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118_vm 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3119 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3164 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256_vm 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3257 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3258 2023-10-05T15:37:20.771 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350_vm 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3351 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3379 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3380 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381_vm 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3394 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3394_fsm 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3394_vm 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3395 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439_vm 2023-10-05T15:37:20.772 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3440 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 3455 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3456 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3456_fsm 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3456_vm 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466_vm 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3467 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3468 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501_vm 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3502 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3503 2023-10-05T15:37:20.773 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3534 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3541_fsm 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541_vm 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3542 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3574 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3575 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576_vm 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596_vm 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3597 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598 2023-10-05T15:37:20.774 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598_vm 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3599 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3600_fsm 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600_vm 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3601_fsm 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601_vm 2023-10-05T15:37:20.775 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602 2023-10-05T15:37:20.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3602_fsm 2023-10-05T15:37:20.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602_vm 2023-10-05T15:37:20.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3603 2023-10-05T15:37:20.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3603_fsm 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3603_vm 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3604 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3605 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3606 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3607 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3608 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 3609 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3712 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3764_fsm 2023-10-05T15:37:20.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764_vm 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3766 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3767 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3997 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 5002 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 548 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 549 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102_vm 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104_vm 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106_vm 2023-10-05T15:37:20.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6110 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6111 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6112 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6113 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6117 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826_vm 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 827 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 828 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:37:20.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:37 PG_VERSION 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/global: 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:total 554 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Oct 5 15:37 . 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1136 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1136_fsm 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1136_vm 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 1137 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1213 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1213_fsm 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1213_vm 2023-10-05T15:37:20.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1214 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1214_fsm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1214_vm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 1232 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 1233 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1260 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1260_fsm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1260_vm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1261 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1261_fsm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1261_vm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1262 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1262_fsm 2023-10-05T15:37:20.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1262_vm 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2396 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2396_fsm 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2396_vm 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2397 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2671 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2672 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2676 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2677 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2694 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2695 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2697 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2698 2023-10-05T15:37:20.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2846 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2846_vm 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2847 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2964 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2964_vm 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2965 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2966 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2966_vm 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2967 2023-10-05T15:37:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3592 2023-10-05T15:37:20.917 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3592_vm 2023-10-05T15:37:20.917 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3593 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 4060 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 4060_vm 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 4061 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6000 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6000_vm 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6001 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6002 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6100 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6100_vm 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6114 2023-10-05T15:37:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6115 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 pg_control 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/log: 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 . 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-05T15:37:20.919 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.920 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.920 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.920 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-05T15:37:20.920 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.920 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.921 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.921 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-05T15:37:20.921 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-10-05T15:37:20.921 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:37 . 2023-10-05T15:37:20.922 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.922 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 mappings 2023-10-05T15:37:20.922 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:37 replorigin_checkpoint 2023-10-05T15:37:20.922 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 snapshots 2023-10-05T15:37:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-05T15:37:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:37 .. 2023-10-05T15:37:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.923 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-05T15:37:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:37 .. 2023-10-05T15:37:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-05T15:37:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-10-05T15:37:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 . 2023-10-05T15:37:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 members 2023-10-05T15:37:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 offsets 2023-10-05T15:37:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.926 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-05T15:37:20.926 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:37:20.926 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 . 2023-10-05T15:37:20.926 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 .. 2023-10-05T15:37:20.926 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 0000 2023-10-05T15:37:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.927 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-05T15:37:20.927 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:37:20.927 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 . 2023-10-05T15:37:20.991 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 .. 2023-10-05T15:37:20.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 0000 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 . 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 0000 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.993 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 . 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.994 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 0000 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-05T15:37:20.995 INFO:teuthology.orchestra.run.smithi017.stdout:total 16386 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:36 . 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:37 000000010000000000000001 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 archive_status 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:36 .. 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:37:20.996 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 . 2023-10-05T15:37:20.997 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Oct 5 15:37 .. 2023-10-05T15:37:20.997 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 0000 2023-10-05T15:37:20.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-10-05T15:37:21.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2023-10-05T15:37:21.533 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-10-05T15:37:21.586 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-10-05T15:37:21.592 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-10-05T15:37:21.600 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-10-05T15:37:21.639 INFO:teuthology.orchestra.run.smithi017.stderr:creating tables... 2023-10-05T15:37:21.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:21 smithi017 ceph-mon[129107]: pgmap v392: 129 pgs: 129 active+clean; 46 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.0 MiB/s wr, 204 op/s 2023-10-05T15:37:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:21 smithi167 ceph-mon[133366]: pgmap v392: 129 pgs: 129 active+clean; 46 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.0 MiB/s wr, 204 op/s 2023-10-05T15:37:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:21 smithi079 ceph-mon[132936]: pgmap v392: 129 pgs: 129 active+clean; 46 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.0 MiB/s wr, 204 op/s 2023-10-05T15:37:22.444 INFO:teuthology.orchestra.run.smithi017.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.80 s, remaining 24.86 s) 2023-10-05T15:37:23.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:37:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 -- 172.21.15.17:0/92514262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201017c0 msgr2=0x7f2f20103bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/92514262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201017c0 0x7f2f20103bb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009990 tx=0x7f2f10009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 -- 172.21.15.17:0/92514262 shutdown_connections 2023-10-05T15:37:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/92514262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 0x7f2f20108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/92514262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201017c0 0x7f2f20103bb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/92514262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201040f0 0x7f2f201064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 -- 172.21.15.17:0/92514262 >> 172.21.15.17:0/92514262 conn(0x7f2f200fb190 msgr2=0x7f2f200fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 -- 172.21.15.17:0/92514262 shutdown_connections 2023-10-05T15:37:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.484+0000 7f2f1f59e700 1 -- 172.21.15.17:0/92514262 wait complete. 2023-10-05T15:37:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 Processor -- start 2023-10-05T15:37:23.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 -- start start 2023-10-05T15:37:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 0x7f2f20196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201040f0 0x7f2f20196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 0x7f2f2019de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2019e400 con 0x7f2f201040f0 2023-10-05T15:37:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2019e540 con 0x7f2f20106a20 2023-10-05T15:37:23.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.486+0000 7f2f1f59e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2019e6d0 con 0x7f2f201017c0 2023-10-05T15:37:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201040f0 0x7f2f20196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 0x7f2f20196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 0x7f2f20196880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53632/0 (socket says 172.21.15.17:53632) 2023-10-05T15:37:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 -- 172.21.15.17:0/2030870609 learned_addr learned my addr 172.21.15.17:0/2030870609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 0x7f2f2019de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 -- 172.21.15.17:0/2030870609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 msgr2=0x7f2f2019de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 0x7f2f2019de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 -- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201040f0 msgr2=0x7f2f20196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201040f0 0x7f2f20196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1e59c700 1 -- 172.21.15.17:0/2030870609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f100095f0 con 0x7f2f201017c0 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201040f0 0x7f2f20196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.487+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 0x7f2f2019de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:23.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.488+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 0x7f2f20196880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005910 tx=0x7f2f10004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.488+0000 7f2f0f7fe700 1 -- 172.21.15.17:0/2030870609 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1001d070 con 0x7f2f201017c0 2023-10-05T15:37:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.488+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2019e950 con 0x7f2f201017c0 2023-10-05T15:37:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.488+0000 7f2f0f7fe700 1 -- 172.21.15.17:0/2030870609 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f10004c70 con 0x7f2f201017c0 2023-10-05T15:37:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.488+0000 7f2f0f7fe700 1 -- 172.21.15.17:0/2030870609 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10003a30 con 0x7f2f201017c0 2023-10-05T15:37:23.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.488+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2019edd0 con 0x7f2f201017c0 2023-10-05T15:37:23.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.492+0000 7f2f0f7fe700 1 -- 172.21.15.17:0/2030870609 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2f10005000 con 0x7f2f201017c0 2023-10-05T15:37:23.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.493+0000 7f2f38639b80 1 Processor -- start 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 -- start start 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f0f7fe700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2f080a1520 0x7f2f080a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2410 0x561a775e2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7754a460 con 0x561a775e2d70 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a7753bc20 con 0x561a775e3c60 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f38639b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a77539540 con 0x561a775e2410 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f0f7fe700 1 -- 172.21.15.17:0/2030870609 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2f100ce070 con 0x7f2f201017c0 2023-10-05T15:37:23.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2f080a1520 0x7f2f080a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775e3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36268/0 (socket says 172.21.15.17:36268) 2023-10-05T15:37:23.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.494+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/533561713 learned_addr learned my addr 172.21.15.17:0/533561713 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2410 0x561a775e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/533561713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2410 msgr2=0x561a775e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2410 0x561a775e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/533561713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 msgr2=0x561a775e40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775e40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/533561713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a7735fde0 con 0x561a775e2d70 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2f080a1520 0x7f2f080a39e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2f18007fd0 tx=0x7f2f18007610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.495+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775e3680 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2f14010530 tx=0x7f2f14010840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eadda4634f44189 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f0cff9700 1 -- 172.21.15.17:0/533561713 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1401c680 con 0x561a775e2d70 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f0cff9700 1 -- 172.21.15.17:0/533561713 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f14015070 con 0x561a775e2d70 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f0cff9700 1 -- 172.21.15.17:0/533561713 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1401a5e0 con 0x561a775e2d70 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 -- 172.21.15.17:0/533561713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 msgr2=0x561a775e3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775e3680 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2f14010530 tx=0x7f2f14010840 comp rx=0 tx=0).stop 2023-10-05T15:37:23.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 -- 172.21.15.17:0/533561713 shutdown_connections 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775e40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2410 0x561a775e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 --2- 172.21.15.17:0/533561713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775e3680 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.496+0000 7f2f38639b80 1 -- 172.21.15.17:0/533561713 >> 172.21.15.17:0/533561713 conn(0x561a77556260 msgr2=0x561a775dd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.497+0000 7f2f38639b80 1 -- 172.21.15.17:0/533561713 shutdown_connections 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.497+0000 7f2f38639b80 1 -- 172.21.15.17:0/533561713 wait complete. 2023-10-05T15:37:23.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.497+0000 7f2f38639b80 1 -- start start 2023-10-05T15:37:23.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.497+0000 7f2f38639b80 1 Processor -- start 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 0x561a775ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a77534e30 con 0x561a775e2410 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a774d1710 con 0x561a775e3c60 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a774d13b0 con 0x561a775e2d70 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f38639b80 10 client.0 _ll_register_callbacks cb 0x561a7732e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f1e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 0x561a775ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f1e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 0x561a775ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36282/0 (socket says 172.21.15.17:36282) 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f1e59c700 1 -- 172.21.15.17:0/1135303566 learned_addr learned my addr 172.21.15.17:0/1135303566 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:23.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.498+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f1e59c700 1 -- 172.21.15.17:0/1135303566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 msgr2=0x561a775ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f1e59c700 1 -- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 msgr2=0x561a775f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f1e59c700 1 -- 172.21.15.17:0/1135303566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1400bd90 con 0x561a775e2410 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 0x561a775ec270 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2f100cb770 tx=0x7f2f1007bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85c8a1ca56f8daf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f05ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f05ffb700 1 -- 172.21.15.17:0/1135303566 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1009b720 con 0x561a775e2410 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a775d5160 con 0x561a775e2410 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f05ffb700 1 -- 172.21.15.17:0/1135303566 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2f10078320 con 0x561a775e2410 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f05ffb700 1 -- 172.21.15.17:0/1135303566 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f1009b020 con 0x561a775e2410 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f38639b80 10 client.15777 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:23.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.499+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561a77348c60 con 0x561a775e2410 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f05ffb700 1 -- 172.21.15.17:0/1135303566 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f100b2080 con 0x561a775e2410 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f05ffb700 1 -- 172.21.15.17:0/1135303566 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2f1009b3a0 con 0x561a775e2410 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f38639b80 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f38639b80 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f38639b80 20 client.15777 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f38639b80 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a775f7cd0 0x561a775fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f38639b80 4 client.15777 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a7752de10 con 0x561a775f7cd0 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.500+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a775f7cd0 0x561a775fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.501+0000 7f2f05ffb700 10 client.15777 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:23.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.501+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a775f7cd0 0x561a775fa0f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d053bddf1273dc6 server_cookie=9771a1dbecaec47b in_seq=0 out_seq=0 2023-10-05T15:37:23.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.501+0000 7f2f05ffb700 1 -- 172.21.15.17:0/1135303566 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a7752de10 con 0x561a775f7cd0 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.501+0000 7f2f05ffb700 10 client.15777 handle_command_reply: tid=0 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 client.15777 shutdown 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 msgr2=0x561a775ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 0x561a775ec270 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2f100cb770 tx=0x7f2f1007bf10 comp rx=0 tx=0).stop 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 shutdown_connections 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a775f7cd0 0x561a775fa0f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e3c60 0x561a775f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2410 0x561a775ec270 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 --2- 172.21.15.17:0/1135303566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f05ffb700 0 client.15777 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 >> 172.21.15.17:0/1135303566 conn(0x561a77556260 msgr2=0x561a775dd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 shutdown_connections 2023-10-05T15:37:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 1 -- 172.21.15.17:0/1135303566 wait complete. 2023-10-05T15:37:23.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.502+0000 7f2f38639b80 20 client.15777 trim_cache size 0 max 16384 2023-10-05T15:37:23.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.522+0000 7f2f38639b80 1 Processor -- start 2023-10-05T15:37:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.522+0000 7f2f38639b80 1 -- start start 2023-10-05T15:37:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.522+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775f3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e3c60 0x561a775ea380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f38639b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a773b5920 con 0x561a775e2d70 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f38639b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a775de070 con 0x561a775e2410 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f38639b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a775f7af0 con 0x561a775e3c60 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36284/0 (socket says 172.21.15.17:36284) 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/331425350 learned_addr learned my addr 172.21.15.17:0/331425350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:23.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e3c60 0x561a775ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/331425350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e3c60 msgr2=0x561a775ea380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e3c60 0x561a775ea380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/331425350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 msgr2=0x561a775e9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775e9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.523+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/331425350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a77386250 con 0x561a775e2d70 2023-10-05T15:37:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.524+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775f3780 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f14010530 tx=0x7f2f1400bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df59dd858c6d10f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.524+0000 7f2f0d7fa700 1 -- 172.21.15.17:0/331425350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14023040 con 0x561a775e2d70 2023-10-05T15:37:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.524+0000 7f2f0d7fa700 1 -- 172.21.15.17:0/331425350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f14011440 con 0x561a775e2d70 2023-10-05T15:37:23.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.524+0000 7f2f0d7fa700 1 -- 172.21.15.17:0/331425350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14027730 con 0x561a775e2d70 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 -- 172.21.15.17:0/331425350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 msgr2=0x561a775f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775f3780 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f14010530 tx=0x7f2f1400bcf0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 -- 172.21.15.17:0/331425350 shutdown_connections 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e3c60 0x561a775ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 --2- 172.21.15.17:0/331425350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e2d70 0x561a775f3780 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 -- 172.21.15.17:0/331425350 >> 172.21.15.17:0/331425350 conn(0x561a77556260 msgr2=0x561a775f4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 -- 172.21.15.17:0/331425350 shutdown_connections 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.525+0000 7f2f38639b80 1 -- 172.21.15.17:0/331425350 wait complete. 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 -- start start 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 Processor -- start 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775f3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e3c60 0x561a775f2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a775f25d0 con 0x561a775e3c60 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a775f2710 con 0x561a775e2410 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.526+0000 7f2f38639b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a775f28d0 con 0x561a775e2d70 2023-10-05T15:37:23.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f38639b80 10 client.0 _ll_register_callbacks cb 0x7f2f1009a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53664/0 (socket says 172.21.15.17:53664) 2023-10-05T15:37:23.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e3c60 0x561a775f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/2369824848 learned_addr learned my addr 172.21.15.17:0/2369824848 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 msgr2=0x561a775f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/2369824848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e3c60 msgr2=0x561a775f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e3c60 0x561a775f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1dd9b700 1 -- 172.21.15.17:0/2369824848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a7735fde0 con 0x561a775e2d70 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.527+0000 7f2f1ed9d700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e3c60 0x561a775f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.528+0000 7f2f1dd9b700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775f1b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400b4f0 tx=0x7f2f140276d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a4a34dc32b9784 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.528+0000 7f2f05ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:23.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.528+0000 7f2f05ffb700 1 -- 172.21.15.17:0/2369824848 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14036070 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.528+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f14015070 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.528+0000 7f2f05ffb700 1 -- 172.21.15.17:0/2369824848 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2f14017070 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.528+0000 7f2f05ffb700 1 -- 172.21.15.17:0/2369824848 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f14023040 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 10 client.25567 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561a7735e2b0 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f05ffb700 1 -- 172.21.15.17:0/2369824848 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f14015070 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f05ffb700 1 -- 172.21.15.17:0/2369824848 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2f14039020 con 0x561a775e2d70 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 10 client.25567 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 10 client.25567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 20 client.25567 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a7764d050 0x561a7764f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 4 client.25567 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:37:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.529+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561a7752db30 con 0x561a7764d050 2023-10-05T15:37:23.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.530+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a7764d050 0x561a7764f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.530+0000 7f2f05ffb700 10 client.25567 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.530+0000 7f2f1e59c700 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a7764d050 0x561a7764f470 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2436d02a86f57a server_cookie=f1476acb4a4ecaf4 in_seq=0 out_seq=0 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f05ffb700 1 -- 172.21.15.17:0/2369824848 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561a7752db30 con 0x561a7764d050 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f05ffb700 10 client.25567 handle_command_reply: tid=0 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 client.25567 shutdown 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 msgr2=0x561a775f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775f1b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400b4f0 tx=0x7f2f140276d0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 shutdown_connections 2023-10-05T15:37:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561a7764d050 0x561a7764f470 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a775e3c60 0x561a775f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561a775e2410 0x561a775f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 --2- 172.21.15.17:0/2369824848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a775e2d70 0x561a775f1b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f05ffb700 0 client.25567 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 >> 172.21.15.17:0/2369824848 conn(0x561a77556260 msgr2=0x561a775e9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 shutdown_connections 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.531+0000 7f2f38639b80 1 -- 172.21.15.17:0/2369824848 wait complete. 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.532+0000 7f2f38639b80 20 client.25567 trim_cache size 0 max 16384 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:37:23.536 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-10-05T15:37:23.537 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-10-05T15:37:23.537 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:37:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.533+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2f080a1520 msgr2=0x7f2f080a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.533+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2f080a1520 0x7f2f080a39e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2f18007fd0 tx=0x7f2f18007610 comp rx=0 tx=0).stop 2023-10-05T15:37:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.533+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 msgr2=0x7f2f20196880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.533+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 0x7f2f20196880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005910 tx=0x7f2f10004730 comp rx=0 tx=0).stop 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 shutdown_connections 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2f080a1520 0x7f2f080a39e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f20106a20 0x7f2f2019de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f201017c0 0x7f2f20196880 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 --2- 172.21.15.17:0/2030870609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f201040f0 0x7f2f20196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 >> 172.21.15.17:0/2030870609 conn(0x7f2f200fb190 msgr2=0x7f2f20102430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 shutdown_connections 2023-10-05T15:37:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.534+0000 7f2f1f59e700 1 -- 172.21.15.17:0/2030870609 wait complete. 2023-10-05T15:37:23.555 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-05T15:37:23.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:37:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 -- 172.21.15.17:0/3847701984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 msgr2=0x7f7208104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 --2- 172.21.15.17:0/3847701984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208104760 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0099c0 tx=0x7f71fc009cd0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 -- 172.21.15.17:0/3847701984 shutdown_connections 2023-10-05T15:37:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 --2- 172.21.15.17:0/3847701984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 0x7f720810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 --2- 172.21.15.17:0/3847701984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7208103110 0x7f7208103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 --2- 172.21.15.17:0/3847701984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208104760 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 -- 172.21.15.17:0/3847701984 >> 172.21.15.17:0/3847701984 conn(0x7f72080fe660 msgr2=0x7f7208100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.800+0000 7f720cfff700 1 -- 172.21.15.17:0/3847701984 shutdown_connections 2023-10-05T15:37:23.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.801+0000 7f720cfff700 1 -- 172.21.15.17:0/3847701984 wait complete. 2023-10-05T15:37:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 Processor -- start 2023-10-05T15:37:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 -- start start 2023-10-05T15:37:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7208103110 0x7f7208198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 0x7f72081a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081a0830 con 0x7f7208104300 2023-10-05T15:37:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081a09a0 con 0x7f7208104ca0 2023-10-05T15:37:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.802+0000 7f720cfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081a0b60 con 0x7f7208103110 2023-10-05T15:37:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7205d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f720659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7208103110 0x7f7208198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7205d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36312/0 (socket says 172.21.15.17:36312) 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7205d9b700 1 -- 172.21.15.17:0/2727161620 learned_addr learned my addr 172.21.15.17:0/2727161620 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 0x7f72081a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 -- 172.21.15.17:0/2727161620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7208103110 msgr2=0x7f7208198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7208103110 0x7f7208198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 -- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 msgr2=0x7f7208199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 -- 172.21.15.17:0/2727161620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc0095f0 con 0x7f7208104ca0 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.803+0000 7f7206d9d700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 0x7f72081a0260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f720000efc0 tx=0x7f720000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.804+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200018070 con 0x7f7208104ca0 2023-10-05T15:37:23.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.804+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72081a0de0 con 0x7f7208104ca0 2023-10-05T15:37:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.804+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f720000f040 con 0x7f7208104ca0 2023-10-05T15:37:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.804+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000cba0 con 0x7f7208104ca0 2023-10-05T15:37:23.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.804+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72081a1210 con 0x7f7208104ca0 2023-10-05T15:37:23.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.806+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720810a690 con 0x7f7208104ca0 2023-10-05T15:37:23.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.808+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7200003a00 con 0x7f7208104ca0 2023-10-05T15:37:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.810+0000 7f71f77fe700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71f00a14d0 0x7f71f00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:23.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.810+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f72000ccc00 con 0x7f7208104ca0 2023-10-05T15:37:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.810+0000 7f720659c700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71f00a14d0 0x7f71f00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:23.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.811+0000 7f720659c700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71f00a14d0 0x7f71f00a3990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7208199b90 tx=0x7f71f800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:23.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:23.814+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7200095ef0 con 0x7f7208104ca0 2023-10-05T15:37:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:23 smithi017 ceph-mon[129107]: pgmap v393: 129 pgs: 129 active+clean; 48 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.2 MiB/s wr, 156 op/s 2023-10-05T15:37:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:23 smithi167 ceph-mon[133366]: pgmap v393: 129 pgs: 129 active+clean; 48 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.2 MiB/s wr, 156 op/s 2023-10-05T15:37:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:23 smithi079 ceph-mon[132936]: pgmap v393: 129 pgs: 129 active+clean; 48 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 1.2 MiB/s wr, 156 op/s 2023-10-05T15:37:24.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.132+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f720802d1c0 con 0x7f7208104ca0 2023-10-05T15:37:24.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.133+0000 7f71f77fe700 1 -- 172.21.15.17:0/2727161620 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f7200099510 con 0x7f7208104ca0 2023-10-05T15:37:24.135 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:24.135 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:35:01.582968+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:37:24.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71f00a14d0 msgr2=0x7f71f00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71f00a14d0 0x7f71f00a3990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7208199b90 tx=0x7f71f800b410 comp rx=0 tx=0).stop 2023-10-05T15:37:24.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 msgr2=0x7f72081a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 0x7f72081a0260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f720000efc0 tx=0x7f720000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 shutdown_connections 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71f00a14d0 0x7f71f00a3990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7208104ca0 0x7f72081a0260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7208103110 0x7f7208198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 --2- 172.21.15.17:0/2727161620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7208104300 0x7f7208199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.136+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 >> 172.21.15.17:0/2727161620 conn(0x7f72080fe660 msgr2=0x7f72081077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.137+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 shutdown_connections 2023-10-05T15:37:24.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.137+0000 7f720cfff700 1 -- 172.21.15.17:0/2727161620 wait complete. 2023-10-05T15:37:24.140 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2023-10-05T15:37:24.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-05T15:37:24.333 INFO:teuthology.orchestra.run.smithi017.stderr:200000 of 3200000 tuples (6%) done (elapsed 2.69 s, remaining 40.36 s) 2023-10-05T15:37:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 -- 172.21.15.17:0/1324794424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081017c0 msgr2=0x7fa308103bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 --2- 172.21.15.17:0/1324794424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081017c0 0x7fa308103bb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009990 tx=0x7fa2f8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 -- 172.21.15.17:0/1324794424 shutdown_connections 2023-10-05T15:37:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 --2- 172.21.15.17:0/1324794424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa308106a20 0x7fa308108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 --2- 172.21.15.17:0/1324794424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081017c0 0x7fa308103bb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 --2- 172.21.15.17:0/1324794424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081040f0 0x7fa3081064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 -- 172.21.15.17:0/1324794424 >> 172.21.15.17:0/1324794424 conn(0x7fa3080fb190 msgr2=0x7fa3080fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 -- 172.21.15.17:0/1324794424 shutdown_connections 2023-10-05T15:37:24.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.395+0000 7fa30c99d700 1 -- 172.21.15.17:0/1324794424 wait complete. 2023-10-05T15:37:24.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.396+0000 7fa30c99d700 1 Processor -- start 2023-10-05T15:37:24.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 -- start start 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 0x7fa308196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081040f0 0x7fa308196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa308106a20 0x7fa30819ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30819e390 con 0x7fa3081040f0 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30819e4d0 con 0x7fa3081017c0 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa30c99d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30819e660 con 0x7fa308106a20 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa306ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081040f0 0x7fa308196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 0x7fa308196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa306ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081040f0 0x7fa308196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49944/0 (socket says 172.21.15.17:49944) 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 0x7fa308196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51798/0 (socket says 172.21.15.17:51798) 2023-10-05T15:37:24.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa306ffd700 1 -- 172.21.15.17:0/3936548277 learned_addr learned my addr 172.21.15.17:0/3936548277 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.397+0000 7fa307fff700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa308106a20 0x7fa30819ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa3077fe700 1 -- 172.21.15.17:0/3936548277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa308106a20 msgr2=0x7fa30819ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa3077fe700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa308106a20 0x7fa30819ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa3077fe700 1 -- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081040f0 msgr2=0x7fa308196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa3077fe700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081040f0 0x7fa308196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa3077fe700 1 -- 172.21.15.17:0/3936548277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80095f0 con 0x7fa3081017c0 2023-10-05T15:37:24.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa3077fe700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 0x7fa308196810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80098e0 tx=0x7fa2f8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa304ff9700 1 -- 172.21.15.17:0/3936548277 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f801d070 con 0x7fa3081017c0 2023-10-05T15:37:24.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa304ff9700 1 -- 172.21.15.17:0/3936548277 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2f800be30 con 0x7fa3081017c0 2023-10-05T15:37:24.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.398+0000 7fa304ff9700 1 -- 172.21.15.17:0/3936548277 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8022e40 con 0x7fa3081017c0 2023-10-05T15:37:24.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.399+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30819e8e0 con 0x7fa3081017c0 2023-10-05T15:37:24.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.399+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30819ecb0 con 0x7fa3081017c0 2023-10-05T15:37:24.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.402+0000 7fa304ff9700 1 -- 172.21.15.17:0/3936548277 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa2f8022600 con 0x7fa3081017c0 2023-10-05T15:37:24.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.404+0000 7fa304ff9700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2f00a1520 0x7fa2f00a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.404+0000 7fa304ff9700 1 -- 172.21.15.17:0/3936548277 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa2f80ce680 con 0x7fa3081017c0 2023-10-05T15:37:24.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.404+0000 7fa306ffd700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2f00a1520 0x7fa2f00a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 Processor -- start 2023-10-05T15:37:24.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa306ffd700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2f00a1520 0x7fa2f00a39e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009d20 tx=0x7fa2fc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 -- start start 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb64222c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64223180 0x55bb64223a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64224070 0x55bb642244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64186460 con 0x55bb64222820 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64177c20 con 0x55bb64223180 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa32148fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64175540 con 0x55bb64224070 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb64222c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb64222c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49948/0 (socket says 172.21.15.17:49948) 2023-10-05T15:37:24.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.405+0000 7fa3077fe700 1 -- 172.21.15.17:0/608232683 learned_addr learned my addr 172.21.15.17:0/608232683 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa306ffd700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64223180 0x55bb64223a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa307fff700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64224070 0x55bb642244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa3077fe700 1 -- 172.21.15.17:0/608232683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64224070 msgr2=0x55bb642244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa3077fe700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64224070 0x55bb642244f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa3077fe700 1 -- 172.21.15.17:0/608232683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64223180 msgr2=0x55bb64223a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa3077fe700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64223180 0x55bb64223a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa3077fe700 1 -- 172.21.15.17:0/608232683 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb63f9bde0 con 0x55bb64222820 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa306ffd700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64223180 0x55bb64223a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:24.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa307fff700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64224070 0x55bb642244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa3077fe700 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb64222c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8097b30 tx=0x7fa2f809b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ff706d88614f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa2edffb700 1 -- 172.21.15.17:0/608232683 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8086110 con 0x55bb64222820 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa2edffb700 1 -- 172.21.15.17:0/608232683 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2f809bd30 con 0x55bb64222820 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.406+0000 7fa2edffb700 1 -- 172.21.15.17:0/608232683 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f809ab20 con 0x55bb64222820 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 -- 172.21.15.17:0/608232683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 msgr2=0x55bb64222c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb64222c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8097b30 tx=0x7fa2f809b480 comp rx=0 tx=0).stop 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 -- 172.21.15.17:0/608232683 shutdown_connections 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64224070 0x55bb642244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb64222c40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 --2- 172.21.15.17:0/608232683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64223180 0x55bb64223a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 -- 172.21.15.17:0/608232683 >> 172.21.15.17:0/608232683 conn(0x55bb64192260 msgr2=0x55bb642192e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 -- 172.21.15.17:0/608232683 shutdown_connections 2023-10-05T15:37:24.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.407+0000 7fa32148fb80 1 -- 172.21.15.17:0/608232683 wait complete. 2023-10-05T15:37:24.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.408+0000 7fa32148fb80 1 -- start start 2023-10-05T15:37:24.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.408+0000 7fa32148fb80 1 Processor -- start 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642338b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64170e30 con 0x55bb64222820 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6410d710 con 0x55bb64224070 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6410d3b0 con 0x55bb64223180 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa32148fb80 10 client.0 _ll_register_callbacks cb 0x55bb63f6a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49952/0 (socket says 172.21.15.17:49952) 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 -- 172.21.15.17:0/4024669074 learned_addr learned my addr 172.21.15.17:0/4024669074 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa306ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa307fff700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 -- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 msgr2=0x55bb6422c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 -- 172.21.15.17:0/4024669074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 msgr2=0x55bb642338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa3077fe700 1 -- 172.21.15.17:0/4024669074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30819ecb0 con 0x55bb64222820 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.409+0000 7fa307fff700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa3077fe700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422c330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80980a0 tx=0x7fa2f8005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619b119910d60d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa2e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/4024669074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80a36a0 con 0x55bb64222820 2023-10-05T15:37:24.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/4024669074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa2f809f780 con 0x55bb64222820 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb64211160 con 0x55bb64222820 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/4024669074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f800b9a0 con 0x55bb64222820 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa32148fb80 10 client.15801 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bb63f84c60 con 0x55bb64222820 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.410+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/4024669074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb64211160 con 0x55bb64222820 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/4024669074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2f80b9aa0 con 0x55bb64222820 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa32148fb80 10 client.15801 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa32148fb80 10 client.15801 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa32148fb80 20 client.15801 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa32148fb80 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64237b80 0x55bb64239f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa32148fb80 4 client.15801 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.411+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb64169e10 con 0x55bb64237b80 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.412+0000 7fa306ffd700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64237b80 0x55bb64239f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.412+0000 7fa306ffd700 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64237b80 0x55bb64239f70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1c041f0ab513f892 server_cookie=4889db1c82fa3cbe in_seq=0 out_seq=0 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.412+0000 7fa2e6ffd700 10 client.15801 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/4024669074 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bb64169e10 con 0x55bb64237b80 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa2e6ffd700 10 client.15801 handle_command_reply: tid=0 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 client.15801 shutdown 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 msgr2=0x55bb6422c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422c330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80980a0 tx=0x7fa2f8005a90 comp rx=0 tx=0).stop 2023-10-05T15:37:24.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 shutdown_connections 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64237b80 0x55bb64239f70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422c330 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 --2- 172.21.15.17:0/4024669074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa2e6ffd700 0 client.15801 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.413+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 >> 172.21.15.17:0/4024669074 conn(0x55bb64192260 msgr2=0x55bb64219130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.414+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 shutdown_connections 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.414+0000 7fa32148fb80 1 -- 172.21.15.17:0/4024669074 wait complete. 2023-10-05T15:37:24.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.414+0000 7fa32148fb80 20 client.15801 trim_cache size 0 max 16384 2023-10-05T15:37:24.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 Processor -- start 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 -- start start 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64222820 0x55bb6421a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 0x55bb6422b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb63ff1920 con 0x55bb64223180 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64223880 con 0x55bb64224070 2023-10-05T15:37:24.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa32148fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64227b50 con 0x55bb64222820 2023-10-05T15:37:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa306ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 0x55bb6422b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa306ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 0x55bb6422b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49964/0 (socket says 172.21.15.17:49964) 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.430+0000 7fa306ffd700 1 -- 172.21.15.17:0/116127741 learned_addr learned my addr 172.21.15.17:0/116127741 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa307fff700 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa3077fe700 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64222820 0x55bb6421a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa306ffd700 1 -- 172.21.15.17:0/116127741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64222820 msgr2=0x55bb6421a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa306ffd700 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64222820 0x55bb6421a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa306ffd700 1 -- 172.21.15.17:0/116127741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 msgr2=0x55bb642190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa306ffd700 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa306ffd700 1 -- 172.21.15.17:0/116127741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb63fc2250 con 0x55bb64223180 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa3077fe700 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64222820 0x55bb6421a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:24.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa306ffd700 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 0x55bb6422b000 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc013010 tx=0x7fa2fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667c9b51638109c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.431+0000 7fa2ee7fc700 1 -- 172.21.15.17:0/116127741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc023040 con 0x55bb64223180 2023-10-05T15:37:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa2ee7fc700 1 -- 172.21.15.17:0/116127741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2fc029d50 con 0x55bb64223180 2023-10-05T15:37:24.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa2ee7fc700 1 -- 172.21.15.17:0/116127741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc01c660 con 0x55bb64223180 2023-10-05T15:37:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 -- 172.21.15.17:0/116127741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 msgr2=0x55bb6422b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 0x55bb6422b000 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc013010 tx=0x7fa2fc017000 comp rx=0 tx=0).stop 2023-10-05T15:37:24.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 -- 172.21.15.17:0/116127741 shutdown_connections 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb642190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64222820 0x55bb6421a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 --2- 172.21.15.17:0/116127741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64223180 0x55bb6422b000 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.432+0000 7fa32148fb80 1 -- 172.21.15.17:0/116127741 >> 172.21.15.17:0/116127741 conn(0x55bb64192260 msgr2=0x55bb64218880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.433+0000 7fa32148fb80 1 -- 172.21.15.17:0/116127741 shutdown_connections 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.433+0000 7fa32148fb80 1 -- 172.21.15.17:0/116127741 wait complete. 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.433+0000 7fa32148fb80 1 -- start start 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.433+0000 7fa32148fb80 1 Processor -- start 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb64232900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64232e70 con 0x55bb64222820 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb64232fe0 con 0x55bb64224070 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb642331a0 con 0x55bb64223180 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa32148fb80 10 client.0 _ll_register_callbacks cb 0x7fa2f8097a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa3077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49978/0 (socket says 172.21.15.17:49978) 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa3077fe700 1 -- 172.21.15.17:0/855731543 learned_addr learned my addr 172.21.15.17:0/855731543 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa307fff700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb64232900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.434+0000 7fa306ffd700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa3077fe700 1 -- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 msgr2=0x55bb6422e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa3077fe700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa3077fe700 1 -- 172.21.15.17:0/855731543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 msgr2=0x55bb64232900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa3077fe700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb64232900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa3077fe700 1 -- 172.21.15.17:0/855731543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc017070 con 0x55bb64222820 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa3077fe700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422da90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8097b30 tx=0x7fa2f8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28526f03d6f249 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa2e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/855731543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8022470 con 0x55bb64222820 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/855731543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa2f80a3930 con 0x55bb64222820 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2f809bd30 con 0x55bb64222820 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/855731543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f8099ab0 con 0x55bb64222820 2023-10-05T15:37:24.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa32148fb80 10 client.15807 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.435+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bb63f9a2b0 con 0x55bb64222820 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/855731543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2f809bd30 con 0x55bb64222820 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/855731543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2f8097590 con 0x55bb64222820 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa32148fb80 10 client.15807 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa32148fb80 10 client.15807 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa32148fb80 20 client.15807 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa32148fb80 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64290810 0x55bb64292c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa32148fb80 4 client.15807 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:24.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.436+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bb64169b30 con 0x55bb64290810 2023-10-05T15:37:24.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa306ffd700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64290810 0x55bb64292c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa306ffd700 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64290810 0x55bb64292c00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=955ca79f169135b6 server_cookie=a5b0363810b10b55 in_seq=0 out_seq=0 2023-10-05T15:37:24.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa2e6ffd700 10 client.15807 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:24.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa2e6ffd700 1 -- 172.21.15.17:0/855731543 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bb64169b30 con 0x55bb64290810 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa2e6ffd700 10 client.15807 handle_command_reply: tid=0 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa32148fb80 1 client.15807 shutdown 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.437+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 msgr2=0x55bb6422da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422da90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8097b30 tx=0x7fa2f8005b00 comp rx=0 tx=0).stop 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 shutdown_connections 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bb64224070 0x55bb64232900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55bb64290810 0x55bb64292c00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bb64222820 0x55bb6422da90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 --2- 172.21.15.17:0/855731543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb64223180 0x55bb6422e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa2e6ffd700 0 client.15807 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 >> 172.21.15.17:0/855731543 conn(0x55bb64192260 msgr2=0x55bb6422b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 shutdown_connections 2023-10-05T15:37:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 1 -- 172.21.15.17:0/855731543 wait complete. 2023-10-05T15:37:24.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.438+0000 7fa32148fb80 20 client.15807 trim_cache size 0 max 16384 2023-10-05T15:37:24.444 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2f00a1520 msgr2=0x7fa2f00a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2f00a1520 0x7fa2f00a39e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009d20 tx=0x7fa2fc009260 comp rx=0 tx=0).stop 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 msgr2=0x7fa308196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 0x7fa308196810 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80098e0 tx=0x7fa2f8004730 comp rx=0 tx=0).stop 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 shutdown_connections 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2f00a1520 0x7fa2f00a39e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa308106a20 0x7fa30819ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3081017c0 0x7fa308196810 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 --2- 172.21.15.17:0/3936548277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3081040f0 0x7fa308196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 >> 172.21.15.17:0/3936548277 conn(0x7fa3080fb190 msgr2=0x7fa308102430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 shutdown_connections 2023-10-05T15:37:24.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.439+0000 7fa30c99d700 1 -- 172.21.15.17:0/3936548277 wait complete. 2023-10-05T15:37:24.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 -- 172.21.15.17:0/666733361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918102a40 msgr2=0x7f6918109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 --2- 172.21.15.17:0/666733361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918102a40 0x7f6918109360 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6910009f90 tx=0x7f691000b330 comp rx=0 tx=0).stop 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 -- 172.21.15.17:0/666733361 shutdown_connections 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 --2- 172.21.15.17:0/666733361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918102a40 0x7f6918109360 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 --2- 172.21.15.17:0/666733361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918100ea0 0x7f69181012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 --2- 172.21.15.17:0/666733361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6918102080 0x7f6918102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 -- 172.21.15.17:0/666733361 >> 172.21.15.17:0/666733361 conn(0x7f69180fc460 msgr2=0x7f69180fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.693+0000 7f691fbff700 1 -- 172.21.15.17:0/666733361 shutdown_connections 2023-10-05T15:37:24.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.694+0000 7f691fbff700 1 -- 172.21.15.17:0/666733361 wait complete. 2023-10-05T15:37:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.695+0000 7f691fbff700 1 Processor -- start 2023-10-05T15:37:24.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 -- start start 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918100ea0 0x7f691819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6918102080 0x7f691819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 0x7f69181a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181a4da0 con 0x7f6918100ea0 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181a4ee0 con 0x7f6918102a40 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.696+0000 7f691fbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181a5070 con 0x7f6918102080 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 0x7f69181a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 0x7f69181a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51832/0 (socket says 172.21.15.17:51832) 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 -- 172.21.15.17:0/1074878237 learned_addr learned my addr 172.21.15.17:0/1074878237 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691d99b700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918100ea0 0x7f691819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691d19a700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6918102080 0x7f691819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 -- 172.21.15.17:0/1074878237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6918102080 msgr2=0x7f691819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6918102080 0x7f691819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 -- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918100ea0 msgr2=0x7f691819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918100ea0 0x7f691819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 -- 172.21.15.17:0/1074878237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6910009c40 con 0x7f6918102a40 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.697+0000 7f691e19c700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 0x7f69181a47d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6910007890 tx=0x7f6910008c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.698+0000 7f690effd700 1 -- 172.21.15.17:0/1074878237 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000e040 con 0x7f6918102a40 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.698+0000 7f690effd700 1 -- 172.21.15.17:0/1074878237 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691000be00 con 0x7f6918102a40 2023-10-05T15:37:24.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.698+0000 7f690effd700 1 -- 172.21.15.17:0/1074878237 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100052a0 con 0x7f6918102a40 2023-10-05T15:37:24.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.698+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69181a52f0 con 0x7f6918102a40 2023-10-05T15:37:24.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.698+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69181a5720 con 0x7f6918102a40 2023-10-05T15:37:24.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.702+0000 7f690effd700 1 -- 172.21.15.17:0/1074878237 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f691001d470 con 0x7f6918102a40 2023-10-05T15:37:24.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.704+0000 7f690effd700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69040a1500 0x7f69040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.704+0000 7f690effd700 1 -- 172.21.15.17:0/1074878237 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f69100ce3f0 con 0x7f6918102a40 2023-10-05T15:37:24.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.704+0000 7f691d99b700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69040a1500 0x7f69040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.704+0000 7f6933472b80 1 Processor -- start 2023-10-05T15:37:24.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.704+0000 7f6933472b80 1 -- start start 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f6933472b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f6933472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81bc0 0x55a722a82480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f6933472b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a82a60 0x55a722a82ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f6933472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7229e9460 con 0x55a722a81bc0 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f6933472b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7229dac20 con 0x55a722a81260 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f6933472b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7229d8540 con 0x55a722a82a60 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69040a1500 0x7f69040a39c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6918101bf0 tx=0x7f6914009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a81680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51840/0 (socket says 172.21.15.17:51840) 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691e19c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a82a60 0x55a722a82ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 -- 172.21.15.17:0/2339780679 learned_addr learned my addr 172.21.15.17:0/2339780679 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d19a700 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81bc0 0x55a722a82480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 -- 172.21.15.17:0/2339780679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a82a60 msgr2=0x55a722a82ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a82a60 0x55a722a82ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 -- 172.21.15.17:0/2339780679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81bc0 msgr2=0x55a722a82480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81bc0 0x55a722a82480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.705+0000 7f691d99b700 1 -- 172.21.15.17:0/2339780679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7227fede0 con 0x55a722a81260 2023-10-05T15:37:24.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.706+0000 7f691d99b700 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a81680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f691400e4b0 tx=0x7f6914014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498e8974b38bab39 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.706+0000 7f6903fff700 1 -- 172.21.15.17:0/2339780679 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400ee50 con 0x55a722a81260 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.706+0000 7f6903fff700 1 -- 172.21.15.17:0/2339780679 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6914021070 con 0x55a722a81260 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.706+0000 7f6903fff700 1 -- 172.21.15.17:0/2339780679 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140257b0 con 0x55a722a81260 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 -- 172.21.15.17:0/2339780679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 msgr2=0x55a722a81680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a81680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f691400e4b0 tx=0x7f6914014000 comp rx=0 tx=0).stop 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 -- 172.21.15.17:0/2339780679 shutdown_connections 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a82a60 0x55a722a82ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a81680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 --2- 172.21.15.17:0/2339780679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81bc0 0x55a722a82480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 -- 172.21.15.17:0/2339780679 >> 172.21.15.17:0/2339780679 conn(0x55a7229f5260 msgr2=0x55a722a7c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 -- 172.21.15.17:0/2339780679 shutdown_connections 2023-10-05T15:37:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.707+0000 7f6933472b80 1 -- 172.21.15.17:0/2339780679 wait complete. 2023-10-05T15:37:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.708+0000 7f6933472b80 1 -- start start 2023-10-05T15:37:24.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.708+0000 7f6933472b80 1 Processor -- start 2023-10-05T15:37:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a8b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a8b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7229d3e30 con 0x55a722a82a60 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722970710 con 0x55a722a81260 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7229703b0 con 0x55a722a81bc0 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f6933472b80 10 client.0 _ll_register_callbacks cb 0x55a7227cd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f691e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f691d99b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a8b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f691e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a925e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50030/0 (socket says 172.21.15.17:50030) 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f691d99b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a8b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51856/0 (socket says 172.21.15.17:51856) 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f691e19c700 1 -- 172.21.15.17:0/1046745352 learned_addr learned my addr 172.21.15.17:0/1046745352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.709+0000 7f691d19a700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a8b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d99b700 1 -- 172.21.15.17:0/1046745352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 msgr2=0x55a722a8b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d99b700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a8b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d99b700 1 -- 172.21.15.17:0/1046745352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 msgr2=0x55a722a925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d99b700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d99b700 1 -- 172.21.15.17:0/1046745352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6914017070 con 0x55a722a81260 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d19a700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a8b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f691d99b700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a8b060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f691400e4b0 tx=0x7f6914009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d74c6c0757627e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f69017fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f69017fa700 1 -- 172.21.15.17:0/1046745352 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400edd0 con 0x55a722a81260 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a722a73f10 con 0x55a722a81260 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.710+0000 7f69017fa700 1 -- 172.21.15.17:0/1046745352 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6914005250 con 0x55a722a81260 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.711+0000 7f69017fa700 1 -- 172.21.15.17:0/1046745352 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6914005410 con 0x55a722a81260 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.711+0000 7f6933472b80 10 client.25619 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.711+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a7227e7c60 con 0x55a722a81260 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.711+0000 7f69017fa700 1 -- 172.21.15.17:0/1046745352 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a722a73f10 con 0x55a722a81260 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.711+0000 7f69017fa700 1 -- 172.21.15.17:0/1046745352 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f691401d410 con 0x55a722a81260 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f6933472b80 10 client.25619 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f6933472b80 10 client.25619 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f6933472b80 20 client.25619 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f6933472b80 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722a96cf0 0x55a722a99110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f6933472b80 4 client.25619 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7229cce10 con 0x55a722a96cf0 2023-10-05T15:37:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.712+0000 7f691d19a700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722a96cf0 0x55a722a99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.713+0000 7f691d19a700 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722a96cf0 0x55a722a99110 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45d0d3448a7a6d83 server_cookie=dd82d9e07d545019 in_seq=0 out_seq=0 2023-10-05T15:37:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.713+0000 7f69017fa700 10 client.25619 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.713+0000 7f69017fa700 1 -- 172.21.15.17:0/1046745352 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7229cce10 con 0x55a722a96cf0 2023-10-05T15:37:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.713+0000 7f69017fa700 10 client.25619 handle_command_reply: tid=0 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.713+0000 7f6933472b80 1 client.25619 shutdown 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 msgr2=0x55a722a8b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a8b060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f691400e4b0 tx=0x7f6914009ae0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 shutdown_connections 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722a96cf0 0x55a722a99110 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a8b060 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 --2- 172.21.15.17:0/1046745352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a8b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 >> 172.21.15.17:0/1046745352 conn(0x55a7229f5260 msgr2=0x55a722a7bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f69017fa700 0 client.25619 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 shutdown_connections 2023-10-05T15:37:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 1 -- 172.21.15.17:0/1046745352 wait complete. 2023-10-05T15:37:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.714+0000 7f6933472b80 20 client.25619 trim_cache size 0 max 16384 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.728+0000 7f6933472b80 1 Processor -- start 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.728+0000 7f6933472b80 1 -- start start 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.728+0000 7f6933472b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a89cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f6933472b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a925a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f6933472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f6933472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722854920 con 0x55a722a82a60 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f6933472b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722a96a90 con 0x55a722a81260 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f6933472b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722a86510 con 0x55a722a81bc0 2023-10-05T15:37:24.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a88e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50032/0 (socket says 172.21.15.17:50032) 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 -- 172.21.15.17:0/806678523 learned_addr learned my addr 172.21.15.17:0/806678523 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691d99b700 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a89cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691d19a700 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a925a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 -- 172.21.15.17:0/806678523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 msgr2=0x55a722a925a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a925a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 -- 172.21.15.17:0/806678523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 msgr2=0x55a722a89cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a89cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691e19c700 1 -- 172.21.15.17:0/806678523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a722825250 con 0x55a722a82a60 2023-10-05T15:37:24.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.729+0000 7f691d99b700 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a89cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:24.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.730+0000 7f691e19c700 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a88e70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6910009790 tx=0x7f691000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97b0c2a54ceb35b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.730+0000 7f690cbff700 1 -- 172.21.15.17:0/806678523 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691009af40 con 0x55a722a82a60 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.730+0000 7f690cbff700 1 -- 172.21.15.17:0/806678523 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691009ad60 con 0x55a722a82a60 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.730+0000 7f690cbff700 1 -- 172.21.15.17:0/806678523 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100997a0 con 0x55a722a82a60 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 -- 172.21.15.17:0/806678523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 msgr2=0x55a722a88e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a88e70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6910009790 tx=0x7f691000b330 comp rx=0 tx=0).stop 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 -- 172.21.15.17:0/806678523 shutdown_connections 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a82a60 0x55a722a88e70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a81260 0x55a722a89cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 --2- 172.21.15.17:0/806678523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a925a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 -- 172.21.15.17:0/806678523 >> 172.21.15.17:0/806678523 conn(0x55a7229f5260 msgr2=0x55a722a7abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 -- 172.21.15.17:0/806678523 shutdown_connections 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 -- 172.21.15.17:0/806678523 wait complete. 2023-10-05T15:37:24.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.731+0000 7f6933472b80 1 -- start start 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 Processor -- start 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 0x55a722a8fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a90060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a82a60 0x55a722a91070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722a915b0 con 0x55a722a81260 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722a91720 con 0x55a722a82a60 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a722a918e0 con 0x55a722a81bc0 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f6933472b80 10 client.0 _ll_register_callbacks cb 0x7f6908009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f691d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 0x55a722a8fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f691d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 0x55a722a8fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50042/0 (socket says 172.21.15.17:50042) 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.732+0000 7f691d99b700 1 -- 172.21.15.17:0/3252584799 learned_addr learned my addr 172.21.15.17:0/3252584799 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691e19c700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a82a60 0x55a722a91070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d19a700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a90060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d99b700 1 -- 172.21.15.17:0/3252584799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 msgr2=0x55a722a90060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d99b700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a90060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d99b700 1 -- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a82a60 msgr2=0x55a722a91070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d99b700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a82a60 0x55a722a91070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d99b700 1 -- 172.21.15.17:0/3252584799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7227e7c60 con 0x55a722a81260 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d19a700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a90060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:24.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691e19c700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a82a60 0x55a722a91070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f691d99b700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 0x55a722a8fb20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6914000c00 tx=0x7f69140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a7ac9d03cd8c7b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.733+0000 7f69017fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f69017fa700 1 -- 172.21.15.17:0/3252584799 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691401d550 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6914021070 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f69017fa700 1 -- 172.21.15.17:0/3252584799 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f691401da30 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f69017fa700 1 -- 172.21.15.17:0/3252584799 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f691401dbf0 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f6933472b80 10 client.15825 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f69181a5720 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f69017fa700 1 -- 172.21.15.17:0/3252584799 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6914021070 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.734+0000 7f69017fa700 1 -- 172.21.15.17:0/3252584799 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6914040440 con 0x55a722a81260 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f6933472b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f6933472b80 10 client.15825 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-10-05T15:37:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f6933472b80 20 client.15825 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f6933472b80 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722aeaff0 0x55a722aed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f6933472b80 4 client.15825 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a7229ccb30 con 0x55a722aeaff0 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.735+0000 7f691d19a700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722aeaff0 0x55a722aed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f691d19a700 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722aeaff0 0x55a722aed3e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=681cc209cf9ca648 server_cookie=28bf6528b817a44d in_seq=0 out_seq=0 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f69017fa700 10 client.15825 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f69017fa700 1 -- 172.21.15.17:0/3252584799 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a7229ccb30 con 0x55a722aeaff0 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f69017fa700 10 client.15825 handle_command_reply: tid=0 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 client.15825 shutdown 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 msgr2=0x55a722a8fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 0x55a722a8fb20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6914000c00 tx=0x7f69140057f0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 shutdown_connections 2023-10-05T15:37:24.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a722a82a60 0x55a722a91070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x55a722aeaff0 0x55a722aed3e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a722a81260 0x55a722a8fb20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 --2- 172.21.15.17:0/3252584799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a722a81bc0 0x55a722a90060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 >> 172.21.15.17:0/3252584799 conn(0x55a7229f5260 msgr2=0x55a722a98d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f69017fa700 0 client.15825 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 shutdown_connections 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.736+0000 7f6933472b80 1 -- 172.21.15.17:0/3252584799 wait complete. 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f6933472b80 20 client.15825 trim_cache size 0 max 16384 2023-10-05T15:37:24.742 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69040a1500 msgr2=0x7f69040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69040a1500 0x7f69040a39c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6918101bf0 tx=0x7f6914009310 comp rx=0 tx=0).stop 2023-10-05T15:37:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 msgr2=0x7f69181a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 0x7f69181a47d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6910007890 tx=0x7f6910008c80 comp rx=0 tx=0).stop 2023-10-05T15:37:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 shutdown_connections 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69040a1500 0x7f69040a39c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6918102a40 0x7f69181a47d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6918100ea0 0x7f691819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 --2- 172.21.15.17:0/1074878237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6918102080 0x7f691819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.737+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 >> 172.21.15.17:0/1074878237 conn(0x7f69180fc460 msgr2=0x7f69180fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.738+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 shutdown_connections 2023-10-05T15:37:24.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.738+0000 7f691fbff700 1 -- 172.21.15.17:0/1074878237 wait complete. 2023-10-05T15:37:24.756 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:24 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2727161620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:37:24.759 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 -- 172.21.15.17:0/246045985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334104270 msgr2=0x7fa334106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 --2- 172.21.15.17:0/246045985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334104270 0x7fa334106660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa328009990 tx=0x7fa328009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 -- 172.21.15.17:0/246045985 shutdown_connections 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 --2- 172.21.15.17:0/246045985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa334106ba0 0x7fa334109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 --2- 172.21.15.17:0/246045985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334101940 0x7fa334103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 --2- 172.21.15.17:0/246045985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334104270 0x7fa334106660 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 -- 172.21.15.17:0/246045985 >> 172.21.15.17:0/246045985 conn(0x7fa3340fb330 msgr2=0x7fa3340fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:24.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 -- 172.21.15.17:0/246045985 shutdown_connections 2023-10-05T15:37:24.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.996+0000 7fa339fff700 1 -- 172.21.15.17:0/246045985 wait complete. 2023-10-05T15:37:24.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 Processor -- start 2023-10-05T15:37:24.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 -- start start 2023-10-05T15:37:25.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 0x7fa334198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa334104270 0x7fa334199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334106ba0 0x7fa3341a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3341a0880 con 0x7fa334101940 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3341a09f0 con 0x7fa334106ba0 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.998+0000 7fa339fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3341a0bb0 con 0x7fa334104270 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 0x7fa334198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 0x7fa334198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50050/0 (socket says 172.21.15.17:50050) 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 -- 172.21.15.17:0/3520308865 learned_addr learned my addr 172.21.15.17:0/3520308865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa333fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334106ba0 0x7fa3341a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa332ffd700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa334104270 0x7fa334199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 -- 172.21.15.17:0/3520308865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa334104270 msgr2=0x7fa334199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa334104270 0x7fa334199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 -- 172.21.15.17:0/3520308865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334106ba0 msgr2=0x7fa3341a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334106ba0 0x7fa3341a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:24.999+0000 7fa3337fe700 1 -- 172.21.15.17:0/3520308865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280095f0 con 0x7fa334101940 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.000+0000 7fa3337fe700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 0x7fa334198d40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa32400d980 tx=0x7fa32400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.000+0000 7fa330ff9700 1 -- 172.21.15.17:0/3520308865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324004220 con 0x7fa334101940 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.000+0000 7fa330ff9700 1 -- 172.21.15.17:0/3520308865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa324007640 con 0x7fa334101940 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.000+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3341a0e90 con 0x7fa334101940 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.000+0000 7fa330ff9700 1 -- 172.21.15.17:0/3520308865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324005660 con 0x7fa334101940 2023-10-05T15:37:25.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.000+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3341a12c0 con 0x7fa334101940 2023-10-05T15:37:25.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.004+0000 7fa330ff9700 1 -- 172.21.15.17:0/3520308865 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa324004750 con 0x7fa334101940 2023-10-05T15:37:25.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.006+0000 7fa34d90fb80 1 Processor -- start 2023-10-05T15:37:25.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.006+0000 7fa34d90fb80 1 -- start start 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.006+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c65680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.006+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c66480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c66ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06bcd460 con 0x564c06c66a60 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06bbec20 con 0x564c06c65bc0 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06bbc540 con 0x564c06c65260 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa330ff9700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa31c0a1500 0x7fa31c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa333fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c65680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa330ff9700 1 -- 172.21.15.17:0/3520308865 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa3240ccdf0 con 0x7fa334101940 2023-10-05T15:37:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa333fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c65680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35910/0 (socket says 172.21.15.17:35910) 2023-10-05T15:37:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa333fff700 1 -- 172.21.15.17:0/1665041325 learned_addr learned my addr 172.21.15.17:0/1665041325 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c66480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa333fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa31c0a1500 0x7fa31c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.007+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c66ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa3337fe700 1 -- 172.21.15.17:0/1665041325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 msgr2=0x564c06c65680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c65680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa3337fe700 1 -- 172.21.15.17:0/1665041325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 msgr2=0x564c06c66ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c66ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa3337fe700 1 -- 172.21.15.17:0/1665041325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c069e2de0 con 0x564c06c65bc0 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c66480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa324096780 tx=0x7fa3240998d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f251313197a85780 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa333fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa31c0a1500 0x7fa31c0a39c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa32c013f90 tx=0x7fa32c004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa319ffb700 1 -- 172.21.15.17:0/1665041325 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324004380 con 0x564c06c65bc0 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa319ffb700 1 -- 172.21.15.17:0/1665041325 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa32409a410 con 0x564c06c65bc0 2023-10-05T15:37:25.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.008+0000 7fa319ffb700 1 -- 172.21.15.17:0/1665041325 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324099200 con 0x564c06c65bc0 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1665041325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 msgr2=0x564c06c66480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c66480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa324096780 tx=0x7fa3240998d0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1665041325 shutdown_connections 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c66ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c65680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1665041325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c66480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1665041325 >> 172.21.15.17:0/1665041325 conn(0x564c06bd9260 msgr2=0x564c06c60140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1665041325 shutdown_connections 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.009+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1665041325 wait complete. 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.010+0000 7fa34d90fb80 1 -- start start 2023-10-05T15:37:25.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.010+0000 7fa34d90fb80 1 Processor -- start 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c6f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c6f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c765a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06bb7e30 con 0x564c06c66a60 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06b54710 con 0x564c06c65bc0 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06b543b0 con 0x564c06c65260 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa34d90fb80 10 client.0 _ll_register_callbacks cb 0x564c069b1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:25.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa333fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c6f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa333fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c765a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50068/0 (socket says 172.21.15.17:50068) 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa333fff700 1 -- 172.21.15.17:0/1192782816 learned_addr learned my addr 172.21.15.17:0/1192782816 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c6f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35916/0 (socket says 172.21.15.17:35916) 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.011+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c6f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa3337fe700 1 -- 172.21.15.17:0/1192782816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 msgr2=0x564c06c6f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c6f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa3337fe700 1 -- 172.21.15.17:0/1192782816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 msgr2=0x564c06c765a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c765a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa3337fe700 1 -- 172.21.15.17:0/1192782816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3341a12c0 con 0x564c06c65260 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa333fff700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c6f020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3240046a0 tx=0x7fa32409a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bfce8cfa23e2ae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa312ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa312ffd700 1 -- 172.21.15.17:0/1192782816 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324099d90 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa312ffd700 1 -- 172.21.15.17:0/1192782816 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa32409de60 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.012+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c06c57f10 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa312ffd700 1 -- 172.21.15.17:0/1192782816 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa324099410 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 10 client.25615 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564c069cbc60 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa312ffd700 1 -- 172.21.15.17:0/1192782816 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c06c57f10 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa312ffd700 1 -- 172.21.15.17:0/1192782816 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa324098c70 con 0x564c06c65260 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 10 client.25615 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 10 client.25615 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-05T15:37:25.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 20 client.25615 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06c7aa30 0x564c06c7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 4 client.25615 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.013+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c06bb0e10 con 0x564c06c7aa30 2023-10-05T15:37:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.014+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06c7aa30 0x564c06c7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.014+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06c7aa30 0x564c06c7ce20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f56aff4b31953c33 server_cookie=2da54b27c73da209 in_seq=0 out_seq=0 2023-10-05T15:37:25.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.014+0000 7fa312ffd700 10 client.25615 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.015+0000 7fa312ffd700 1 -- 172.21.15.17:0/1192782816 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564c06bb0e10 con 0x564c06c7aa30 2023-10-05T15:37:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.015+0000 7fa312ffd700 10 client.25615 handle_command_reply: tid=0 2023-10-05T15:37:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.015+0000 7fa34d90fb80 1 client.25615 shutdown 2023-10-05T15:37:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 msgr2=0x564c06c6f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c6f020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3240046a0 tx=0x7fa32409a580 comp rx=0 tx=0).stop 2023-10-05T15:37:25.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 shutdown_connections 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06c7aa30 0x564c06c7ce20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c66a60 0x564c06c765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65260 0x564c06c6f020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1192782816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65bc0 0x564c06c6f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 >> 172.21.15.17:0/1192782816 conn(0x564c06bd9260 msgr2=0x564c06c5ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa312ffd700 0 client.25615 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 shutdown_connections 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1192782816 wait complete. 2023-10-05T15:37:25.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.016+0000 7fa34d90fb80 20 client.25615 trim_cache size 0 max 16384 2023-10-05T15:37:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 Processor -- start 2023-10-05T15:37:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 -- start start 2023-10-05T15:37:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65260 0x564c06c6e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 0x564c06c76560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c66a60 0x564c06c5ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06a38920 con 0x564c06c65bc0 2023-10-05T15:37:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06bb0e10 con 0x564c06c65260 2023-10-05T15:37:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.032+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06c70210 con 0x564c06c66a60 2023-10-05T15:37:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 0x564c06c76560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 0x564c06c76560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50074/0 (socket says 172.21.15.17:50074) 2023-10-05T15:37:25.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 -- 172.21.15.17:0/412168986 learned_addr learned my addr 172.21.15.17:0/412168986 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa333fff700 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c66a60 0x564c06c5ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa3337fe700 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65260 0x564c06c6e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 -- 172.21.15.17:0/412168986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c66a60 msgr2=0x564c06c5ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c66a60 0x564c06c5ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 -- 172.21.15.17:0/412168986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65260 msgr2=0x564c06c6e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65260 0x564c06c6e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa332ffd700 1 -- 172.21.15.17:0/412168986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c06a09250 con 0x564c06c65bc0 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.033+0000 7fa3337fe700 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65260 0x564c06c6e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.034+0000 7fa332ffd700 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 0x564c06c76560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa328009990 tx=0x7fa32800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a4fd9e997a1641 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.034+0000 7fa31a7fc700 1 -- 172.21.15.17:0/412168986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32802a070 con 0x564c06c65bc0 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.034+0000 7fa31a7fc700 1 -- 172.21.15.17:0/412168986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa32801e040 con 0x564c06c65bc0 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.034+0000 7fa31a7fc700 1 -- 172.21.15.17:0/412168986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32801d040 con 0x564c06c65bc0 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 -- 172.21.15.17:0/412168986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 msgr2=0x564c06c76560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 0x564c06c76560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa328009990 tx=0x7fa32800b260 comp rx=0 tx=0).stop 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 -- 172.21.15.17:0/412168986 shutdown_connections 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c66a60 0x564c06c5ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c65260 0x564c06c6e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/412168986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65bc0 0x564c06c76560 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 -- 172.21.15.17:0/412168986 >> 172.21.15.17:0/412168986 conn(0x564c06bd9260 msgr2=0x564c06c6dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 -- 172.21.15.17:0/412168986 shutdown_connections 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 -- 172.21.15.17:0/412168986 wait complete. 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.035+0000 7fa34d90fb80 1 -- start start 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 Processor -- start 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 0x564c06c742d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65bc0 0x564c06c74810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c66a60 0x564c06c75820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06c75d60 con 0x564c06c65260 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06c75ed0 con 0x564c06c66a60 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c06c76090 con 0x564c06c65bc0 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa34d90fb80 10 client.0 _ll_register_callbacks cb 0x7fa32c0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 0x564c06c742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 0x564c06c742d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50090/0 (socket says 172.21.15.17:50090) 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.036+0000 7fa3337fe700 1 -- 172.21.15.17:0/1904507961 learned_addr learned my addr 172.21.15.17:0/1904507961 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa333fff700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c66a60 0x564c06c75820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65bc0 0x564c06c74810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa3337fe700 1 -- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65bc0 msgr2=0x564c06c74810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65bc0 0x564c06c74810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa3337fe700 1 -- 172.21.15.17:0/1904507961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c66a60 msgr2=0x564c06c75820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c66a60 0x564c06c75820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa3337fe700 1 -- 172.21.15.17:0/1904507961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c069cbc60 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa3337fe700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 0x564c06c742d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa324099a10 tx=0x7fa3240998d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3af9cce6e0416c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa312ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa312ffd700 1 -- 172.21.15.17:0/1904507961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240adcf0 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa32409a410 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.037+0000 7fa312ffd700 1 -- 172.21.15.17:0/1904507961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa324099410 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa312ffd700 1 -- 172.21.15.17:0/1904507961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3240a2110 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 10 client.15843 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa334109c00 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa312ffd700 1 -- 172.21.15.17:0/1904507961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa32409a410 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa312ffd700 1 -- 172.21.15.17:0/1904507961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa32409eba0 con 0x564c06c65260 2023-10-05T15:37:25.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 10 client.15843 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 10 client.15843 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-05T15:37:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 20 client.15843 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06ccf300 0x564c06cd1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 4 client.15843 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.038+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564c06bb0b30 con 0x564c06ccf300 2023-10-05T15:37:25.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.039+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06ccf300 0x564c06cd1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.039+0000 7fa332ffd700 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06ccf300 0x564c06cd1720 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d1320dd315a3e99 server_cookie=4c0ce3a59438d2f2 in_seq=0 out_seq=0 2023-10-05T15:37:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.039+0000 7fa312ffd700 10 client.15843 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.039+0000 7fa312ffd700 1 -- 172.21.15.17:0/1904507961 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564c06bb0b30 con 0x564c06ccf300 2023-10-05T15:37:25.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.039+0000 7fa312ffd700 10 client.15843 handle_command_reply: tid=0 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 client.15843 shutdown 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 msgr2=0x564c06c742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 0x564c06c742d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa324099a10 tx=0x7fa3240998d0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 shutdown_connections 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x564c06ccf300 0x564c06cd1720 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564c06c66a60 0x564c06c75820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c06c65260 0x564c06c742d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 --2- 172.21.15.17:0/1904507961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564c06c65bc0 0x564c06c74810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 >> 172.21.15.17:0/1904507961 conn(0x564c06bd9260 msgr2=0x564c06c6dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa312ffd700 0 client.15843 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 shutdown_connections 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 1 -- 172.21.15.17:0/1904507961 wait complete. 2023-10-05T15:37:25.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.040+0000 7fa34d90fb80 20 client.15843 trim_cache size 0 max 16384 2023-10-05T15:37:25.046 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa31c0a1500 msgr2=0x7fa31c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa31c0a1500 0x7fa31c0a39c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa32c013f90 tx=0x7fa32c004b40 comp rx=0 tx=0).stop 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 msgr2=0x7fa334198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 0x7fa334198d40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa32400d980 tx=0x7fa32400dc90 comp rx=0 tx=0).stop 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 shutdown_connections 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa31c0a1500 0x7fa31c0a39c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa334106ba0 0x7fa3341a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa334101940 0x7fa334198d40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 --2- 172.21.15.17:0/3520308865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa334104270 0x7fa334199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 >> 172.21.15.17:0/3520308865 conn(0x7fa3340fb330 msgr2=0x7fa3340fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 shutdown_connections 2023-10-05T15:37:25.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.041+0000 7fa339fff700 1 -- 172.21.15.17:0/3520308865 wait complete. 2023-10-05T15:37:25.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-05T15:37:25.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:24 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2727161620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:37:25.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:24 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2727161620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:37:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 -- 172.21.15.17:0/2123380050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1600ffdc0 msgr2=0x7fa1601001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 --2- 172.21.15.17:0/2123380050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1600ffdc0 0x7fa1601001e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa1500099c0 tx=0x7fa150009cd0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 -- 172.21.15.17:0/2123380050 shutdown_connections 2023-10-05T15:37:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 --2- 172.21.15.17:0/2123380050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160101950 0x7fa160108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 --2- 172.21.15.17:0/2123380050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1600ffdc0 0x7fa1601001e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 --2- 172.21.15.17:0/2123380050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa160100fb0 0x7fa160101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 -- 172.21.15.17:0/2123380050 >> 172.21.15.17:0/2123380050 conn(0x7fa1600fb330 msgr2=0x7fa1600fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 -- 172.21.15.17:0/2123380050 shutdown_connections 2023-10-05T15:37:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.305+0000 7fa1649ff700 1 -- 172.21.15.17:0/2123380050 wait complete. 2023-10-05T15:37:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.307+0000 7fa1649ff700 1 Processor -- start 2023-10-05T15:37:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.307+0000 7fa1649ff700 1 -- start start 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.307+0000 7fa1649ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1600ffdc0 0x7fa160196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.307+0000 7fa1649ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160100fb0 0x7fa160197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.307+0000 7fa1649ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 0x7fa16019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa1649ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16019e750 con 0x7fa160101950 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa1649ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16019e890 con 0x7fa160100fb0 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa1649ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16019ea20 con 0x7fa1600ffdc0 2023-10-05T15:37:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 0x7fa16019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 0x7fa16019e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50108/0 (socket says 172.21.15.17:50108) 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1600ffdc0 0x7fa160196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 -- 172.21.15.17:0/572739353 learned_addr learned my addr 172.21.15.17:0/572739353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160100fb0 0x7fa160197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 -- 172.21.15.17:0/572739353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1600ffdc0 msgr2=0x7fa160196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1600ffdc0 0x7fa160196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 -- 172.21.15.17:0/572739353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160100fb0 msgr2=0x7fa160197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160100fb0 0x7fa160197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15ed9d700 1 -- 172.21.15.17:0/572739353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500095f0 con 0x7fa160101950 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.308+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160100fb0 0x7fa160197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.309+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 0x7fa16019e180 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa15800ef30 tx=0x7fa15800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.309+0000 7fa14f7fe700 1 -- 172.21.15.17:0/572739353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158018070 con 0x7fa160101950 2023-10-05T15:37:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.309+0000 7fa14f7fe700 1 -- 172.21.15.17:0/572739353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa15800f040 con 0x7fa160101950 2023-10-05T15:37:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.309+0000 7fa14f7fe700 1 -- 172.21.15.17:0/572739353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800cc70 con 0x7fa160101950 2023-10-05T15:37:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.309+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa160108b50 con 0x7fa160101950 2023-10-05T15:37:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.309+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160109010 con 0x7fa160101950 2023-10-05T15:37:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.313+0000 7fa14f7fe700 1 -- 172.21.15.17:0/572739353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa158007500 con 0x7fa160101950 2023-10-05T15:37:25.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.314+0000 7fa178229b80 1 Processor -- start 2023-10-05T15:37:25.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.314+0000 7fa178229b80 1 -- start start 2023-10-05T15:37:25.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.314+0000 7fa14f7fe700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa1480a1480 0x7fa1480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa178229b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 0x558997160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa178229b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997161480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa14f7fe700 1 -- 172.21.15.17:0/572739353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa1580ccc00 con 0x7fa160101950 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa178229b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997161a60 0x558997161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa178229b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589970c8460 con 0x558997161a60 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa178229b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589970b9c20 con 0x558997160bc0 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa178229b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589970b7540 con 0x558997160260 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa1480a1480 0x7fa1480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 0x558997160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 0x558997160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35958/0 (socket says 172.21.15.17:35958) 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa15e59c700 1 -- 172.21.15.17:0/1099059030 learned_addr learned my addr 172.21.15.17:0/1099059030 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.315+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997161a60 0x558997161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15e59c700 1 -- 172.21.15.17:0/1099059030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 msgr2=0x558997161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15e59c700 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15e59c700 1 -- 172.21.15.17:0/1099059030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997161a60 msgr2=0x558997161ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15e59c700 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997161a60 0x558997161ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15e59c700 1 -- 172.21.15.17:0/1099059030 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558996eddde0 con 0x558997160260 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997161a60 0x558997161ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa1480a1480 0x7fa1480a3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa154009e20 tx=0x7fa154009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa15e59c700 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 0x558997160680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa15000b580 tx=0x7fa150005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=850f1b053133b279 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa14cff9700 1 -- 172.21.15.17:0/1099059030 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000ba10 con 0x558997160260 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa14cff9700 1 -- 172.21.15.17:0/1099059030 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa150022040 con 0x558997160260 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.316+0000 7fa14cff9700 1 -- 172.21.15.17:0/1099059030 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1500053f0 con 0x558997160260 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 -- 172.21.15.17:0/1099059030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 msgr2=0x558997160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 0x558997160680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa15000b580 tx=0x7fa150005bc0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 -- 172.21.15.17:0/1099059030 shutdown_connections 2023-10-05T15:37:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997161a60 0x558997161ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997160260 0x558997160680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 --2- 172.21.15.17:0/1099059030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 -- 172.21.15.17:0/1099059030 >> 172.21.15.17:0/1099059030 conn(0x5589970d4260 msgr2=0x55899715b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 -- 172.21.15.17:0/1099059030 shutdown_connections 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.317+0000 7fa178229b80 1 -- 172.21.15.17:0/1099059030 wait complete. 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.318+0000 7fa178229b80 1 -- start start 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.318+0000 7fa178229b80 1 Processor -- start 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x558997169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997171550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589970b2e30 con 0x558997160bc0 2023-10-05T15:37:25.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899704f710 con 0x558997160260 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899704f3b0 con 0x558997161a60 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa178229b80 10 client.0 _ll_register_callbacks cb 0x558996eac800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997171550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x558997169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997171550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35960/0 (socket says 172.21.15.17:35960) 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x558997169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51962/0 (socket says 172.21.15.17:51962) 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 -- 172.21.15.17:0/3546873117 learned_addr learned my addr 172.21.15.17:0/3546873117 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 -- 172.21.15.17:0/3546873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 msgr2=0x558997169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x558997169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 -- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 msgr2=0x55899716a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.319+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa15ed9d700 1 -- 172.21.15.17:0/3546873117 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160109010 con 0x558997161a60 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997171550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1580ca300 tx=0x7fa15809a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580c66c7cc32829 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa145ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa145ffb700 1 -- 172.21.15.17:0/3546873117 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15809a2b0 con 0x558997161a60 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558997152f10 con 0x558997161a60 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa145ffb700 1 -- 172.21.15.17:0/3546873117 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa158099bb0 con 0x558997161a60 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa145ffb700 1 -- 172.21.15.17:0/3546873117 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa15809dd00 con 0x558997161a60 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa178229b80 10 client.25633 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.320+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fa160068040 con 0x558997161a60 2023-10-05T15:37:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa145ffb700 1 -- 172.21.15.17:0/3546873117 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558997152f10 con 0x558997161a60 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa145ffb700 1 -- 172.21.15.17:0/3546873117 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa1580b2220 con 0x558997161a60 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa178229b80 10 client.25633 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa178229b80 10 client.25633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa178229b80 20 client.25633 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa178229b80 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558997175e70 0x558997178290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa178229b80 4 client.25633 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589970abe10 con 0x558997175e70 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.321+0000 7fa15e59c700 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558997175e70 0x558997178290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.322+0000 7fa15e59c700 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558997175e70 0x558997178290 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e27c9ad53b5de4d server_cookie=bb7babab7a9b2f93 in_seq=0 out_seq=0 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.322+0000 7fa145ffb700 10 client.25633 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa145ffb700 1 -- 172.21.15.17:0/3546873117 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5589970abe10 con 0x558997175e70 2023-10-05T15:37:25.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa145ffb700 10 client.25633 handle_command_reply: tid=0 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 client.25633 shutdown 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 msgr2=0x558997171550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997171550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1580ca300 tx=0x7fa15809a0f0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 shutdown_connections 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558997175e70 0x558997178290 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997171550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x558997169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa145ffb700 0 client.25633 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 --2- 172.21.15.17:0/3546873117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 >> 172.21.15.17:0/3546873117 conn(0x5589970d4260 msgr2=0x55899715af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 shutdown_connections 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 1 -- 172.21.15.17:0/3546873117 wait complete. 2023-10-05T15:37:25.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.323+0000 7fa178229b80 20 client.25633 trim_cache size 0 max 16384 2023-10-05T15:37:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.342+0000 7fa178229b80 1 Processor -- start 2023-10-05T15:37:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 -- start start 2023-10-05T15:37:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 0x55899715af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997171510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997167e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558996f33920 con 0x558997160260 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899716b1c0 con 0x558997160bc0 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa178229b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558997155570 con 0x558997161a60 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 0x55899715af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa15dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997171510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa15dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997171510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51964/0 (socket says 172.21.15.17:51964) 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa15e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 0x55899715af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50134/0 (socket says 172.21.15.17:50134) 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.343+0000 7fa15dd9b700 1 -- 172.21.15.17:0/2338332290 learned_addr learned my addr 172.21.15.17:0/2338332290 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15e59c700 1 -- 172.21.15.17:0/2338332290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 msgr2=0x558997167e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997167e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15e59c700 1 -- 172.21.15.17:0/2338332290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 msgr2=0x558997171510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997171510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15e59c700 1 -- 172.21.15.17:0/2338332290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558996ec6c60 con 0x558997160260 2023-10-05T15:37:25.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.344+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 0x55899715af50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa1500098e0 tx=0x7fa150009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8694e718994eac2c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.345+0000 7fa14d7fa700 1 -- 172.21.15.17:0/2338332290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1500058e0 con 0x558997160260 2023-10-05T15:37:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.345+0000 7fa14d7fa700 1 -- 172.21.15.17:0/2338332290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa150033070 con 0x558997160260 2023-10-05T15:37:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.345+0000 7fa14d7fa700 1 -- 172.21.15.17:0/2338332290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150005320 con 0x558997160260 2023-10-05T15:37:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.345+0000 7fa178229b80 1 -- 172.21.15.17:0/2338332290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 msgr2=0x55899715af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.345+0000 7fa178229b80 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 0x55899715af50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa1500098e0 tx=0x7fa150009310 comp rx=0 tx=0).stop 2023-10-05T15:37:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 -- 172.21.15.17:0/2338332290 shutdown_connections 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x558997167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160260 0x55899715af50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 --2- 172.21.15.17:0/2338332290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160bc0 0x558997171510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 -- 172.21.15.17:0/2338332290 >> 172.21.15.17:0/2338332290 conn(0x5589970d4260 msgr2=0x558997168c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 -- 172.21.15.17:0/2338332290 shutdown_connections 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 -- 172.21.15.17:0/2338332290 wait complete. 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 -- start start 2023-10-05T15:37:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.346+0000 7fa178229b80 1 Processor -- start 2023-10-05T15:37:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x55899716d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x5589971708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558997170e30 con 0x558997160bc0 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558997170fa0 con 0x558997160260 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558997171160 con 0x558997161a60 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa178229b80 10 client.0 _ll_register_callbacks cb 0x7fa1580996f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa15dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa15dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50146/0 (socket says 172.21.15.17:50146) 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa15dd9b700 1 -- 172.21.15.17:0/2799164990 learned_addr learned my addr 172.21.15.17:0/2799164990 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.347+0000 7fa15ed9d700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x5589971708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x55899716d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15dd9b700 1 -- 172.21.15.17:0/2799164990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 msgr2=0x5589971708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x5589971708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15dd9b700 1 -- 172.21.15.17:0/2799164990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 msgr2=0x55899716d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x55899716d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15dd9b700 1 -- 172.21.15.17:0/2799164990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558996eddde0 con 0x558997160bc0 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.348+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x55899716d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.349+0000 7fa15dd9b700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716d8d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa154009810 tx=0x7fa1540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eabdd597018275 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.349+0000 7fa145ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:25.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.349+0000 7fa145ffb700 1 -- 172.21.15.17:0/2799164990 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154025070 con 0x558997160bc0 2023-10-05T15:37:25.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.350+0000 7fa145ffb700 1 -- 172.21.15.17:0/2799164990 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa15401f630 con 0x558997160bc0 2023-10-05T15:37:25.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.350+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa150022040 con 0x558997160bc0 2023-10-05T15:37:25.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.350+0000 7fa145ffb700 1 -- 172.21.15.17:0/2799164990 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa15401f7f0 con 0x558997160bc0 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.350+0000 7fa178229b80 10 client.15861 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.350+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558996f04250 con 0x558997160bc0 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.350+0000 7fa145ffb700 1 -- 172.21.15.17:0/2799164990 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa150022040 con 0x558997160bc0 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa145ffb700 1 -- 172.21.15.17:0/2799164990 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa15402aa60 con 0x558997160bc0 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa178229b80 10 client.15861 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa178229b80 10 client.15861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa178229b80 20 client.15861 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa178229b80 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x5589971cadc0 0x5589971cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa178229b80 4 client.15861 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5589970abb30 con 0x5589971cadc0 2023-10-05T15:37:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.351+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x5589971cadc0 0x5589971cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.352+0000 7fa15e59c700 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x5589971cadc0 0x5589971cd1e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa3382a8aec412a2 server_cookie=9b4cba7ea79f508e in_seq=0 out_seq=0 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.352+0000 7fa145ffb700 10 client.15861 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.352+0000 7fa145ffb700 1 -- 172.21.15.17:0/2799164990 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5589970abb30 con 0x5589971cadc0 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.352+0000 7fa145ffb700 10 client.15861 handle_command_reply: tid=0 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.352+0000 7fa178229b80 1 client.15861 shutdown 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 msgr2=0x55899716d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716d8d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa154009810 tx=0x7fa1540047c0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 shutdown_connections 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x5589971cadc0 0x5589971cd1e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558997161a60 0x5589971708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558997160260 0x55899716d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 --2- 172.21.15.17:0/2799164990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558997160bc0 0x55899716d8d0 secure :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa154009810 tx=0x7fa1540047c0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 >> 172.21.15.17:0/2799164990 conn(0x5589970d4260 msgr2=0x558997164970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.353+0000 7fa145ffb700 0 client.15861 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.354+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 shutdown_connections 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.354+0000 7fa178229b80 1 -- 172.21.15.17:0/2799164990 wait complete. 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.354+0000 7fa178229b80 20 client.15861 trim_cache size 0 max 16384 2023-10-05T15:37:25.357 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa1480a1480 msgr2=0x7fa1480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa1480a1480 0x7fa1480a3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa154009e20 tx=0x7fa154009890 comp rx=0 tx=0).stop 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 msgr2=0x7fa16019e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 0x7fa16019e180 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa15800ef30 tx=0x7fa15800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 shutdown_connections 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa1480a1480 0x7fa1480a3940 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa160101950 0x7fa16019e180 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1600ffdc0 0x7fa160196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 --2- 172.21.15.17:0/572739353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa160100fb0 0x7fa160197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 >> 172.21.15.17:0/572739353 conn(0x7fa1600fb330 msgr2=0x7fa160104630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 shutdown_connections 2023-10-05T15:37:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.355+0000 7fa1649ff700 1 -- 172.21.15.17:0/572739353 wait complete. 2023-10-05T15:37:25.376 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-05T15:37:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/4287704442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94100ea0 msgr2=0x7f7b941012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/4287704442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94100ea0 0x7f7b941012c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009990 tx=0x7f7b90009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/4287704442 shutdown_connections 2023-10-05T15:37:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/4287704442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b94102a40 0x7f7b94109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/4287704442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94100ea0 0x7f7b941012c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/4287704442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b94102080 0x7f7b94102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/4287704442 >> 172.21.15.17:0/4287704442 conn(0x7f7b940fc460 msgr2=0x7f7b940fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/4287704442 shutdown_connections 2023-10-05T15:37:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.617+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/4287704442 wait complete. 2023-10-05T15:37:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 Processor -- start 2023-10-05T15:37:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 -- start start 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b94100ea0 0x7f7b94074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b94102080 0x7f7b940732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 0x7f7b940737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94073f80 con 0x7f7b94102a40 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940740f0 con 0x7f7b94100ea0 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.619+0000 7f7b9b9ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b941a0bc0 con 0x7f7b94102080 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 0x7f7b940737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 0x7f7b940737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50168/0 (socket says 172.21.15.17:50168) 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2759087005 learned_addr learned my addr 172.21.15.17:0/2759087005 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b9979b700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b94100ea0 0x7f7b94074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b94102080 0x7f7b940732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2759087005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b94102080 msgr2=0x7f7b940732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b94102080 0x7f7b940732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2759087005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b94100ea0 msgr2=0x7f7b94074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b94100ea0 0x7f7b94074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.620+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2759087005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900095f0 con 0x7f7b94102a40 2023-10-05T15:37:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.621+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 0x7f7b940737e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00ef30 tx=0x7f7b8c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.621+0000 7f7b8a7fc700 1 -- 172.21.15.17:0/2759087005 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c018070 con 0x7f7b94102a40 2023-10-05T15:37:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.621+0000 7f7b8a7fc700 1 -- 172.21.15.17:0/2759087005 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b8c00f040 con 0x7f7b94102a40 2023-10-05T15:37:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.621+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b941a0e40 con 0x7f7b94102a40 2023-10-05T15:37:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.621+0000 7f7b8a7fc700 1 -- 172.21.15.17:0/2759087005 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00cbc0 con 0x7f7b94102a40 2023-10-05T15:37:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.621+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b941a12c0 con 0x7f7b94102a40 2023-10-05T15:37:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.625+0000 7f7b8a7fc700 1 -- 172.21.15.17:0/2759087005 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7b8c007500 con 0x7f7b94102a40 2023-10-05T15:37:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.627+0000 7f7baf3fbb80 1 Processor -- start 2023-10-05T15:37:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.627+0000 7f7baf3fbb80 1 -- start start 2023-10-05T15:37:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.627+0000 7f7b8a7fc700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b800a15d0 0x7f7b800a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7b8a7fc700 1 -- 172.21.15.17:0/2759087005 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7b8c0ccae0 con 0x7f7b94102a40 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b6398680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b6399480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6399a60 0x55b4b6399ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b6300460 con 0x55b4b6398bc0 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b62f1c20 con 0x55b4b6398260 2023-10-05T15:37:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b62ef540 con 0x55b4b6399a60 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7b9979b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b6398680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b800a15d0 0x7f7b800a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7b9979b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b6398680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51998/0 (socket says 172.21.15.17:51998) 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7b9979b700 1 -- 172.21.15.17:0/1322451061 learned_addr learned my addr 172.21.15.17:0/1322451061 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.628+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6399a60 0x55b4b6399ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b9979b700 1 -- 172.21.15.17:0/1322451061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6399a60 msgr2=0x55b4b6399ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b9979b700 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6399a60 0x55b4b6399ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b9979b700 1 -- 172.21.15.17:0/1322451061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 msgr2=0x55b4b6399480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b9979b700 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b6399480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b9979b700 1 -- 172.21.15.17:0/1322451061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4b6115de0 con 0x55b4b6398260 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b9979b700 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b6398680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009990 tx=0x7f7b90005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8fdd1b4dbb20edc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b800a15d0 0x7f7b800a3a90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b94100bc0 tx=0x7f7b840098c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b7f7fe700 1 -- 172.21.15.17:0/1322451061 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9001d070 con 0x55b4b6398260 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b7f7fe700 1 -- 172.21.15.17:0/1322451061 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b9001e040 con 0x55b4b6398260 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.629+0000 7f7b7f7fe700 1 -- 172.21.15.17:0/1322451061 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9000b7b0 con 0x55b4b6398260 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1322451061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 msgr2=0x55b4b6398680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b6398680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009990 tx=0x7f7b90005c00 comp rx=0 tx=0).stop 2023-10-05T15:37:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1322451061 shutdown_connections 2023-10-05T15:37:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6399a60 0x55b4b6399ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b6398680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1322451061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b6399480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.630+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1322451061 >> 172.21.15.17:0/1322451061 conn(0x55b4b630c260 msgr2=0x55b4b6393140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.631+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1322451061 shutdown_connections 2023-10-05T15:37:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.631+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1322451061 wait complete. 2023-10-05T15:37:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.631+0000 7f7baf3fbb80 1 -- start start 2023-10-05T15:37:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.631+0000 7f7baf3fbb80 1 Processor -- start 2023-10-05T15:37:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398260 0x55b4b63a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b62eae30 con 0x55b4b6398260 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b6287710 con 0x55b4b6399a60 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b62873b0 con 0x55b4b6398bc0 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7baf3fbb80 10 client.0 _ll_register_callbacks cb 0x55b4b60e4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7b98f9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.632+0000 7f7b98f9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35990/0 (socket says 172.21.15.17:35990) 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 -- 172.21.15.17:0/3270312436 learned_addr learned my addr 172.21.15.17:0/3270312436 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 -- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 msgr2=0x55b4b63a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 -- 172.21.15.17:0/3270312436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398260 msgr2=0x55b4b63a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398260 0x55b4b63a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 -- 172.21.15.17:0/3270312436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b94109c90 con 0x55b4b6398bc0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a24a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009740 tx=0x7f7b840047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301226862ef66957 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.633+0000 7f7b7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7b7cff9700 1 -- 172.21.15.17:0/3270312436 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840108c0 con 0x55b4b6398bc0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4b638af10 con 0x55b4b6398bc0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7b7cff9700 1 -- 172.21.15.17:0/3270312436 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7b8401b040 con 0x55b4b6398bc0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7b7cff9700 1 -- 172.21.15.17:0/3270312436 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b84010a20 con 0x55b4b6398bc0 2023-10-05T15:37:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7baf3fbb80 10 client.25651 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b4b60fec60 con 0x55b4b6398bc0 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.634+0000 7f7b7cff9700 1 -- 172.21.15.17:0/3270312436 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b4b638af10 con 0x55b4b6398bc0 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7b7cff9700 1 -- 172.21.15.17:0/3270312436 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7b84020c10 con 0x55b4b6398bc0 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7baf3fbb80 10 client.25651 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7baf3fbb80 10 client.25651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7baf3fbb80 20 client.25651 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b63ade30 0x55b4b63b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7baf3fbb80 4 client.25651 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:25.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4b62e3e10 con 0x55b4b63ade30 2023-10-05T15:37:25.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.635+0000 7f7b9979b700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b63ade30 0x55b4b63b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.636+0000 7f7b9979b700 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b63ade30 0x55b4b63b0270 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30853d7fb4fcba6c server_cookie=7304c12fae3ce474 in_seq=0 out_seq=0 2023-10-05T15:37:25.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.636+0000 7f7b7cff9700 10 client.25651 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7b7cff9700 1 -- 172.21.15.17:0/3270312436 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b4b62e3e10 con 0x55b4b63ade30 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7b7cff9700 10 client.25651 handle_command_reply: tid=0 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 client.25651 shutdown 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 msgr2=0x55b4b63a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a24a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009740 tx=0x7f7b840047c0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 shutdown_connections 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b63ade30 0x55b4b63b0270 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398260 0x55b4b63a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7b7cff9700 0 client.25651 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/3270312436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a24a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 >> 172.21.15.17:0/3270312436 conn(0x55b4b630c260 msgr2=0x55b4b6392f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.637+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 shutdown_connections 2023-10-05T15:37:25.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.638+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/3270312436 wait complete. 2023-10-05T15:37:25.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.638+0000 7f7baf3fbb80 20 client.25651 trim_cache size 0 max 16384 2023-10-05T15:37:25.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 Processor -- start 2023-10-05T15:37:25.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 -- start start 2023-10-05T15:37:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b63a1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6399a60 0x55b4b6391bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b616b920 con 0x55b4b6399a60 2023-10-05T15:37:25.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b63a2e60 con 0x55b4b6398260 2023-10-05T15:37:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b638fa20 con 0x55b4b6398bc0 2023-10-05T15:37:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.656+0000 7f7b99f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6399a60 0x55b4b6391bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b99f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6399a60 0x55b4b6391bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50182/0 (socket says 172.21.15.17:50182) 2023-10-05T15:37:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b9979b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b63a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b99f9c700 1 -- 172.21.15.17:0/1798219929 learned_addr learned my addr 172.21.15.17:0/1798219929 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 -- 172.21.15.17:0/1798219929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 msgr2=0x55b4b63a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b63a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 -- 172.21.15.17:0/1798219929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6399a60 msgr2=0x55b4b6391bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6399a60 0x55b4b6391bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 -- 172.21.15.17:0/1798219929 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4b613c250 con 0x55b4b6398bc0 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.657+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a94a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009ce0 tx=0x7f7b84015b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46c22f0c52360ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.658+0000 7f7b7ffff700 1 -- 172.21.15.17:0/1798219929 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84004220 con 0x55b4b6398bc0 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.658+0000 7f7b7ffff700 1 -- 172.21.15.17:0/1798219929 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b84005c10 con 0x55b4b6398bc0 2023-10-05T15:37:25.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.658+0000 7f7b7ffff700 1 -- 172.21.15.17:0/1798219929 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84010920 con 0x55b4b6398bc0 2023-10-05T15:37:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1798219929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 msgr2=0x55b4b63a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a94a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009ce0 tx=0x7f7b84015b80 comp rx=0 tx=0).stop 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1798219929 shutdown_connections 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6399a60 0x55b4b6391bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6398260 0x55b4b63a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/1798219929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398bc0 0x55b4b63a94a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1798219929 >> 172.21.15.17:0/1798219929 conn(0x55b4b630c260 msgr2=0x55b4b6392f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1798219929 shutdown_connections 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/1798219929 wait complete. 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.659+0000 7f7baf3fbb80 1 -- start start 2023-10-05T15:37:25.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.660+0000 7f7baf3fbb80 1 Processor -- start 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.660+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398260 0x55b4b63a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.660+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b63a5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7baf3fbb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b63a8bd0 con 0x55b4b6398bc0 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b63a8d40 con 0x55b4b6399a60 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7baf3fbb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4b63a8f00 con 0x55b4b6398260 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7baf3fbb80 10 client.0 _ll_register_callbacks cb 0x7f7b840150d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:25.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b9979b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398260 0x55b4b63a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b9979b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398260 0x55b4b63a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:36006/0 (socket says 172.21.15.17:36006) 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b9979b700 1 -- 172.21.15.17:0/2734866713 learned_addr learned my addr 172.21.15.17:0/2734866713 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b98f9a700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b63a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2734866713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398260 msgr2=0x55b4b63a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398260 0x55b4b63a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2734866713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 msgr2=0x55b4b63a5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b63a5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.661+0000 7f7b99f9c700 1 -- 172.21.15.17:0/2734866713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4b60fec60 con 0x55b4b6399a60 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.662+0000 7f7b99f9c700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a8690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0090a0 tx=0x7f7b8c099260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7d3237aae59b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:25.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.662+0000 7f7b7cff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.662+0000 7f7b7cff9700 1 -- 172.21.15.17:0/2734866713 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c012340 con 0x55b4b6399a60 2023-10-05T15:37:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.662+0000 7f7b7cff9700 1 -- 172.21.15.17:0/2734866713 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7b8c09a190 con 0x55b4b6399a60 2023-10-05T15:37:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.662+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b9001e040 con 0x55b4b6399a60 2023-10-05T15:37:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.667+0000 7f7b7cff9700 1 -- 172.21.15.17:0/2734866713 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b8c099a90 con 0x55b4b6399a60 2023-10-05T15:37:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.667+0000 7f7baf3fbb80 10 client.25676 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.667+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b4b61142b0 con 0x55b4b6399a60 2023-10-05T15:37:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7b7cff9700 1 -- 172.21.15.17:0/2734866713 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b9001e040 con 0x55b4b6399a60 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7b7cff9700 1 -- 172.21.15.17:0/2734866713 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7b8c095910 con 0x55b4b6399a60 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7baf3fbb80 10 client.25676 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7baf3fbb80 10 client.25676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7baf3fbb80 20 client.25676 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b6402c30 0x55b4b6405050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7baf3fbb80 4 client.25676 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b4b62e3b30 con 0x55b4b6402c30 2023-10-05T15:37:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.668+0000 7f7b9979b700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b6402c30 0x55b4b6405050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7b9979b700 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b6402c30 0x55b4b6405050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81a3800823f2b44 server_cookie=227bf864e7f1e138 in_seq=0 out_seq=0 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7b7cff9700 10 client.25676 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7b7cff9700 1 -- 172.21.15.17:0/2734866713 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b4b62e3b30 con 0x55b4b6402c30 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7b7cff9700 10 client.25676 handle_command_reply: tid=0 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7baf3fbb80 1 client.25676 shutdown 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 msgr2=0x55b4b63a8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.669+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a8690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c0090a0 tx=0x7f7b8c099260 comp rx=0 tx=0).stop 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 shutdown_connections 2023-10-05T15:37:25.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b4b6402c30 0x55b4b6405050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b4b6399a60 0x55b4b63a8690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b4b6398260 0x55b4b63a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 --2- 172.21.15.17:0/2734866713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4b6398bc0 0x55b4b63a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 >> 172.21.15.17:0/2734866713 conn(0x55b4b630c260 msgr2=0x55b4b6391bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7b7cff9700 0 client.25676 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 shutdown_connections 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.670+0000 7f7baf3fbb80 1 -- 172.21.15.17:0/2734866713 wait complete. 2023-10-05T15:37:25.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7baf3fbb80 20 client.25676 trim_cache size 0 max 16384 2023-10-05T15:37:25.674 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:25.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b800a15d0 msgr2=0x7f7b800a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b800a15d0 0x7f7b800a3a90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7b94100bc0 tx=0x7f7b840098c0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 msgr2=0x7f7b940737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 0x7f7b940737e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00ef30 tx=0x7f7b8c00c3a0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 shutdown_connections 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7b800a15d0 0x7f7b800a3a90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b94102a40 0x7f7b940737e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b94100ea0 0x7f7b94074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 --2- 172.21.15.17:0/2759087005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b94102080 0x7f7b940732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.671+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 >> 172.21.15.17:0/2759087005 conn(0x7f7b940fc460 msgr2=0x7f7b940fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.672+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 shutdown_connections 2023-10-05T15:37:25.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:25.672+0000 7f7b9b9ff700 1 -- 172.21.15.17:0/2759087005 wait complete. 2023-10-05T15:37:25.870 INFO:teuthology.orchestra.run.smithi017.stderr:300000 of 3200000 tuples (9%) done (elapsed 4.23 s, remaining 40.86 s) 2023-10-05T15:37:25.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:25 smithi017 ceph-mon[129107]: pgmap v394: 129 pgs: 129 active+clean; 69 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-10-05T15:37:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:25 smithi167 ceph-mon[133366]: pgmap v394: 129 pgs: 129 active+clean; 69 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-10-05T15:37:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:25 smithi079 ceph-mon[132936]: pgmap v394: 129 pgs: 129 active+clean; 69 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 4.9 MiB/s wr, 234 op/s 2023-10-05T15:37:26.694 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:37:26.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:37:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 -- 172.21.15.17:0/3190757920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 msgr2=0x7f0768109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3190757920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f0768109360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f076000b0a0 tx=0x7f076000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 -- 172.21.15.17:0/3190757920 shutdown_connections 2023-10-05T15:37:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3190757920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f0768109360 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3190757920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768100ea0 0x7f07681012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3190757920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0768102080 0x7f0768102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 -- 172.21.15.17:0/3190757920 >> 172.21.15.17:0/3190757920 conn(0x7f07680fc460 msgr2=0x7f07680fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 -- 172.21.15.17:0/3190757920 shutdown_connections 2023-10-05T15:37:26.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.936+0000 7f076d7ff700 1 -- 172.21.15.17:0/3190757920 wait complete. 2023-10-05T15:37:26.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 Processor -- start 2023-10-05T15:37:26.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 -- start start 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0768100ea0 0x7f0768074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 0x7f07680732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f07680737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768073f80 con 0x7f0768102a40 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680740f0 con 0x7f0768102080 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f076d7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681a0c30 con 0x7f0768100ea0 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f07677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f07680737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.938+0000 7f07667fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 0x7f07680732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f07680737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50216/0 (socket says 172.21.15.17:50216) 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 0x7f07680732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52026/0 (socket says 172.21.15.17:52026) 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07677fe700 1 -- 172.21.15.17:0/3456331016 learned_addr learned my addr 172.21.15.17:0/3456331016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:26.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0768100ea0 0x7f0768074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 -- 172.21.15.17:0/3456331016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0768100ea0 msgr2=0x7f0768074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0768100ea0 0x7f0768074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 -- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 msgr2=0x7f07680737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f07680737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 -- 172.21.15.17:0/3456331016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009520 con 0x7f0768102080 2023-10-05T15:37:26.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07677fe700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f07680737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.939+0000 7f07667fc700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 0x7f07680732a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f075c00e9c0 tx=0x7f075c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.940+0000 7f074ffff700 1 -- 172.21.15.17:0/3456331016 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c004220 con 0x7f0768102080 2023-10-05T15:37:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.940+0000 7f074ffff700 1 -- 172.21.15.17:0/3456331016 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f075c004380 con 0x7f0768102080 2023-10-05T15:37:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.940+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0760009d00 con 0x7f0768102080 2023-10-05T15:37:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.940+0000 7f074ffff700 1 -- 172.21.15.17:0/3456331016 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c003b40 con 0x7f0768102080 2023-10-05T15:37:26.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.940+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681a1230 con 0x7f0768102080 2023-10-05T15:37:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.944+0000 7f0781077b80 1 Processor -- start 2023-10-05T15:37:26.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f074ffff700 1 -- 172.21.15.17:0/3456331016 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f075c003d00 con 0x7f0768102080 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 -- start start 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d62f0 0x55b8a53d6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a53344e0 con 0x55b8a53d4af0 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a5325ca0 con 0x55b8a53d62f0 2023-10-05T15:37:26.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f0781077b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a53235c0 con 0x55b8a53d5450 2023-10-05T15:37:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f07677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f07677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53d4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50224/0 (socket says 172.21.15.17:50224) 2023-10-05T15:37:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.945+0000 7f07677fe700 1 -- 172.21.15.17:0/3806082202 learned_addr learned my addr 172.21.15.17:0/3806082202 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f07667fc700 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d62f0 0x55b8a53d6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f07677fe700 1 -- 172.21.15.17:0/3806082202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 msgr2=0x55b8a53d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f07677fe700 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53d5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f07677fe700 1 -- 172.21.15.17:0/3806082202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d62f0 msgr2=0x55b8a53d6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f07677fe700 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d62f0 0x55b8a53d6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f07677fe700 1 -- 172.21.15.17:0/3806082202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a5149e60 con 0x55b8a53d4af0 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f074ffff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f07500a1480 0x7f07500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.946+0000 7f074ffff700 1 -- 172.21.15.17:0/3456331016 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f075c014070 con 0x7f0768102080 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.947+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f07500a1480 0x7f07500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.947+0000 7f07677fe700 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53d4f10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f076000b070 tx=0x7f0760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57825064faf7ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:26.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.947+0000 7f074d7fa700 1 -- 172.21.15.17:0/3806082202 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000e040 con 0x55b8a53d4af0 2023-10-05T15:37:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.947+0000 7f074d7fa700 1 -- 172.21.15.17:0/3806082202 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0760006080 con 0x55b8a53d4af0 2023-10-05T15:37:26.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.947+0000 7f074d7fa700 1 -- 172.21.15.17:0/3806082202 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760004ea0 con 0x55b8a53d4af0 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 -- 172.21.15.17:0/3806082202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 msgr2=0x55b8a53d4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f07500a1480 0x7f07500a3940 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0768101bf0 tx=0x7f0758009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53d4f10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f076000b070 tx=0x7f0760009c00 comp rx=0 tx=0).stop 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 -- 172.21.15.17:0/3806082202 shutdown_connections 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d62f0 0x55b8a53d6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53d4f10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 --2- 172.21.15.17:0/3806082202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53d5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 -- 172.21.15.17:0/3806082202 >> 172.21.15.17:0/3806082202 conn(0x55b8a53402e0 msgr2=0x55b8a53c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 -- 172.21.15.17:0/3806082202 shutdown_connections 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.948+0000 7f0781077b80 1 -- 172.21.15.17:0/3806082202 wait complete. 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.949+0000 7f0781077b80 1 -- start start 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.949+0000 7f0781077b80 1 Processor -- start 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 0x55b8a53dedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d62f0 0x55b8a53e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a531eeb0 con 0x55b8a53d4af0 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a52bb790 con 0x55b8a53d5450 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a52bb430 con 0x55b8a53d62f0 2023-10-05T15:37:26.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0781077b80 10 client.0 _ll_register_callbacks cb 0x55b8a5118880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f07667fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 0x55b8a53dedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f07667fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 0x55b8a53dedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52042/0 (socket says 172.21.15.17:52042) 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f07667fc700 1 -- 172.21.15.17:0/2596118122 learned_addr learned my addr 172.21.15.17:0/2596118122 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.950+0000 7f07667fc700 1 -- 172.21.15.17:0/2596118122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d62f0 msgr2=0x55b8a53e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f07667fc700 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d62f0 0x55b8a53e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f07667fc700 1 -- 172.21.15.17:0/2596118122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 msgr2=0x55b8a53de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f07667fc700 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f07667fc700 1 -- 172.21.15.17:0/2596118122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0768109c90 con 0x55b8a53d5450 2023-10-05T15:37:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f07667fc700 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 0x55b8a53dedd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f075c09a1d0 tx=0x7f075c095f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4accaccd5b986f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f074aff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f074aff5700 1 -- 172.21.15.17:0/2596118122 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c099d80 con 0x55b8a53d5450 2023-10-05T15:37:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8a53bef90 con 0x55b8a53d5450 2023-10-05T15:37:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f074aff5700 1 -- 172.21.15.17:0/2596118122 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f075c0044f0 con 0x55b8a53d5450 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f074aff5700 1 -- 172.21.15.17:0/2596118122 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f075c099ba0 con 0x55b8a53d5450 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f0781077b80 10 client.25688 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.951+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b8a5132ce0 con 0x55b8a53d5450 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f074aff5700 1 -- 172.21.15.17:0/2596118122 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b8a53bef90 con 0x55b8a53d5450 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f074aff5700 1 -- 172.21.15.17:0/2596118122 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f075c09a4a0 con 0x55b8a53d5450 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0781077b80 10 client.25688 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0781077b80 10 client.25688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0781077b80 20 client.25688 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0781077b80 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a53ea640 0x55b8a53eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0781077b80 4 client.25688 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8a5317e90 con 0x55b8a53ea640 2023-10-05T15:37:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.952+0000 7f0766ffd700 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a53ea640 0x55b8a53eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.953+0000 7f0766ffd700 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a53ea640 0x55b8a53eca60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f034a03a5d3d29f server_cookie=4096b621cac51308 in_seq=0 out_seq=0 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.953+0000 7f074aff5700 10 client.25688 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f074aff5700 1 -- 172.21.15.17:0/2596118122 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b8a5317e90 con 0x55b8a53ea640 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f074aff5700 10 client.25688 handle_command_reply: tid=0 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 client.25688 shutdown 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 msgr2=0x55b8a53dedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 0x55b8a53dedd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f075c09a1d0 tx=0x7f075c095f50 comp rx=0 tx=0).stop 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 shutdown_connections 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a53ea640 0x55b8a53eca60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d62f0 0x55b8a53e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d4af0 0x55b8a53de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f074aff5700 0 client.25688 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 --2- 172.21.15.17:0/2596118122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d5450 0x55b8a53dedd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 >> 172.21.15.17:0/2596118122 conn(0x55b8a53402e0 msgr2=0x55b8a53c6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 shutdown_connections 2023-10-05T15:37:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.954+0000 7f0781077b80 1 -- 172.21.15.17:0/2596118122 wait complete. 2023-10-05T15:37:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.955+0000 7f0781077b80 20 client.25688 trim_cache size 0 max 16384 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 Processor -- start 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 -- start start 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a519f9a0 con 0x55b8a53d62f0 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a5317e90 con 0x55b8a53d4af0 2023-10-05T15:37:26.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.982+0000 7f0781077b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a53dfa80 con 0x55b8a53d5450 2023-10-05T15:37:26.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f07677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53dc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52044/0 (socket says 172.21.15.17:52044) 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 -- 172.21.15.17:0/3786783793 learned_addr learned my addr 172.21.15.17:0/3786783793 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f07667fc700 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 -- 172.21.15.17:0/3786783793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 msgr2=0x55b8a53e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 -- 172.21.15.17:0/3786783793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 msgr2=0x55b8a53de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f0766ffd700 1 -- 172.21.15.17:0/3786783793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a53f1690 con 0x55b8a53d4af0 2023-10-05T15:37:26.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.983+0000 7f07677fe700 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:26.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.984+0000 7f0766ffd700 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53dc6a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0758000c00 tx=0x7f075801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87f09ddf6c5be8a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:26.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.984+0000 7f074dffb700 1 -- 172.21.15.17:0/3786783793 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758024040 con 0x55b8a53d4af0 2023-10-05T15:37:26.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.984+0000 7f074dffb700 1 -- 172.21.15.17:0/3786783793 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f07580293a0 con 0x55b8a53d4af0 2023-10-05T15:37:26.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.984+0000 7f074dffb700 1 -- 172.21.15.17:0/3786783793 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758017070 con 0x55b8a53d4af0 2023-10-05T15:37:26.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 -- 172.21.15.17:0/3786783793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 msgr2=0x55b8a53dc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53dc6a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0758000c00 tx=0x7f075801b000 comp rx=0 tx=0).stop 2023-10-05T15:37:26.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 -- 172.21.15.17:0/3786783793 shutdown_connections 2023-10-05T15:37:26.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53dc6a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 --2- 172.21.15.17:0/3786783793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 -- 172.21.15.17:0/3786783793 >> 172.21.15.17:0/3786783793 conn(0x55b8a53402e0 msgr2=0x55b8a53e6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 -- 172.21.15.17:0/3786783793 shutdown_connections 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 -- 172.21.15.17:0/3786783793 wait complete. 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.985+0000 7f0781077b80 1 -- start start 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 Processor -- start 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53e30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53e4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a53e4b80 con 0x55b8a53d62f0 2023-10-05T15:37:26.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a53e4cf0 con 0x55b8a53d4af0 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a53e4eb0 con 0x55b8a53d5450 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.986+0000 7f0781077b80 10 client.0 _ll_register_callbacks cb 0x7f075c00cee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53e30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53e30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52060/0 (socket says 172.21.15.17:52060) 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 -- 172.21.15.17:0/1743000310 learned_addr learned my addr 172.21.15.17:0/1743000310 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f07667fc700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f07677fe700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 -- 172.21.15.17:0/1743000310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 msgr2=0x55b8a53e3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 -- 172.21.15.17:0/1743000310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 msgr2=0x55b8a53e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53e4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.987+0000 7f0766ffd700 1 -- 172.21.15.17:0/1743000310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8a5149e60 con 0x55b8a53d4af0 2023-10-05T15:37:26.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f0766ffd700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53e30f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0758013010 tx=0x7f075802ae60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4ba6d7183e76d78 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f074aff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f074aff5700 1 -- 172.21.15.17:0/1743000310 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758017040 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0760006080 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f074aff5700 1 -- 172.21.15.17:0/1743000310 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f07580299c0 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f074aff5700 1 -- 172.21.15.17:0/1743000310 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0758024040 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f0781077b80 10 client.25694 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.988+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f0758012e50 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f074aff5700 1 -- 172.21.15.17:0/1743000310 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0760006080 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f074aff5700 1 -- 172.21.15.17:0/1743000310 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0758004750 con 0x55b8a53d4af0 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f0781077b80 10 client.25694 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f0781077b80 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f0781077b80 20 client.25694 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f0781077b80 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a54409a0 0x55b8a5442dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f0781077b80 4 client.25694 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b8a5317bb0 con 0x55b8a54409a0 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.989+0000 7f07667fc700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a54409a0 0x55b8a5442dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.990+0000 7f07667fc700 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a54409a0 0x55b8a5442dc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a4d7c56a1088de9 server_cookie=75f085912be1d1c8 in_seq=0 out_seq=0 2023-10-05T15:37:26.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.990+0000 7f074aff5700 10 client.25694 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f074aff5700 1 -- 172.21.15.17:0/1743000310 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b8a5317bb0 con 0x55b8a54409a0 2023-10-05T15:37:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f074aff5700 10 client.25694 handle_command_reply: tid=0 2023-10-05T15:37:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 client.25694 shutdown 2023-10-05T15:37:26.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 msgr2=0x55b8a53e30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53e30f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0758013010 tx=0x7f075802ae60 comp rx=0 tx=0).stop 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 shutdown_connections 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b8a54409a0 0x55b8a5442dc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b8a53d62f0 0x55b8a53e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b8a53d4af0 0x55b8a53e30f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 --2- 172.21.15.17:0/1743000310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8a53d5450 0x55b8a53e3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 >> 172.21.15.17:0/1743000310 conn(0x55b8a53402e0 msgr2=0x55b8a53dc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.991+0000 7f074aff5700 0 client.25694 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 shutdown_connections 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f0781077b80 1 -- 172.21.15.17:0/1743000310 wait complete. 2023-10-05T15:37:26.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f0781077b80 20 client.25694 trim_cache size 0 max 16384 2023-10-05T15:37:26.997 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:37:26.997 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-10-05T15:37:26.997 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "38582e9e-2a70-47af-86f3-a9ccb51ee5d7", 2023-10-05T15:37:26.997 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-10-05T15:37:26.997 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f07500a1480 msgr2=0x7f07500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f07500a1480 0x7f07500a3940 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0768101bf0 tx=0x7f0758009260 comp rx=0 tx=0).stop 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 msgr2=0x7f07680732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.992+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 0x7f07680732a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f075c00e9c0 tx=0x7f075c00ecd0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 shutdown_connections 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f07500a1480 0x7f07500a3940 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0768102a40 0x7f07680737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0768100ea0 0x7f0768074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 --2- 172.21.15.17:0/3456331016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0768102080 0x7f07680732a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 >> 172.21.15.17:0/3456331016 conn(0x7f07680fc460 msgr2=0x7f07680fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 shutdown_connections 2023-10-05T15:37:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:26.993+0000 7f076d7ff700 1 -- 172.21.15.17:0/3456331016 wait complete. 2023-10-05T15:37:27.015 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:37:27.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.271+0000 7f46bd1ff700 1 -- 172.21.15.17:0/4268647586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 msgr2=0x7f46b81012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.271+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/4268647586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 0x7f46b81012c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f46a80098f0 tx=0x7f46a8009c00 comp rx=0 tx=0).stop 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 -- 172.21.15.17:0/4268647586 shutdown_connections 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/4268647586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b8109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/4268647586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 0x7f46b81012c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/4268647586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8102080 0x7f46b8102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 -- 172.21.15.17:0/4268647586 >> 172.21.15.17:0/4268647586 conn(0x7f46b80fc460 msgr2=0x7f46b80fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 -- 172.21.15.17:0/4268647586 shutdown_connections 2023-10-05T15:37:27.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.272+0000 7f46bd1ff700 1 -- 172.21.15.17:0/4268647586 wait complete. 2023-10-05T15:37:27.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.273+0000 7f46bd1ff700 1 Processor -- start 2023-10-05T15:37:27.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.273+0000 7f46bd1ff700 1 -- start start 2023-10-05T15:37:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46bd1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 0x7f46b8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46bd1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8102080 0x7f46b81970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46bd1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46bd1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b819e6f0 con 0x7f46b8100ea0 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46bd1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b819e830 con 0x7f46b8102a40 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46bd1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b819e9c0 con 0x7f46b8102080 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 0x7f46b8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46b759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46b759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b819e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52076/0 (socket says 172.21.15.17:52076) 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.274+0000 7f46b759e700 1 -- 172.21.15.17:0/525966567 learned_addr learned my addr 172.21.15.17:0/525966567 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:27.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b659c700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8102080 0x7f46b81970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b759e700 1 -- 172.21.15.17:0/525966567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8102080 msgr2=0x7f46b81970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b759e700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8102080 0x7f46b81970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b759e700 1 -- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 msgr2=0x7f46b8196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b759e700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 0x7f46b8196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b759e700 1 -- 172.21.15.17:0/525966567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8009520 con 0x7f46b8102a40 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.275+0000 7f46b759e700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b819e120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c110 tx=0x7f46b000c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.276+0000 7f469ffff700 1 -- 172.21.15.17:0/525966567 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0017070 con 0x7f46b8102a40 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.276+0000 7f469ffff700 1 -- 172.21.15.17:0/525966567 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b000e050 con 0x7f46b8102a40 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.276+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b819ec40 con 0x7f46b8102a40 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.276+0000 7f469ffff700 1 -- 172.21.15.17:0/525966567 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0007880 con 0x7f46b8102a40 2023-10-05T15:37:27.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.276+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b819f100 con 0x7f46b8102a40 2023-10-05T15:37:27.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.281+0000 7f469ffff700 1 -- 172.21.15.17:0/525966567 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f46b000cad0 con 0x7f46b8102a40 2023-10-05T15:37:27.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.282+0000 7f46d0c22b80 1 Processor -- start 2023-10-05T15:37:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.282+0000 7f46d0c22b80 1 -- start start 2023-10-05T15:37:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.282+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.282+0000 7f469ffff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f46a00a1480 0x7f46a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccc9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccc9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5cc30460 con 0x55fe5ccc8260 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5cc21c20 con 0x55fe5ccc8bc0 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5cc1f540 con 0x55fe5ccc9a60 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f469ffff700 1 -- 172.21.15.17:0/525966567 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f46b00ccb90 con 0x7f46b8102a40 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46b659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46b659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50302/0 (socket says 172.21.15.17:50302) 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46b659c700 1 -- 172.21.15.17:0/1966832953 learned_addr learned my addr 172.21.15.17:0/1966832953 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46b759e700 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccc9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46b659c700 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccc9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.283+0000 7f46b659c700 1 -- 172.21.15.17:0/1966832953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 msgr2=0x55fe5ccc9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f46b659c700 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccc9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f46b659c700 1 -- 172.21.15.17:0/1966832953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 msgr2=0x55fe5ccc9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f46b659c700 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccc9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f46b659c700 1 -- 172.21.15.17:0/1966832953 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe5ca45de0 con 0x55fe5ccc8260 2023-10-05T15:37:27.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f46a00a1480 0x7f46a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f46b659c700 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc8680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0135a0 tx=0x7f46ac009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48daf9e81d2f4664 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f469d7fa700 1 -- 172.21.15.17:0/1966832953 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac009610 con 0x55fe5ccc8260 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f469d7fa700 1 -- 172.21.15.17:0/1966832953 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46ac00fb10 con 0x55fe5ccc8260 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.284+0000 7f469d7fa700 1 -- 172.21.15.17:0/1966832953 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00eb30 con 0x55fe5ccc8260 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f46a00a1480 0x7f46a00a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46a80098c0 tx=0x7f46a8019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1966832953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 msgr2=0x55fe5ccc8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc8680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0135a0 tx=0x7f46ac009820 comp rx=0 tx=0).stop 2023-10-05T15:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1966832953 shutdown_connections 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccc9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc8680 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1966832953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccc9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1966832953 >> 172.21.15.17:0/1966832953 conn(0x55fe5cc3c260 msgr2=0x55fe5ccc3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1966832953 shutdown_connections 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.285+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1966832953 wait complete. 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.286+0000 7f46d0c22b80 1 -- start start 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.286+0000 7f46d0c22b80 1 Processor -- start 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8260 0x55fe5ccd6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccd69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5cc1ae30 con 0x55fe5ccc9a60 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5cbb7710 con 0x55fe5ccc8260 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5cbb73b0 con 0x55fe5ccc8bc0 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46d0c22b80 10 client.0 _ll_register_callbacks cb 0x55fe5ca14800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50316/0 (socket says 172.21.15.17:50316) 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 -- 172.21.15.17:0/3911198687 learned_addr learned my addr 172.21.15.17:0/3911198687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:27.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8260 0x55fe5ccd6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b659c700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccd69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 -- 172.21.15.17:0/3911198687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8bc0 msgr2=0x55fe5ccd69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccd69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 -- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8260 msgr2=0x55fe5ccd6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8260 0x55fe5ccd6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.287+0000 7f46b759e700 1 -- 172.21.15.17:0/3911198687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac009d20 con 0x55fe5ccc9a60 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f46b759e700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdda10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f46b0099810 tx=0x7f46b00195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b8cd3e46756418 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f469aff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f469aff5700 1 -- 172.21.15.17:0/3911198687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b009a210 con 0x55fe5ccc9a60 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe5ccbaf10 con 0x55fe5ccc9a60 2023-10-05T15:37:27.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f469aff5700 1 -- 172.21.15.17:0/3911198687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f46b009ae40 con 0x55fe5ccc9a60 2023-10-05T15:37:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f469aff5700 1 -- 172.21.15.17:0/3911198687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46b006de90 con 0x55fe5ccc9a60 2023-10-05T15:37:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f46d0c22b80 10 client.15903 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:27.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.288+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fe5ca2ec60 con 0x55fe5ccc9a60 2023-10-05T15:37:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f469aff5700 1 -- 172.21.15.17:0/3911198687 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe5ccbaf10 con 0x55fe5ccc9a60 2023-10-05T15:37:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f469aff5700 1 -- 172.21.15.17:0/3911198687 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46b0099000 con 0x55fe5ccc9a60 2023-10-05T15:37:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f46d0c22b80 10 client.15903 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f46d0c22b80 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f46d0c22b80 20 client.15903 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:27.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cce21d0 0x55fe5cce45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f46d0c22b80 4 client.15903 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.289+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe5cc13e10 con 0x55fe5cce21d0 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.290+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cce21d0 0x55fe5cce45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.290+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cce21d0 0x55fe5cce45f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488f6f8f5f8dff02 server_cookie=73ca374472bdc651 in_seq=0 out_seq=0 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.290+0000 7f469aff5700 10 client.15903 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f469aff5700 1 -- 172.21.15.17:0/3911198687 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe5cc13e10 con 0x55fe5cce21d0 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f469aff5700 10 client.15903 handle_command_reply: tid=0 2023-10-05T15:37:27.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 client.15903 shutdown 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 msgr2=0x55fe5ccdda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdda10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f46b0099810 tx=0x7f46b00195a0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 shutdown_connections 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cce21d0 0x55fe5cce45f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdda10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8260 0x55fe5ccd6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/3911198687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccd69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f469aff5700 0 client.15903 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 >> 172.21.15.17:0/3911198687 conn(0x55fe5cc3c260 msgr2=0x55fe5ccc2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 shutdown_connections 2023-10-05T15:37:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.291+0000 7f46d0c22b80 1 -- 172.21.15.17:0/3911198687 wait complete. 2023-10-05T15:37:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.292+0000 7f46d0c22b80 20 client.15903 trim_cache size 0 max 16384 2023-10-05T15:37:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.316+0000 7f46d0c22b80 1 Processor -- start 2023-10-05T15:37:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.316+0000 7f46d0c22b80 1 -- start start 2023-10-05T15:37:27.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5cccfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5ca9b920 con 0x55fe5ccc9a60 2023-10-05T15:37:27.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5ccd76b0 con 0x55fe5ccc8bc0 2023-10-05T15:37:27.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5ccd74c0 con 0x55fe5ccc8260 2023-10-05T15:37:27.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46b759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5cccfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46b659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46b759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5cccfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50330/0 (socket says 172.21.15.17:50330) 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46b659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52114/0 (socket says 172.21.15.17:52114) 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.317+0000 7f46b759e700 1 -- 172.21.15.17:0/1251239783 learned_addr learned my addr 172.21.15.17:0/1251239783 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b6d9d700 1 -- 172.21.15.17:0/1251239783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 msgr2=0x55fe5ccdd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b6d9d700 1 -- 172.21.15.17:0/1251239783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 msgr2=0x55fe5cccfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5cccfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b6d9d700 1 -- 172.21.15.17:0/1251239783 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe5ca6c250 con 0x55fe5ccc8260 2023-10-05T15:37:27.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b759e700 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5cccfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:27.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc2f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46a8000c00 tx=0x7f46a801e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8a68515763f32e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:27.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f469dffb700 1 -- 172.21.15.17:0/1251239783 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a802b040 con 0x55fe5ccc8260 2023-10-05T15:37:27.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f469dffb700 1 -- 172.21.15.17:0/1251239783 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46a801d040 con 0x55fe5ccc8260 2023-10-05T15:37:27.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.318+0000 7f469dffb700 1 -- 172.21.15.17:0/1251239783 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800b930 con 0x55fe5ccc8260 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1251239783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8260 msgr2=0x55fe5ccc2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc2f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46a8000c00 tx=0x7f46a801e000 comp rx=0 tx=0).stop 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1251239783 shutdown_connections 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc9a60 0x55fe5cccfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc8260 0x55fe5ccc2f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/1251239783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1251239783 >> 172.21.15.17:0/1251239783 conn(0x55fe5cc3c260 msgr2=0x55fe5ccd0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:27.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1251239783 shutdown_connections 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.319+0000 7f46d0c22b80 1 -- 172.21.15.17:0/1251239783 wait complete. 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.320+0000 7f46d0c22b80 1 -- start start 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.320+0000 7f46d0c22b80 1 Processor -- start 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccdd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5ccdc770 con 0x55fe5ccc8260 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5ccdc8e0 con 0x55fe5ccc8bc0 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5ccdcaa0 con 0x55fe5ccc9a60 2023-10-05T15:37:27.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46d0c22b80 10 client.0 _ll_register_callbacks cb 0x7f46b0099470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccdd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccdd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50338/0 (socket says 172.21.15.17:50338) 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 -- 172.21.15.17:0/151120086 learned_addr learned my addr 172.21.15.17:0/151120086 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b759e700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 -- 172.21.15.17:0/151120086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 msgr2=0x55fe5ccdc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 -- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 msgr2=0x55fe5ccdbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.321+0000 7f46b6d9d700 1 -- 172.21.15.17:0/151120086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe5ca2ec60 con 0x55fe5ccc8260 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f46b659c700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f46b6d9d700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccdd6e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f46a8010010 tx=0x7f46a800f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf6281a55ad8685 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f469aff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f469aff5700 1 -- 172.21.15.17:0/151120086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a802b040 con 0x55fe5ccc8260 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46ac00fb10 con 0x55fe5ccc8260 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f469aff5700 1 -- 172.21.15.17:0/151120086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f46a8030d10 con 0x55fe5ccc8260 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f469aff5700 1 -- 172.21.15.17:0/151120086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46a800b6b0 con 0x55fe5ccc8260 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f46d0c22b80 10 client.15909 fetch_fsmap learned FSMap version 27 2023-10-05T15:37:27.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.322+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f46b8109c90 con 0x55fe5ccc8260 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f469aff5700 1 -- 172.21.15.17:0/151120086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46ac00fb10 con 0x55fe5ccc8260 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f469aff5700 1 -- 172.21.15.17:0/151120086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46a8037070 con 0x55fe5ccc8260 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46d0c22b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 27 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46d0c22b80 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46d0c22b80 20 client.15909 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cd373b0 0x55fe5cd397d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46d0c22b80 4 client.15909 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fe5cc13b30 con 0x55fe5cd373b0 2023-10-05T15:37:27.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.323+0000 7f46b659c700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cd373b0 0x55fe5cd397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f46b659c700 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cd373b0 0x55fe5cd397d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e754503e8372ecfd server_cookie=3ecb601a38f81adf in_seq=0 out_seq=0 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f469aff5700 10 client.15909 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f469aff5700 1 -- 172.21.15.17:0/151120086 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fe5cc13b30 con 0x55fe5cd373b0 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f469aff5700 10 client.15909 handle_command_reply: tid=0 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f46d0c22b80 1 client.15909 shutdown 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 msgr2=0x55fe5ccdd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccdd6e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f46a8010010 tx=0x7f46a800f8f0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.324+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 shutdown_connections 2023-10-05T15:37:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fe5cd373b0 0x55fe5cd397d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fe5ccc9a60 0x55fe5ccdc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fe5ccc8260 0x55fe5ccdd6e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f469aff5700 0 client.15909 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:27.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 --2- 172.21.15.17:0/151120086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fe5ccc8bc0 0x55fe5ccdbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 >> 172.21.15.17:0/151120086 conn(0x55fe5cc3c260 msgr2=0x55fe5cccc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 shutdown_connections 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 1 -- 172.21.15.17:0/151120086 wait complete. 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.325+0000 7f46d0c22b80 20 client.15909 trim_cache size 0 max 16384 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:37:27.333 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout: "38582e9e-2a70-47af-86f3-a9ccb51ee5d7": { 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "38582e9e-2a70-47af-86f3-a9ccb51ee5d7", 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:37:27.334 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f46a00a1480 msgr2=0x7f46a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f46a00a1480 0x7f46a00a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46a80098c0 tx=0x7f46a8019040 comp rx=0 tx=0).stop 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 msgr2=0x7f46b819e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b819e120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c110 tx=0x7f46b000c420 comp rx=0 tx=0).stop 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 shutdown_connections 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f46a00a1480 0x7f46a00a3940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46b8102a40 0x7f46b819e120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b8100ea0 0x7f46b8196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 --2- 172.21.15.17:0/525966567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b8102080 0x7f46b81970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 >> 172.21.15.17:0/525966567 conn(0x7f46b80fc460 msgr2=0x7f46b80fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 shutdown_connections 2023-10-05T15:37:27.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:27.326+0000 7f46bd1ff700 1 -- 172.21.15.17:0/525966567 wait complete. 2023-10-05T15:37:27.348 INFO:tasks.cephfs.filesystem:scrub status for tag:38582e9e-2a70-47af-86f3-a9ccb51ee5d7 - {'path': '/', 'tag': '38582e9e-2a70-47af-86f3-a9ccb51ee5d7', 'options': 'recursive,force'} 2023-10-05T15:37:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:400000 of 3200000 tuples (12%) done (elapsed 6.04 s, remaining 42.25 s) 2023-10-05T15:37:27.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:27 smithi017 ceph-mon[129107]: pgmap v395: 129 pgs: 129 active+clean; 74 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 4.9 MiB/s wr, 218 op/s 2023-10-05T15:37:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:27 smithi167 ceph-mon[133366]: pgmap v395: 129 pgs: 129 active+clean; 74 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 4.9 MiB/s wr, 218 op/s 2023-10-05T15:37:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:27 smithi079 ceph-mon[132936]: pgmap v395: 129 pgs: 129 active+clean; 74 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 4.9 MiB/s wr, 218 op/s 2023-10-05T15:37:28.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:28 smithi017 ceph-mon[129107]: scrub queued for path: / 2023-10-05T15:37:28.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:28 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:37:28.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:28 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:37:28.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:28 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:37:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:28 smithi167 ceph-mon[133366]: scrub queued for path: / 2023-10-05T15:37:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:28 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:37:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:28 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:37:29.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:28 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:37:29.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:28 smithi079 ceph-mon[132936]: scrub queued for path: / 2023-10-05T15:37:29.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:28 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:37:29.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:28 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:37:29.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:28 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:37:29.556 INFO:teuthology.orchestra.run.smithi017.stderr:500000 of 3200000 tuples (15%) done (elapsed 7.91 s, remaining 42.73 s) 2023-10-05T15:37:29.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:29 smithi017 ceph-mon[129107]: pgmap v396: 129 pgs: 129 active+clean; 106 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 10 MiB/s wr, 243 op/s 2023-10-05T15:37:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:29 smithi167 ceph-mon[133366]: pgmap v396: 129 pgs: 129 active+clean; 106 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 10 MiB/s wr, 243 op/s 2023-10-05T15:37:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:29 smithi079 ceph-mon[132936]: pgmap v396: 129 pgs: 129 active+clean; 106 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 10 MiB/s wr, 243 op/s 2023-10-05T15:37:30.918 INFO:teuthology.orchestra.run.smithi017.stderr:600000 of 3200000 tuples (18%) done (elapsed 9.28 s, remaining 40.19 s) 2023-10-05T15:37:31.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:31 smithi017 ceph-mon[129107]: pgmap v397: 129 pgs: 129 active+clean; 140 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 16 MiB/s wr, 289 op/s 2023-10-05T15:37:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:31 smithi167 ceph-mon[133366]: pgmap v397: 129 pgs: 129 active+clean; 140 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 16 MiB/s wr, 289 op/s 2023-10-05T15:37:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:31 smithi079 ceph-mon[132936]: pgmap v397: 129 pgs: 129 active+clean; 140 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 16 MiB/s wr, 289 op/s 2023-10-05T15:37:32.718 INFO:teuthology.orchestra.run.smithi017.stderr:700000 of 3200000 tuples (21%) done (elapsed 11.08 s, remaining 39.55 s) 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.859+0000 7fb5cad9d700 1 -- 172.21.15.17:0/3156150892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c4101f30 msgr2=0x7fb5c4102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/3156150892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c4101f30 0x7fb5c4102390 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40099c0 tx=0x7fb5b4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 -- 172.21.15.17:0/3156150892 shutdown_connections 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/3156150892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5c41028d0 0x7fb5c4109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/3156150892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 0x7fb5c4101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/3156150892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c4101f30 0x7fb5c4102390 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 -- 172.21.15.17:0/3156150892 >> 172.21.15.17:0/3156150892 conn(0x7fb5c40fc2d0 msgr2=0x7fb5c40fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 -- 172.21.15.17:0/3156150892 shutdown_connections 2023-10-05T15:37:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.860+0000 7fb5cad9d700 1 -- 172.21.15.17:0/3156150892 wait complete. 2023-10-05T15:37:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 Processor -- start 2023-10-05T15:37:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 -- start start 2023-10-05T15:37:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 0x7fb5c4106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5c4101f30 0x7fb5c4107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 0x7fb5c4103650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4103df0 con 0x7fb5c41028d0 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4103f60 con 0x7fb5c4100d40 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.861+0000 7fb5cad9d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4104120 con 0x7fb5c4101f30 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 0x7fb5c4103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 0x7fb5c4103650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50342/0 (socket says 172.21.15.17:50342) 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5ca59c700 1 -- 172.21.15.17:0/2436515357 learned_addr learned my addr 172.21.15.17:0/2436515357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 0x7fb5c4106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5c959a700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5c4101f30 0x7fb5c4107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2436515357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5c4101f30 msgr2=0x7fb5c4107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.862+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5c4101f30 0x7fb5c4107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 msgr2=0x7fb5c4103650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 0x7fb5c4103650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2436515357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40095f0 con 0x7fb5c4100d40 2023-10-05T15:37:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5ca59c700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 0x7fb5c4103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 0x7fb5c4106ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e9c0 tx=0x7fb5c000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5baffd700 1 -- 172.21.15.17:0/2436515357 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0004220 con 0x7fb5c4100d40 2023-10-05T15:37:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5baffd700 1 -- 172.21.15.17:0/2436515357 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5c0004380 con 0x7fb5c4100d40 2023-10-05T15:37:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c41a5080 con 0x7fb5c4100d40 2023-10-05T15:37:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5baffd700 1 -- 172.21.15.17:0/2436515357 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0003b40 con 0x7fb5c4100d40 2023-10-05T15:37:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.863+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c41a55b0 con 0x7fb5c4100d40 2023-10-05T15:37:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.867+0000 7fb5baffd700 1 -- 172.21.15.17:0/2436515357 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb5c0003ca0 con 0x7fb5c4100d40 2023-10-05T15:37:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.868+0000 7fb5df9d2b80 1 Processor -- start 2023-10-05T15:37:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.868+0000 7fb5df9d2b80 1 -- start start 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5baffd700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5b00a1500 0x7fb5b00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299a1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299a9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d929909400 con 0x55d9299a2af0 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9298fabc0 con 0x55d9299a2130 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9298f84e0 con 0x55d9299a1020 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5baffd700 1 -- 172.21.15.17:0/2436515357 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb5c0014070 con 0x7fb5c4100d40 2023-10-05T15:37:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:36138/0 (socket says 172.21.15.17:36138) 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2141764852 learned_addr learned my addr 172.21.15.17:0/2141764852 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5ca59c700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5b00a1500 0x7fb5b00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5ca59c700 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5c959a700 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.869+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2141764852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 msgr2=0x55d9299a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2141764852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 msgr2=0x55d9299a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2141764852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d92971ed80 con 0x55d9299a1020 2023-10-05T15:37:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5c959a700 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5ca59c700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5b00a1500 0x7fb5b00a39c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009fd0 tx=0x7fb5bc009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299a1440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00966b0 tx=0x7fb5c0096620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249076a57e79a525 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5affff700 1 -- 172.21.15.17:0/2141764852 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00b9e30 con 0x55d9299a1020 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5affff700 1 -- 172.21.15.17:0/2141764852 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5c00044f0 con 0x55d9299a1020 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.870+0000 7fb5affff700 1 -- 172.21.15.17:0/2141764852 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00a2540 con 0x55d9299a1020 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2141764852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 msgr2=0x55d9299a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299a1440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5c00966b0 tx=0x7fb5c0096620 comp rx=0 tx=0).stop 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2141764852 shutdown_connections 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299a1440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2141764852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2141764852 >> 172.21.15.17:0/2141764852 conn(0x55d929915200 msgr2=0x55d92999bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2141764852 shutdown_connections 2023-10-05T15:37:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.871+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2141764852 wait complete. 2023-10-05T15:37:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.872+0000 7fb5df9d2b80 1 -- start start 2023-10-05T15:37:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.872+0000 7fb5df9d2b80 1 Processor -- start 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a1020 0x55d9299aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2130 0x55d9299ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9298f3dd0 con 0x55d9299a2af0 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9298906b0 con 0x55d9299a1020 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d929890350 con 0x55d9299a2130 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5df9d2b80 10 client.0 _ll_register_callbacks cb 0x55d9296ed7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c959a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2130 0x55d9299ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a1020 0x55d9299aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c959a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2130 0x55d9299ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:36152/0 (socket says 172.21.15.17:36152) 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c959a700 1 -- 172.21.15.17:0/1037198410 learned_addr learned my addr 172.21.15.17:0/1037198410 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/1037198410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2130 msgr2=0x55d9299ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2130 0x55d9299ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/1037198410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 msgr2=0x55d9299b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.873+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/1037198410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c41a55b0 con 0x55d9299a1020 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a1020 0x55d9299aad00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000f010 tx=0x7fb5c0098760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcf0a4a7c1e7dce server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/1037198410 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c00b9e30 con 0x55d9299a1020 2023-10-05T15:37:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/1037198410 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb5c009a1b0 con 0x55d9299a1020 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d929993eb0 con 0x55d9299a1020 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/1037198410 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5c00caa10 con 0x55d9299a1020 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5df9d2b80 10 client.25721 fetch_fsmap learned FSMap version 28 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d929707c00 con 0x55d9299a1020 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.874+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/1037198410 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d929993eb0 con 0x55d9299a1020 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/1037198410 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb5c00996a0 con 0x55d9299a1020 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5df9d2b80 10 client.25721 fetch_fsmap finished waiting for FSMap version 28 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5df9d2b80 10 client.25721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5df9d2b80 20 client.25721 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d9299b67b0 0x55d9299b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5df9d2b80 4 client.25721 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9298ecdb0 con 0x55d9299b67b0 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.875+0000 7fb5c959a700 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d9299b67b0 0x55d9299b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.876+0000 7fb5c959a700 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d9299b67b0 0x55d9299b8bd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8166efb1146b2c71 server_cookie=121214f2f9f2bb6e in_seq=0 out_seq=0 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.876+0000 7fb5ad7fa700 10 client.25721 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.876+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/1037198410 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d9298ecdb0 con 0x55d9299b67b0 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5ad7fa700 10 client.25721 handle_command_reply: tid=0 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 client.25721 shutdown 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a1020 msgr2=0x55d9299aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a1020 0x55d9299aad00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000f010 tx=0x7fb5c0098760 comp rx=0 tx=0).stop 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 shutdown_connections 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d9299b67b0 0x55d9299b8bd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a1020 0x55d9299aad00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5ad7fa700 0 client.25721 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/1037198410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2130 0x55d9299ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 >> 172.21.15.17:0/1037198410 conn(0x55d929915200 msgr2=0x55d92999b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 shutdown_connections 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/1037198410 wait complete. 2023-10-05T15:37:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.877+0000 7fb5df9d2b80 20 client.25721 trim_cache size 0 max 16384 2023-10-05T15:37:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 Processor -- start 2023-10-05T15:37:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 -- start start 2023-10-05T15:37:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 0x55d92999c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2af0 0x55d9299a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9299aa8d0 con 0x55d9299a1020 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9297748c0 con 0x55d9299a2130 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.895+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9299aa1b0 con 0x55d9299a2af0 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 0x55d92999c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 0x55d92999c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50368/0 (socket says 172.21.15.17:50368) 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2651270953 learned_addr learned my addr 172.21.15.17:0/2651270953 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c959a700 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5ca59c700 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2af0 0x55d9299a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2651270953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2af0 msgr2=0x55d9299a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2af0 0x55d9299a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2651270953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 msgr2=0x55d9299b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c9d9b700 1 -- 172.21.15.17:0/2651270953 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9297451f0 con 0x55d9299a1020 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.896+0000 7fb5c959a700 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.897+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 0x55d92999c9e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb5c009a140 tx=0x7fb5c0096620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86a659fc0c50a9b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.897+0000 7fb5b8ff9700 1 -- 172.21.15.17:0/2651270953 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c009a8b0 con 0x55d9299a1020 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.897+0000 7fb5b8ff9700 1 -- 172.21.15.17:0/2651270953 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5c009a1b0 con 0x55d9299a1020 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.897+0000 7fb5b8ff9700 1 -- 172.21.15.17:0/2651270953 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c009a410 con 0x55d9299a1020 2023-10-05T15:37:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2651270953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 msgr2=0x55d92999c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 0x55d92999c9e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb5c009a140 tx=0x7fb5c0096620 comp rx=0 tx=0).stop 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2651270953 shutdown_connections 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a2af0 0x55d9299a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a1020 0x55d92999c9e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/2651270953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2651270953 >> 172.21.15.17:0/2651270953 conn(0x55d929915200 msgr2=0x55d9299a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2651270953 shutdown_connections 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/2651270953 wait complete. 2023-10-05T15:37:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.898+0000 7fb5df9d2b80 1 -- start start 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 Processor -- start 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9299b1250 con 0x55d9299a2af0 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9299b13c0 con 0x55d9299a2130 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9299b1580 con 0x55d9299a1020 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5df9d2b80 10 client.0 _ll_register_callbacks cb 0x7fb5c009a010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5ca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50382/0 (socket says 172.21.15.17:50382) 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5c959a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.899+0000 7fb5ca59c700 1 -- 172.21.15.17:0/3437335197 learned_addr learned my addr 172.21.15.17:0/3437335197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c959a700 1 -- 172.21.15.17:0/3437335197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 msgr2=0x55d9299af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c959a700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c959a700 1 -- 172.21.15.17:0/3437335197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 msgr2=0x55d9299b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c959a700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c959a700 1 -- 172.21.15.17:0/3437335197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c4109ad0 con 0x55d9299a2130 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5ca59c700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5c959a700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299afd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55d9299b9470 tx=0x7fb5b400b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72f61f7d2d754d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.900+0000 7fb5ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/3437335197 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b401d030 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5c00044f0 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/3437335197 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb5b4027a70 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/3437335197 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5b4027c30 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5df9d2b80 10 client.25727 fetch_fsmap learned FSMap version 28 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d929707c00 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/3437335197 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5c00044f0 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.901+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/3437335197 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 28) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb5b40054d0 con 0x55d9299a2130 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5df9d2b80 10 client.25727 fetch_fsmap finished waiting for FSMap version 28 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5df9d2b80 10 client.25727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5df9d2b80 20 client.25727 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d929a0acf0 0x55d929a0d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5df9d2b80 4 client.25727 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:37:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d9298ecad0 con 0x55d929a0acf0 2023-10-05T15:37:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d929a0acf0 0x55d929a0d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5c9d9b700 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d929a0acf0 0x55d929a0d0e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7e6368956769803 server_cookie=8f1f5a5a6a4ecc03 in_seq=0 out_seq=0 2023-10-05T15:37:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.902+0000 7fb5ad7fa700 10 client.25727 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.928+0000 7fb5ad7fa700 1 -- 172.21.15.17:0/3437335197 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d9298ecad0 con 0x55d929a0acf0 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.928+0000 7fb5ad7fa700 10 client.25727 handle_command_reply: tid=0 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.928+0000 7fb5df9d2b80 1 client.25727 shutdown 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 msgr2=0x55d9299afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299afd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55d9299b9470 tx=0x7fb5b400b860 comp rx=0 tx=0).stop 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 shutdown_connections 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d929a0acf0 0x55d929a0d0e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9299a2af0 0x55d9299b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d9299a1020 0x55d9299af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 --2- 172.21.15.17:0/3437335197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d9299a2130 0x55d9299afd00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 >> 172.21.15.17:0/3437335197 conn(0x55d929915200 msgr2=0x55d92999c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5ad7fa700 0 client.25727 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 shutdown_connections 2023-10-05T15:37:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 1 -- 172.21.15.17:0/3437335197 wait complete. 2023-10-05T15:37:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.929+0000 7fb5df9d2b80 20 client.25727 trim_cache size 0 max 16384 2023-10-05T15:37:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:37:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:37:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:37:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:37:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5b00a1500 msgr2=0x7fb5b00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5b00a1500 0x7fb5b00a39c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009fd0 tx=0x7fb5bc009920 comp rx=0 tx=0).stop 2023-10-05T15:37:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 msgr2=0x7fb5c4106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 0x7fb5c4106ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e9c0 tx=0x7fb5c000ecd0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 shutdown_connections 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb5b00a1500 0x7fb5b00a39c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5c41028d0 0x7fb5c4103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5c4100d40 0x7fb5c4106ac0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 --2- 172.21.15.17:0/2436515357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5c4101f30 0x7fb5c4107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 >> 172.21.15.17:0/2436515357 conn(0x7fb5c40fc2d0 msgr2=0x7fb5c40fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 shutdown_connections 2023-10-05T15:37:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:32.930+0000 7fb5cad9d700 1 -- 172.21.15.17:0/2436515357 wait complete. 2023-10-05T15:37:32.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:32 smithi017 ceph-mon[129107]: scrub summary: idle 2023-10-05T15:37:32.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:32 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:32 smithi167 ceph-mon[133366]: scrub summary: idle 2023-10-05T15:37:33.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:32 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:33.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:32 smithi079 ceph-mon[132936]: scrub summary: idle 2023-10-05T15:37:33.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:32 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:33.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:33 smithi017 ceph-mon[129107]: pgmap v398: 129 pgs: 129 active+clean; 144 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 16 MiB/s wr, 236 op/s 2023-10-05T15:37:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:33 smithi167 ceph-mon[133366]: pgmap v398: 129 pgs: 129 active+clean; 144 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 16 MiB/s wr, 236 op/s 2023-10-05T15:37:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:33 smithi079 ceph-mon[132936]: pgmap v398: 129 pgs: 129 active+clean; 144 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 16 MiB/s wr, 236 op/s 2023-10-05T15:37:34.636 INFO:teuthology.orchestra.run.smithi017.stderr:800000 of 3200000 tuples (25%) done (elapsed 12.99 s, remaining 38.98 s) 2023-10-05T15:37:35.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:35 smithi017 ceph-mon[129107]: pgmap v399: 129 pgs: 129 active+clean; 200 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 25 MiB/s wr, 195 op/s 2023-10-05T15:37:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:900000 of 3200000 tuples (28%) done (elapsed 14.35 s, remaining 36.67 s) 2023-10-05T15:37:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:35 smithi167 ceph-mon[133366]: pgmap v399: 129 pgs: 129 active+clean; 200 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 25 MiB/s wr, 195 op/s 2023-10-05T15:37:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:35 smithi079 ceph-mon[132936]: pgmap v399: 129 pgs: 129 active+clean; 200 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 25 MiB/s wr, 195 op/s 2023-10-05T15:37:37.932 INFO:teuthology.orchestra.run.smithi017.stderr:1000000 of 3200000 tuples (31%) done (elapsed 16.29 s, remaining 35.84 s) 2023-10-05T15:37:37.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:37 smithi017 ceph-mon[129107]: pgmap v400: 129 pgs: 129 active+clean; 204 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 23 MiB/s wr, 122 op/s 2023-10-05T15:37:37.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:37 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:37 smithi167 ceph-mon[133366]: pgmap v400: 129 pgs: 129 active+clean; 204 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 23 MiB/s wr, 122 op/s 2023-10-05T15:37:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:37 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:37 smithi079 ceph-mon[132936]: pgmap v400: 129 pgs: 129 active+clean; 204 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 23 MiB/s wr, 122 op/s 2023-10-05T15:37:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:37 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:39.780 INFO:teuthology.orchestra.run.smithi017.stderr:1100000 of 3200000 tuples (34%) done (elapsed 18.14 s, remaining 34.63 s) 2023-10-05T15:37:39.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:39 smithi017 ceph-mon[129107]: pgmap v401: 129 pgs: 129 active+clean; 241 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 28 MiB/s wr, 118 op/s 2023-10-05T15:37:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:39 smithi167 ceph-mon[133366]: pgmap v401: 129 pgs: 129 active+clean; 241 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 28 MiB/s wr, 118 op/s 2023-10-05T15:37:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:39 smithi079 ceph-mon[132936]: pgmap v401: 129 pgs: 129 active+clean; 241 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 28 MiB/s wr, 118 op/s 2023-10-05T15:37:41.101 INFO:teuthology.orchestra.run.smithi017.stderr:1200000 of 3200000 tuples (37%) done (elapsed 19.46 s, remaining 32.43 s) 2023-10-05T15:37:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:41 smithi167 ceph-mon[133366]: pgmap v402: 129 pgs: 129 active+clean; 274 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 28 MiB/s wr, 97 op/s 2023-10-05T15:37:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:41 smithi079 ceph-mon[132936]: pgmap v402: 129 pgs: 129 active+clean; 274 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 28 MiB/s wr, 97 op/s 2023-10-05T15:37:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:41 smithi017 ceph-mon[129107]: pgmap v402: 129 pgs: 129 active+clean; 274 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 28 MiB/s wr, 97 op/s 2023-10-05T15:37:42.879 INFO:teuthology.orchestra.run.smithi017.stderr:1300000 of 3200000 tuples (40%) done (elapsed 21.24 s, remaining 31.04 s) 2023-10-05T15:37:43.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:43 smithi017 ceph-mon[129107]: pgmap v403: 129 pgs: 129 active+clean; 284 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-10-05T15:37:43.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:43 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:43 smithi167 ceph-mon[133366]: pgmap v403: 129 pgs: 129 active+clean; 284 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-10-05T15:37:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:43 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:43 smithi079 ceph-mon[132936]: pgmap v403: 129 pgs: 129 active+clean; 284 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-10-05T15:37:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:43 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:44.779 INFO:teuthology.orchestra.run.smithi017.stderr:1400000 of 3200000 tuples (43%) done (elapsed 23.14 s, remaining 29.75 s) 2023-10-05T15:37:45.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:45 smithi017 ceph-mon[129107]: pgmap v404: 129 pgs: 129 active+clean; 330 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 43 op/s 2023-10-05T15:37:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:45 smithi167 ceph-mon[133366]: pgmap v404: 129 pgs: 129 active+clean; 330 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 43 op/s 2023-10-05T15:37:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.102+0000 7fd26359e700 1 -- 172.21.15.17:0/860864117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2640738b0 msgr2=0x7fd264073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.102+0000 7fd26359e700 1 --2- 172.21.15.17:0/860864117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2640738b0 0x7fd264073d30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd258009990 tx=0x7fd258009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 -- 172.21.15.17:0/860864117 shutdown_connections 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 --2- 172.21.15.17:0/860864117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd264108c10 0x7fd26410b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 --2- 172.21.15.17:0/860864117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd2640732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 --2- 172.21.15.17:0/860864117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2640738b0 0x7fd264073d30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 -- 172.21.15.17:0/860864117 >> 172.21.15.17:0/860864117 conn(0x7fd2640fc2d0 msgr2=0x7fd2640fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 -- 172.21.15.17:0/860864117 shutdown_connections 2023-10-05T15:37:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.103+0000 7fd26359e700 1 -- 172.21.15.17:0/860864117 wait complete. 2023-10-05T15:37:46.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:45 smithi079 ceph-mon[132936]: pgmap v404: 129 pgs: 129 active+clean; 330 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 32 MiB/s wr, 43 op/s 2023-10-05T15:37:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.104+0000 7fd26359e700 1 Processor -- start 2023-10-05T15:37:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.104+0000 7fd26359e700 1 -- start start 2023-10-05T15:37:46.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2640738b0 0x7fd264198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26359e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd264199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd264108c10 0x7fd2641a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26359e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641a0680 con 0x7fd264108c10 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26359e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641a07c0 con 0x7fd2640738b0 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26359e700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2641a0950 con 0x7fd264074e90 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd264199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd262d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd264108c10 0x7fd2641a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd26259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2640738b0 0x7fd264198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd264199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54322/0 (socket says 172.21.15.17:54322) 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.105+0000 7fd261d9b700 1 -- 172.21.15.17:0/483423950 learned_addr learned my addr 172.21.15.17:0/483423950 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd261d9b700 1 -- 172.21.15.17:0/483423950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2640738b0 msgr2=0x7fd264198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd261d9b700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2640738b0 0x7fd264198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd261d9b700 1 -- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd264108c10 msgr2=0x7fd2641a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd261d9b700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd264108c10 0x7fd2641a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd261d9b700 1 -- 172.21.15.17:0/483423950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580095f0 con 0x7fd264074e90 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd262d9d700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd264108c10 0x7fd2641a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd261d9b700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd264199040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd258006010 tx=0x7fd258003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd2537fe700 1 -- 172.21.15.17:0/483423950 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25801d070 con 0x7fd264074e90 2023-10-05T15:37:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd2537fe700 1 -- 172.21.15.17:0/483423950 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd25800bd70 con 0x7fd264074e90 2023-10-05T15:37:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd2537fe700 1 -- 172.21.15.17:0/483423950 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258022c40 con 0x7fd264074e90 2023-10-05T15:37:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.106+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2641a0bd0 con 0x7fd264074e90 2023-10-05T15:37:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.107+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2641a0fa0 con 0x7fd264074e90 2023-10-05T15:37:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.110+0000 7fd2537fe700 1 -- 172.21.15.17:0/483423950 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd258022470 con 0x7fd264074e90 2023-10-05T15:37:46.112 INFO:teuthology.orchestra.run.smithi017.stderr:1500000 of 3200000 tuples (46%) done (elapsed 24.47 s, remaining 27.73 s) 2023-10-05T15:37:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.112+0000 7fd27c9d1b80 1 Processor -- start 2023-10-05T15:37:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.112+0000 7fd27c9d1b80 1 -- start start 2023-10-05T15:37:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd2537fe700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd24c0a1500 0x7fd24c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3af0 0x564a5c5ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c51a400 con 0x564a5c5b3130 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c50bbc0 con 0x564a5c5b3af0 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c5094e0 con 0x564a5c5b2020 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd2537fe700 1 -- 172.21.15.17:0/483423950 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd2580ce690 con 0x7fd264074e90 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd26259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd26259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54324/0 (socket says 172.21.15.17:54324) 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd26259c700 1 -- 172.21.15.17:0/1960134707 learned_addr learned my addr 172.21.15.17:0/1960134707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38684/0 (socket says 172.21.15.17:38684) 2023-10-05T15:37:46.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.113+0000 7fd262d9d700 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3af0 0x564a5c5ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd26259c700 1 -- 172.21.15.17:0/1960134707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3af0 msgr2=0x564a5c5ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd26259c700 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3af0 0x564a5c5ba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd262d9d700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd24c0a1500 0x7fd24c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd26259c700 1 -- 172.21.15.17:0/1960134707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 msgr2=0x564a5c5b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd26259c700 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd26259c700 1 -- 172.21.15.17:0/1960134707 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a5c32fd80 con 0x564a5c5b2020 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd26259c700 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5b2440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd254007d70 tx=0x7fd2540106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540354cc7d5c8563 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd262d9d700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd24c0a1500 0x7fd24c0a39c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd25c007910 tx=0x7fd25c009100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd250ff9700 1 -- 172.21.15.17:0/1960134707 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254010db0 con 0x564a5c5b2020 2023-10-05T15:37:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd250ff9700 1 -- 172.21.15.17:0/1960134707 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd254015070 con 0x564a5c5b2020 2023-10-05T15:37:46.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.114+0000 7fd250ff9700 1 -- 172.21.15.17:0/1960134707 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254003d50 con 0x564a5c5b2020 2023-10-05T15:37:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1960134707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 msgr2=0x564a5c5b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5b2440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd254007d70 tx=0x7fd2540106b0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1960134707 shutdown_connections 2023-10-05T15:37:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3af0 0x564a5c5ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5b2440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1960134707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1960134707 >> 172.21.15.17:0/1960134707 conn(0x564a5c526200 msgr2=0x564a5c5acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.115+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1960134707 shutdown_connections 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.116+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1960134707 wait complete. 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.116+0000 7fd27c9d1b80 1 -- start start 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 Processor -- start 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5bc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c504dd0 con 0x564a5c5b3af0 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c4a16b0 con 0x564a5c5b3130 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c4a1350 con 0x564a5c5b2020 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.117+0000 7fd27c9d1b80 10 client.0 _ll_register_callbacks cb 0x564a5c2fe7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54336/0 (socket says 172.21.15.17:54336) 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 -- 172.21.15.17:0/1205996948 learned_addr learned my addr 172.21.15.17:0/1205996948 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd261d9b700 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5bc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 -- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 msgr2=0x564a5c5bc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5bc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 -- 172.21.15.17:0/1205996948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 msgr2=0x564a5c5c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.118+0000 7fd26259c700 1 -- 172.21.15.17:0/1205996948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2540079a0 con 0x564a5c5b2020 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.119+0000 7fd26259c700 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbd10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd254003850 tx=0x7fd254007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e0e549f85737bae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.119+0000 7fd249ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.119+0000 7fd249ffb700 1 -- 172.21.15.17:0/1205996948 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254020070 con 0x564a5c5b2020 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.119+0000 7fd249ffb700 1 -- 172.21.15.17:0/1205996948 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd25401a480 con 0x564a5c5b2020 2023-10-05T15:37:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.119+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a5c5a4eb0 con 0x564a5c5b2020 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.120+0000 7fd249ffb700 1 -- 172.21.15.17:0/1205996948 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd25401a640 con 0x564a5c5b2020 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.120+0000 7fd27c9d1b80 10 client.25720 fetch_fsmap learned FSMap version 30 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.120+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564a5c318c00 con 0x564a5c5b2020 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.120+0000 7fd249ffb700 1 -- 172.21.15.17:0/1205996948 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a5c5a4eb0 con 0x564a5c5b2020 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd249ffb700 1 -- 172.21.15.17:0/1205996948 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd254011950 con 0x564a5c5b2020 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd27c9d1b80 10 client.25720 fetch_fsmap finished waiting for FSMap version 30 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd27c9d1b80 10 client.25720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd27c9d1b80 20 client.25720 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c5c7bf0 0x564a5c5ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd27c9d1b80 4 client.25720 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a5c4fddb0 con 0x564a5c5c7bf0 2023-10-05T15:37:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.121+0000 7fd261d9b700 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c5c7bf0 0x564a5c5ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.122+0000 7fd261d9b700 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c5c7bf0 0x564a5c5ca010 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a4f164a737f552 server_cookie=67a1a58a2c712a6f in_seq=0 out_seq=0 2023-10-05T15:37:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.122+0000 7fd249ffb700 10 client.25720 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd249ffb700 1 -- 172.21.15.17:0/1205996948 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a5c4fddb0 con 0x564a5c5c7bf0 2023-10-05T15:37:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd249ffb700 10 client.25720 handle_command_reply: tid=0 2023-10-05T15:37:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 client.25720 shutdown 2023-10-05T15:37:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 msgr2=0x564a5c5bbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbd10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd254003850 tx=0x7fd254007f70 comp rx=0 tx=0).stop 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 shutdown_connections 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c5c7bf0 0x564a5c5ca010 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbd10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1205996948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5bc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd249ffb700 0 client.25720 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 >> 172.21.15.17:0/1205996948 conn(0x564a5c526200 msgr2=0x564a5c5ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 shutdown_connections 2023-10-05T15:37:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1205996948 wait complete. 2023-10-05T15:37:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.123+0000 7fd27c9d1b80 20 client.25720 trim_cache size 0 max 16384 2023-10-05T15:37:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 Processor -- start 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 -- start start 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c5bb8e0 con 0x564a5c5b3af0 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c3858c0 con 0x564a5c5b3130 2023-10-05T15:37:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c5a76b0 con 0x564a5c5b2020 2023-10-05T15:37:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd262d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd262d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5bc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38698/0 (socket says 172.21.15.17:38698) 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.142+0000 7fd262d9d700 1 -- 172.21.15.17:0/1892560642 learned_addr learned my addr 172.21.15.17:0/1892560642 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd261d9b700 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd26259c700 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd262d9d700 1 -- 172.21.15.17:0/1892560642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 msgr2=0x564a5c5bbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd262d9d700 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd262d9d700 1 -- 172.21.15.17:0/1892560642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 msgr2=0x564a5c5c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd262d9d700 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd262d9d700 1 -- 172.21.15.17:0/1892560642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a5c3561f0 con 0x564a5c5b3af0 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.143+0000 7fd262d9d700 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5bc000 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd25c015860 tx=0x7fd25c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6086ebb771a07327 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd2517fa700 1 -- 172.21.15.17:0/1892560642 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c020070 con 0x564a5c5b3af0 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd2517fa700 1 -- 172.21.15.17:0/1892560642 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd25c00f040 con 0x564a5c5b3af0 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd2517fa700 1 -- 172.21.15.17:0/1892560642 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c01a520 con 0x564a5c5b3af0 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1892560642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 msgr2=0x564a5c5bc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5bc000 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd25c015860 tx=0x7fd25c004ad0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1892560642 shutdown_connections 2023-10-05T15:37:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3af0 0x564a5c5bc000 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b2020 0x564a5c5bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/1892560642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b3130 0x564a5c5c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.144+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1892560642 >> 172.21.15.17:0/1892560642 conn(0x564a5c526200 msgr2=0x564a5c5b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:46.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.145+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1892560642 shutdown_connections 2023-10-05T15:37:46.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.145+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/1892560642 wait complete. 2023-10-05T15:37:46.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.145+0000 7fd27c9d1b80 1 -- start start 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.145+0000 7fd27c9d1b80 1 Processor -- start 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b2020 0x564a5c5c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5c1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b3af0 0x564a5c5c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c5c25b0 con 0x564a5c5b3130 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c5c2720 con 0x564a5c5b2020 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5c5c28e0 con 0x564a5c5b3af0 2023-10-05T15:37:46.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd27c9d1b80 10 client.0 _ll_register_callbacks cb 0x7fd2580094b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd261d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5c1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38704/0 (socket says 172.21.15.17:38704) 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd261d9b700 1 -- 172.21.15.17:0/2456658461 learned_addr learned my addr 172.21.15.17:0/2456658461 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd262d9d700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b3af0 0x564a5c5c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.146+0000 7fd26259c700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b2020 0x564a5c5c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd261d9b700 1 -- 172.21.15.17:0/2456658461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b3af0 msgr2=0x564a5c5c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd261d9b700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b3af0 0x564a5c5c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd261d9b700 1 -- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b2020 msgr2=0x564a5c5c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd261d9b700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b2020 0x564a5c5c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd261d9b700 1 -- 172.21.15.17:0/2456658461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c011040 con 0x564a5c5b3130 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd26259c700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b2020 0x564a5c5c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd261d9b700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5c1060 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd2580cbd90 tx=0x7fd2580bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2475f874e9990f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd249ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd249ffb700 1 -- 172.21.15.17:0/2456658461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2580a3940 con 0x564a5c5b3130 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd249ffb700 1 -- 172.21.15.17:0/2456658461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd2580cbea0 con 0x564a5c5b3130 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd254015070 con 0x564a5c5b3130 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.147+0000 7fd249ffb700 1 -- 172.21.15.17:0/2456658461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd25806bb30 con 0x564a5c5b3130 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 10 client.15942 fetch_fsmap learned FSMap version 30 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x564a5c32e250 con 0x564a5c5b3130 2023-10-05T15:37:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd249ffb700 1 -- 172.21.15.17:0/2456658461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd254015070 con 0x564a5c5b3130 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd249ffb700 1 -- 172.21.15.17:0/2456658461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fd258068040 con 0x564a5c5b3130 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 10 client.15942 fetch_fsmap finished waiting for FSMap version 30 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 20 client.15942 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c61c230 0x564a5c61e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 4 client.15942 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.148+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a5c4fdad0 con 0x564a5c61c230 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.149+0000 7fd26259c700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c61c230 0x564a5c61e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.149+0000 7fd26259c700 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c61c230 0x564a5c61e620 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29a4d11d60a7390b server_cookie=c8fd2b47a65777d2 in_seq=0 out_seq=0 2023-10-05T15:37:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.149+0000 7fd249ffb700 10 client.15942 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.168+0000 7fd249ffb700 1 -- 172.21.15.17:0/2456658461 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a5c4fdad0 con 0x564a5c61c230 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.168+0000 7fd249ffb700 10 client.15942 handle_command_reply: tid=0 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.168+0000 7fd27c9d1b80 1 client.15942 shutdown 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.168+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 msgr2=0x564a5c5c1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.168+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5c1060 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd2580cbd90 tx=0x7fd2580bb040 comp rx=0 tx=0).stop 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 shutdown_connections 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a5c61c230 0x564a5c61e620 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a5c5b3af0 0x564a5c5c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a5c5b2020 0x564a5c5c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd249ffb700 0 client.15942 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 --2- 172.21.15.17:0/2456658461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a5c5b3130 0x564a5c5c1060 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 >> 172.21.15.17:0/2456658461 conn(0x564a5c526200 msgr2=0x564a5c5b9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 shutdown_connections 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 1 -- 172.21.15.17:0/2456658461 wait complete. 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.169+0000 7fd27c9d1b80 20 client.15942 trim_cache size 0 max 16384 2023-10-05T15:37:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:37:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:37:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:37:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:37:46.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd24c0a1500 msgr2=0x7fd24c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd24c0a1500 0x7fd24c0a39c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd25c007910 tx=0x7fd25c009100 comp rx=0 tx=0).stop 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 msgr2=0x7fd264199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd264199040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd258006010 tx=0x7fd258003a50 comp rx=0 tx=0).stop 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 shutdown_connections 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd24c0a1500 0x7fd24c0a39c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd264108c10 0x7fd2641a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2640738b0 0x7fd264198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 --2- 172.21.15.17:0/483423950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd264074e90 0x7fd264199040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 >> 172.21.15.17:0/483423950 conn(0x7fd2640fc2d0 msgr2=0x7fd2640fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 shutdown_connections 2023-10-05T15:37:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:46.170+0000 7fd26359e700 1 -- 172.21.15.17:0/483423950 wait complete. 2023-10-05T15:37:47.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:47 smithi017 ceph-mon[129107]: pgmap v405: 129 pgs: 129 active+clean; 339 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-10-05T15:37:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:1600000 of 3200000 tuples (50%) done (elapsed 26.33 s, remaining 26.33 s) 2023-10-05T15:37:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:47 smithi167 ceph-mon[133366]: pgmap v405: 129 pgs: 129 active+clean; 339 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-10-05T15:37:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:47 smithi079 ceph-mon[132936]: pgmap v405: 129 pgs: 129 active+clean; 339 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-10-05T15:37:48.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:48 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:49.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:48 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:49.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:48 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:37:49.307 INFO:teuthology.orchestra.run.smithi017.stderr:1700000 of 3200000 tuples (53%) done (elapsed 27.66 s, remaining 24.41 s) 2023-10-05T15:37:49.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:49 smithi017 ceph-mon[129107]: pgmap v406: 129 pgs: 129 active+clean; 361 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 31 op/s 2023-10-05T15:37:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:49 smithi167 ceph-mon[133366]: pgmap v406: 129 pgs: 129 active+clean; 361 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 31 op/s 2023-10-05T15:37:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:49 smithi079 ceph-mon[132936]: pgmap v406: 129 pgs: 129 active+clean; 361 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 27 MiB/s wr, 31 op/s 2023-10-05T15:37:51.191 INFO:teuthology.orchestra.run.smithi017.stderr:1800000 of 3200000 tuples (56%) done (elapsed 29.55 s, remaining 22.98 s) 2023-10-05T15:37:51.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:51 smithi017 ceph-mon[129107]: pgmap v407: 129 pgs: 129 active+clean; 409 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 MiB/s wr, 36 op/s 2023-10-05T15:37:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:51 smithi167 ceph-mon[133366]: pgmap v407: 129 pgs: 129 active+clean; 409 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 MiB/s wr, 36 op/s 2023-10-05T15:37:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:51 smithi079 ceph-mon[132936]: pgmap v407: 129 pgs: 129 active+clean; 409 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 MiB/s wr, 36 op/s 2023-10-05T15:37:53.024 INFO:teuthology.orchestra.run.smithi017.stderr:1900000 of 3200000 tuples (59%) done (elapsed 31.38 s, remaining 21.47 s) 2023-10-05T15:37:53.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:53 smithi017 ceph-mon[129107]: pgmap v408: 129 pgs: 129 active+clean; 425 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-10-05T15:37:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:53 smithi167 ceph-mon[133366]: pgmap v408: 129 pgs: 129 active+clean; 425 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-10-05T15:37:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:53 smithi079 ceph-mon[132936]: pgmap v408: 129 pgs: 129 active+clean; 425 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-10-05T15:37:54.216 INFO:teuthology.orchestra.run.smithi017.stderr:2000000 of 3200000 tuples (62%) done (elapsed 32.57 s, remaining 19.54 s) 2023-10-05T15:37:55.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:55 smithi017 ceph-mon[129107]: pgmap v409: 129 pgs: 129 active+clean; 473 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 30 MiB/s wr, 37 op/s 2023-10-05T15:37:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:55 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:37:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:55 smithi167 ceph-mon[133366]: pgmap v409: 129 pgs: 129 active+clean; 473 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 30 MiB/s wr, 37 op/s 2023-10-05T15:37:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:55 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:37:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:55 smithi079 ceph-mon[132936]: pgmap v409: 129 pgs: 129 active+clean; 473 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 30 MiB/s wr, 37 op/s 2023-10-05T15:37:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:55 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:37:56.134 INFO:teuthology.orchestra.run.smithi017.stderr:2100000 of 3200000 tuples (65%) done (elapsed 34.49 s, remaining 18.07 s) 2023-10-05T15:37:57.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:37:57.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.420 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.421 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:57 smithi017 ceph-mon[129107]: pgmap v410: 129 pgs: 129 active+clean; 489 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 32 op/s 2023-10-05T15:37:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:57 smithi167 ceph-mon[133366]: pgmap v410: 129 pgs: 129 active+clean; 489 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 32 op/s 2023-10-05T15:37:57.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/3328186838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb40ff730 msgr2=0x7f5fb4101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/3328186838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb40ff730 0x7f5fb4101b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009990 tx=0x7f5fb0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/3328186838 shutdown_connections 2023-10-05T15:37:57.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/3328186838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb4104a70 0x7f5fb4104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/3328186838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb40ff730 0x7f5fb4101b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/3328186838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 0x7f5fb4104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/3328186838 >> 172.21.15.17:0/3328186838 conn(0x7f5fb40fb330 msgr2=0x7f5fb40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.601+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/3328186838 shutdown_connections 2023-10-05T15:37:57.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.602+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/3328186838 wait complete. 2023-10-05T15:37:57.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:57.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:57 smithi079 ceph-mon[132936]: pgmap v410: 129 pgs: 129 active+clean; 489 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 32 op/s 2023-10-05T15:37:57.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.603+0000 7f5fbc3ff700 1 Processor -- start 2023-10-05T15:37:57.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 -- start start 2023-10-05T15:37:57.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 0x7f5fb419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 0x7f5fb419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb4104a70 0x7f5fb41a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41a4cb0 con 0x7f5fb40ff730 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41a4df0 con 0x7f5fb4104a70 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.604+0000 7f5fbc3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb41a4f80 con 0x7f5fb41020a0 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 0x7f5fb419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fb999a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 0x7f5fb419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 0x7f5fb419d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33866/0 (socket says 172.21.15.17:33866) 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 -- 172.21.15.17:0/2311120525 learned_addr learned my addr 172.21.15.17:0/2311120525 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fb999a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 0x7f5fb419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44408/0 (socket says 172.21.15.17:44408) 2023-10-05T15:37:57.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba99c700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb4104a70 0x7f5fb41a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 -- 172.21.15.17:0/2311120525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 msgr2=0x7f5fb419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 0x7f5fb419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 -- 172.21.15.17:0/2311120525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb4104a70 msgr2=0x7f5fb41a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb4104a70 0x7f5fb41a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 -- 172.21.15.17:0/2311120525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00095f0 con 0x7f5fb40ff730 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.605+0000 7f5fba19b700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 0x7f5fb419d130 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0005910 tx=0x7f5fb0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.606+0000 7f5fab7fe700 1 -- 172.21.15.17:0/2311120525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb001d070 con 0x7f5fb40ff730 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.606+0000 7f5fab7fe700 1 -- 172.21.15.17:0/2311120525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb000be70 con 0x7f5fb40ff730 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.606+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb41a5200 con 0x7f5fb40ff730 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.606+0000 7f5fab7fe700 1 -- 172.21.15.17:0/2311120525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0022e60 con 0x7f5fb40ff730 2023-10-05T15:37:57.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.606+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb41a5620 con 0x7f5fb40ff730 2023-10-05T15:37:57.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.610+0000 7f5fab7fe700 1 -- 172.21.15.17:0/2311120525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5fb0022600 con 0x7f5fb40ff730 2023-10-05T15:37:57.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.611+0000 7f5fab7fe700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5fa00a1480 0x7f5fa00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.611+0000 7f5fcfc3ab80 1 Processor -- start 2023-10-05T15:37:57.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.611+0000 7f5fab7fe700 1 -- 172.21.15.17:0/2311120525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5fb00ce4f0 con 0x7f5fb40ff730 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.611+0000 7f5fb999a700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5fa00a1480 0x7f5fa00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 -- start start 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24260 0x5589edc24680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 0x5589edc25480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc25ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edb8c460 con 0x5589edc24bc0 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edb7dc20 con 0x5589edc25a60 2023-10-05T15:37:57.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edb7b540 con 0x5589edc24260 2023-10-05T15:37:57.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fb999a700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5fa00a1480 0x7f5fa00a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009c60 tx=0x7f5fa4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.612+0000 7f5fb999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 0x5589edc25480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 0x5589edc25480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33882/0 (socket says 172.21.15.17:33882) 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 -- 172.21.15.17:0/975228815 learned_addr learned my addr 172.21.15.17:0/975228815 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fba19b700 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24260 0x5589edc24680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fba99c700 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc25ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 -- 172.21.15.17:0/975228815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24260 msgr2=0x5589edc24680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24260 0x5589edc24680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 -- 172.21.15.17:0/975228815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 msgr2=0x5589edc25ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc25ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 -- 172.21.15.17:0/975228815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ed9a1de0 con 0x5589edc24bc0 2023-10-05T15:37:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.613+0000 7f5fb999a700 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 0x5589edc25480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e430 tx=0x7f5fa4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2684326ec832277 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fa8bfe700 1 -- 172.21.15.17:0/975228815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400edd0 con 0x5589edc24bc0 2023-10-05T15:37:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fa8bfe700 1 -- 172.21.15.17:0/975228815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa4021070 con 0x5589edc24bc0 2023-10-05T15:37:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fa8bfe700 1 -- 172.21.15.17:0/975228815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4005650 con 0x5589edc24bc0 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/975228815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 msgr2=0x5589edc25480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 0x5589edc25480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400e430 tx=0x7f5fa4014000 comp rx=0 tx=0).stop 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/975228815 shutdown_connections 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc25ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.614+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24260 0x5589edc24680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.615+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/975228815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24bc0 0x5589edc25480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.615+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/975228815 >> 172.21.15.17:0/975228815 conn(0x5589edb98260 msgr2=0x5589edc1f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.615+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/975228815 shutdown_connections 2023-10-05T15:37:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.615+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/975228815 wait complete. 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.615+0000 7f5fcfc3ab80 1 -- start start 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.615+0000 7f5fcfc3ab80 1 Processor -- start 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc2e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc2e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edb76e30 con 0x5589edc24260 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edb13710 con 0x5589edc24bc0 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edb133b0 con 0x5589edc25a60 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fcfc3ab80 10 client.0 _ll_register_callbacks cb 0x5589ed970800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fb999a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc2e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fb999a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc2e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55004/0 (socket says 172.21.15.17:55004) 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fb999a700 1 -- 172.21.15.17:0/464608379 learned_addr learned my addr 172.21.15.17:0/464608379 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fba99c700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.616+0000 7f5fba19b700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc2e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5fba99c700 1 -- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 msgr2=0x5589edc2e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5fba99c700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc2e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5fba99c700 1 -- 172.21.15.17:0/464608379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 msgr2=0x5589edc2e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5fba99c700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc2e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5fba99c700 1 -- 172.21.15.17:0/464608379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa4017070 con 0x5589edc25a60 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5fba99c700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc355e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5fac011e60 tx=0x7f5fac014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d40f47f29e3f4d9b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.617+0000 7f5f9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:57.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5f9dffb700 1 -- 172.21.15.17:0/464608379 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00e040 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589edc16f10 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5f9dffb700 1 -- 172.21.15.17:0/464608379 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5fac0093a0 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5f9dffb700 1 -- 172.21.15.17:0/464608379 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fac004db0 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5fcfc3ab80 10 client.25738 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5589ed98ac60 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5f9dffb700 1 -- 172.21.15.17:0/464608379 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5589edc16f10 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.618+0000 7f5f9dffb700 1 -- 172.21.15.17:0/464608379 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5fac01c030 con 0x5589edc25a60 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fcfc3ab80 10 client.25738 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fcfc3ab80 10 client.25738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fcfc3ab80 20 client.25738 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc39fc0 0x5589edc3c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fcfc3ab80 4 client.25738 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589edb6fe10 con 0x5589edc39fc0 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.619+0000 7f5fba19b700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc39fc0 0x5589edc3c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.620+0000 7f5fba19b700 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc39fc0 0x5589edc3c3e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab226cd595a772f2 server_cookie=f33ee3a87eb0d3da in_seq=0 out_seq=0 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.620+0000 7f5f9dffb700 10 client.25738 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.620+0000 7f5f9dffb700 1 -- 172.21.15.17:0/464608379 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5589edb6fe10 con 0x5589edc39fc0 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.620+0000 7f5f9dffb700 10 client.25738 handle_command_reply: tid=0 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.620+0000 7f5fcfc3ab80 1 client.25738 shutdown 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 msgr2=0x5589edc355e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc355e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5fac011e60 tx=0x7f5fac014600 comp rx=0 tx=0).stop 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 shutdown_connections 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc39fc0 0x5589edc3c3e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc355e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc2e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5f9dffb700 0 client.25738 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/464608379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc2e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 >> 172.21.15.17:0/464608379 conn(0x5589edb98260 msgr2=0x5589edc1ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 shutdown_connections 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/464608379 wait complete. 2023-10-05T15:37:57.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.621+0000 7f5fcfc3ab80 20 client.25738 trim_cache size 0 max 16384 2023-10-05T15:37:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.643+0000 7f5fcfc3ab80 1 Processor -- start 2023-10-05T15:37:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.643+0000 7f5fcfc3ab80 1 -- start start 2023-10-05T15:37:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc28970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24bc0 0x5589edc28eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edc2da70 con 0x5589edc24260 2023-10-05T15:37:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed9f7920 con 0x5589edc25a60 2023-10-05T15:37:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edc25340 con 0x5589edc24bc0 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc28970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc28970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33898/0 (socket says 172.21.15.17:33898) 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 -- 172.21.15.17:0/1282366793 learned_addr learned my addr 172.21.15.17:0/1282366793 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fb999a700 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24bc0 0x5589edc28eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba99c700 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 -- 172.21.15.17:0/1282366793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24bc0 msgr2=0x5589edc28eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24bc0 0x5589edc28eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 -- 172.21.15.17:0/1282366793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 msgr2=0x5589edc355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.644+0000 7f5fba19b700 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.645+0000 7f5fba19b700 1 -- 172.21.15.17:0/1282366793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589edc1b140 con 0x5589edc24260 2023-10-05T15:37:57.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.645+0000 7f5fba99c700 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:57.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.645+0000 7f5fba19b700 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc28970 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0003ec0 tx=0x7f5fb0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ef85b30aaa660 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.645+0000 7f5fa93ff700 1 -- 172.21.15.17:0/1282366793 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb009bba0 con 0x5589edc24260 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.645+0000 7f5fa93ff700 1 -- 172.21.15.17:0/1282366793 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb009b4a0 con 0x5589edc24260 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.645+0000 7f5fa93ff700 1 -- 172.21.15.17:0/1282366793 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0099880 con 0x5589edc24260 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/1282366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 msgr2=0x5589edc28970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc28970 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0003ec0 tx=0x7f5fb0086040 comp rx=0 tx=0).stop 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/1282366793 shutdown_connections 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc25a60 0x5589edc355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc28970 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/1282366793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc24bc0 0x5589edc28eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/1282366793 >> 172.21.15.17:0/1282366793 conn(0x5589edb98260 msgr2=0x5589edc35ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/1282366793 shutdown_connections 2023-10-05T15:37:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.646+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/1282366793 wait complete. 2023-10-05T15:37:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.647+0000 7f5fcfc3ab80 1 -- start start 2023-10-05T15:37:57.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.647+0000 7f5fcfc3ab80 1 Processor -- start 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc30f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc314a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edc34a00 con 0x5589edc24260 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edc34b70 con 0x5589edc24bc0 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589edc34d30 con 0x5589edc25a60 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fcfc3ab80 10 client.0 _ll_register_callbacks cb 0x7f5fac0117c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc30f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc30f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33912/0 (socket says 172.21.15.17:33912) 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 -- 172.21.15.17:0/469229421 learned_addr learned my addr 172.21.15.17:0/469229421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba99c700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fb999a700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 -- 172.21.15.17:0/469229421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 msgr2=0x5589edc344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 -- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 msgr2=0x5589edc314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc314a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba19b700 1 -- 172.21.15.17:0/469229421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb41a5620 con 0x5589edc24260 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fba99c700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.648+0000 7f5fb999a700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc314a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5fba19b700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc30f60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00a3270 tx=0x7f5fb009bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8257b6b18fd9f50d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5f9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5f9dffb700 1 -- 172.21.15.17:0/469229421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb009f370 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fa4021070 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5f9dffb700 1 -- 172.21.15.17:0/469229421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5fb009b700 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5f9dffb700 1 -- 172.21.15.17:0/469229421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb009b900 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5fcfc3ab80 10 client.15960 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5589ed9c8250 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.649+0000 7f5f9dffb700 1 -- 172.21.15.17:0/469229421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa4021070 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5f9dffb700 1 -- 172.21.15.17:0/469229421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5fb00a3310 con 0x5589edc24260 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fcfc3ab80 10 client.15960 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fcfc3ab80 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fcfc3ab80 20 client.15960 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:57.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc8e6d0 0x5589edc90af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fcfc3ab80 4 client.15960 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:37:57.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5589edb6fb30 con 0x5589edc8e6d0 2023-10-05T15:37:57.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.650+0000 7f5fb999a700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc8e6d0 0x5589edc90af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fb999a700 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc8e6d0 0x5589edc90af0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a07a2be0eaeb33 server_cookie=6a761da1374fa8fc in_seq=0 out_seq=0 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5f9dffb700 10 client.15960 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5f9dffb700 1 -- 172.21.15.17:0/469229421 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5589edb6fb30 con 0x5589edc8e6d0 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5f9dffb700 10 client.15960 handle_command_reply: tid=0 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 client.15960 shutdown 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 msgr2=0x5589edc30f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc30f60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00a3270 tx=0x7f5fb009bba0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 shutdown_connections 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5589edc8e6d0 0x5589edc90af0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589edc25a60 0x5589edc344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5589edc24260 0x5589edc30f60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 --2- 172.21.15.17:0/469229421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5589edc24bc0 0x5589edc314a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 >> 172.21.15.17:0/469229421 conn(0x5589edb98260 msgr2=0x5589edc28970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5f9dffb700 0 client.15960 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 shutdown_connections 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.651+0000 7f5fcfc3ab80 1 -- 172.21.15.17:0/469229421 wait complete. 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fcfc3ab80 20 client.15960 trim_cache size 0 max 16384 2023-10-05T15:37:57.657 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:37:57.658 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-10-05T15:37:57.658 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-10-05T15:37:57.658 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:37:57.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5fa00a1480 msgr2=0x7f5fa00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5fa00a1480 0x7f5fa00a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009c60 tx=0x7f5fa4009260 comp rx=0 tx=0).stop 2023-10-05T15:37:57.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 msgr2=0x7f5fb419d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 0x7f5fb419d130 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0005910 tx=0x7f5fb0005740 comp rx=0 tx=0).stop 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 shutdown_connections 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5fa00a1480 0x7f5fa00a3940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fb4104a70 0x7f5fb41a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb40ff730 0x7f5fb419d130 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 --2- 172.21.15.17:0/2311120525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fb41020a0 0x7f5fb419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.652+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 >> 172.21.15.17:0/2311120525 conn(0x7f5fb40fb330 msgr2=0x7f5fb41003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.653+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 shutdown_connections 2023-10-05T15:37:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.653+0000 7f5fbc3ff700 1 -- 172.21.15.17:0/2311120525 wait complete. 2023-10-05T15:37:57.676 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-05T15:37:57.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-05T15:37:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 -- 172.21.15.17:0/3832105265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8104ca0 msgr2=0x7fdef810b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/3832105265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8104ca0 0x7fdef810b550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdef000b0d0 tx=0x7fdef000b3e0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 -- 172.21.15.17:0/3832105265 shutdown_connections 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/3832105265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8104ca0 0x7fdef810b550 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/3832105265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8103110 0x7fdef8103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/3832105265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef8104300 0x7fdef8104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.906+0000 7fdefe1ff700 1 -- 172.21.15.17:0/3832105265 >> 172.21.15.17:0/3832105265 conn(0x7fdef80fe660 msgr2=0x7fdef8100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.907+0000 7fdefe1ff700 1 -- 172.21.15.17:0/3832105265 shutdown_connections 2023-10-05T15:37:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.907+0000 7fdefe1ff700 1 -- 172.21.15.17:0/3832105265 wait complete. 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 Processor -- start 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 -- start start 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 0x7fdef8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef8104300 0x7fdef8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8104ca0 0x7fdef81a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef81a0890 con 0x7fdef8103110 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef81a0a00 con 0x7fdef8104ca0 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.908+0000 7fdefe1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef81a0bc0 con 0x7fdef8104300 2023-10-05T15:37:57.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 0x7fdef8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef6ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef8104300 0x7fdef8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 0x7fdef8198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33920/0 (socket says 172.21.15.17:33920) 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 -- 172.21.15.17:0/860637597 learned_addr learned my addr 172.21.15.17:0/860637597 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef7fff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8104ca0 0x7fdef81a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 -- 172.21.15.17:0/860637597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef8104300 msgr2=0x7fdef8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef8104300 0x7fdef8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 -- 172.21.15.17:0/860637597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8104ca0 msgr2=0x7fdef81a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8104ca0 0x7fdef81a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 -- 172.21.15.17:0/860637597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0009d00 con 0x7fdef8103110 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef7fff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8104ca0 0x7fdef81a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.909+0000 7fdef77fe700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 0x7fdef8198d50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e970 tx=0x7fdee800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.910+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8009790 con 0x7fdef8103110 2023-10-05T15:37:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.910+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdee800eec0 con 0x7fdef8103110 2023-10-05T15:37:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.910+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef81a0ea0 con 0x7fdef8103110 2023-10-05T15:37:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.910+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8003c10 con 0x7fdef8103110 2023-10-05T15:37:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.910+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef81a12c0 con 0x7fdef8103110 2023-10-05T15:37:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.911+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef810e7e0 con 0x7fdef8103110 2023-10-05T15:37:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.913+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdee8004870 con 0x7fdef8103110 2023-10-05T15:37:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.915+0000 7fdef4ff9700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdee00a14d0 0x7fdee00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.916+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdee8014070 con 0x7fdef8103110 2023-10-05T15:37:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.916+0000 7fdef6ffd700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdee00a14d0 0x7fdee00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.916+0000 7fdef6ffd700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdee00a14d0 0x7fdee00a3990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009c60 tx=0x7fdeec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:57.917+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdee80966e0 con 0x7fdef8103110 2023-10-05T15:37:58.089 INFO:teuthology.orchestra.run.smithi017.stderr:2200000 of 3200000 tuples (68%) done (elapsed 36.45 s, remaining 16.57 s) 2023-10-05T15:37:58.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.226+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdef8109f90 con 0x7fdef8103110 2023-10-05T15:37:58.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.227+0000 7fdef4ff9700 1 -- 172.21.15.17:0/860637597 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11368 (secure 0 0 0) 0x7fdee8099d00 con 0x7fdef8103110 2023-10-05T15:37:58.229 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:37:58.229 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/906244086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":906244086},{"type":"v1","addr":"172.21.15.17:6835","nonce":906244086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/3361787400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":3361787400},{"type":"v1","addr":"172.21.15.17:6841","nonce":3361787400}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-05T15:34:32.118456+0000","modified":"2023-10-05T15:37:46.660819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24593,"mds_1":24569,"mds_2":24550,"mds_3":24539,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24457":{"gid":24457,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/978373819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":978373819},{"type":"v1","addr":"172.21.15.167:6833","nonce":978373819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6833/926038497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":926038497},{"type":"v1","addr":"172.21.15.79:6833","nonce":926038497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24488":{"gid":24488,"name":"d","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6837/3739441472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3739441472},{"type":"v1","addr":"172.21.15.17:6837","nonce":3739441472}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/331259911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":331259911},{"type":"v1","addr":"172.21.15.79:6835","nonce":331259911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/4056762327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":4056762327},{"type":"v1","addr":"172.21.15.167:6835","nonce":4056762327}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24526":{"gid":24526,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6837/2368363786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":2368363786},{"type":"v1","addr":"172.21.15.167:6837","nonce":2368363786}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24539":{"gid":24539,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.79:6837/2714086354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":2714086354},{"type":"v1","addr":"172.21.15.79:6837","nonce":2714086354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24550":{"gid":24550,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":12,"addr":"172.21.15.167:6839/3231858560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":3231858560},{"type":"v1","addr":"172.21.15.167:6839","nonce":3231858560}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.17:6839/2274947328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":2274947328},{"type":"v1","addr":"172.21.15.17:6839","nonce":2274947328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6839/2052945872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":2052945872},{"type":"v1","addr":"172.21.15.79:6839","nonce":2052945872}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-05T15:37:58.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.229+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdee00a14d0 msgr2=0x7fdee00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.229+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdee00a14d0 0x7fdee00a3990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009c60 tx=0x7fdeec009260 comp rx=0 tx=0).stop 2023-10-05T15:37:58.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.229+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 msgr2=0x7fdef8198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.229+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 0x7fdef8198d50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdee800e970 tx=0x7fdee800ec80 comp rx=0 tx=0).stop 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 shutdown_connections 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdee00a14d0 0x7fdee00a3990 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef8104ca0 0x7fdef81a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef8103110 0x7fdef8198d50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 --2- 172.21.15.17:0/860637597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdef8104300 0x7fdef8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 >> 172.21.15.17:0/860637597 conn(0x7fdef80fe660 msgr2=0x7fdef8100870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 shutdown_connections 2023-10-05T15:37:58.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.230+0000 7fdefe1ff700 1 -- 172.21.15.17:0/860637597 wait complete. 2023-10-05T15:37:58.233 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2023-10-05T15:37:58.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-05T15:37:58.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:37:58.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:37:58.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:58 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 -- 172.21.15.17:0/3166831424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 msgr2=0x7f1ab0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/3166831424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab0073340 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009990 tx=0x7f1aa0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 -- 172.21.15.17:0/3166831424 shutdown_connections 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/3166831424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab010d330 0x7f1ab010f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/3166831424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab0073340 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/3166831424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ab0073910 0x7f1ab0073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.486+0000 7f1ab49fe700 1 -- 172.21.15.17:0/3166831424 >> 172.21.15.17:0/3166831424 conn(0x7f1ab00fc2f0 msgr2=0x7f1ab00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.487+0000 7f1ab49fe700 1 -- 172.21.15.17:0/3166831424 shutdown_connections 2023-10-05T15:37:58.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.487+0000 7f1ab49fe700 1 -- 172.21.15.17:0/3166831424 wait complete. 2023-10-05T15:37:58.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.488+0000 7f1ab49fe700 1 Processor -- start 2023-10-05T15:37:58.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.488+0000 7f1ab49fe700 1 -- start start 2023-10-05T15:37:58.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1ab49fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 0x7f1ab019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1ab49fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab019d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1ab49fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ab010d330 0x7f1ab01a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1ab49fe700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab01a49b0 con 0x7f1ab0074ef0 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1ab49fe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab01a4af0 con 0x7f1ab010d330 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1ab49fe700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab01a4c80 con 0x7f1ab0073910 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 0x7f1ab019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1aae59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab019d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 0x7f1ab019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44510/0 (socket says 172.21.15.17:44510) 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4002835135 learned_addr learned my addr 172.21.15.17:0/4002835135 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.489+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ab010d330 0x7f1ab01a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4002835135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ab010d330 msgr2=0x7f1ab01a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ab010d330 0x7f1ab01a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 msgr2=0x7f1ab019d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab019d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4002835135 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00095f0 con 0x7f1ab0073910 2023-10-05T15:37:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aae59c700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab019d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:58.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 0x7f1ab019ce30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0005910 tx=0x7f1aa0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1a97fff700 1 -- 172.21.15.17:0/4002835135 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa001d070 con 0x7f1ab0073910 2023-10-05T15:37:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1a97fff700 1 -- 172.21.15.17:0/4002835135 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aa0004c70 con 0x7f1ab0073910 2023-10-05T15:37:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab01a4f00 con 0x7f1ab0073910 2023-10-05T15:37:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.490+0000 7f1a97fff700 1 -- 172.21.15.17:0/4002835135 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0003a30 con 0x7f1ab0073910 2023-10-05T15:37:58.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.491+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab01a5270 con 0x7f1ab0073910 2023-10-05T15:37:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.494+0000 7f1a97fff700 1 -- 172.21.15.17:0/4002835135 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1aa0005000 con 0x7f1ab0073910 2023-10-05T15:37:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.496+0000 7f1a97fff700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1a980a1520 0x7f1a980a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.496+0000 7f1a97fff700 1 -- 172.21.15.17:0/4002835135 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1aa00ce070 con 0x7f1ab0073910 2023-10-05T15:37:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.496+0000 7f1aae59c700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1a980a1520 0x7f1a980a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.496+0000 7f1ac8abab80 1 Processor -- start 2023-10-05T15:37:58.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.496+0000 7f1ac8abab80 1 -- start start 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1aae59c700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1a980a1520 0x7f1a980a39e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0074c10 tx=0x7f1aa400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 0x55d21be0e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be0f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0fc60 0x55d21be100e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bd76460 con 0x55d21be0e410 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bd67c20 con 0x55d21be0fc60 2023-10-05T15:37:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bd65540 con 0x55d21be0ed70 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 0x55d21be0e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 0x55d21be0e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33934/0 (socket says 172.21.15.17:33934) 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1aaed9d700 1 -- 172.21.15.17:0/1432687188 learned_addr learned my addr 172.21.15.17:0/1432687188 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0fc60 0x55d21be100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.497+0000 7f1aae59c700 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be0f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaed9d700 1 -- 172.21.15.17:0/1432687188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 msgr2=0x55d21be0f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be0f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaed9d700 1 -- 172.21.15.17:0/1432687188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0fc60 msgr2=0x55d21be100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0fc60 0x55d21be100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaed9d700 1 -- 172.21.15.17:0/1432687188 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d21bb8bde0 con 0x55d21be0e410 2023-10-05T15:37:58.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0fc60 0x55d21be100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 0x55d21be0e830 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1aa009afb0 tx=0x7f1aa0005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30db100c38c78bd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1a957fa700 1 -- 172.21.15.17:0/1432687188 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa009b020 con 0x55d21be0e410 2023-10-05T15:37:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1a957fa700 1 -- 172.21.15.17:0/1432687188 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aa009f170 con 0x55d21be0e410 2023-10-05T15:37:58.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.498+0000 7f1a957fa700 1 -- 172.21.15.17:0/1432687188 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa009a770 con 0x55d21be0e410 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 -- 172.21.15.17:0/1432687188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 msgr2=0x55d21be0e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 0x55d21be0e830 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1aa009afb0 tx=0x7f1aa0005ac0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 -- 172.21.15.17:0/1432687188 shutdown_connections 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0fc60 0x55d21be100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0e410 0x55d21be0e830 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/1432687188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be0f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 -- 172.21.15.17:0/1432687188 >> 172.21.15.17:0/1432687188 conn(0x55d21bd82260 msgr2=0x55d21be092e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 -- 172.21.15.17:0/1432687188 shutdown_connections 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.499+0000 7f1ac8abab80 1 -- 172.21.15.17:0/1432687188 wait complete. 2023-10-05T15:37:58.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.500+0000 7f1ac8abab80 1 -- start start 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.500+0000 7f1ac8abab80 1 Processor -- start 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.500+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be17f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.500+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be18470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.500+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bd60e30 con 0x55d21be0ed70 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bcfd710 con 0x55d21be0e410 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bcfd3b0 con 0x55d21be0fc60 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1ac8abab80 10 client.0 _ll_register_callbacks cb 0x55d21bb5a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aae59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be18470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaf59e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aae59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be18470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33946/0 (socket says 172.21.15.17:33946) 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aae59c700 1 -- 172.21.15.17:0/3682852073 learned_addr learned my addr 172.21.15.17:0/3682852073 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be17f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaf59e700 1 -- 172.21.15.17:0/3682852073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 msgr2=0x55d21be17f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be17f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaf59e700 1 -- 172.21.15.17:0/3682852073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 msgr2=0x55d21be18470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be18470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.501+0000 7f1aaf59e700 1 -- 172.21.15.17:0/3682852073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab01a5270 con 0x55d21be0fc60 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.502+0000 7f1aae59c700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be18470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.502+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1f4b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55d21be0f440 tx=0x7f1aa8007e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dfd632a54fdca33 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.502+0000 7f1a92ff5700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.502+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3682852073 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003c10 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.502+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3682852073 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1aa8003d70 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.502+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d21be01160 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3682852073 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa800f6c0 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 10 client.25759 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d21bb74c60 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3682852073 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d21be01160 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3682852073 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1aa80044f0 con 0x55d21be0fc60 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 10 client.25759 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 10 client.25759 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 20 client.25759 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be23d80 0x55d21be261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 4 client.25759 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.503+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d21bd59e10 con 0x55d21be23d80 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.504+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be23d80 0x55d21be261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.504+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be23d80 0x55d21be261a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5cd0d8de3359f19f server_cookie=58e43332782b05e0 in_seq=0 out_seq=0 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.504+0000 7f1a92ff5700 10 client.25759 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3682852073 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d21bd59e10 con 0x55d21be23d80 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1a92ff5700 10 client.25759 handle_command_reply: tid=0 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 client.25759 shutdown 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 msgr2=0x55d21be1f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1f4b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55d21be0f440 tx=0x7f1aa8007e50 comp rx=0 tx=0).stop 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 shutdown_connections 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1f4b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be17f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be23d80 0x55d21be261a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3682852073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be18470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 >> 172.21.15.17:0/3682852073 conn(0x55d21bd82260 msgr2=0x55d21be09130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1a92ff5700 0 client.25759 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 shutdown_connections 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.505+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3682852073 wait complete. 2023-10-05T15:37:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.506+0000 7f1ac8abab80 20 client.25759 trim_cache size 0 max 16384 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 Processor -- start 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 -- start start 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be16bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be1f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0fc60 0x55d21be16080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bbe1920 con 0x55d21be0fc60 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21bd59e10 con 0x55d21be0e410 2023-10-05T15:37:58.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.522+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21be211a0 con 0x55d21be0ed70 2023-10-05T15:37:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaf59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0fc60 0x55d21be16080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be16bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be16bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55054/0 (socket says 172.21.15.17:55054) 2023-10-05T15:37:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4040986991 learned_addr learned my addr 172.21.15.17:0/4040986991 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aae59c700 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be1f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4040986991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 msgr2=0x55d21be1f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be1f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4040986991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0fc60 msgr2=0x55d21be16080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0fc60 0x55d21be16080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 -- 172.21.15.17:0/4040986991 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d21bbb2250 con 0x55d21be0e410 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaf59e700 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0fc60 0x55d21be16080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.523+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be16bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000b5c0 tx=0x7f1aa0009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136e44438ace9b98 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1a95ffb700 1 -- 172.21.15.17:0/4040986991 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00a10b0 con 0x55d21be0e410 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1a95ffb700 1 -- 172.21.15.17:0/4040986991 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aa009b020 con 0x55d21be0e410 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1a95ffb700 1 -- 172.21.15.17:0/4040986991 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa009a510 con 0x55d21be0e410 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 -- 172.21.15.17:0/4040986991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 msgr2=0x55d21be16bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be16bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000b5c0 tx=0x7f1aa0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 -- 172.21.15.17:0/4040986991 shutdown_connections 2023-10-05T15:37:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0fc60 0x55d21be16080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be16bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/4040986991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0ed70 0x55d21be1f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 -- 172.21.15.17:0/4040986991 >> 172.21.15.17:0/4040986991 conn(0x55d21bd82260 msgr2=0x55d21be050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.524+0000 7f1ac8abab80 1 -- 172.21.15.17:0/4040986991 shutdown_connections 2023-10-05T15:37:58.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.525+0000 7f1ac8abab80 1 -- 172.21.15.17:0/4040986991 wait complete. 2023-10-05T15:37:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.525+0000 7f1ac8abab80 1 -- start start 2023-10-05T15:37:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.525+0000 7f1ac8abab80 1 Processor -- start 2023-10-05T15:37:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be1c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be1ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21be1e3e0 con 0x55d21be0ed70 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21be1e550 con 0x55d21be0e410 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21be1e710 con 0x55d21be0fc60 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1ac8abab80 10 client.0 _ll_register_callbacks cb 0x7f1aa80115f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be1c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aae59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be1ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaf59e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be1c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55070/0 (socket says 172.21.15.17:55070) 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 -- 172.21.15.17:0/3483381194 learned_addr learned my addr 172.21.15.17:0/3483381194 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 -- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 msgr2=0x55d21be1dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 -- 172.21.15.17:0/3483381194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 msgr2=0x55d21be1ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be1ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.526+0000 7f1aaed9d700 1 -- 172.21.15.17:0/3483381194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d21bb74c60 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1aaed9d700 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be1c950 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00a1010 tx=0x7f1aa0099450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a220666b71c90f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1a92ff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3483381194 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00a1130 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1aa009f170 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3483381194 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1aa00b9140 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3483381194 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1aa009a510 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1ac8abab80 10 client.25781 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.527+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d21bb8bde0 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3483381194 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1aa009f170 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3483381194 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1aa0096e10 con 0x55d21be0e410 2023-10-05T15:37:58.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1ac8abab80 10 client.25781 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1ac8abab80 10 client.25781 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2023-10-05T15:37:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1ac8abab80 20 client.25781 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be77e20 0x55d21be7a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1ac8abab80 4 client.25781 mds_command: new command op to 24526 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 --> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d21bd59b30 con 0x55d21be77e20 2023-10-05T15:37:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.528+0000 7f1aae59c700 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be77e20 0x55d21be7a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.529+0000 7f1aae59c700 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be77e20 0x55d21be7a210 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fb53f9259ec84aec server_cookie=3988e2312d517520 in_seq=0 out_seq=0 2023-10-05T15:37:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.529+0000 7f1a92ff5700 10 client.25781 ms_handle_connect on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.529+0000 7f1a92ff5700 1 -- 172.21.15.17:0/3483381194 <== mds.4 v2:172.21.15.167:6836/2368363786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d21bd59b30 con 0x55d21be77e20 2023-10-05T15:37:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.529+0000 7f1a92ff5700 10 client.25781 handle_command_reply: tid=0 2023-10-05T15:37:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.529+0000 7f1ac8abab80 1 client.25781 shutdown 2023-10-05T15:37:58.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 msgr2=0x55d21be1c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be1c950 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00a1010 tx=0x7f1aa0099450 comp rx=0 tx=0).stop 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 shutdown_connections 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d21be0fc60 0x55d21be1dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d21be0e410 0x55d21be1c950 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.167:6836/2368363786,v1:172.21.15.167:6837/2368363786] conn(0x55d21be77e20 0x55d21be7a210 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 --2- 172.21.15.17:0/3483381194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d21be0ed70 0x55d21be1ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1a92ff5700 0 client.25781 ms_handle_reset on v2:172.21.15.167:6836/2368363786 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 >> 172.21.15.17:0/3483381194 conn(0x55d21bd82260 msgr2=0x55d21be16bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 shutdown_connections 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 1 -- 172.21.15.17:0/3483381194 wait complete. 2023-10-05T15:37:58.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.530+0000 7f1ac8abab80 20 client.25781 trim_cache size 0 max 16384 2023-10-05T15:37:58.536 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1a980a1520 msgr2=0x7f1a980a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1a980a1520 0x7f1a980a39e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0074c10 tx=0x7f1aa400b410 comp rx=0 tx=0).stop 2023-10-05T15:37:58.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 msgr2=0x7f1ab019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 0x7f1ab019ce30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0005910 tx=0x7f1aa0004730 comp rx=0 tx=0).stop 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 shutdown_connections 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1a980a1520 0x7f1a980a39e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ab010d330 0x7f1ab01a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab0073910 0x7f1ab019ce30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 --2- 172.21.15.17:0/4002835135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab0074ef0 0x7f1ab019d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 >> 172.21.15.17:0/4002835135 conn(0x7f1ab00fc2f0 msgr2=0x7f1ab00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 shutdown_connections 2023-10-05T15:37:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.531+0000 7f1ab49fe700 1 -- 172.21.15.17:0/4002835135 wait complete. 2023-10-05T15:37:58.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-05T15:37:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:37:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:37:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:58 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:58.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:37:58.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:37:58.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:58 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 -- 172.21.15.17:0/2430202573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102a40 msgr2=0x7fb814109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/2430202573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102a40 0x7fb814109360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00b0a0 tx=0x7fb80c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 -- 172.21.15.17:0/2430202573 shutdown_connections 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/2430202573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102a40 0x7fb814109360 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/2430202573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814100ea0 0x7fb8141012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/2430202573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb814102080 0x7fb814102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 -- 172.21.15.17:0/2430202573 >> 172.21.15.17:0/2430202573 conn(0x7fb8140fc460 msgr2=0x7fb8140fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 -- 172.21.15.17:0/2430202573 shutdown_connections 2023-10-05T15:37:58.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.797+0000 7fb81b5ff700 1 -- 172.21.15.17:0/2430202573 wait complete. 2023-10-05T15:37:58.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.798+0000 7fb81b5ff700 1 Processor -- start 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 -- start start 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb814100ea0 0x7fb814196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 0x7fb814197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814102a40 0x7fb81419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81419e760 con 0x7fb814102080 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81419e8a0 con 0x7fb814100ea0 2023-10-05T15:37:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb81b5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81419ea30 con 0x7fb814102a40 2023-10-05T15:37:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb818b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 0x7fb814197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb818b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 0x7fb814197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33970/0 (socket says 172.21.15.17:33970) 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.799+0000 7fb818b9a700 1 -- 172.21.15.17:0/4088911499 learned_addr learned my addr 172.21.15.17:0/4088911499 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb81939b700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb814100ea0 0x7fb814196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb819b9c700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814102a40 0x7fb81419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb818b9a700 1 -- 172.21.15.17:0/4088911499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814102a40 msgr2=0x7fb81419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb818b9a700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814102a40 0x7fb81419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb818b9a700 1 -- 172.21.15.17:0/4088911499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb814100ea0 msgr2=0x7fb814196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb818b9a700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb814100ea0 0x7fb814196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb818b9a700 1 -- 172.21.15.17:0/4088911499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c009d00 con 0x7fb814102080 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb819b9c700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814102a40 0x7fb81419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb818b9a700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 0x7fb814197120 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb80400e970 tx=0x7fb80400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb80a7fc700 1 -- 172.21.15.17:0/4088911499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804009790 con 0x7fb814102080 2023-10-05T15:37:58.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.800+0000 7fb80a7fc700 1 -- 172.21.15.17:0/4088911499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb80400eec0 con 0x7fb814102080 2023-10-05T15:37:58.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.801+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb814073140 con 0x7fb814102080 2023-10-05T15:37:58.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.801+0000 7fb80a7fc700 1 -- 172.21.15.17:0/4088911499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80400cd60 con 0x7fb814102080 2023-10-05T15:37:58.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.801+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8140736a0 con 0x7fb814102080 2023-10-05T15:37:58.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.804+0000 7fb80a7fc700 1 -- 172.21.15.17:0/4088911499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb80401b440 con 0x7fb814102080 2023-10-05T15:37:58.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 Processor -- start 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 -- start start 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb80a7fc700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb8000a1500 0x7fb8000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb80a7fc700 1 -- 172.21.15.17:0/4088911499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb8040d1320 con 0x7fb814102080 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd41680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd42480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd42ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecca9460 con 0x556eecd42a60 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecc9ac20 con 0x556eecd41260 2023-10-05T15:37:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecc98540 con 0x556eecd41bc0 2023-10-05T15:37:58.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.806+0000 7fb819b9c700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb8000a1500 0x7fb8000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd41680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd41680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55102/0 (socket says 172.21.15.17:55102) 2023-10-05T15:37:58.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 -- 172.21.15.17:0/328355133 learned_addr learned my addr 172.21.15.17:0/328355133 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb818b9a700 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd42480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb819b9c700 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd42ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 -- 172.21.15.17:0/328355133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 msgr2=0x556eecd42480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd42480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 -- 172.21.15.17:0/328355133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 msgr2=0x556eecd42ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd42ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 -- 172.21.15.17:0/328355133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556eecabede0 con 0x556eecd41260 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb819b9c700 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd42ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb81939b700 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd41680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb810007d10 tx=0x7fb8100106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2371dd35831cf99f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.807+0000 7fb819b9c700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb8000a1500 0x7fb8000a39c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556eecd42240 tx=0x7fb80c009320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb7ff7fe700 1 -- 172.21.15.17:0/328355133 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810010e10 con 0x556eecd41260 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb7ff7fe700 1 -- 172.21.15.17:0/328355133 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb810015070 con 0x556eecd41260 2023-10-05T15:37:58.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb7ff7fe700 1 -- 172.21.15.17:0/328355133 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100195d0 con 0x556eecd41260 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb82ee49b80 1 -- 172.21.15.17:0/328355133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 msgr2=0x556eecd41680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd41680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb810007d10 tx=0x7fb8100106b0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb82ee49b80 1 -- 172.21.15.17:0/328355133 shutdown_connections 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd42ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd41680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.808+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/328355133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd42480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.809+0000 7fb82ee49b80 1 -- 172.21.15.17:0/328355133 >> 172.21.15.17:0/328355133 conn(0x556eeccb5260 msgr2=0x556eecd3c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.809+0000 7fb82ee49b80 1 -- 172.21.15.17:0/328355133 shutdown_connections 2023-10-05T15:37:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.809+0000 7fb82ee49b80 1 -- 172.21.15.17:0/328355133 wait complete. 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.809+0000 7fb82ee49b80 1 -- start start 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.809+0000 7fb82ee49b80 1 Processor -- start 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 0x556eecd4afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41bc0 0x556eecd4b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd42a60 0x556eecd52550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecc93e30 con 0x556eecd41260 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecc30710 con 0x556eecd41bc0 2023-10-05T15:37:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecc303b0 con 0x556eecd42a60 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb82ee49b80 10 client.0 _ll_register_callbacks cb 0x556eeca8d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb81939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 0x556eecd4afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb81939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 0x556eecd4afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33982/0 (socket says 172.21.15.17:33982) 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb81939b700 1 -- 172.21.15.17:0/2667150650 learned_addr learned my addr 172.21.15.17:0/2667150650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb818b9a700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41bc0 0x556eecd4b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.810+0000 7fb819b9c700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd42a60 0x556eecd52550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb81939b700 1 -- 172.21.15.17:0/2667150650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd42a60 msgr2=0x556eecd52550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb81939b700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd42a60 0x556eecd52550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb81939b700 1 -- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41bc0 msgr2=0x556eecd4b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb81939b700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41bc0 0x556eecd4b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb81939b700 1 -- 172.21.15.17:0/2667150650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb810007970 con 0x556eecd41260 2023-10-05T15:37:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb818b9a700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41bc0 0x556eecd4b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb81939b700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 0x556eecd4afd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb810005c50 tx=0x7fb810010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145f09e305885b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.811+0000 7fb7fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb7fcff9700 1 -- 172.21.15.17:0/2667150650 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810004230 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556eecd33f10 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb7fcff9700 1 -- 172.21.15.17:0/2667150650 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb810004390 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb7fcff9700 1 -- 172.21.15.17:0/2667150650 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb810004550 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb82ee49b80 10 client.15993 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556eecaa7c60 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.812+0000 7fb7fcff9700 1 -- 172.21.15.17:0/2667150650 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556eecd33f10 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb7fcff9700 1 -- 172.21.15.17:0/2667150650 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fb810005460 con 0x556eecd41260 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb82ee49b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb82ee49b80 10 client.15993 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-10-05T15:37:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb82ee49b80 20 client.15993 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecd56c30 0x556eecd59050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb82ee49b80 4 client.15993 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556eecc8ce10 con 0x556eecd56c30 2023-10-05T15:37:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.813+0000 7fb818b9a700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecd56c30 0x556eecd59050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.814+0000 7fb7fcff9700 10 client.15993 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.814+0000 7fb818b9a700 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecd56c30 0x556eecd59050 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d37ac266f31e370 server_cookie=e1a926aec9b4338c in_seq=0 out_seq=0 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.814+0000 7fb7fcff9700 1 -- 172.21.15.17:0/2667150650 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556eecc8ce10 con 0x556eecd56c30 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.814+0000 7fb7fcff9700 10 client.15993 handle_command_reply: tid=0 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 client.15993 shutdown 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 msgr2=0x556eecd4afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 0x556eecd4afd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb810005c50 tx=0x7fb810010d70 comp rx=0 tx=0).stop 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 shutdown_connections 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd42a60 0x556eecd52550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecd56c30 0x556eecd59050 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd41260 0x556eecd4afd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/2667150650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41bc0 0x556eecd4b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 >> 172.21.15.17:0/2667150650 conn(0x556eeccb5260 msgr2=0x556eecd3bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb7fcff9700 0 client.15993 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 shutdown_connections 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 1 -- 172.21.15.17:0/2667150650 wait complete. 2023-10-05T15:37:58.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.815+0000 7fb82ee49b80 20 client.15993 trim_cache size 0 max 16384 2023-10-05T15:37:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.831+0000 7fb82ee49b80 1 Processor -- start 2023-10-05T15:37:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 -- start start 2023-10-05T15:37:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd52e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecb14920 con 0x556eecd42a60 2023-10-05T15:37:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecd38a20 con 0x556eecd41260 2023-10-05T15:37:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecd56770 con 0x556eecd41bc0 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb819b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd52e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb81939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb819b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd52e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33986/0 (socket says 172.21.15.17:33986) 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb819b9c700 1 -- 172.21.15.17:0/1936734899 learned_addr learned my addr 172.21.15.17:0/1936734899 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.832+0000 7fb818b9a700 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb81939b700 1 -- 172.21.15.17:0/1936734899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 msgr2=0x556eecd524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb81939b700 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb81939b700 1 -- 172.21.15.17:0/1936734899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 msgr2=0x556eecd52e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb81939b700 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd52e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb81939b700 1 -- 172.21.15.17:0/1936734899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556eecae5250 con 0x556eecd41260 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb81939b700 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4a680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb810007c60 tx=0x7fb8100071c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0fa9d75c7085d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb7fffff700 1 -- 172.21.15.17:0/1936734899 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810004cc0 con 0x556eecd41260 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb7fffff700 1 -- 172.21.15.17:0/1936734899 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8100052b0 con 0x556eecd41260 2023-10-05T15:37:58.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.833+0000 7fb7fffff700 1 -- 172.21.15.17:0/1936734899 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100117c0 con 0x556eecd41260 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 -- 172.21.15.17:0/1936734899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 msgr2=0x556eecd4a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4a680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb810007c60 tx=0x7fb8100071c0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 -- 172.21.15.17:0/1936734899 shutdown_connections 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd52e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4a680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/1936734899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 -- 172.21.15.17:0/1936734899 >> 172.21.15.17:0/1936734899 conn(0x556eeccb5260 msgr2=0x556eecd3abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 -- 172.21.15.17:0/1936734899 shutdown_connections 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.834+0000 7fb82ee49b80 1 -- 172.21.15.17:0/1936734899 wait complete. 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 -- start start 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 Processor -- start 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd4e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd51370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecd518b0 con 0x556eecd42a60 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecd51a20 con 0x556eecd41260 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.835+0000 7fb82ee49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eecd51be0 con 0x556eecd41bc0 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb82ee49b80 10 client.0 _ll_register_callbacks cb 0x7fb80400cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb818b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd4e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55132/0 (socket says 172.21.15.17:55132) 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 -- 172.21.15.17:0/3981540969 learned_addr learned my addr 172.21.15.17:0/3981540969 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb819b9c700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd51370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 -- 172.21.15.17:0/3981540969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 msgr2=0x556eecd4e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd4e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 -- 172.21.15.17:0/3981540969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 msgr2=0x556eecd51370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd51370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb81939b700 1 -- 172.21.15.17:0/3981540969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556eecaa7c60 con 0x556eecd41260 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb818b9a700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd4e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.836+0000 7fb819b9c700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd51370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:58.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb81939b700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4de10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb810010d20 tx=0x7fb8100057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40aa4ce9d6ca8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:58.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb7fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb7fcff9700 1 -- 172.21.15.17:0/3981540969 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810004cc0 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb810015070 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb7fcff9700 1 -- 172.21.15.17:0/3981540969 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb810000e40 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb7fcff9700 1 -- 172.21.15.17:0/3981540969 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb810004e20 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb82ee49b80 10 client.25799 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.837+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556eecabd2b0 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb7fcff9700 1 -- 172.21.15.17:0/3981540969 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb810015070 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb7fcff9700 1 -- 172.21.15.17:0/3981540969 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fb810010720 con 0x556eecd41260 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb82ee49b80 10 client.25799 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb82ee49b80 10 client.25799 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb82ee49b80 20 client.25799 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:58.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecdab070 0x556eecdad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb82ee49b80 4 client.25799 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 --> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556eecc8cb30 con 0x556eecdab070 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.838+0000 7fb818b9a700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecdab070 0x556eecdad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb7fcff9700 10 client.25799 ms_handle_connect on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb818b9a700 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecdab070 0x556eecdad4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fa9705313753a7fd server_cookie=333dd63cf481dc7e in_seq=0 out_seq=0 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb7fcff9700 1 -- 172.21.15.17:0/3981540969 <== mds.3 v2:172.21.15.79:6836/2714086354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556eecc8cb30 con 0x556eecdab070 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb7fcff9700 10 client.25799 handle_command_reply: tid=0 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 client.25799 shutdown 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 msgr2=0x556eecd4de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4de10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb810010d20 tx=0x7fb8100057f0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 shutdown_connections 2023-10-05T15:37:58.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:6836/2714086354,v1:172.21.15.79:6837/2714086354] conn(0x556eecdab070 0x556eecdad4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556eecd42a60 0x556eecd51370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556eecd41260 0x556eecd4de10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb7fcff9700 0 client.25799 ms_handle_reset on v2:172.21.15.79:6836/2714086354 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 --2- 172.21.15.17:0/3981540969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556eecd41bc0 0x556eecd4e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 >> 172.21.15.17:0/3981540969 conn(0x556eeccb5260 msgr2=0x556eecd52e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 shutdown_connections 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.839+0000 7fb82ee49b80 1 -- 172.21.15.17:0/3981540969 wait complete. 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb82ee49b80 20 client.25799 trim_cache size 0 max 16384 2023-10-05T15:37:58.845 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb8000a1500 msgr2=0x7fb8000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb8000a1500 0x7fb8000a39c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556eecd42240 tx=0x7fb80c009320 comp rx=0 tx=0).stop 2023-10-05T15:37:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 msgr2=0x7fb814197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 0x7fb814197120 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb80400e970 tx=0x7fb80400ec80 comp rx=0 tx=0).stop 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 shutdown_connections 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb8000a1500 0x7fb8000a39c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb814102a40 0x7fb81419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb814100ea0 0x7fb814196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 --2- 172.21.15.17:0/4088911499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb814102080 0x7fb814197120 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.840+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 >> 172.21.15.17:0/4088911499 conn(0x7fb8140fc460 msgr2=0x7fb8140fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.841+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 shutdown_connections 2023-10-05T15:37:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:58.841+0000 7fb81b5ff700 1 -- 172.21.15.17:0/4088911499 wait complete. 2023-10-05T15:37:58.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-05T15:37:59.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 -- 172.21.15.17:0/776519101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64480738d0 msgr2=0x7f6448073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 --2- 172.21.15.17:0/776519101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64480738d0 0x7f6448073d30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f643c009990 tx=0x7f643c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 -- 172.21.15.17:0/776519101 shutdown_connections 2023-10-05T15:37:59.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 --2- 172.21.15.17:0/776519101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6448108dc0 0x7f644810b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 --2- 172.21.15.17:0/776519101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448074eb0 0x7f6448073300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 --2- 172.21.15.17:0/776519101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64480738d0 0x7f6448073d30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 -- 172.21.15.17:0/776519101 >> 172.21.15.17:0/776519101 conn(0x7f64480fc460 msgr2=0x7f64480fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 -- 172.21.15.17:0/776519101 shutdown_connections 2023-10-05T15:37:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.108+0000 7f644e7ff700 1 -- 172.21.15.17:0/776519101 wait complete. 2023-10-05T15:37:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 Processor -- start 2023-10-05T15:37:59.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 -- start start 2023-10-05T15:37:59.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64480738d0 0x7f6448198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448074eb0 0x7f6448199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 0x7f64481a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481a0870 con 0x7f6448108dc0 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481a09e0 con 0x7f6448074eb0 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.110+0000 7f644e7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64481a0ba0 con 0x7f64480738d0 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 0x7f64481a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 0x7f64481a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34008/0 (socket says 172.21.15.17:34008) 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 -- 172.21.15.17:0/4226399478 learned_addr learned my addr 172.21.15.17:0/4226399478 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f6447fff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64480738d0 0x7f6448198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f64477fe700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448074eb0 0x7f6448199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 -- 172.21.15.17:0/4226399478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64480738d0 msgr2=0x7f6448198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64480738d0 0x7f6448198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 -- 172.21.15.17:0/4226399478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448074eb0 msgr2=0x7f6448199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448074eb0 0x7f6448199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 -- 172.21.15.17:0/4226399478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438009520 con 0x7f6448108dc0 2023-10-05T15:37:59.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.111+0000 7f644cd9c700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 0x7f64481a02a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f644000ef30 tx=0x7f644000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.112+0000 7f64457fa700 1 -- 172.21.15.17:0/4226399478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440018070 con 0x7f6448108dc0 2023-10-05T15:37:59.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.112+0000 7f64457fa700 1 -- 172.21.15.17:0/4226399478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f644000f040 con 0x7f6448108dc0 2023-10-05T15:37:59.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.112+0000 7f64457fa700 1 -- 172.21.15.17:0/4226399478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000cbc0 con 0x7f6448108dc0 2023-10-05T15:37:59.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.112+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c0095f0 con 0x7f6448108dc0 2023-10-05T15:37:59.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.113+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64481a1120 con 0x7f6448108dc0 2023-10-05T15:37:59.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.119+0000 7f6462118b80 1 Processor -- start 2023-10-05T15:37:59.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.119+0000 7f64457fa700 1 -- 172.21.15.17:0/4226399478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f644000cd20 con 0x7f6448108dc0 2023-10-05T15:37:59.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 -- start start 2023-10-05T15:37:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c12a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12abc0 0x55e28c12b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c12bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c092460 con 0x55e28c12a260 2023-10-05T15:37:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c083c20 con 0x55e28c12abc0 2023-10-05T15:37:59.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6462118b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c081540 con 0x55e28c12ba60 2023-10-05T15:37:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f64477fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c12a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f6447fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12abc0 0x55e28c12b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f64477fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c12a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34018/0 (socket says 172.21.15.17:34018) 2023-10-05T15:37:59.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.121+0000 7f64477fe700 1 -- 172.21.15.17:0/516551727 learned_addr learned my addr 172.21.15.17:0/516551727 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f64477fe700 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c12bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f6447fff700 1 -- 172.21.15.17:0/516551727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 msgr2=0x55e28c12bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f6447fff700 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c12bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f6447fff700 1 -- 172.21.15.17:0/516551727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 msgr2=0x55e28c12a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f6447fff700 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c12a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f6447fff700 1 -- 172.21.15.17:0/516551727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e28bea7de0 con 0x55e28c12abc0 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f64457fa700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f64300a1500 0x7f64300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f6447fff700 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12abc0 0x55e28c12b480 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6438009e10 tx=0x7f6438011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3189523d16c7b2be server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.122+0000 7f64457fa700 1 -- 172.21.15.17:0/4226399478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f64400cc2f0 con 0x7f6448108dc0 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.123+0000 7f642e7fc700 1 -- 172.21.15.17:0/516551727 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438004230 con 0x55e28c12abc0 2023-10-05T15:37:59.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.123+0000 7f642e7fc700 1 -- 172.21.15.17:0/516551727 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6438004390 con 0x55e28c12abc0 2023-10-05T15:37:59.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.123+0000 7f642e7fc700 1 -- 172.21.15.17:0/516551727 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380198a0 con 0x55e28c12abc0 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 -- 172.21.15.17:0/516551727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12abc0 msgr2=0x55e28c12b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12abc0 0x55e28c12b480 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6438009e10 tx=0x7f6438011720 comp rx=0 tx=0).stop 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 -- 172.21.15.17:0/516551727 shutdown_connections 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c12bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c12a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 --2- 172.21.15.17:0/516551727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12abc0 0x55e28c12b480 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 -- 172.21.15.17:0/516551727 >> 172.21.15.17:0/516551727 conn(0x55e28c09e260 msgr2=0x55e28c125140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 -- 172.21.15.17:0/516551727 shutdown_connections 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f6462118b80 1 -- 172.21.15.17:0/516551727 wait complete. 2023-10-05T15:37:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.124+0000 7f64477fe700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f64300a1500 0x7f64300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.125+0000 7f6462118b80 1 -- start start 2023-10-05T15:37:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.125+0000 7f64477fe700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f64300a1500 0x7f64300a39c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f643c000c00 tx=0x7f643c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.125+0000 7f6462118b80 1 Processor -- start 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c134050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c134590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c07ce30 con 0x55e28c12abc0 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c019710 con 0x55e28c12a260 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c0193b0 con 0x55e28c12ba60 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6462118b80 10 client.0 _ll_register_callbacks cb 0x55e28be76800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6447fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6447fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c134050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55144/0 (socket says 172.21.15.17:55144) 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.126+0000 7f6447fff700 1 -- 172.21.15.17:0/1190098126 learned_addr learned my addr 172.21.15.17:0/1190098126 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f644cd9c700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f64477fe700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c134590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f6447fff700 1 -- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 msgr2=0x55e28c13b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f6447fff700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f6447fff700 1 -- 172.21.15.17:0/1190098126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 msgr2=0x55e28c134590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f6447fff700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c134590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f6447fff700 1 -- 172.21.15.17:0/1190098126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6438009a70 con 0x55e28c12a260 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f644cd9c700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f64477fe700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c134590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f6447fff700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c134050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6438005c50 tx=0x7f6438005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a39dbd838395c788 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.127+0000 7f64277fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.128+0000 7f64277fe700 1 -- 172.21.15.17:0/1190098126 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438003890 con 0x55e28c12a260 2023-10-05T15:37:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.128+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e28c11cf10 con 0x55e28c12a260 2023-10-05T15:37:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.128+0000 7f64277fe700 1 -- 172.21.15.17:0/1190098126 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f64380039f0 con 0x55e28c12a260 2023-10-05T15:37:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.128+0000 7f64277fe700 1 -- 172.21.15.17:0/1190098126 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6438003bb0 con 0x55e28c12a260 2023-10-05T15:37:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.128+0000 7f6462118b80 10 client.25811 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.128+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e28be90c60 con 0x55e28c12a260 2023-10-05T15:37:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.129+0000 7f64277fe700 1 -- 172.21.15.17:0/1190098126 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e28c11cf10 con 0x55e28c12a260 2023-10-05T15:37:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f64277fe700 1 -- 172.21.15.17:0/1190098126 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6438019620 con 0x55e28c12a260 2023-10-05T15:37:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f6462118b80 10 client.25811 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f6462118b80 10 client.25811 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-05T15:37:59.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f6462118b80 20 client.25811 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f6462118b80 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c13fd40 0x55e28c142160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f6462118b80 4 client.25811 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.130+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e28c075e10 con 0x55e28c13fd40 2023-10-05T15:37:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.131+0000 7f64477fe700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c13fd40 0x55e28c142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.132+0000 7f64477fe700 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c13fd40 0x55e28c142160 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3965aeb71fcd25b8 server_cookie=6614ced627dcfcd0 in_seq=0 out_seq=0 2023-10-05T15:37:59.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.132+0000 7f64277fe700 10 client.25811 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.132+0000 7f64277fe700 1 -- 172.21.15.17:0/1190098126 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e28c075e10 con 0x55e28c13fd40 2023-10-05T15:37:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.132+0000 7f64277fe700 10 client.25811 handle_command_reply: tid=0 2023-10-05T15:37:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 client.25811 shutdown 2023-10-05T15:37:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 msgr2=0x55e28c134050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c134050 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6438005c50 tx=0x7f6438005e40 comp rx=0 tx=0).stop 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 shutdown_connections 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c13fd40 0x55e28c142160 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c134050 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 --2- 172.21.15.17:0/1190098126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c134590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 >> 172.21.15.17:0/1190098126 conn(0x55e28c09e260 msgr2=0x55e28c124f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f64277fe700 0 client.25811 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 shutdown_connections 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.133+0000 7f6462118b80 1 -- 172.21.15.17:0/1190098126 wait complete. 2023-10-05T15:37:59.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.134+0000 7f6462118b80 20 client.25811 trim_cache size 0 max 16384 2023-10-05T15:37:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.151+0000 7f6462118b80 1 Processor -- start 2023-10-05T15:37:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.151+0000 7f6462118b80 1 -- start start 2023-10-05T15:37:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.152+0000 7f6462118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c123bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.152+0000 7f6462118b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c13b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.152+0000 7f6462118b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.152+0000 7f6462118b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28befd920 con 0x55e28c12abc0 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.152+0000 7f6462118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c131c00 con 0x55e28c12a260 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.152+0000 7f6462118b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c12f510 con 0x55e28c12ba60 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c123bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f644cd9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f64477fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c13b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c123bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55146/0 (socket says 172.21.15.17:55146) 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 -- 172.21.15.17:0/1397363313 learned_addr learned my addr 172.21.15.17:0/1397363313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 -- 172.21.15.17:0/1397363313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 msgr2=0x55e28c13bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 -- 172.21.15.17:0/1397363313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 msgr2=0x55e28c13b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c13b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 -- 172.21.15.17:0/1397363313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e28bece250 con 0x55e28c12a260 2023-10-05T15:37:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f64477fe700 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c13b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.153+0000 7f6447fff700 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c123bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6438009d60 tx=0x7f6438011b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada46d8b5598cc21 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f642effd700 1 -- 172.21.15.17:0/1397363313 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380195b0 con 0x55e28c12a260 2023-10-05T15:37:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f642effd700 1 -- 172.21.15.17:0/1397363313 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6438019710 con 0x55e28c12a260 2023-10-05T15:37:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f642effd700 1 -- 172.21.15.17:0/1397363313 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643801a6f0 con 0x55e28c12a260 2023-10-05T15:37:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 -- 172.21.15.17:0/1397363313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 msgr2=0x55e28c123bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c123bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6438009d60 tx=0x7f6438011b20 comp rx=0 tx=0).stop 2023-10-05T15:37:59.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 -- 172.21.15.17:0/1397363313 shutdown_connections 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12ba60 0x55e28c13bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12a260 0x55e28c123bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 --2- 172.21.15.17:0/1397363313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12abc0 0x55e28c13b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.154+0000 7f6462118b80 1 -- 172.21.15.17:0/1397363313 >> 172.21.15.17:0/1397363313 conn(0x55e28c09e260 msgr2=0x55e28c132cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.155+0000 7f6462118b80 1 -- 172.21.15.17:0/1397363313 shutdown_connections 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.155+0000 7f6462118b80 1 -- 172.21.15.17:0/1397363313 wait complete. 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.155+0000 7f6462118b80 1 -- start start 2023-10-05T15:37:59.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.155+0000 7f6462118b80 1 Processor -- start 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12abc0 0x55e28c139020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12ba60 0x55e28c13a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c13a570 con 0x55e28c12a260 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c13a6e0 con 0x55e28c12ba60 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28c13a8a0 con 0x55e28c12abc0 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6462118b80 10 client.0 _ll_register_callbacks cb 0x7f6438009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6447fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6447fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34038/0 (socket says 172.21.15.17:34038) 2023-10-05T15:37:59.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.156+0000 7f6447fff700 1 -- 172.21.15.17:0/1689706373 learned_addr learned my addr 172.21.15.17:0/1689706373 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f64477fe700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12abc0 0x55e28c139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f644cd9c700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12ba60 0x55e28c13a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f6447fff700 1 -- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12abc0 msgr2=0x55e28c139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f6447fff700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12abc0 0x55e28c139020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f6447fff700 1 -- 172.21.15.17:0/1689706373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12ba60 msgr2=0x55e28c13a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f6447fff700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12ba60 0x55e28c13a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f6447fff700 1 -- 172.21.15.17:0/1689706373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c020040 con 0x55e28c12a260 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f644cd9c700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12ba60 0x55e28c13a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f6447fff700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c138ae0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6438003e70 tx=0x7f64380098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7240f8d24655493 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f64277fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:59.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.157+0000 7f64277fe700 1 -- 172.21.15.17:0/1689706373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380195b0 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6438004390 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f64277fe700 1 -- 172.21.15.17:0/1689706373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6438000e40 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f64277fe700 1 -- 172.21.15.17:0/1689706373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6438019d60 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 10 client.16017 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e28be90c60 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f64277fe700 1 -- 172.21.15.17:0/1689706373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6438004390 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f64277fe700 1 -- 172.21.15.17:0/1689706373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f643802c440 con 0x55e28c12a260 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 10 client.16017 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 10 client.16017 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 20 client.16017 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.158+0000 7f6462118b80 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c19c510 0x55e28c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.159+0000 7f6462118b80 4 client.16017 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:59.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.159+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 --> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e28c075b30 con 0x55e28c19c510 2023-10-05T15:37:59.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.159+0000 7f64477fe700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c19c510 0x55e28c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.159+0000 7f64477fe700 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c19c510 0x55e28c19e930 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c11dee35238f50e6 server_cookie=5c82623d75f743c4 in_seq=0 out_seq=0 2023-10-05T15:37:59.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.159+0000 7f64277fe700 10 client.16017 ms_handle_connect on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f64277fe700 1 -- 172.21.15.17:0/1689706373 <== mds.2 v2:172.21.15.167:6838/3231858560 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e28c075b30 con 0x55e28c19c510 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f64277fe700 10 client.16017 handle_command_reply: tid=0 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 client.16017 shutdown 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 msgr2=0x55e28c138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c138ae0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6438003e70 tx=0x7f64380098e0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 shutdown_connections 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:6838/3231858560,v1:172.21.15.167:6839/3231858560] conn(0x55e28c19c510 0x55e28c19e930 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e28c12ba60 0x55e28c13a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e28c12a260 0x55e28c138ae0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 --2- 172.21.15.17:0/1689706373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e28c12abc0 0x55e28c139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 >> 172.21.15.17:0/1689706373 conn(0x55e28c09e260 msgr2=0x55e28c13bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f64277fe700 0 client.16017 ms_handle_reset on v2:172.21.15.167:6838/3231858560 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 shutdown_connections 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 1 -- 172.21.15.17:0/1689706373 wait complete. 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.160+0000 7f6462118b80 20 client.16017 trim_cache size 0 max 16384 2023-10-05T15:37:59.166 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f64300a1500 msgr2=0x7f64300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f64300a1500 0x7f64300a39c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f643c000c00 tx=0x7f643c00b260 comp rx=0 tx=0).stop 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 msgr2=0x7f64481a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 0x7f64481a02a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f644000ef30 tx=0x7f644000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 shutdown_connections 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f64300a1500 0x7f64300a39c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6448108dc0 0x7f64481a02a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64480738d0 0x7f6448198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 --2- 172.21.15.17:0/4226399478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6448074eb0 0x7f6448199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 >> 172.21.15.17:0/4226399478 conn(0x7f64480fc460 msgr2=0x7f64480fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.161+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 shutdown_connections 2023-10-05T15:37:59.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.162+0000 7f644e7ff700 1 -- 172.21.15.17:0/4226399478 wait complete. 2023-10-05T15:37:59.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-05T15:37:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.347+0000 7f0ddd79d700 1 -- 172.21.15.17:0/4024454090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd81017d0 msgr2=0x7f0dd8103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.347+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/4024454090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd81017d0 0x7f0dd8103bc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009990 tx=0x7f0dc8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 -- 172.21.15.17:0/4024454090 shutdown_connections 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/4024454090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd8106a30 0x7f0dd8108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/4024454090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd81017d0 0x7f0dd8103bc0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/4024454090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd8104100 0x7f0dd81064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 -- 172.21.15.17:0/4024454090 >> 172.21.15.17:0/4024454090 conn(0x7f0dd80fb1a0 msgr2=0x7f0dd80fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 -- 172.21.15.17:0/4024454090 shutdown_connections 2023-10-05T15:37:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.348+0000 7f0ddd79d700 1 -- 172.21.15.17:0/4024454090 wait complete. 2023-10-05T15:37:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.349+0000 7f0ddd79d700 1 Processor -- start 2023-10-05T15:37:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.349+0000 7f0ddd79d700 1 -- start start 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.349+0000 7f0ddd79d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd81017d0 0x7f0dd8198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.349+0000 7f0ddd79d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd8104100 0x7f0dd8199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddd79d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 0x7f0dd81a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddd79d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81a06c0 con 0x7f0dd8106a30 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddd79d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81a0800 con 0x7f0dd81017d0 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddd79d700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd81a0990 con 0x7f0dd8104100 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 0x7f0dd81a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 0x7f0dd81a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34058/0 (socket says 172.21.15.17:34058) 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/2719370103 learned_addr learned my addr 172.21.15.17:0/2719370103 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd8104100 0x7f0dd8199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd81017d0 0x7f0dd8198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/2719370103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd8104100 msgr2=0x7f0dd8199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd8104100 0x7f0dd8199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/2719370103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd81017d0 msgr2=0x7f0dd8198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd81017d0 0x7f0dd8198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.350+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/2719370103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80095f0 con 0x7f0dd8106a30 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.351+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 0x7f0dd81a00f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000ef30 tx=0x7f0dd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.351+0000 7f0dd57fa700 1 -- 172.21.15.17:0/2719370103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0018070 con 0x7f0dd8106a30 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.351+0000 7f0dd57fa700 1 -- 172.21.15.17:0/2719370103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dd000f040 con 0x7f0dd8106a30 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.351+0000 7f0dd57fa700 1 -- 172.21.15.17:0/2719370103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000cbc0 con 0x7f0dd8106a30 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.351+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd81a0c10 con 0x7f0dd8106a30 2023-10-05T15:37:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.351+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd81a10d0 con 0x7f0dd8106a30 2023-10-05T15:37:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.356+0000 7f0dd57fa700 1 -- 172.21.15.17:0/2719370103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0dd0007500 con 0x7f0dd8106a30 2023-10-05T15:37:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.357+0000 7f0df233bb80 1 Processor -- start 2023-10-05T15:37:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.357+0000 7f0df233bb80 1 -- start start 2023-10-05T15:37:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f95440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1f9d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd57fa700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0dc00a1500 0x7f0dc00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0df233bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1efd400 con 0x55cee1f96130 2023-10-05T15:37:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0df233bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1eeebc0 con 0x55cee1f96af0 2023-10-05T15:37:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0df233bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1eec4e0 con 0x55cee1f95020 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd57fa700 1 -- 172.21.15.17:0/2719370103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0dd00ccb50 con 0x7f0dd8106a30 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f95440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f95440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44664/0 (socket says 172.21.15.17:44664) 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd77fe700 1 -- 172.21.15.17:0/1480118742 learned_addr learned my addr 172.21.15.17:0/1480118742 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0dc00a1500 0x7f0dc00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1f9d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1480118742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 msgr2=0x55cee1f95440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f95440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1480118742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 msgr2=0x55cee1f9d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.358+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1f9d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1480118742 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee1d12d80 con 0x55cee1f96130 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f95440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1f9d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f965b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80098e0 tx=0x7f0dc8005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193d27e69718d7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0dc00a1500 0x7f0dc00a39c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55cee1f94dc0 tx=0x7f0dcc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dbe7fc700 1 -- 172.21.15.17:0/1480118742 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc801d070 con 0x55cee1f96130 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dbe7fc700 1 -- 172.21.15.17:0/1480118742 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc801e040 con 0x55cee1f96130 2023-10-05T15:37:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.359+0000 7f0dbe7fc700 1 -- 172.21.15.17:0/1480118742 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80038c0 con 0x55cee1f96130 2023-10-05T15:37:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.360+0000 7f0df233bb80 1 -- 172.21.15.17:0/1480118742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 msgr2=0x55cee1f965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.360+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f965b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80098e0 tx=0x7f0dc8005f00 comp rx=0 tx=0).stop 2023-10-05T15:37:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 -- 172.21.15.17:0/1480118742 shutdown_connections 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1f9d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f95440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1480118742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f965b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 -- 172.21.15.17:0/1480118742 >> 172.21.15.17:0/1480118742 conn(0x55cee1f09200 msgr2=0x55cee1f8fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 -- 172.21.15.17:0/1480118742 shutdown_connections 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.361+0000 7f0df233bb80 1 -- 172.21.15.17:0/1480118742 wait complete. 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.362+0000 7f0df233bb80 1 -- start start 2023-10-05T15:37:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.362+0000 7f0df233bb80 1 Processor -- start 2023-10-05T15:37:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f9ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f9f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1fa6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1ee7dd0 con 0x55cee1f96130 2023-10-05T15:37:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1e846b0 con 0x55cee1f96af0 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1e84350 con 0x55cee1f95020 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0df233bb80 10 client.0 _ll_register_callbacks cb 0x55cee1ce17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f9f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f9f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34074/0 (socket says 172.21.15.17:34074) 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0dd77fe700 1 -- 172.21.15.17:0/3439704940 learned_addr learned my addr 172.21.15.17:0/3439704940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1fa6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.363+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f9ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/3439704940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 msgr2=0x55cee1f9ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f9ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/3439704940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 msgr2=0x55cee1f9f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f9f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0ddcf9c700 1 -- 172.21.15.17:0/3439704940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc0123f0 con 0x55cee1f96af0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1fa6230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00ca250 tx=0x7f0dd00ba9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50677e4fb38e8a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0db77fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0db77fe700 1 -- 172.21.15.17:0/3439704940 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0084070 con 0x55cee1f96af0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cee1f87eb0 con 0x55cee1f96af0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0db77fe700 1 -- 172.21.15.17:0/3439704940 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0dd0099b00 con 0x55cee1f96af0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0db77fe700 1 -- 172.21.15.17:0/3439704940 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dd009dc50 con 0x55cee1f96af0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0df233bb80 10 client.25823 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.364+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f0dd8109a90 con 0x55cee1f96af0 2023-10-05T15:37:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0db77fe700 1 -- 172.21.15.17:0/3439704940 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cee1f87eb0 con 0x55cee1f96af0 2023-10-05T15:37:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0db77fe700 1 -- 172.21.15.17:0/3439704940 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0dd0099d60 con 0x55cee1f96af0 2023-10-05T15:37:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0df233bb80 10 client.25823 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0df233bb80 10 client.25823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0df233bb80 20 client.25823 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0df233bb80 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1faab00 0x55cee1facf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0df233bb80 4 client.25823 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.365+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cee1ee0db0 con 0x55cee1faab00 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.366+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1faab00 0x55cee1facf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.366+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1faab00 0x55cee1facf20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b29d31c21311df server_cookie=2a5ad47338f8f0fc in_seq=0 out_seq=0 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.366+0000 7f0db77fe700 10 client.25823 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0db77fe700 1 -- 172.21.15.17:0/3439704940 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cee1ee0db0 con 0x55cee1faab00 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0db77fe700 10 client.25823 handle_command_reply: tid=0 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0df233bb80 1 client.25823 shutdown 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 msgr2=0x55cee1fa6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0df233bb80 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1fa6230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00ca250 tx=0x7f0dd00ba9e0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 shutdown_connections 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.367+0000 7f0df233bb80 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1faab00 0x55cee1facf20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96af0 0x55cee1fa6230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f95020 0x55cee1f9ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0db77fe700 0 client.25823 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 1 --2- 172.21.15.17:0/3439704940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1f9f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 >> 172.21.15.17:0/3439704940 conn(0x55cee1f09200 msgr2=0x55cee1f8f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 shutdown_connections 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 1 -- 172.21.15.17:0/3439704940 wait complete. 2023-10-05T15:37:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.368+0000 7f0df233bb80 20 client.25823 trim_cache size 0 max 16384 2023-10-05T15:37:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.385+0000 7f0df233bb80 1 Processor -- start 2023-10-05T15:37:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.385+0000 7f0df233bb80 1 -- start start 2023-10-05T15:37:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f95020 0x55cee1f9e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1fa61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1f9d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0df233bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1d688c0 con 0x55cee1f96130 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0df233bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1f995b0 con 0x55cee1f95020 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0df233bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1fa7e10 con 0x55cee1f96af0 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1fa61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1fa61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34088/0 (socket says 172.21.15.17:34088) 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd77fe700 1 -- 172.21.15.17:0/2432860373 learned_addr learned my addr 172.21.15.17:0/2432860373 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f95020 0x55cee1f9e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1f9d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd7fff700 1 -- 172.21.15.17:0/2432860373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 msgr2=0x55cee1f9d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1f9d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd7fff700 1 -- 172.21.15.17:0/2432860373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 msgr2=0x55cee1fa61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1fa61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0dd7fff700 1 -- 172.21.15.17:0/2432860373 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cee1cfbc00 con 0x55cee1f95020 2023-10-05T15:37:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.386+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1f9d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.387+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1fa61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.387+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f95020 0x55cee1f9e360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55cee1fad830 tx=0x7f0dc8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b73371fc4846198 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.387+0000 7f0dbeffd700 1 -- 172.21.15.17:0/2432860373 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc801d040 con 0x55cee1f95020 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.387+0000 7f0dbeffd700 1 -- 172.21.15.17:0/2432860373 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc803ae70 con 0x55cee1f95020 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.387+0000 7f0dbeffd700 1 -- 172.21.15.17:0/2432860373 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8033040 con 0x55cee1f95020 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 -- 172.21.15.17:0/2432860373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f95020 msgr2=0x55cee1f9e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f95020 0x55cee1f9e360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55cee1fad830 tx=0x7f0dc8009310 comp rx=0 tx=0).stop 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 -- 172.21.15.17:0/2432860373 shutdown_connections 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1f9d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f95020 0x55cee1f9e360 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 --2- 172.21.15.17:0/2432860373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f96130 0x55cee1fa61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 -- 172.21.15.17:0/2432860373 >> 172.21.15.17:0/2432860373 conn(0x55cee1f09200 msgr2=0x55cee1f8be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 -- 172.21.15.17:0/2432860373 shutdown_connections 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 -- 172.21.15.17:0/2432860373 wait complete. 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.388+0000 7f0df233bb80 1 -- start start 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 Processor -- start 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 0x55cee1fa3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96130 0x55cee1fa3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1fa4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1fa53b0 con 0x55cee1f95020 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1fa5520 con 0x55cee1f96130 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cee1fa56e0 con 0x55cee1f96af0 2023-10-05T15:37:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.389+0000 7f0df233bb80 10 client.0 _ll_register_callbacks cb 0x7f0dd0099640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 0x55cee1fa3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 0x55cee1fa3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34092/0 (socket says 172.21.15.17:34092) 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1580861813 learned_addr learned my addr 172.21.15.17:0/1580861813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96130 0x55cee1fa3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1fa4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1580861813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 msgr2=0x55cee1fa4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1fa4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96130 msgr2=0x55cee1fa3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96130 0x55cee1fa3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd7fff700 1 -- 172.21.15.17:0/1580861813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc004120 con 0x55cee1f95020 2023-10-05T15:37:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0ddcf9c700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1fa4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:37:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.390+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96130 0x55cee1fa3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.391+0000 7f0dd7fff700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 0x55cee1fa3a90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009ce0 tx=0x7f0dc80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1443d79792ef2ebb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.391+0000 7f0db77fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.391+0000 7f0db77fe700 1 -- 172.21.15.17:0/1580861813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8033070 con 0x55cee1f95020 2023-10-05T15:37:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.391+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dc801e040 con 0x55cee1f95020 2023-10-05T15:37:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.391+0000 7f0db77fe700 1 -- 172.21.15.17:0/1580861813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0dc803a110 con 0x55cee1f95020 2023-10-05T15:37:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0db77fe700 1 -- 172.21.15.17:0/1580861813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc801d070 con 0x55cee1f95020 2023-10-05T15:37:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0df233bb80 10 client.16035 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f0dd8109a90 con 0x55cee1f95020 2023-10-05T15:37:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0db77fe700 1 -- 172.21.15.17:0/1580861813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc801e040 con 0x55cee1f95020 2023-10-05T15:37:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0db77fe700 1 -- 172.21.15.17:0/1580861813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0dc800b750 con 0x55cee1f95020 2023-10-05T15:37:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0df233bb80 10 client.16035 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0df233bb80 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0df233bb80 20 client.16035 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.392+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1ffef30 0x55cee2001320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.393+0000 7f0df233bb80 4 client.16035 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.393+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cee1ee0ad0 con 0x55cee1ffef30 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.393+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1ffef30 0x55cee2001320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.394+0000 7f0dd77fe700 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1ffef30 0x55cee2001320 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62468c7c0249bce5 server_cookie=6ca8ecb559f704ab in_seq=0 out_seq=0 2023-10-05T15:37:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.394+0000 7f0db77fe700 10 client.16035 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0db77fe700 1 -- 172.21.15.17:0/1580861813 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cee1ee0ad0 con 0x55cee1ffef30 2023-10-05T15:37:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0db77fe700 10 client.16035 handle_command_reply: tid=0 2023-10-05T15:37:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 client.16035 shutdown 2023-10-05T15:37:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 msgr2=0x55cee1fa3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 0x55cee1fa3a90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009ce0 tx=0x7f0dc80056e0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 shutdown_connections 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cee1ffef30 0x55cee2001320 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cee1f96af0 0x55cee1fa4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cee1f95020 0x55cee1fa3a90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 --2- 172.21.15.17:0/1580861813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cee1f96130 0x55cee1fa3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 >> 172.21.15.17:0/1580861813 conn(0x55cee1f09200 msgr2=0x55cee1f9d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.407+0000 7f0db77fe700 0 client.16035 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 shutdown_connections 2023-10-05T15:37:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0df233bb80 1 -- 172.21.15.17:0/1580861813 wait complete. 2023-10-05T15:37:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0df233bb80 20 client.16035 trim_cache size 0 max 16384 2023-10-05T15:37:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:37:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:37:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:37:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0dc00a1500 msgr2=0x7f0dc00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0dc00a1500 0x7f0dc00a39c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55cee1f94dc0 tx=0x7f0dcc00b410 comp rx=0 tx=0).stop 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 msgr2=0x7f0dd81a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.408+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 0x7f0dd81a00f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000ef30 tx=0x7f0dd000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 shutdown_connections 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0dc00a1500 0x7f0dc00a39c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dd8106a30 0x7f0dd81a00f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0dd81017d0 0x7f0dd8198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 --2- 172.21.15.17:0/2719370103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dd8104100 0x7f0dd8199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 >> 172.21.15.17:0/2719370103 conn(0x7f0dd80fb1a0 msgr2=0x7f0dd8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 shutdown_connections 2023-10-05T15:37:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:37:59.409+0000 7f0ddd79d700 1 -- 172.21.15.17:0/2719370103 wait complete. 2023-10-05T15:37:59.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.437+0000 7fc37e7ff700 1 -- 172.21.15.17:0/515632887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780738b0 msgr2=0x7fc378073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.437+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/515632887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780738b0 0x7fc378073d30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009990 tx=0x7fc36c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 -- 172.21.15.17:0/515632887 shutdown_connections 2023-10-05T15:37:59.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/515632887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc378108dc0 0x7fc37810b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/515632887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc378074e90 0x7fc3780732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/515632887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3780738b0 0x7fc378073d30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 -- 172.21.15.17:0/515632887 >> 172.21.15.17:0/515632887 conn(0x7fc3780fc460 msgr2=0x7fc3780fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 -- 172.21.15.17:0/515632887 shutdown_connections 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.438+0000 7fc37e7ff700 1 -- 172.21.15.17:0/515632887 wait complete. 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 Processor -- start 2023-10-05T15:37:59.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 -- start start 2023-10-05T15:37:59.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3780738b0 0x7fc378198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc378074e90 0x7fc378199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 0x7fc3781a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3781a0870 con 0x7fc378108dc0 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.439+0000 7fc37e7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3781a09e0 con 0x7fc3780738b0 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37e7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3781a0ba0 con 0x7fc378074e90 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 0x7fc3781a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc378074e90 0x7fc378199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 0x7fc3781a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34106/0 (socket says 172.21.15.17:34106) 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 -- 172.21.15.17:0/343461970 learned_addr learned my addr 172.21.15.17:0/343461970 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc377fff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3780738b0 0x7fc378198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 -- 172.21.15.17:0/343461970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc378074e90 msgr2=0x7fc378199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc378074e90 0x7fc378199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 -- 172.21.15.17:0/343461970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3780738b0 msgr2=0x7fc378198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3780738b0 0x7fc378198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.440+0000 7fc37cd9c700 1 -- 172.21.15.17:0/343461970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c0095f0 con 0x7fc378108dc0 2023-10-05T15:37:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.441+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 0x7fc3781a02a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc37000ef30 tx=0x7fc37000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.441+0000 7fc3757fa700 1 -- 172.21.15.17:0/343461970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370018070 con 0x7fc378108dc0 2023-10-05T15:37:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.441+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3781a0e20 con 0x7fc378108dc0 2023-10-05T15:37:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.441+0000 7fc3757fa700 1 -- 172.21.15.17:0/343461970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc37000f040 con 0x7fc378108dc0 2023-10-05T15:37:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.441+0000 7fc3757fa700 1 -- 172.21.15.17:0/343461970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37000cbc0 con 0x7fc378108dc0 2023-10-05T15:37:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.441+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3781a1240 con 0x7fc378108dc0 2023-10-05T15:37:59.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:59 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/860637597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:37:59.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:37:59 smithi017 ceph-mon[129107]: pgmap v411: 129 pgs: 129 active+clean; 521 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 30 MiB/s wr, 31 op/s 2023-10-05T15:37:59.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.446+0000 7fc3757fa700 1 -- 172.21.15.17:0/343461970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc370007500 con 0x7fc378108dc0 2023-10-05T15:37:59.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.448+0000 7fc392206b80 1 Processor -- start 2023-10-05T15:37:59.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.448+0000 7fc392206b80 1 -- start start 2023-10-05T15:37:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.448+0000 7fc392206b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde75e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.448+0000 7fc392206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde75f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.448+0000 7fc392206b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 0x558cde75fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc392206b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde6c6460 con 0x558cde75fa60 2023-10-05T15:37:59.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.448+0000 7fc3757fa700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc3600a1500 0x7fc3600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc392206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde6b7c20 con 0x558cde75ebc0 2023-10-05T15:37:59.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc392206b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde6b5540 con 0x558cde75e260 2023-10-05T15:37:59.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 0x558cde75fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc3757fa700 1 -- 172.21.15.17:0/343461970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc3700ccb00 con 0x7fc378108dc0 2023-10-05T15:37:59.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 0x558cde75fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34120/0 (socket says 172.21.15.17:34120) 2023-10-05T15:37:59.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 -- 172.21.15.17:0/2927818158 learned_addr learned my addr 172.21.15.17:0/2927818158 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc3777fe700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc3600a1500 0x7fc3600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc3777fe700 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde75e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc377fff700 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde75f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 -- 172.21.15.17:0/2927818158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 msgr2=0x558cde75e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde75e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 -- 172.21.15.17:0/2927818158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 msgr2=0x558cde75f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde75f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.449+0000 7fc37cd9c700 1 -- 172.21.15.17:0/2927818158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cde4dbde0 con 0x558cde75fa60 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.450+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 0x558cde75fee0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc37000cdd0 tx=0x7fc370099670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d59cdcf10471ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.450+0000 7fc3777fe700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc3600a1500 0x7fc3600a39c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc36c006010 tx=0x7fc36c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.450+0000 7fc35e7fc700 1 -- 172.21.15.17:0/2927818158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700a67c0 con 0x558cde75fa60 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.450+0000 7fc35e7fc700 1 -- 172.21.15.17:0/2927818158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc370012340 con 0x558cde75fa60 2023-10-05T15:37:59.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.450+0000 7fc35e7fc700 1 -- 172.21.15.17:0/2927818158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37009dc00 con 0x558cde75fa60 2023-10-05T15:37:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 -- 172.21.15.17:0/2927818158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 msgr2=0x558cde75fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 0x558cde75fee0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc37000cdd0 tx=0x7fc370099670 comp rx=0 tx=0).stop 2023-10-05T15:37:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 -- 172.21.15.17:0/2927818158 shutdown_connections 2023-10-05T15:37:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75fa60 0x558cde75fee0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde75e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 --2- 172.21.15.17:0/2927818158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde75f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 -- 172.21.15.17:0/2927818158 >> 172.21.15.17:0/2927818158 conn(0x558cde6d2260 msgr2=0x558cde759140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 -- 172.21.15.17:0/2927818158 shutdown_connections 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.451+0000 7fc392206b80 1 -- 172.21.15.17:0/2927818158 wait complete. 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.452+0000 7fc392206b80 1 -- start start 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.452+0000 7fc392206b80 1 Processor -- start 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.452+0000 7fc392206b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde768050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc392206b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde768590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc392206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc392206b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde6b0e30 con 0x558cde75ebc0 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc392206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde64d710 con 0x558cde75fa60 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc392206b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde64d3b0 con 0x558cde75e260 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc392206b80 10 client.0 _ll_register_callbacks cb 0x558cde4aa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde768590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde768590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34130/0 (socket says 172.21.15.17:34130) 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc3777fe700 1 -- 172.21.15.17:0/1152758141 learned_addr learned my addr 172.21.15.17:0/1152758141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc377fff700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde768050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.453+0000 7fc3777fe700 1 -- 172.21.15.17:0/1152758141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 msgr2=0x558cde768050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3777fe700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde768050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3777fe700 1 -- 172.21.15.17:0/1152758141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 msgr2=0x558cde76f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3777fe700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3777fe700 1 -- 172.21.15.17:0/1152758141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3781a1240 con 0x558cde75ebc0 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc377fff700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde768050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3777fe700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde768590 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009990 tx=0x7fc36c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe1b93f510dd8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3577fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3577fe700 1 -- 172.21.15.17:0/1152758141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c02d070 con 0x558cde75ebc0 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cde750f10 con 0x558cde75ebc0 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.454+0000 7fc3577fe700 1 -- 172.21.15.17:0/1152758141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc36c003d30 con 0x558cde75ebc0 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc3577fe700 1 -- 172.21.15.17:0/1152758141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36c032470 con 0x558cde75ebc0 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 10 client.16047 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558cde4c4c60 con 0x558cde75ebc0 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc3577fe700 1 -- 172.21.15.17:0/1152758141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558cde750f10 con 0x558cde75ebc0 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc3577fe700 1 -- 172.21.15.17:0/1152758141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc36c00f580 con 0x558cde75ebc0 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 10 client.16047 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 20 client.16047 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde773e80 0x558cde7762a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 4 client.16047 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.455+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cde6a9e10 con 0x558cde773e80 2023-10-05T15:37:59.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.456+0000 7fc377fff700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde773e80 0x558cde7762a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.456+0000 7fc3577fe700 10 client.16047 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.456+0000 7fc377fff700 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde773e80 0x558cde7762a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=399a77ccb1f546a5 server_cookie=260194decba38e19 in_seq=0 out_seq=0 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc3577fe700 1 -- 172.21.15.17:0/1152758141 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558cde6a9e10 con 0x558cde773e80 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc3577fe700 10 client.16047 handle_command_reply: tid=0 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 client.16047 shutdown 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 msgr2=0x558cde768590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde768590 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009990 tx=0x7fc36c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 shutdown_connections 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde773e80 0x558cde7762a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde768050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 --2- 172.21.15.17:0/1152758141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde768590 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 >> 172.21.15.17:0/1152758141 conn(0x558cde6d2260 msgr2=0x558cde758f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.457+0000 7fc3577fe700 0 client.16047 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.458+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 shutdown_connections 2023-10-05T15:37:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.458+0000 7fc392206b80 1 -- 172.21.15.17:0/1152758141 wait complete. 2023-10-05T15:37:59.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.458+0000 7fc392206b80 20 client.16047 trim_cache size 0 max 16384 2023-10-05T15:37:59.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 Processor -- start 2023-10-05T15:37:59.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 -- start start 2023-10-05T15:37:59.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 0x558cde75a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde76f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75fa60 0x558cde758f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde767a60 con 0x558cde75e260 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde531920 con 0x558cde75ebc0 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc392206b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde753550 con 0x558cde75fa60 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.473+0000 7fc377fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 0x558cde75a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 0x558cde75a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34132/0 (socket says 172.21.15.17:34132) 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 -- 172.21.15.17:0/2071845053 learned_addr learned my addr 172.21.15.17:0/2071845053 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc3777fe700 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde76f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75fa60 0x558cde758f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 -- 172.21.15.17:0/2071845053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75fa60 msgr2=0x558cde758f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75fa60 0x558cde758f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 -- 172.21.15.17:0/2071845053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 msgr2=0x558cde76f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde76f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 -- 172.21.15.17:0/2071845053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cde502250 con 0x558cde75e260 2023-10-05T15:37:59.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc3777fe700 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde76f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.474+0000 7fc377fff700 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 0x558cde75a020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x558cde776ba0 tx=0x7fc368009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee23e4d0b47a9c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc35effd700 1 -- 172.21.15.17:0/2071845053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368017040 con 0x558cde75e260 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc35effd700 1 -- 172.21.15.17:0/2071845053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc368018040 con 0x558cde75e260 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc35effd700 1 -- 172.21.15.17:0/2071845053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3680053a0 con 0x558cde75e260 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 -- 172.21.15.17:0/2071845053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 msgr2=0x558cde75a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 0x558cde75a020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x558cde776ba0 tx=0x7fc368009260 comp rx=0 tx=0).stop 2023-10-05T15:37:59.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 -- 172.21.15.17:0/2071845053 shutdown_connections 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75fa60 0x558cde758f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75e260 0x558cde75a020 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 --2- 172.21.15.17:0/2071845053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75ebc0 0x558cde76f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.475+0000 7fc392206b80 1 -- 172.21.15.17:0/2071845053 >> 172.21.15.17:0/2071845053 conn(0x558cde6d2260 msgr2=0x558cde77ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.476+0000 7fc392206b80 1 -- 172.21.15.17:0/2071845053 shutdown_connections 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.476+0000 7fc392206b80 1 -- 172.21.15.17:0/2071845053 wait complete. 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.476+0000 7fc392206b80 1 -- start start 2023-10-05T15:37:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.476+0000 7fc392206b80 1 Processor -- start 2023-10-05T15:37:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde76ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde76b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde76e820 con 0x558cde75ebc0 2023-10-05T15:37:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde76e990 con 0x558cde75fa60 2023-10-05T15:37:59.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cde76eb50 con 0x558cde75e260 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc392206b80 10 client.0 _ll_register_callbacks cb 0x7fc36c005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde76b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde76b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34148/0 (socket says 172.21.15.17:34148) 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc3777fe700 1 -- 172.21.15.17:0/1118867852 learned_addr learned my addr 172.21.15.17:0/1118867852 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc377fff700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde76ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.477+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3777fe700 1 -- 172.21.15.17:0/1118867852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 msgr2=0x558cde76ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3777fe700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde76ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3777fe700 1 -- 172.21.15.17:0/1118867852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 msgr2=0x558cde76e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3777fe700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3777fe700 1 -- 172.21.15.17:0/1118867852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cde4c4c60 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc37cd9c700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3777fe700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde76b380 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0098e0 tx=0x7fc36c00fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3360a7c5cfcb893c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3577fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3577fe700 1 -- 172.21.15.17:0/1118867852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c02b070 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc370012340 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.478+0000 7fc3577fe700 1 -- 172.21.15.17:0/1118867852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc36c00f460 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc3577fe700 1 -- 172.21.15.17:0/1118867852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc36c02d070 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 10 client.16053 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fc368012040 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc3577fe700 1 -- 172.21.15.17:0/1118867852 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc370012340 con 0x558cde75ebc0 2023-10-05T15:37:59.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc3577fe700 1 -- 172.21.15.17:0/1118867852 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc36c03a030 con 0x558cde75ebc0 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 10 client.16053 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 10 client.16053 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 20 client.16053 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde7c80c0 0x558cde7ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 4 client.16053 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 --> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558cde6a9b30 con 0x558cde7c80c0 2023-10-05T15:37:59.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.479+0000 7fc377fff700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde7c80c0 0x558cde7ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.480+0000 7fc3577fe700 10 client.16053 ms_handle_connect on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:59.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.480+0000 7fc377fff700 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde7c80c0 0x558cde7ca4e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83c0cedf3f9a3c26 server_cookie=5fd994ad8bfb6d37 in_seq=0 out_seq=0 2023-10-05T15:37:59.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.480+0000 7fc3577fe700 1 -- 172.21.15.17:0/1118867852 <== mds.1 v2:172.21.15.17:6838/2274947328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558cde6a9b30 con 0x558cde7c80c0 2023-10-05T15:37:59.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.480+0000 7fc3577fe700 10 client.16053 handle_command_reply: tid=0 2023-10-05T15:37:59.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.480+0000 7fc392206b80 1 client.16053 shutdown 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 msgr2=0x558cde76b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde76b380 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0098e0 tx=0x7fc36c00fd00 comp rx=0 tx=0).stop 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 shutdown_connections 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:6838/2274947328,v1:172.21.15.17:6839/2274947328] conn(0x558cde7c80c0 0x558cde7ca4e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558cde75fa60 0x558cde76e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558cde75e260 0x558cde76ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 --2- 172.21.15.17:0/1118867852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cde75ebc0 0x558cde76b380 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 >> 172.21.15.17:0/1118867852 conn(0x558cde6d2260 msgr2=0x558cde765df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc3577fe700 0 client.16053 ms_handle_reset on v2:172.21.15.17:6838/2274947328 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 shutdown_connections 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 1 -- 172.21.15.17:0/1118867852 wait complete. 2023-10-05T15:37:59.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.481+0000 7fc392206b80 20 client.16053 trim_cache size 0 max 16384 2023-10-05T15:37:59.487 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:59.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc3600a1500 msgr2=0x7fc3600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc3600a1500 0x7fc3600a39c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc36c006010 tx=0x7fc36c01a040 comp rx=0 tx=0).stop 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 msgr2=0x7fc3781a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 0x7fc3781a02a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc37000ef30 tx=0x7fc37000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 shutdown_connections 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc3600a1500 0x7fc3600a39c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc378108dc0 0x7fc3781a02a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3780738b0 0x7fc378198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 --2- 172.21.15.17:0/343461970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc378074e90 0x7fc378199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 >> 172.21.15.17:0/343461970 conn(0x7fc3780fc460 msgr2=0x7fc3780fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 shutdown_connections 2023-10-05T15:37:59.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.482+0000 7fc37e7ff700 1 -- 172.21.15.17:0/343461970 wait complete. 2023-10-05T15:37:59.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-05T15:37:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:59 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/860637597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:37:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:37:59 smithi167 ceph-mon[133366]: pgmap v411: 129 pgs: 129 active+clean; 521 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 30 MiB/s wr, 31 op/s 2023-10-05T15:37:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2300000 of 3200000 tuples (71%) done (elapsed 37.96 s, remaining 14.85 s) 2023-10-05T15:37:59.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:59 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/860637597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-05T15:37:59.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:37:59 smithi079 ceph-mon[132936]: pgmap v411: 129 pgs: 129 active+clean; 521 MiB data, 555 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 30 MiB/s wr, 31 op/s 2023-10-05T15:37:59.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.785+0000 7ff43e1ff700 1 -- 172.21.15.17:0/2761886953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438102a40 msgr2=0x7ff438109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.785+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/2761886953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438102a40 0x7ff438109360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff430009f90 tx=0x7ff43000b330 comp rx=0 tx=0).stop 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 -- 172.21.15.17:0/2761886953 shutdown_connections 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/2761886953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438102a40 0x7ff438109360 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/2761886953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438100ea0 0x7ff4381012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/2761886953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff438102080 0x7ff438102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 -- 172.21.15.17:0/2761886953 >> 172.21.15.17:0/2761886953 conn(0x7ff4380fc460 msgr2=0x7ff4380fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 -- 172.21.15.17:0/2761886953 shutdown_connections 2023-10-05T15:37:59.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.786+0000 7ff43e1ff700 1 -- 172.21.15.17:0/2761886953 wait complete. 2023-10-05T15:37:59.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.787+0000 7ff43e1ff700 1 Processor -- start 2023-10-05T15:37:59.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.787+0000 7ff43e1ff700 1 -- start start 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff43e1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 0x7ff438196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff43e1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438102080 0x7ff438197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff43e1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff438102a40 0x7ff43819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff43e1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43819e760 con 0x7ff438100ea0 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff43e1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43819e8a0 con 0x7ff438102080 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff43e1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43819ea30 con 0x7ff438102a40 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 0x7ff438196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 0x7ff438196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34172/0 (socket says 172.21.15.17:34172) 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff4377fe700 1 -- 172.21.15.17:0/1548352086 learned_addr learned my addr 172.21.15.17:0/1548352086 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.788+0000 7ff437fff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff438102a40 0x7ff43819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff4377fe700 1 -- 172.21.15.17:0/1548352086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff438102a40 msgr2=0x7ff43819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff4377fe700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff438102a40 0x7ff43819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff4377fe700 1 -- 172.21.15.17:0/1548352086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438102080 msgr2=0x7ff438197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff436ffd700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438102080 0x7ff438197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff4377fe700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438102080 0x7ff438197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff4377fe700 1 -- 172.21.15.17:0/1548352086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009c40 con 0x7ff438100ea0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff436ffd700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438102080 0x7ff438197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff4377fe700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 0x7ff438196be0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff42800e970 tx=0x7ff42800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff434ff9700 1 -- 172.21.15.17:0/1548352086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428009790 con 0x7ff438100ea0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff434ff9700 1 -- 172.21.15.17:0/1548352086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4280044b0 con 0x7ff438100ea0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff434ff9700 1 -- 172.21.15.17:0/1548352086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428003dd0 con 0x7ff438100ea0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.789+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff438073140 con 0x7ff438100ea0 2023-10-05T15:37:59.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.790+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438073600 con 0x7ff438100ea0 2023-10-05T15:37:59.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.795+0000 7ff451a76b80 1 Processor -- start 2023-10-05T15:37:59.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.795+0000 7ff451a76b80 1 -- start start 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685260 0x556348685680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685bc0 0x556348686480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348686a60 0x556348686ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff451a76b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563485ed460 con 0x556348685260 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff451a76b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563485dec20 con 0x556348685bc0 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff451a76b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563485dc540 con 0x556348686a60 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685260 0x556348685680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685260 0x556348685680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34176/0 (socket says 172.21.15.17:34176) 2023-10-05T15:37:59.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff437fff700 1 -- 172.21.15.17:0/650930607 learned_addr learned my addr 172.21.15.17:0/650930607 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff4377fe700 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685bc0 0x556348686480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.796+0000 7ff436ffd700 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348686a60 0x556348686ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff4377fe700 1 -- 172.21.15.17:0/650930607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348686a60 msgr2=0x556348686ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff4377fe700 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348686a60 0x556348686ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff4377fe700 1 -- 172.21.15.17:0/650930607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685260 msgr2=0x556348685680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff4377fe700 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685260 0x556348685680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff434ff9700 1 -- 172.21.15.17:0/1548352086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff428003f30 con 0x7ff438100ea0 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff4377fe700 1 -- 172.21.15.17:0/650930607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556348402de0 con 0x556348685bc0 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.797+0000 7ff4377fe700 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685bc0 0x556348686480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff438073790 tx=0x7ff4280d39c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d48b556cbd1a87e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.798+0000 7ff41dffb700 1 -- 172.21.15.17:0/650930607 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280cc520 con 0x556348685bc0 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.798+0000 7ff41dffb700 1 -- 172.21.15.17:0/650930607 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4280cc680 con 0x556348685bc0 2023-10-05T15:37:59.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.798+0000 7ff41dffb700 1 -- 172.21.15.17:0/650930607 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280df9c0 con 0x556348685bc0 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.798+0000 7ff451a76b80 1 -- 172.21.15.17:0/650930607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685bc0 msgr2=0x556348686480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.798+0000 7ff451a76b80 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685bc0 0x556348686480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff438073790 tx=0x7ff4280d39c0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 -- 172.21.15.17:0/650930607 shutdown_connections 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348686a60 0x556348686ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685260 0x556348685680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 --2- 172.21.15.17:0/650930607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685bc0 0x556348686480 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 -- 172.21.15.17:0/650930607 >> 172.21.15.17:0/650930607 conn(0x5563485f9260 msgr2=0x556348680140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 -- 172.21.15.17:0/650930607 shutdown_connections 2023-10-05T15:37:59.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff434ff9700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4200a58a0 0x7ff4200a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.799+0000 7ff451a76b80 1 -- 172.21.15.17:0/650930607 wait complete. 2023-10-05T15:37:59.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.800+0000 7ff434ff9700 1 -- 172.21.15.17:0/1548352086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff428014070 con 0x7ff438100ea0 2023-10-05T15:37:59.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.800+0000 7ff451a76b80 1 -- start start 2023-10-05T15:37:59.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.801+0000 7ff451a76b80 1 Processor -- start 2023-10-05T15:37:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.801+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 0x5563486978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.801+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685bc0 0x556348697de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.801+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348686a60 0x55634869ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff451a76b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563485d7e30 con 0x556348685bc0 2023-10-05T15:37:59.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff451a76b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556348574710 con 0x556348686a60 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff451a76b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563485743b0 con 0x556348685260 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff451a76b80 10 client.0 _ll_register_callbacks cb 0x5563483d1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 0x5563486978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 0x5563486978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44800/0 (socket says 172.21.15.17:44800) 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 -- 172.21.15.17:0/3099916889 learned_addr learned my addr 172.21.15.17:0/3099916889 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff437fff700 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348686a60 0x55634869ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 -- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348686a60 msgr2=0x55634869ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348686a60 0x55634869ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 -- 172.21.15.17:0/3099916889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685bc0 msgr2=0x556348697de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685bc0 0x556348697de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.802+0000 7ff4377fe700 1 -- 172.21.15.17:0/3099916889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438073600 con 0x556348685260 2023-10-05T15:37:59.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.803+0000 7ff4377fe700 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 0x5563486978a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff42800f010 tx=0x7ff428003790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed42a6c3b09e0484 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.803+0000 7ff416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.803+0000 7ff416ffd700 1 -- 172.21.15.17:0/3099916889 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280cde00 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.803+0000 7ff416ffd700 1 -- 172.21.15.17:0/3099916889 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff42809a2e0 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.803+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556348677f10 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff416ffd700 1 -- 172.21.15.17:0/3099916889 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff428095f20 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 10 client.25849 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5563483ebc60 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff416ffd700 1 -- 172.21.15.17:0/3099916889 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4280b6070 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff416ffd700 1 -- 172.21.15.17:0/3099916889 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ff4280d3300 con 0x556348685260 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 10 client.25849 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:59.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 20 client.25849 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348692cd0 0x5563486950f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 4 client.25849 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:37:59.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.804+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563485d0e10 con 0x556348692cd0 2023-10-05T15:37:59.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.805+0000 7ff436ffd700 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348692cd0 0x5563486950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.806+0000 7ff416ffd700 10 client.25849 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.806+0000 7ff436ffd700 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348692cd0 0x5563486950f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c82cb692be627e5 server_cookie=23dee5bf6dffce4d in_seq=0 out_seq=0 2023-10-05T15:37:59.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.807+0000 7ff436ffd700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4200a58a0 0x7ff4200a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.807+0000 7ff416ffd700 1 -- 172.21.15.17:0/3099916889 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5563485d0e10 con 0x556348692cd0 2023-10-05T15:37:59.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.807+0000 7ff416ffd700 10 client.25849 handle_command_reply: tid=0 2023-10-05T15:37:59.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.807+0000 7ff451a76b80 1 client.25849 shutdown 2023-10-05T15:37:59.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 msgr2=0x5563486978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 0x5563486978a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff42800f010 tx=0x7ff428003790 comp rx=0 tx=0).stop 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff436ffd700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4200a58a0 0x7ff4200a7d60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x556348695980 tx=0x7ff42c009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 shutdown_connections 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348692cd0 0x5563486950f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348686a60 0x55634869ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff416ffd700 0 client.25849 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685260 0x5563486978a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 --2- 172.21.15.17:0/3099916889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348685bc0 0x556348697de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.808+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 >> 172.21.15.17:0/3099916889 conn(0x5563485f9260 msgr2=0x55634867ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.809+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 shutdown_connections 2023-10-05T15:37:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.809+0000 7ff451a76b80 1 -- 172.21.15.17:0/3099916889 wait complete. 2023-10-05T15:37:59.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.809+0000 7ff451a76b80 20 client.25849 trim_cache size 0 max 16384 2023-10-05T15:37:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.828+0000 7ff451a76b80 1 Processor -- start 2023-10-05T15:37:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 -- start start 2023-10-05T15:37:59.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x556348686e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634868dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556348458920 con 0x556348686a60 2023-10-05T15:37:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556348692830 con 0x556348685260 2023-10-05T15:37:59.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff451a76b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634868e540 con 0x556348685bc0 2023-10-05T15:37:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634868dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634868dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34190/0 (socket says 172.21.15.17:34190) 2023-10-05T15:37:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff437fff700 1 -- 172.21.15.17:0/2388421754 learned_addr learned my addr 172.21.15.17:0/2388421754 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.829+0000 7ff4377fe700 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x556348686e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff436ffd700 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff437fff700 1 -- 172.21.15.17:0/2388421754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 msgr2=0x55634869ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff437fff700 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff437fff700 1 -- 172.21.15.17:0/2388421754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 msgr2=0x556348686e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff437fff700 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x556348686e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff437fff700 1 -- 172.21.15.17:0/2388421754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556348429250 con 0x556348686a60 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.830+0000 7ff437fff700 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634868dd00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff430009320 tx=0x7ff430009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadbad9e4d5bccb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.831+0000 7ff41e7fc700 1 -- 172.21.15.17:0/2388421754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000e040 con 0x556348686a60 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.831+0000 7ff41e7fc700 1 -- 172.21.15.17:0/2388421754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff430020070 con 0x556348686a60 2023-10-05T15:37:59.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.831+0000 7ff41e7fc700 1 -- 172.21.15.17:0/2388421754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000bc50 con 0x556348686a60 2023-10-05T15:37:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.831+0000 7ff451a76b80 1 -- 172.21.15.17:0/2388421754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 msgr2=0x55634868dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.831+0000 7ff451a76b80 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634868dd00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff430009320 tx=0x7ff430009350 comp rx=0 tx=0).stop 2023-10-05T15:37:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 -- 172.21.15.17:0/2388421754 shutdown_connections 2023-10-05T15:37:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634868dd00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x556348686e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 --2- 172.21.15.17:0/2388421754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 -- 172.21.15.17:0/2388421754 >> 172.21.15.17:0/2388421754 conn(0x5563485f9260 msgr2=0x5563486b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 -- 172.21.15.17:0/2388421754 shutdown_connections 2023-10-05T15:37:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 -- 172.21.15.17:0/2388421754 wait complete. 2023-10-05T15:37:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.832+0000 7ff451a76b80 1 -- start start 2023-10-05T15:37:59.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 Processor -- start 2023-10-05T15:37:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x55634869e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634869b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634869b600 con 0x556348686a60 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634869b770 con 0x556348685260 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55634869b930 con 0x556348685bc0 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.833+0000 7ff451a76b80 10 client.0 _ll_register_callbacks cb 0x7ff42c0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x55634869e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff436ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x55634869e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55338/0 (socket says 172.21.15.17:55338) 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 -- 172.21.15.17:0/1363043431 learned_addr learned my addr 172.21.15.17:0/1363043431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 -- 172.21.15.17:0/1363043431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 msgr2=0x55634869eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 -- 172.21.15.17:0/1363043431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 msgr2=0x55634869b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634869b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.834+0000 7ff4377fe700 1 -- 172.21.15.17:0/1363043431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438109c90 con 0x556348685260 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.835+0000 7ff4377fe700 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x55634869e5e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4280998e0 tx=0x7ff42809dd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0719cbe6422e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.835+0000 7ff416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.835+0000 7ff416ffd700 1 -- 172.21.15.17:0/1363043431 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4280999b0 con 0x556348685260 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.835+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4280cc680 con 0x556348685260 2023-10-05T15:37:59.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.835+0000 7ff416ffd700 1 -- 172.21.15.17:0/1363043431 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff42809a2e0 con 0x556348685260 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.835+0000 7ff416ffd700 1 -- 172.21.15.17:0/1363043431 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff428099540 con 0x556348685260 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.836+0000 7ff451a76b80 10 client.25862 fetch_fsmap learned FSMap version 31 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.836+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5563484012b0 con 0x556348685260 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.836+0000 7ff416ffd700 1 -- 172.21.15.17:0/1363043431 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff42807c020 con 0x556348685260 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff416ffd700 1 -- 172.21.15.17:0/1363043431 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ff4280d3300 con 0x556348685260 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff451a76b80 10 client.25862 fetch_fsmap finished waiting for FSMap version 31 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff451a76b80 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:37:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff451a76b80 20 client.25862 populate_metadata read hostname 'smithi017' 2023-10-05T15:37:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff451a76b80 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348700360 0x556348702750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:37:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff451a76b80 4 client.25862 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-05T15:37:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5563485d0b30 con 0x556348700360 2023-10-05T15:37:59.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.837+0000 7ff436ffd700 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348700360 0x556348702750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.838+0000 7ff416ffd700 10 client.25862 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.838+0000 7ff436ffd700 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348700360 0x556348702750 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a2152277aae4f26 server_cookie=41a8652aa67347bb in_seq=0 out_seq=0 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.838+0000 7ff416ffd700 1 -- 172.21.15.17:0/1363043431 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5563485d0b30 con 0x556348700360 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.838+0000 7ff416ffd700 10 client.25862 handle_command_reply: tid=0 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.838+0000 7ff451a76b80 1 client.25862 shutdown 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 msgr2=0x55634869e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x55634869e5e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4280998e0 tx=0x7ff42809dd50 comp rx=0 tx=0).stop 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 shutdown_connections 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556348700360 0x556348702750 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556348686a60 0x55634869b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff416ffd700 0 client.25862 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556348685260 0x55634869e5e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 --2- 172.21.15.17:0/1363043431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556348685bc0 0x55634869eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 >> 172.21.15.17:0/1363043431 conn(0x5563485f9260 msgr2=0x55634868dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 shutdown_connections 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 1 -- 172.21.15.17:0/1363043431 wait complete. 2023-10-05T15:37:59.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.839+0000 7ff451a76b80 20 client.25862 trim_cache size 0 max 16384 2023-10-05T15:37:59.843 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-10-05T15:37:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4200a58a0 msgr2=0x7ff4200a7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4200a58a0 0x7ff4200a7d60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x556348695980 tx=0x7ff42c009580 comp rx=0 tx=0).stop 2023-10-05T15:37:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 msgr2=0x7ff438196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:37:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 0x7ff438196be0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff42800e970 tx=0x7ff42800ed30 comp rx=0 tx=0).stop 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 shutdown_connections 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4200a58a0 0x7ff4200a7d60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff438102a40 0x7ff43819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff438100ea0 0x7ff438196be0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 --2- 172.21.15.17:0/1548352086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff438102080 0x7ff438197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 >> 172.21.15.17:0/1548352086 conn(0x7ff4380fc460 msgr2=0x7ff4380fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 shutdown_connections 2023-10-05T15:37:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:37:59.840+0000 7ff43e1ff700 1 -- 172.21.15.17:0/1548352086 wait complete. 2023-10-05T15:38:00.862 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-05T15:38:00.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-05T15:38:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 -- 172.21.15.17:0/4263455763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 msgr2=0x7f0cdc100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/4263455763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc100590 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009990 tx=0x7f0cd0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 -- 172.21.15.17:0/4263455763 shutdown_connections 2023-10-05T15:38:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/4263455763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc100ad0 0x7f0cdc100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/4263455763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc0ff7b0 0x7f0cdc0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/4263455763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc100590 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 -- 172.21.15.17:0/4263455763 >> 172.21.15.17:0/4263455763 conn(0x7f0cdc0fb330 msgr2=0x7f0cdc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 -- 172.21.15.17:0/4263455763 shutdown_connections 2023-10-05T15:38:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.095+0000 7f0ce15ff700 1 -- 172.21.15.17:0/4263455763 wait complete. 2023-10-05T15:38:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 Processor -- start 2023-10-05T15:38:01.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 -- start start 2023-10-05T15:38:01.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc0ff7b0 0x7f0cdc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc100ad0 0x7f0cdc1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1a08e0 con 0x7f0cdc100110 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1a0a20 con 0x7f0cdc100ad0 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.097+0000 7f0ce15ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1a0bb0 con 0x7f0cdc0ff7b0 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34210/0 (socket says 172.21.15.17:34210) 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 -- 172.21.15.17:0/807885653 learned_addr learned my addr 172.21.15.17:0/807885653 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc0ff7b0 0x7f0cdc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc100ad0 0x7f0cdc1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 -- 172.21.15.17:0/807885653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc0ff7b0 msgr2=0x7f0cdc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc0ff7b0 0x7f0cdc198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 -- 172.21.15.17:0/807885653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc100ad0 msgr2=0x7f0cdc1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc100ad0 0x7f0cdc1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 -- 172.21.15.17:0/807885653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00095f0 con 0x7f0cdc100110 2023-10-05T15:38:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.098+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc1992a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005910 tx=0x7f0cd0005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.099+0000 7f0cc3fff700 1 -- 172.21.15.17:0/807885653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd001d070 con 0x7f0cdc100110 2023-10-05T15:38:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.099+0000 7f0cc3fff700 1 -- 172.21.15.17:0/807885653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cd000be90 con 0x7f0cdc100110 2023-10-05T15:38:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.099+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc1a0e30 con 0x7f0cdc100110 2023-10-05T15:38:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.099+0000 7f0cc3fff700 1 -- 172.21.15.17:0/807885653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0022e60 con 0x7f0cdc100110 2023-10-05T15:38:01.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.099+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc1a1250 con 0x7f0cdc100110 2023-10-05T15:38:01.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.103+0000 7f0cc3fff700 1 -- 172.21.15.17:0/807885653 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0cd0022600 con 0x7f0cdc100110 2023-10-05T15:38:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.104+0000 7f0cf4eebb80 1 Processor -- start 2023-10-05T15:38:01.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 -- start start 2023-10-05T15:38:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a342e0 0x561e24a34700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a35500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a35ae0 0x561e24a35f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e2499c4e0 con 0x561e24a34c40 2023-10-05T15:38:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e2498dca0 con 0x561e24a342e0 2023-10-05T15:38:01.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.105+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e2498b5c0 con 0x561e24a35ae0 2023-10-05T15:38:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a35500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a342e0 0x561e24a34700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cc3fff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0cc40a1500 0x7f0cc40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a342e0 0x561e24a34700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55368/0 (socket says 172.21.15.17:55368) 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdb7fe700 1 -- 172.21.15.17:0/1422823293 learned_addr learned my addr 172.21.15.17:0/1422823293 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a35ae0 0x561e24a35f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cc3fff700 1 -- 172.21.15.17:0/807885653 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0cd00ce440 con 0x7f0cdc100110 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0cc40a1500 0x7f0cc40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdaffd700 1 -- 172.21.15.17:0/1422823293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a35ae0 msgr2=0x561e24a35f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a35ae0 0x561e24a35f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdaffd700 1 -- 172.21.15.17:0/1422823293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a342e0 msgr2=0x561e24a34700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a342e0 0x561e24a34700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.106+0000 7f0cdaffd700 1 -- 172.21.15.17:0/1422823293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e247b1e60 con 0x561e24a34c40 2023-10-05T15:38:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.107+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a35500 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc007c70 tx=0x7f0ccc007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247e4c1a2d73f63f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.107+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0cc40a1500 0x7f0cc40a39c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009510 tx=0x7f0cd4004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.107+0000 7f0cc17fa700 1 -- 172.21.15.17:0/1422823293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc010ca0 con 0x561e24a34c40 2023-10-05T15:38:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.107+0000 7f0cc17fa700 1 -- 172.21.15.17:0/1422823293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ccc0044e0 con 0x561e24a34c40 2023-10-05T15:38:01.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.107+0000 7f0cc17fa700 1 -- 172.21.15.17:0/1422823293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc005020 con 0x561e24a34c40 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/1422823293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 msgr2=0x561e24a35500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a35500 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc007c70 tx=0x7f0ccc007f80 comp rx=0 tx=0).stop 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/1422823293 shutdown_connections 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a35ae0 0x561e24a35f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a342e0 0x561e24a34700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/1422823293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a35500 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/1422823293 >> 172.21.15.17:0/1422823293 conn(0x561e249a82e0 msgr2=0x561e24a2f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/1422823293 shutdown_connections 2023-10-05T15:38:01.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.108+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/1422823293 wait complete. 2023-10-05T15:38:01.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.109+0000 7f0cf4eebb80 1 -- start start 2023-10-05T15:38:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.110+0000 7f0cf4eebb80 1 Processor -- start 2023-10-05T15:38:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a3e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a45620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24986eb0 con 0x561e24a342e0 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24923790 con 0x561e24a35ae0 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24923430 con 0x561e24a34c40 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cf4eebb80 10 client.0 _ll_register_callbacks cb 0x561e24780880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a3e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34222/0 (socket says 172.21.15.17:34222) 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3054161171 learned_addr learned my addr 172.21.15.17:0/3054161171 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a3e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3054161171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 msgr2=0x561e24a3e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a3e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 msgr2=0x561e24a45620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a45620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3054161171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc0078a0 con 0x561e24a342e0 2023-10-05T15:38:01.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.111+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a3e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:38:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.112+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a3e0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc004980 tx=0x7f0ccc004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941a080521a343e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.112+0000 7f0cbeff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.112+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3054161171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc01f070 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.112+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3054161171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0ccc0042e0 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.112+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e24a26f90 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3054161171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ccc010aa0 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 10 client.16077 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561e2479ace0 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3054161171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e24a26f90 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3054161171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f0ccc003790 con 0x561e24a342e0 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 10 client.16077 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 20 client.16077 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:01.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a49e70 0x561e24a4c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 4 client.16077 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.113+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e2497fe90 con 0x561e24a49e70 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.114+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a49e70 0x561e24a4c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.114+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a49e70 0x561e24a4c290 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95242ff6210323a2 server_cookie=8023ac004b5606fb in_seq=0 out_seq=0 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.114+0000 7f0cbeff5700 10 client.16077 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.115+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3054161171 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e2497fe90 con 0x561e24a49e70 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.115+0000 7f0cbeff5700 10 client.16077 handle_command_reply: tid=0 2023-10-05T15:38:01.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.115+0000 7f0cf4eebb80 1 client.16077 shutdown 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.115+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 msgr2=0x561e24a3e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.115+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a3e0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc004980 tx=0x7f0ccc004a60 comp rx=0 tx=0).stop 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 shutdown_connections 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a49e70 0x561e24a4c290 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a45620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a3e0a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3054161171 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a3e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cbeff5700 0 client.16077 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 >> 172.21.15.17:0/3054161171 conn(0x561e249a82e0 msgr2=0x561e24a2efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 shutdown_connections 2023-10-05T15:38:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3054161171 wait complete. 2023-10-05T15:38:01.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.116+0000 7f0cf4eebb80 20 client.16077 trim_cache size 0 max 16384 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.143+0000 7f0cf4eebb80 1 Processor -- start 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.143+0000 7f0cf4eebb80 1 -- start start 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.143+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a342e0 0x561e24a389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.143+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.143+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a38ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e248079a0 con 0x561e24a34c40 2023-10-05T15:38:01.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24a295c0 con 0x561e24a35ae0 2023-10-05T15:38:01.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24a36360 con 0x561e24a342e0 2023-10-05T15:38:01.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34234/0 (socket says 172.21.15.17:34234) 2023-10-05T15:38:01.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 -- 172.21.15.17:0/247783195 learned_addr learned my addr 172.21.15.17:0/247783195 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a38ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a342e0 0x561e24a389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 -- 172.21.15.17:0/247783195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a342e0 msgr2=0x561e24a389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a342e0 0x561e24a389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 -- 172.21.15.17:0/247783195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 msgr2=0x561e24a38ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a38ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cda7fc700 1 -- 172.21.15.17:0/247783195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e24a2df10 con 0x561e24a34c40 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.144+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a342e0 0x561e24a389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.145+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a455e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0cd009b150 tx=0x7f0cd001fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa0d902f38db326 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.145+0000 7f0cc1ffb700 1 -- 172.21.15.17:0/247783195 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd009af90 con 0x561e24a34c40 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.145+0000 7f0cc1ffb700 1 -- 172.21.15.17:0/247783195 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cd009adb0 con 0x561e24a34c40 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.145+0000 7f0cc1ffb700 1 -- 172.21.15.17:0/247783195 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00a3750 con 0x561e24a34c40 2023-10-05T15:38:01.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/247783195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 msgr2=0x561e24a455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a455e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0cd009b150 tx=0x7f0cd001fb90 comp rx=0 tx=0).stop 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/247783195 shutdown_connections 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a38ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a342e0 0x561e24a389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/247783195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a34c40 0x561e24a455e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/247783195 >> 172.21.15.17:0/247783195 conn(0x561e249a82e0 msgr2=0x561e24a3be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/247783195 shutdown_connections 2023-10-05T15:38:01.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/247783195 wait complete. 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 -- start start 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.146+0000 7f0cf4eebb80 1 Processor -- start 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a44f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a45480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24a420b0 con 0x561e24a342e0 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24a42220 con 0x561e24a35ae0 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e24a423e0 con 0x561e24a34c40 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cf4eebb80 10 client.0 _ll_register_callbacks cb 0x7f0cd4009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a44f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a44f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34238/0 (socket says 172.21.15.17:34238) 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3442958513 learned_addr learned my addr 172.21.15.17:0/3442958513 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.147+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a45480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3442958513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 msgr2=0x561e24a45480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a45480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 msgr2=0x561e24a419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdaffd700 1 -- 172.21.15.17:0/3442958513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc1a1250 con 0x561e24a342e0 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdb7fe700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cdaffd700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a44f40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc010850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddce23bb19e2bab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cbeff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:38:01.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3442958513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc01f040 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ccc0044e0 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3442958513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0ccc000e40 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3442958513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ccc003ee0 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cf4eebb80 10 client.16083 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.148+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561e24a2b1c0 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3442958513 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ccc0044e0 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3442958513 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f0ccc0103d0 con 0x561e24a342e0 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cf4eebb80 10 client.16083 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cf4eebb80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cf4eebb80 20 client.16083 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a9f1d0 0x561e24aa15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cf4eebb80 4 client.16083 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-05T15:38:01.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.149+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561e2497fbb0 con 0x561e24a9f1d0 2023-10-05T15:38:01.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.150+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a9f1d0 0x561e24aa15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.150+0000 7f0cda7fc700 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a9f1d0 0x561e24aa15f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6b86c827100ce3 server_cookie=3d224a0237c96e3b in_seq=0 out_seq=0 2023-10-05T15:38:01.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.150+0000 7f0cbeff5700 10 client.16083 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.151+0000 7f0cbeff5700 1 -- 172.21.15.17:0/3442958513 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561e2497fbb0 con 0x561e24a9f1d0 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.151+0000 7f0cbeff5700 10 client.16083 handle_command_reply: tid=0 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.151+0000 7f0cf4eebb80 1 client.16083 shutdown 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 msgr2=0x561e24a44f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a44f40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc000c00 tx=0x7f0ccc010850 comp rx=0 tx=0).stop 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 shutdown_connections 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561e24a9f1d0 0x561e24aa15f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e24a35ae0 0x561e24a419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e24a342e0 0x561e24a44f40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 --2- 172.21.15.17:0/3442958513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561e24a34c40 0x561e24a45480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cbeff5700 0 client.16083 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 >> 172.21.15.17:0/3442958513 conn(0x561e249a82e0 msgr2=0x561e24a389b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 shutdown_connections 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 1 -- 172.21.15.17:0/3442958513 wait complete. 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.152+0000 7f0cf4eebb80 20 client.16083 trim_cache size 0 max 16384 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-10-05T15:38:01.157 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:38:01.158 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-10-05T15:38:01.158 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:38:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0cc40a1500 msgr2=0x7f0cc40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0cc40a1500 0x7f0cc40a39c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009510 tx=0x7f0cd4004b40 comp rx=0 tx=0).stop 2023-10-05T15:38:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 msgr2=0x7f0cdc1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc1992a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0005910 tx=0x7f0cd0005720 comp rx=0 tx=0).stop 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 shutdown_connections 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0cc40a1500 0x7f0cc40a39c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cdc100ad0 0x7f0cdc1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc0ff7b0 0x7f0cdc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 --2- 172.21.15.17:0/807885653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0cdc100110 0x7f0cdc1992a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 >> 172.21.15.17:0/807885653 conn(0x7f0cdc0fb330 msgr2=0x7f0cdc0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 shutdown_connections 2023-10-05T15:38:01.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.153+0000 7f0ce15ff700 1 -- 172.21.15.17:0/807885653 wait complete. 2023-10-05T15:38:01.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:38:01.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 -- 172.21.15.17:0/685913172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694101940 msgr2=0x7f9694103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 --2- 172.21.15.17:0/685913172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694101940 0x7f9694103d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9684009990 tx=0x7f9684009ca0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 -- 172.21.15.17:0/685913172 shutdown_connections 2023-10-05T15:38:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 --2- 172.21.15.17:0/685913172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 0x7f9694109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 --2- 172.21.15.17:0/685913172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694101940 0x7f9694103d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 --2- 172.21.15.17:0/685913172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694104270 0x7f9694106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.431+0000 7f96993ff700 1 -- 172.21.15.17:0/685913172 >> 172.21.15.17:0/685913172 conn(0x7f96940fb330 msgr2=0x7f96940fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.432+0000 7f96993ff700 1 -- 172.21.15.17:0/685913172 shutdown_connections 2023-10-05T15:38:01.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.432+0000 7f96993ff700 1 -- 172.21.15.17:0/685913172 wait complete. 2023-10-05T15:38:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 Processor -- start 2023-10-05T15:38:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 -- start start 2023-10-05T15:38:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694101940 0x7f9694198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 0x7f9694199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 0x7f96941a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941a0840 con 0x7f9694101940 2023-10-05T15:38:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941a09b0 con 0x7f9694106ba0 2023-10-05T15:38:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96993ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941a0b70 con 0x7f9694104270 2023-10-05T15:38:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694101940 0x7f9694198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 0x7f96941a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.433+0000 7f96927fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 0x7f9694199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694101940 0x7f9694198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34244/0 (socket says 172.21.15.17:34244) 2023-10-05T15:38:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 0x7f9694199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44884/0 (socket says 172.21.15.17:44884) 2023-10-05T15:38:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 0x7f96941a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55420/0 (socket says 172.21.15.17:55420) 2023-10-05T15:38:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f9692ffd700 1 -- 172.21.15.17:0/2616259633 learned_addr learned my addr 172.21.15.17:0/2616259633 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 -- 172.21.15.17:0/2616259633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 msgr2=0x7f96941a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 0x7f96941a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 -- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694101940 msgr2=0x7f9694198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694101940 0x7f9694198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 -- 172.21.15.17:0/2616259633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840095f0 con 0x7f9694104270 2023-10-05T15:38:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f96927fc700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 0x7f9694199240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f968800e9f0 tx=0x7f968800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.434+0000 7f967bfff700 1 -- 172.21.15.17:0/2616259633 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800c9c0 con 0x7f9694104270 2023-10-05T15:38:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.435+0000 7f967bfff700 1 -- 172.21.15.17:0/2616259633 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9688010430 con 0x7f9694104270 2023-10-05T15:38:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.435+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96941a0e50 con 0x7f9694104270 2023-10-05T15:38:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.435+0000 7f967bfff700 1 -- 172.21.15.17:0/2616259633 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688018680 con 0x7f9694104270 2023-10-05T15:38:01.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.435+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96941a12d0 con 0x7f9694104270 2023-10-05T15:38:01.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.440+0000 7f967bfff700 1 -- 172.21.15.17:0/2616259633 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f96880105a0 con 0x7f9694104270 2023-10-05T15:38:01.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.440+0000 7f96acdb7b80 1 Processor -- start 2023-10-05T15:38:01.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 -- start start 2023-10-05T15:38:01.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aa2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64aa2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64a09460 con 0x55cb64aa2a60 2023-10-05T15:38:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb649fac20 con 0x55cb64aa1bc0 2023-10-05T15:38:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb649f8540 con 0x55cb64aa1260 2023-10-05T15:38:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96937fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aa2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96937fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44890/0 (socket says 172.21.15.17:44890) 2023-10-05T15:38:01.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96927fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64aa2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.441+0000 7f96937fe700 1 -- 172.21.15.17:0/4176805546 learned_addr learned my addr 172.21.15.17:0/4176805546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96937fe700 1 -- 172.21.15.17:0/4176805546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 msgr2=0x55cb64aa2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96937fe700 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aa2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96937fe700 1 -- 172.21.15.17:0/4176805546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 msgr2=0x55cb64aa2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96937fe700 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64aa2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96937fe700 1 -- 172.21.15.17:0/4176805546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb6481ede0 con 0x55cb64aa1260 2023-10-05T15:38:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96937fe700 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa1680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f968c011680 tx=0x7f968c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df27e086696f2fc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96797fa700 1 -- 172.21.15.17:0/4176805546 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00e040 con 0x55cb64aa1260 2023-10-05T15:38:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96797fa700 1 -- 172.21.15.17:0/4176805546 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968c00f040 con 0x55cb64aa1260 2023-10-05T15:38:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.442+0000 7f96797fa700 1 -- 172.21.15.17:0/4176805546 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c004730 con 0x55cb64aa1260 2023-10-05T15:38:01.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f967bfff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f967c0a1500 0x7f967c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f967bfff700 1 -- 172.21.15.17:0/2616259633 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9688014070 con 0x7f9694104270 2023-10-05T15:38:01.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f9692ffd700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f967c0a1500 0x7f967c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 -- 172.21.15.17:0/4176805546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 msgr2=0x55cb64aa1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa1680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f968c011680 tx=0x7f968c009920 comp rx=0 tx=0).stop 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 -- 172.21.15.17:0/4176805546 shutdown_connections 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64aa2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa1680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/4176805546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aa2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.443+0000 7f96acdb7b80 1 -- 172.21.15.17:0/4176805546 >> 172.21.15.17:0/4176805546 conn(0x55cb64a15260 msgr2=0x55cb64a9c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.444+0000 7f96acdb7b80 1 -- 172.21.15.17:0/4176805546 shutdown_connections 2023-10-05T15:38:01.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.444+0000 7f96acdb7b80 1 -- 172.21.15.17:0/4176805546 wait complete. 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.444+0000 7f9692ffd700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f967c0a1500 0x7f967c0a39c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f969419a1d0 tx=0x7f968400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.444+0000 7f96acdb7b80 1 -- start start 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 Processor -- start 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1260 0x55cb64aaafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 0x55cb64aab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb649f3e30 con 0x55cb64aa2a60 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64990710 con 0x55cb64aa1260 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb649903b0 con 0x55cb64aa1bc0 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.445+0000 7f96acdb7b80 10 client.0 _ll_register_callbacks cb 0x55cb647ed800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 0x55cb64aab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 0x55cb64aab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44896/0 (socket says 172.21.15.17:44896) 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 -- 172.21.15.17:0/2762714315 learned_addr learned my addr 172.21.15.17:0/2762714315 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f9692ffd700 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1260 0x55cb64aaafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.456 INFO:teuthology.orchestra.run.smithi017.stderr:2400000 of 3200000 tuples (75%) done (elapsed 39.81 s, remaining 13.27 s) 2023-10-05T15:38:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 -- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1260 msgr2=0x55cb64aaafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1260 0x55cb64aaafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 -- 172.21.15.17:0/2762714315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 msgr2=0x55cb64ab2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 -- 172.21.15.17:0/2762714315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c011330 con 0x55cb64aa1bc0 2023-10-05T15:38:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f96927fc700 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 0x55cb64aab520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9688096ea0 tx=0x7f968809a970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b2e19277248e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.446+0000 7f9676ff5700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:38:01.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f9676ff5700 1 -- 172.21.15.17:0/2762714315 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688099f70 con 0x55cb64aa1bc0 2023-10-05T15:38:01.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f9676ff5700 1 -- 172.21.15.17:0/2762714315 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9688010880 con 0x55cb64aa1bc0 2023-10-05T15:38:01.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb64a93f10 con 0x55cb64aa1bc0 2023-10-05T15:38:01.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f9676ff5700 1 -- 172.21.15.17:0/2762714315 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9688099d90 con 0x55cb64aa1bc0 2023-10-05T15:38:01.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 10 client.25882 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:01.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55cb64807c60 con 0x55cb64aa1bc0 2023-10-05T15:38:01.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f9676ff5700 1 -- 172.21.15.17:0/2762714315 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96880b6020 con 0x55cb64aa1bc0 2023-10-05T15:38:01.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f9676ff5700 1 -- 172.21.15.17:0/2762714315 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f968809e130 con 0x55cb64aa1bc0 2023-10-05T15:38:01.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 10 client.25882 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 20 client.25882 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64ab6eb0 0x55cb64ab92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 4 client.25882 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.447+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb649ece10 con 0x55cb64ab6eb0 2023-10-05T15:38:01.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.448+0000 7f9692ffd700 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64ab6eb0 0x55cb64ab92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.449+0000 7f9692ffd700 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64ab6eb0 0x55cb64ab92f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51980a18631ecee0 server_cookie=c27d0807b34380a7 in_seq=0 out_seq=0 2023-10-05T15:38:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.449+0000 7f9676ff5700 10 client.25882 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f9676ff5700 1 -- 172.21.15.17:0/2762714315 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cb649ece10 con 0x55cb64ab6eb0 2023-10-05T15:38:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f9676ff5700 10 client.25882 handle_command_reply: tid=0 2023-10-05T15:38:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 client.25882 shutdown 2023-10-05T15:38:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 msgr2=0x55cb64aab520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 0x55cb64aab520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9688096ea0 tx=0x7f968809a970 comp rx=0 tx=0).stop 2023-10-05T15:38:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 shutdown_connections 2023-10-05T15:38:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64ab6eb0 0x55cb64ab92f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f9676ff5700 0 client.25882 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1260 0x55cb64aaafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/2762714315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1bc0 0x55cb64aab520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 >> 172.21.15.17:0/2762714315 conn(0x55cb64a15260 msgr2=0x55cb64a9bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 shutdown_connections 2023-10-05T15:38:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 1 -- 172.21.15.17:0/2762714315 wait complete. 2023-10-05T15:38:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.450+0000 7f96acdb7b80 20 client.25882 trim_cache size 0 max 16384 2023-10-05T15:38:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 Processor -- start 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 -- start start 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 0x55cb64ab2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa2a60 0x55cb64aa8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64874920 con 0x55cb64aa1bc0 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64aaab50 con 0x55cb64aa2a60 2023-10-05T15:38:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64ab4200 con 0x55cb64aa1260 2023-10-05T15:38:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96927fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 0x55cb64ab2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96927fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 0x55cb64ab2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34284/0 (socket says 172.21.15.17:34284) 2023-10-05T15:38:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96927fc700 1 -- 172.21.15.17:0/109825872 learned_addr learned my addr 172.21.15.17:0/109825872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.470+0000 7f96937fe700 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa2a60 0x55cb64aa8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f96927fc700 1 -- 172.21.15.17:0/109825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 msgr2=0x55cb64aa2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f96927fc700 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f96927fc700 1 -- 172.21.15.17:0/109825872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa2a60 msgr2=0x55cb64aa8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f96927fc700 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa2a60 0x55cb64aa8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f96927fc700 1 -- 172.21.15.17:0/109825872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb64845250 con 0x55cb64aa1bc0 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f9692ffd700 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f96927fc700 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 0x55cb64ab2520 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f968809aa90 tx=0x7f9688005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73253a6bd5a9e593 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f9679ffb700 1 -- 172.21.15.17:0/109825872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688099d90 con 0x55cb64aa1bc0 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f9679ffb700 1 -- 172.21.15.17:0/109825872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96880b6030 con 0x55cb64aa1bc0 2023-10-05T15:38:01.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.471+0000 7f9679ffb700 1 -- 172.21.15.17:0/109825872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968809a430 con 0x55cb64aa1bc0 2023-10-05T15:38:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 -- 172.21.15.17:0/109825872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 msgr2=0x55cb64ab2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 0x55cb64ab2520 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f968809aa90 tx=0x7f9688005bc0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 -- 172.21.15.17:0/109825872 shutdown_connections 2023-10-05T15:38:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa2a60 0x55cb64aa8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aa2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/109825872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa1bc0 0x55cb64ab2520 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 -- 172.21.15.17:0/109825872 >> 172.21.15.17:0/109825872 conn(0x55cb64a15260 msgr2=0x55cb64abdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 -- 172.21.15.17:0/109825872 shutdown_connections 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.472+0000 7f96acdb7b80 1 -- 172.21.15.17:0/109825872 wait complete. 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.473+0000 7f96acdb7b80 1 -- start start 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.473+0000 7f96acdb7b80 1 Processor -- start 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64ab1c80 con 0x55cb64aa2a60 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64ab1df0 con 0x55cb64aa1bc0 2023-10-05T15:38:01.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64ab1fb0 con 0x55cb64aa1260 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96acdb7b80 10 client.0 _ll_register_callbacks cb 0x55cb647ed800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96937fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f9692ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44916/0 (socket says 172.21.15.17:44916) 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f9692ffd700 1 -- 172.21.15.17:0/3955358348 learned_addr learned my addr 172.21.15.17:0/3955358348 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96927fc700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96937fe700 1 -- 172.21.15.17:0/3955358348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 msgr2=0x55cb64aae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96937fe700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96937fe700 1 -- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 msgr2=0x55cb64aae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96937fe700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.474+0000 7f96937fe700 1 -- 172.21.15.17:0/3955358348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9694109c00 con 0x55cb64aa2a60 2023-10-05T15:38:01.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f9692ffd700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f96937fe700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab1740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f968c000f80 tx=0x7f968c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aaa3f6373ceabe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:01.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f9676ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f9676ff5700 1 -- 172.21.15.17:0/3955358348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00e040 con 0x55cb64aa2a60 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f968c00f040 con 0x55cb64aa2a60 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f9676ff5700 1 -- 172.21.15.17:0/3955358348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f968c007710 con 0x55cb64aa2a60 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f9676ff5700 1 -- 172.21.15.17:0/3955358348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f968c009ac0 con 0x55cb64aa2a60 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f96acdb7b80 10 client.16098 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.475+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55cb64807c60 con 0x55cb64aa2a60 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f9676ff5700 1 -- 172.21.15.17:0/3955358348 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968c00f040 con 0x55cb64aa2a60 2023-10-05T15:38:01.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f9676ff5700 1 -- 172.21.15.17:0/3955358348 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f968c024020 con 0x55cb64aa2a60 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f96acdb7b80 10 client.16098 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f96acdb7b80 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f96acdb7b80 20 client.16098 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64b0bc00 0x55cb64b0e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f96acdb7b80 4 client.16098 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cb649ecb30 con 0x55cb64b0bc00 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.476+0000 7f9692ffd700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64b0bc00 0x55cb64b0e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f9692ffd700 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64b0bc00 0x55cb64b0e020 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85757011ac4f37f server_cookie=2148940542b9fde2 in_seq=0 out_seq=0 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f9676ff5700 10 client.16098 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f9676ff5700 1 -- 172.21.15.17:0/3955358348 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cb649ecb30 con 0x55cb64b0bc00 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f9676ff5700 10 client.16098 handle_command_reply: tid=0 2023-10-05T15:38:01.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f96acdb7b80 1 client.16098 shutdown 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 msgr2=0x55cb64ab1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab1740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f968c000f80 tx=0x7f968c009510 comp rx=0 tx=0).stop 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 shutdown_connections 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.477+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cb64b0bc00 0x55cb64b0e020 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64aa2a60 0x55cb64ab1740 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb64aa1260 0x55cb64aae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 1 --2- 172.21.15.17:0/3955358348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb64aa1bc0 0x55cb64aae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 >> 172.21.15.17:0/3955358348 conn(0x55cb64a15260 msgr2=0x55cb64aa8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f9676ff5700 0 client.16098 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 shutdown_connections 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 1 -- 172.21.15.17:0/3955358348 wait complete. 2023-10-05T15:38:01.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.478+0000 7f96acdb7b80 20 client.16098 trim_cache size 0 max 16384 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:38:01.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:38:01.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:38:01.485 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:38:01.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f967c0a1500 msgr2=0x7f967c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f967c0a1500 0x7f967c0a39c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f969419a1d0 tx=0x7f968400b260 comp rx=0 tx=0).stop 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 msgr2=0x7f9694199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 0x7f9694199240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f968800e9f0 tx=0x7f968800ed00 comp rx=0 tx=0).stop 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 shutdown_connections 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f967c0a1500 0x7f967c0a39c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9694106ba0 0x7f96941a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9694101940 0x7f9694198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 --2- 172.21.15.17:0/2616259633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9694104270 0x7f9694199240 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 >> 172.21.15.17:0/2616259633 conn(0x7f96940fb330 msgr2=0x7f96941025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 shutdown_connections 2023-10-05T15:38:01.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:01.479+0000 7f96993ff700 1 -- 172.21.15.17:0/2616259633 wait complete. 2023-10-05T15:38:01.504 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: pgmap v412: 129 pgs: 129 active+clean; 549 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 35 op/s 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:01 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:38:01.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: pgmap v412: 129 pgs: 129 active+clean; 549 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 35 op/s 2023-10-05T15:38:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:01 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:38:01.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: pgmap v412: 129 pgs: 129 active+clean; 549 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 35 op/s 2023-10-05T15:38:01.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:01.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:01 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:02.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub queued for path: / 2023-10-05T15:38:02.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:02.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:02 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub queued for path: / 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:02 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub queued for path: / 2023-10-05T15:38:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:03.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:02 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:03.284 INFO:teuthology.orchestra.run.smithi017.stderr:2500000 of 3200000 tuples (78%) done (elapsed 41.64 s, remaining 11.66 s) 2023-10-05T15:38:03.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:03 smithi017 ceph-mon[129107]: pgmap v413: 129 pgs: 129 active+clean; 553 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-10-05T15:38:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:03 smithi167 ceph-mon[133366]: pgmap v413: 129 pgs: 129 active+clean; 553 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-10-05T15:38:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:03 smithi079 ceph-mon[132936]: pgmap v413: 129 pgs: 129 active+clean; 553 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-10-05T15:38:04.620 INFO:teuthology.orchestra.run.smithi017.stderr:2600000 of 3200000 tuples (81%) done (elapsed 42.98 s, remaining 9.92 s) 2023-10-05T15:38:05.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:05 smithi017 ceph-mon[129107]: pgmap v414: 129 pgs: 129 active+clean; 615 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 31 MiB/s wr, 95 op/s 2023-10-05T15:38:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:05 smithi167 ceph-mon[133366]: pgmap v414: 129 pgs: 129 active+clean; 615 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 31 MiB/s wr, 95 op/s 2023-10-05T15:38:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:05 smithi079 ceph-mon[132936]: pgmap v414: 129 pgs: 129 active+clean; 615 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 31 MiB/s wr, 95 op/s 2023-10-05T15:38:06.367 INFO:teuthology.orchestra.run.smithi017.stderr:2700000 of 3200000 tuples (84%) done (elapsed 44.72 s, remaining 8.28 s) 2023-10-05T15:38:07.750 INFO:teuthology.orchestra.run.smithi017.stderr:2800000 of 3200000 tuples (87%) done (elapsed 46.11 s, remaining 6.59 s) 2023-10-05T15:38:07.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:07 smithi017 ceph-mon[129107]: pgmap v415: 129 pgs: 129 active+clean; 623 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-10-05T15:38:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:07 smithi167 ceph-mon[133366]: pgmap v415: 129 pgs: 129 active+clean; 623 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-10-05T15:38:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:07 smithi079 ceph-mon[132936]: pgmap v415: 129 pgs: 129 active+clean; 623 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-10-05T15:38:09.466 INFO:teuthology.orchestra.run.smithi017.stderr:2900000 of 3200000 tuples (90%) done (elapsed 47.82 s, remaining 4.95 s) 2023-10-05T15:38:09.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:09 smithi017 ceph-mon[129107]: pgmap v416: 129 pgs: 129 active+clean; 643 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 97 op/s 2023-10-05T15:38:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:09 smithi167 ceph-mon[133366]: pgmap v416: 129 pgs: 129 active+clean; 643 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 97 op/s 2023-10-05T15:38:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:09 smithi079 ceph-mon[132936]: pgmap v416: 129 pgs: 129 active+clean; 643 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 97 op/s 2023-10-05T15:38:11.326 INFO:teuthology.orchestra.run.smithi017.stderr:3000000 of 3200000 tuples (93%) done (elapsed 49.68 s, remaining 3.31 s) 2023-10-05T15:38:11.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:11 smithi017 ceph-mon[129107]: pgmap v417: 129 pgs: 129 active+clean; 687 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 28 MiB/s wr, 101 op/s 2023-10-05T15:38:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:11 smithi167 ceph-mon[133366]: pgmap v417: 129 pgs: 129 active+clean; 687 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 28 MiB/s wr, 101 op/s 2023-10-05T15:38:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:11 smithi079 ceph-mon[132936]: pgmap v417: 129 pgs: 129 active+clean; 687 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 28 MiB/s wr, 101 op/s 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 -- 172.21.15.17:0/3770211750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102090 msgr2=0x7f6a98102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/3770211750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102090 0x7f6a98102510 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009990 tx=0x7f6a88009ca0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 -- 172.21.15.17:0/3770211750 shutdown_connections 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/3770211750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98102a50 0x7f6a98109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/3770211750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a981012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/3770211750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102090 0x7f6a98102510 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 -- 172.21.15.17:0/3770211750 >> 172.21.15.17:0/3770211750 conn(0x7f6a980fc430 msgr2=0x7f6a980fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 -- 172.21.15.17:0/3770211750 shutdown_connections 2023-10-05T15:38:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.572+0000 7f6aa03ff700 1 -- 172.21.15.17:0/3770211750 wait complete. 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.573+0000 7f6aa03ff700 1 Processor -- start 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.573+0000 7f6aa03ff700 1 -- start start 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.573+0000 7f6aa03ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a980732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6aa03ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98102090 0x7f6a980737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6aa03ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102a50 0x7f6a98073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6aa03ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981a0be0 con 0x7f6a98102a50 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6aa03ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981a0d20 con 0x7f6a98102090 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6aa03ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981a0e60 con 0x7f6a98100eb0 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a980732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102a50 0x7f6a98073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a980732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:43832/0 (socket says 172.21.15.17:43832) 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98102090 0x7f6a980737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 -- 172.21.15.17:0/75132294 learned_addr learned my addr 172.21.15.17:0/75132294 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 -- 172.21.15.17:0/75132294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98102090 msgr2=0x7f6a980737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98102090 0x7f6a980737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 -- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102a50 msgr2=0x7f6a98073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102a50 0x7f6a98073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.574+0000 7f6a9e19b700 1 -- 172.21.15.17:0/75132294 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880095f0 con 0x7f6a98100eb0 2023-10-05T15:38:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.575+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a980732a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400e970 tx=0x7f6a9400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.575+0000 7f6a8f7fe700 1 -- 172.21.15.17:0/75132294 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94009790 con 0x7f6a98100eb0 2023-10-05T15:38:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.575+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981a10f0 con 0x7f6a98100eb0 2023-10-05T15:38:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.575+0000 7f6a8f7fe700 1 -- 172.21.15.17:0/75132294 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9400c7e0 con 0x7f6a98100eb0 2023-10-05T15:38:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.575+0000 7f6a8f7fe700 1 -- 172.21.15.17:0/75132294 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94003bd0 con 0x7f6a98100eb0 2023-10-05T15:38:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.575+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981a15d0 con 0x7f6a98100eb0 2023-10-05T15:38:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.579+0000 7f6a8f7fe700 1 -- 172.21.15.17:0/75132294 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6a9400c950 con 0x7f6a98100eb0 2023-10-05T15:38:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.580+0000 7f6ab3cb6b80 1 Processor -- start 2023-10-05T15:38:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 -- start start 2023-10-05T15:38:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 0x5557075202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x555707521450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707521990 0x555707528220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707488400 con 0x555707520fd0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707479bc0 con 0x555707521990 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557074774e0 con 0x55570751fec0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6a9e99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 0x5557075202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6a9e99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 0x5557075202e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:43848/0 (socket says 172.21.15.17:43848) 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1204457861 learned_addr learned my addr 172.21.15.17:0/1204457861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6a8f7fe700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a840a1480 0x7f6a840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x555707521450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.581+0000 7f6a9d99a700 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707521990 0x555707528220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a8f7fe700 1 -- 172.21.15.17:0/75132294 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6a94014070 con 0x7f6a98100eb0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a840a1480 0x7f6a840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1204457861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707521990 msgr2=0x555707528220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707521990 0x555707528220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1204457861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 msgr2=0x555707521450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x555707521450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1204457861 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570729dd80 con 0x55570751fec0 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.582+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 0x5557075202e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000fc70 tx=0x7f6a9000ff80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6445f6e0498fabd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.583+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a840a1480 0x7f6a840a3940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009000 tx=0x7f6a9001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.583+0000 7f6a8cbfe700 1 -- 172.21.15.17:0/1204457861 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000e040 con 0x55570751fec0 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.583+0000 7f6a8cbfe700 1 -- 172.21.15.17:0/1204457861 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9000f040 con 0x55570751fec0 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.583+0000 7f6a8cbfe700 1 -- 172.21.15.17:0/1204457861 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9001a680 con 0x55570751fec0 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1204457861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 msgr2=0x5557075202e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 0x5557075202e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000fc70 tx=0x7f6a9000ff80 comp rx=0 tx=0).stop 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1204457861 shutdown_connections 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707521990 0x555707528220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55570751fec0 0x5557075202e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1204457861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x555707521450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1204457861 >> 172.21.15.17:0/1204457861 conn(0x555707494200 msgr2=0x55570751abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1204457861 shutdown_connections 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1204457861 wait complete. 2023-10-05T15:38:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.584+0000 7f6ab3cb6b80 1 -- start start 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.585+0000 7f6ab3cb6b80 1 Processor -- start 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.585+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 0x555707529cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 0x55570752a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707531230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707472dd0 con 0x55570751fec0 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570740f6b0 con 0x555707520fd0 2023-10-05T15:38:12.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570740f350 con 0x555707521990 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6ab3cb6b80 10 client.0 _ll_register_callbacks cb 0x55570726c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 0x555707529cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 0x55570752a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 0x55570752a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50540/0 (socket says 172.21.15.17:50540) 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 0x555707529cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41454/0 (socket says 172.21.15.17:41454) 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 -- 172.21.15.17:0/2983789760 learned_addr learned my addr 172.21.15.17:0/2983789760 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707531230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 -- 172.21.15.17:0/2983789760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 msgr2=0x555707531230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707531230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 -- 172.21.15.17:0/2983789760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 msgr2=0x555707529cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 0x555707529cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.586+0000 7f6a9d99a700 1 -- 172.21.15.17:0/2983789760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9000f820 con 0x555707520fd0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.587+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 0x555707529cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.587+0000 7f6a9d99a700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 0x55570752a1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a98100bd0 tx=0x7f6a880054f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9d4ecb20cae3cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.587+0000 7f6a81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.587+0000 7f6a81ffb700 1 -- 172.21.15.17:0/2983789760 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8801d070 con 0x555707520fd0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.587+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555707512d50 con 0x555707520fd0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.587+0000 7f6a81ffb700 1 -- 172.21.15.17:0/2983789760 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6a88003b60 con 0x555707520fd0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6a81ffb700 1 -- 172.21.15.17:0/2983789760 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a88003d20 con 0x555707520fd0 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 10 client.25907 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x555707286c00 con 0x555707520fd0 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6a81ffb700 1 -- 172.21.15.17:0/2983789760 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555707512d50 con 0x555707520fd0 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6a81ffb700 1 -- 172.21.15.17:0/2983789760 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f6a880046c0 con 0x555707520fd0 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 10 client.25907 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 10 client.25907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 20 client.25907 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555707535c10 0x555707538030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 4 client.25907 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.588+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55570746bdb0 con 0x555707535c10 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.589+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555707535c10 0x555707538030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.589+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555707535c10 0x555707538030 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51895b73db8225c4 server_cookie=e369b2c9530e4481 in_seq=0 out_seq=0 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.589+0000 7f6a81ffb700 10 client.25907 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6a81ffb700 1 -- 172.21.15.17:0/2983789760 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55570746bdb0 con 0x555707535c10 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6a81ffb700 10 client.25907 handle_command_reply: tid=0 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 client.25907 shutdown 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 msgr2=0x55570752a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 0x55570752a1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a98100bd0 tx=0x7f6a880054f0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 shutdown_connections 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555707535c10 0x555707538030 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707531230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55570751fec0 0x555707529cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6a81ffb700 0 client.25907 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/2983789760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555707520fd0 0x55570752a1f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 >> 172.21.15.17:0/2983789760 conn(0x555707494200 msgr2=0x55570751a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 shutdown_connections 2023-10-05T15:38:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.590+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/2983789760 wait complete. 2023-10-05T15:38:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.591+0000 7f6ab3cb6b80 20 client.25907 trim_cache size 0 max 16384 2023-10-05T15:38:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.612+0000 7f6ab3cb6b80 1 Processor -- start 2023-10-05T15:38:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 -- start start 2023-10-05T15:38:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x555707527e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x5557075311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x5557075249e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557072f38c0 con 0x555707520fd0 2023-10-05T15:38:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707529880 con 0x55570751fec0 2023-10-05T15:38:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707520e00 con 0x555707521990 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x555707527e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6a9d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x5557075311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x555707527e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50544/0 (socket says 172.21.15.17:50544) 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6a9e19b700 1 -- 172.21.15.17:0/3703440271 learned_addr learned my addr 172.21.15.17:0/3703440271 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.613+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x5557075249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a9e19b700 1 -- 172.21.15.17:0/3703440271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 msgr2=0x5557075249e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x5557075249e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a9e19b700 1 -- 172.21.15.17:0/3703440271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 msgr2=0x5557075311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x5557075311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a9e19b700 1 -- 172.21.15.17:0/3703440271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557072c41f0 con 0x55570751fec0 2023-10-05T15:38:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x555707527e90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a9409a160 tx=0x7f6a9409e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89d059faf447cc76 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a8d3ff700 1 -- 172.21.15.17:0/3703440271 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9409a8d0 con 0x55570751fec0 2023-10-05T15:38:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a8d3ff700 1 -- 172.21.15.17:0/3703440271 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9409e320 con 0x55570751fec0 2023-10-05T15:38:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.614+0000 7f6a8d3ff700 1 -- 172.21.15.17:0/3703440271 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940cf0f0 con 0x55570751fec0 2023-10-05T15:38:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/3703440271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 msgr2=0x555707527e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x555707527e90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a9409a160 tx=0x7f6a9409e040 comp rx=0 tx=0).stop 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/3703440271 shutdown_connections 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x5557075249e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x555707527e90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/3703440271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x5557075311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/3703440271 >> 172.21.15.17:0/3703440271 conn(0x555707494200 msgr2=0x555707528920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/3703440271 shutdown_connections 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.615+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/3703440271 wait complete. 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 -- start start 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 Processor -- start 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x55570752eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x55570752f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707530420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707530960 con 0x555707520fd0 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707530ad0 con 0x55570751fec0 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555707530c90 con 0x555707521990 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.616+0000 7f6ab3cb6b80 10 client.0 _ll_register_callbacks cb 0x7f6a88005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x55570752f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x55570752eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707530420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x55570752eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50548/0 (socket says 172.21.15.17:50548) 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e19b700 1 -- 172.21.15.17:0/1857436645 learned_addr learned my addr 172.21.15.17:0/1857436645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 msgr2=0x55570752eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x55570752eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1857436645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 msgr2=0x55570752f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x55570752f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 -- 172.21.15.17:0/1857436645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981a15d0 con 0x555707521990 2023-10-05T15:38:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x55570752eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9d99a700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x55570752f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a9e99c700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707530420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000afd0 tx=0x7f6a9000f560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe3758b1ce6bf30 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.617+0000 7f6a81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:38:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6a81ffb700 1 -- 172.21.15.17:0/1857436645 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9000e040 con 0x555707521990 2023-10-05T15:38:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6a81ffb700 1 -- 172.21.15.17:0/1857436645 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6a90003e30 con 0x555707521990 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a9000f040 con 0x555707521990 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6a81ffb700 1 -- 172.21.15.17:0/1857436645 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a90009540 con 0x555707521990 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6ab3cb6b80 10 client.25906 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55570729c250 con 0x555707521990 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6a81ffb700 1 -- 172.21.15.17:0/1857436645 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9003e080 con 0x555707521990 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.618+0000 7f6a81ffb700 1 -- 172.21.15.17:0/1857436645 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f6a9000fca0 con 0x555707521990 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6ab3cb6b80 10 client.25906 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6ab3cb6b80 10 client.25906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6ab3cb6b80 20 client.25906 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55570758aa00 0x55570758ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6ab3cb6b80 4 client.25906 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:38:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55570746bad0 con 0x55570758aa00 2023-10-05T15:38:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55570758aa00 0x55570758ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6a81ffb700 10 client.25906 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.619+0000 7f6a9e19b700 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55570758aa00 0x55570758ce20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278cfcd51422c070 server_cookie=362e695a69547e89 in_seq=0 out_seq=0 2023-10-05T15:38:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.634+0000 7f6a81ffb700 1 -- 172.21.15.17:0/1857436645 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55570746bad0 con 0x55570758aa00 2023-10-05T15:38:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.634+0000 7f6a81ffb700 10 client.25906 handle_command_reply: tid=0 2023-10-05T15:38:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.634+0000 7f6ab3cb6b80 1 client.25906 shutdown 2023-10-05T15:38:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.634+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 msgr2=0x555707530420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.634+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707530420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000afd0 tx=0x7f6a9000f560 comp rx=0 tx=0).stop 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 shutdown_connections 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55570758aa00 0x55570758ce20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555707521990 0x555707530420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55570751fec0 0x55570752eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 --2- 172.21.15.17:0/1857436645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555707520fd0 0x55570752f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 >> 172.21.15.17:0/1857436645 conn(0x555707494200 msgr2=0x555707528920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6a81ffb700 0 client.25906 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 shutdown_connections 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 1 -- 172.21.15.17:0/1857436645 wait complete. 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.635+0000 7f6ab3cb6b80 20 client.25906 trim_cache size 0 max 16384 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:38:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a840a1480 msgr2=0x7f6a840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a840a1480 0x7f6a840a3940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009000 tx=0x7f6a9001e000 comp rx=0 tx=0).stop 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 msgr2=0x7f6a980732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a980732a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400e970 tx=0x7f6a9400ec80 comp rx=0 tx=0).stop 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 shutdown_connections 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6a840a1480 0x7f6a840a3940 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a98102a50 0x7f6a98073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a98100eb0 0x7f6a980732a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 --2- 172.21.15.17:0/75132294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a98102090 0x7f6a980737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 >> 172.21.15.17:0/75132294 conn(0x7f6a980fc430 msgr2=0x7f6a980fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 shutdown_connections 2023-10-05T15:38:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:12.636+0000 7f6aa03ff700 1 -- 172.21.15.17:0/75132294 wait complete. 2023-10-05T15:38:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:3100000 of 3200000 tuples (96%) done (elapsed 51.02 s, remaining 1.65 s) 2023-10-05T15:38:13.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:13 smithi017 ceph-mon[129107]: pgmap v418: 129 pgs: 129 active+clean; 699 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-10-05T15:38:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:13 smithi167 ceph-mon[133366]: pgmap v418: 129 pgs: 129 active+clean; 699 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-10-05T15:38:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:13 smithi079 ceph-mon[132936]: pgmap v418: 129 pgs: 129 active+clean; 699 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-10-05T15:38:14.536 INFO:teuthology.orchestra.run.smithi017.stderr:3200000 of 3200000 tuples (100%) done (elapsed 52.89 s, remaining 0.00 s) 2023-10-05T15:38:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:vacuum... 2023-10-05T15:38:15.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:15 smithi017 ceph-mon[129107]: pgmap v419: 129 pgs: 129 active+clean; 743 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 32 MiB/s wr, 91 op/s 2023-10-05T15:38:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:15 smithi167 ceph-mon[133366]: pgmap v419: 129 pgs: 129 active+clean; 743 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 32 MiB/s wr, 91 op/s 2023-10-05T15:38:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:15 smithi079 ceph-mon[132936]: pgmap v419: 129 pgs: 129 active+clean; 743 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 32 MiB/s wr, 91 op/s 2023-10-05T15:38:17.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:17 smithi017 ceph-mon[129107]: pgmap v420: 129 pgs: 129 active+clean; 761 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-10-05T15:38:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:17 smithi167 ceph-mon[133366]: pgmap v420: 129 pgs: 129 active+clean; 761 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-10-05T15:38:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:17 smithi079 ceph-mon[132936]: pgmap v420: 129 pgs: 129 active+clean; 761 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-10-05T15:38:19.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:19 smithi017 ceph-mon[129107]: pgmap v421: 129 pgs: 129 active+clean; 772 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 33 op/s 2023-10-05T15:38:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:19 smithi167 ceph-mon[133366]: pgmap v421: 129 pgs: 129 active+clean; 772 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 33 op/s 2023-10-05T15:38:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:19 smithi079 ceph-mon[132936]: pgmap v421: 129 pgs: 129 active+clean; 772 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 33 op/s 2023-10-05T15:38:21.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:21 smithi017 ceph-mon[129107]: pgmap v422: 129 pgs: 129 active+clean; 772 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 36 op/s 2023-10-05T15:38:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:21 smithi167 ceph-mon[133366]: pgmap v422: 129 pgs: 129 active+clean; 772 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 36 op/s 2023-10-05T15:38:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:21 smithi079 ceph-mon[132936]: pgmap v422: 129 pgs: 129 active+clean; 772 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 MiB/s wr, 36 op/s 2023-10-05T15:38:22.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:22 smithi017 ceph-mon[129107]: scrub summary: active paths [/] 2023-10-05T15:38:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:22 smithi167 ceph-mon[133366]: scrub summary: active paths [/] 2023-10-05T15:38:23.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:22 smithi079 ceph-mon[132936]: scrub summary: active paths [/] 2023-10-05T15:38:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:23 smithi017 ceph-mon[129107]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:23.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:23 smithi017 ceph-mon[129107]: pgmap v423: 129 pgs: 129 active+clean; 772 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2023-10-05T15:38:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:23 smithi167 ceph-mon[133366]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:23 smithi167 ceph-mon[133366]: pgmap v423: 129 pgs: 129 active+clean; 772 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2023-10-05T15:38:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:23 smithi079 ceph-mon[132936]: scrub summary: idle+waiting paths [/] 2023-10-05T15:38:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:23 smithi079 ceph-mon[132936]: pgmap v423: 129 pgs: 129 active+clean; 772 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 33 op/s 2023-10-05T15:38:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 -- 172.21.15.17:0/3875340714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 msgr2=0x7f0e9c103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/3875340714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c103d60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009990 tx=0x7f0e8c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 -- 172.21.15.17:0/3875340714 shutdown_connections 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/3875340714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e9c106bd0 0x7f0e9c109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/3875340714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c103d60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/3875340714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 0x7f0e9c106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 -- 172.21.15.17:0/3875340714 >> 172.21.15.17:0/3875340714 conn(0x7f0e9c0fb340 msgr2=0x7f0e9c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 -- 172.21.15.17:0/3875340714 shutdown_connections 2023-10-05T15:38:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.846+0000 7f0ea1fff700 1 -- 172.21.15.17:0/3875340714 wait complete. 2023-10-05T15:38:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.847+0000 7f0ea1fff700 1 Processor -- start 2023-10-05T15:38:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.847+0000 7f0ea1fff700 1 -- start start 2023-10-05T15:38:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0ea1fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0ea1fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 0x7f0e9c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0ea1fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e9c106bd0 0x7f0e9c19a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0ea1fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c19a840 con 0x7f0e9c1042a0 2023-10-05T15:38:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0ea1fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c19a9b0 con 0x7f0e9c101970 2023-10-05T15:38:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0ea1fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c19ab70 con 0x7f0e9c106bd0 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57084/0 (socket says 172.21.15.17:57084) 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1562970728 learned_addr learned my addr 172.21.15.17:0/1562970728 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 0x7f0e9c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e9c106bd0 0x7f0e9c19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1562970728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e9c106bd0 msgr2=0x7f0e9c19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e9c106bd0 0x7f0e9c19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 msgr2=0x7f0e9c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 0x7f0e9c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1562970728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0095f0 con 0x7f0e9c101970 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.848+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 0x7f0e9c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.849+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c198e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005910 tx=0x7f0e8c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.849+0000 7f0e98ff9700 1 -- 172.21.15.17:0/1562970728 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c01d070 con 0x7f0e9c101970 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.849+0000 7f0e98ff9700 1 -- 172.21.15.17:0/1562970728 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e8c00be70 con 0x7f0e9c101970 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.849+0000 7f0e98ff9700 1 -- 172.21.15.17:0/1562970728 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c022e60 con 0x7f0e9c101970 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.849+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c19adf0 con 0x7f0e9c101970 2023-10-05T15:38:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.849+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c1a1560 con 0x7f0e9c101970 2023-10-05T15:38:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.854+0000 7f0e98ff9700 1 -- 172.21.15.17:0/1562970728 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0e8c022600 con 0x7f0e9c101970 2023-10-05T15:38:25.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.855+0000 7f0eb5987b80 1 Processor -- start 2023-10-05T15:38:25.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.855+0000 7f0eb5987b80 1 -- start start 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fdd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fde450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fe5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9f45400 con 0x5603d9fdcec0 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9f36bc0 con 0x5603d9fde990 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9f344e0 con 0x5603d9fddfd0 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e98ff9700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e840a1480 0x7f0e840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e9bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fdd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e9affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fe5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fde450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e9affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fe5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57088/0 (socket says 172.21.15.17:57088) 2023-10-05T15:38:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e9affd700 1 -- 172.21.15.17:0/1709709550 learned_addr learned my addr 172.21.15.17:0/1709709550 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.856+0000 7f0e98ff9700 1 -- 172.21.15.17:0/1562970728 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0e8c0ce4c0 con 0x7f0e9c101970 2023-10-05T15:38:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e840a1480 0x7f0e840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9affd700 1 -- 172.21.15.17:0/1709709550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 msgr2=0x5603d9fde450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fde450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9affd700 1 -- 172.21.15.17:0/1709709550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 msgr2=0x5603d9fdd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fdd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9affd700 1 -- 172.21.15.17:0/1709709550 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d9d5ad80 con 0x5603d9fde990 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fe5220 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0e900115f0 tx=0x7f0e90011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a382742b055c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e81ffb700 1 -- 172.21.15.17:0/1709709550 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90019630 con 0x5603d9fde990 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e840a1480 0x7f0e840a3940 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009ec0 tx=0x7f0e94004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e81ffb700 1 -- 172.21.15.17:0/1709709550 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e90019c20 con 0x5603d9fde990 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.857+0000 7f0e81ffb700 1 -- 172.21.15.17:0/1709709550 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000eb40 con 0x5603d9fde990 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1709709550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 msgr2=0x5603d9fe5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fe5220 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0e900115f0 tx=0x7f0e90011900 comp rx=0 tx=0).stop 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1709709550 shutdown_connections 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fe5220 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fdd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1709709550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fde450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1709709550 >> 172.21.15.17:0/1709709550 conn(0x5603d9f51200 msgr2=0x5603d9fd7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1709709550 shutdown_connections 2023-10-05T15:38:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.858+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1709709550 wait complete. 2023-10-05T15:38:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.859+0000 7f0eb5987b80 1 -- start start 2023-10-05T15:38:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.859+0000 7f0eb5987b80 1 Processor -- start 2023-10-05T15:38:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fe7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9f2fdd0 con 0x5603d9fdcec0 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9ecc6b0 con 0x5603d9fde990 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9ecc350 con 0x5603d9fddfd0 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0eb5987b80 10 client.0 _ll_register_callbacks cb 0x5603d9d297a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fee0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57102/0 (socket says 172.21.15.17:57102) 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 -- 172.21.15.17:0/163244691 learned_addr learned my addr 172.21.15.17:0/163244691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9affd700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fe7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 -- 172.21.15.17:0/163244691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 msgr2=0x5603d9fe7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fe7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 -- 172.21.15.17:0/163244691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 msgr2=0x5603d9fe6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.860+0000 7f0e9bfff700 1 -- 172.21.15.17:0/163244691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e90009dd0 con 0x5603d9fde990 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.861+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fee0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e94003cb0 tx=0x7f0e94004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a56b04319495af server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.861+0000 7f0e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.861+0000 7f0e7affd700 1 -- 172.21.15.17:0/163244691 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94028070 con 0x5603d9fde990 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.861+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603d9fcfd50 con 0x5603d9fde990 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.861+0000 7f0e7affd700 1 -- 172.21.15.17:0/163244691 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0e94016ce0 con 0x5603d9fde990 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0e7affd700 1 -- 172.21.15.17:0/163244691 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e9401e040 con 0x5603d9fde990 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 10 client.25925 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5603d9d43c00 con 0x5603d9fde990 2023-10-05T15:38:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0e7affd700 1 -- 172.21.15.17:0/163244691 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603d9fcfd50 con 0x5603d9fde990 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0e7affd700 1 -- 172.21.15.17:0/163244691 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f0e9402b020 con 0x5603d9fde990 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 10 client.25925 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 10 client.25925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 20 client.25925 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603d9ff2ab0 0x5603d9ff4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 4 client.25925 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.862+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603d9f28db0 con 0x5603d9ff2ab0 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.863+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603d9ff2ab0 0x5603d9ff4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.863+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603d9ff2ab0 0x5603d9ff4ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a370f3d90b713c91 server_cookie=6579d7162e4a1eb1 in_seq=0 out_seq=0 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.863+0000 7f0e7affd700 10 client.25925 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0e7affd700 1 -- 172.21.15.17:0/163244691 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5603d9f28db0 con 0x5603d9ff2ab0 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0e7affd700 10 client.25925 handle_command_reply: tid=0 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 client.25925 shutdown 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 msgr2=0x5603d9fee0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fee0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e94003cb0 tx=0x7f0e94004ad0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 shutdown_connections 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603d9ff2ab0 0x5603d9ff4ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fde990 0x5603d9fee0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0e7affd700 0 client.25925 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/163244691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fddfd0 0x5603d9fe7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 >> 172.21.15.17:0/163244691 conn(0x5603d9f51200 msgr2=0x5603d9fd7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 shutdown_connections 2023-10-05T15:38:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.864+0000 7f0eb5987b80 1 -- 172.21.15.17:0/163244691 wait complete. 2023-10-05T15:38:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.865+0000 7f0eb5987b80 20 client.25925 trim_cache size 0 max 16384 2023-10-05T15:38:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 Processor -- start 2023-10-05T15:38:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 -- start start 2023-10-05T15:38:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fddfd0 0x5603d9fee060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fe4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9db08c0 con 0x5603d9fdcec0 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9fefd10 con 0x5603d9fddfd0 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9fd9680 con 0x5603d9fde990 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0e9bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fe4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34584/0 (socket says 172.21.15.17:34584) 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.882+0000 7f0e9affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fddfd0 0x5603d9fee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1109850587 learned_addr learned my addr 172.21.15.17:0/1109850587 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1109850587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 msgr2=0x5603d9fe4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fe4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1109850587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fddfd0 msgr2=0x5603d9fee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fddfd0 0x5603d9fee060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1109850587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d9d811f0 con 0x5603d9fdcec0 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fe4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fddfd0 0x5603d9fee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe61d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0a3240 tx=0x7f0e8c06d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344a12f4851d511c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e827fc700 1 -- 172.21.15.17:0/1109850587 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0b3ea0 con 0x5603d9fdcec0 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.883+0000 7f0e827fc700 1 -- 172.21.15.17:0/1109850587 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e8c022470 con 0x5603d9fdcec0 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0e827fc700 1 -- 172.21.15.17:0/1109850587 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c09f5c0 con 0x5603d9fdcec0 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1109850587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 msgr2=0x5603d9fe61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe61d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0a3240 tx=0x7f0e8c06d380 comp rx=0 tx=0).stop 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1109850587 shutdown_connections 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fe4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fdcec0 0x5603d9fe61d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1109850587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fddfd0 0x5603d9fee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1109850587 >> 172.21.15.17:0/1109850587 conn(0x5603d9f51200 msgr2=0x5603d9fe5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.884+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1109850587 shutdown_connections 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.885+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1109850587 wait complete. 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.885+0000 7f0eb5987b80 1 -- start start 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.885+0000 7f0eb5987b80 1 Processor -- start 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.885+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 0x5603d9feb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.885+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fddfd0 0x5603d9febed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0eb5987b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fecee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9fed420 con 0x5603d9fddfd0 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9fed590 con 0x5603d9fdcec0 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0eb5987b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d9fed750 con 0x5603d9fde990 2023-10-05T15:38:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0eb5987b80 10 client.0 _ll_register_callbacks cb 0x7f0e94013f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 0x5603d9feb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fddfd0 0x5603d9febed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 0x5603d9feb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57120/0 (socket says 172.21.15.17:57120) 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1862450531 learned_addr learned my addr 172.21.15.17:0/1862450531 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1862450531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 msgr2=0x5603d9fecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1862450531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fddfd0 msgr2=0x5603d9febed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fddfd0 0x5603d9febed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9b7fe700 1 -- 172.21.15.17:0/1862450531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603d9d5ad80 con 0x5603d9fdcec0 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.886+0000 7f0e9bfff700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e9b7fe700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 0x5603d9feb990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c097970 tx=0x7f0e8c09afb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e44466a8fc6312a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e7affd700 1 -- 172.21.15.17:0/1862450531 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0b3ea0 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e7affd700 1 -- 172.21.15.17:0/1862450531 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0e8c0a3770 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e90019c20 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e7affd700 1 -- 172.21.15.17:0/1862450531 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e8c09add0 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0eb5987b80 10 client.25931 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5603d9d43c00 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e7affd700 1 -- 172.21.15.17:0/1862450531 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e8c080020 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.887+0000 7f0e7affd700 1 -- 172.21.15.17:0/1862450531 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f0e8c09f200 con 0x5603d9fdcec0 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0eb5987b80 10 client.25931 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0eb5987b80 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0eb5987b80 20 client.25931 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603da046fc0 0x5603da0493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0eb5987b80 4 client.25931 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5603d9f28ad0 con 0x5603da046fc0 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603da046fc0 0x5603da0493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0e9affd700 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603da046fc0 0x5603da0493b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5dbf7bec19a2d8 server_cookie=1ffc484fd7ee3996 in_seq=0 out_seq=0 2023-10-05T15:38:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.888+0000 7f0e7affd700 10 client.25931 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0e7affd700 1 -- 172.21.15.17:0/1862450531 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5603d9f28ad0 con 0x5603da046fc0 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0e7affd700 10 client.25931 handle_command_reply: tid=0 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 client.25931 shutdown 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 msgr2=0x5603d9feb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 0x5603d9feb990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c097970 tx=0x7f0e8c09afb0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 shutdown_connections 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5603da046fc0 0x5603da0493b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603d9fde990 0x5603d9fecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5603d9fdcec0 0x5603d9feb990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0e7affd700 0 client.25931 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 --2- 172.21.15.17:0/1862450531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5603d9fddfd0 0x5603d9febed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 >> 172.21.15.17:0/1862450531 conn(0x5603d9f51200 msgr2=0x5603d9fe5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 shutdown_connections 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 1 -- 172.21.15.17:0/1862450531 wait complete. 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.906+0000 7f0eb5987b80 20 client.25931 trim_cache size 0 max 16384 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:38:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e840a1480 msgr2=0x7f0e840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e840a1480 0x7f0e840a3940 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009ec0 tx=0x7f0e94004b40 comp rx=0 tx=0).stop 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 msgr2=0x7f0e9c198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c198e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005910 tx=0x7f0e8c005740 comp rx=0 tx=0).stop 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 shutdown_connections 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e840a1480 0x7f0e840a3940 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e9c106bd0 0x7f0e9c19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e9c101970 0x7f0e9c198e50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 --2- 172.21.15.17:0/1562970728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e9c1042a0 0x7f0e9c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 >> 172.21.15.17:0/1562970728 conn(0x7f0e9c0fb340 msgr2=0x7f0e9c1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 shutdown_connections 2023-10-05T15:38:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:25.907+0000 7f0ea1fff700 1 -- 172.21.15.17:0/1562970728 wait complete. 2023-10-05T15:38:25.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:25 smithi017 ceph-mon[129107]: pgmap v424: 129 pgs: 129 active+clean; 772 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 43 op/s 2023-10-05T15:38:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:25 smithi167 ceph-mon[133366]: pgmap v424: 129 pgs: 129 active+clean; 772 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 43 op/s 2023-10-05T15:38:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:25 smithi079 ceph-mon[132936]: pgmap v424: 129 pgs: 129 active+clean; 772 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 43 op/s 2023-10-05T15:38:27.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:27 smithi017 ceph-mon[129107]: pgmap v425: 129 pgs: 129 active+clean; 776 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 41 op/s 2023-10-05T15:38:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:27 smithi167 ceph-mon[133366]: pgmap v425: 129 pgs: 129 active+clean; 776 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 41 op/s 2023-10-05T15:38:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:27 smithi079 ceph-mon[132936]: pgmap v425: 129 pgs: 129 active+clean; 776 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 28 MiB/s wr, 41 op/s 2023-10-05T15:38:28.895 INFO:teuthology.orchestra.run.smithi017.stderr:set primary keys... 2023-10-05T15:38:29.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:29 smithi017 ceph-mon[129107]: pgmap v426: 129 pgs: 129 active+clean; 780 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 MiB/s wr, 41 op/s 2023-10-05T15:38:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:29 smithi167 ceph-mon[133366]: pgmap v426: 129 pgs: 129 active+clean; 780 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 MiB/s wr, 41 op/s 2023-10-05T15:38:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:29 smithi079 ceph-mon[132936]: pgmap v426: 129 pgs: 129 active+clean; 780 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 28 MiB/s wr, 41 op/s 2023-10-05T15:38:31.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:38:31.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 -- 172.21.15.17:0/997230900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 msgr2=0x7f04f4073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 --2- 172.21.15.17:0/997230900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4073d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f04e80098f0 tx=0x7f04e8009c00 comp rx=0 tx=0).stop 2023-10-05T15:38:31.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 -- 172.21.15.17:0/997230900 shutdown_connections 2023-10-05T15:38:31.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 --2- 172.21.15.17:0/997230900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 0x7f04f410b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 --2- 172.21.15.17:0/997230900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f40732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 --2- 172.21.15.17:0/997230900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4073d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 -- 172.21.15.17:0/997230900 >> 172.21.15.17:0/997230900 conn(0x7f04f40fc460 msgr2=0x7f04f40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:31.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 -- 172.21.15.17:0/997230900 shutdown_connections 2023-10-05T15:38:31.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.752+0000 7f04f8fff700 1 -- 172.21.15.17:0/997230900 wait complete. 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.753+0000 7f04f8fff700 1 Processor -- start 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.753+0000 7f04f8fff700 1 -- start start 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f8fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f8fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f8fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 0x7f04f41a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f8fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f41a08d0 con 0x7f04f4074e70 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f8fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f41a0a10 con 0x7f04f4108e00 2023-10-05T15:38:31.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f8fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f41a0ba0 con 0x7f04f4073890 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f4199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34614/0 (socket says 172.21.15.17:34614) 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 -- 172.21.15.17:0/2117703037 learned_addr learned my addr 172.21.15.17:0/2117703037 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 0x7f04f41a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 -- 172.21.15.17:0/2117703037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 msgr2=0x7f04f4198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 -- 172.21.15.17:0/2117703037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 msgr2=0x7f04f41a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 0x7f04f41a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.754+0000 7f04f1d9b700 1 -- 172.21.15.17:0/2117703037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009520 con 0x7f04f4074e70 2023-10-05T15:38:31.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04f259c700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 0x7f04f41a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f4199290 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009fd0 tx=0x7f04e800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04e37fe700 1 -- 172.21.15.17:0/2117703037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e801c070 con 0x7f04f4074e70 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f41a0e20 con 0x7f04f4074e70 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04e37fe700 1 -- 172.21.15.17:0/2117703037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e800f7b0 con 0x7f04f4074e70 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04e37fe700 1 -- 172.21.15.17:0/2117703037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8004a00 con 0x7f04f4074e70 2023-10-05T15:38:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.755+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f41a1240 con 0x7f04f4074e70 2023-10-05T15:38:31.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.760+0000 7f04e37fe700 1 -- 172.21.15.17:0/2117703037 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f04e8020070 con 0x7f04f4074e70 2023-10-05T15:38:31.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.761+0000 7f050c933b80 1 Processor -- start 2023-10-05T15:38:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.761+0000 7f050c933b80 1 -- start start 2023-10-05T15:38:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f050c933b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df91680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f050c933b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df92480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f050c933b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df92ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f050c933b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69def9460 con 0x55e69df91260 2023-10-05T15:38:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f050c933b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69deeac20 con 0x55e69df91bc0 2023-10-05T15:38:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f050c933b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dee8540 con 0x55e69df92a60 2023-10-05T15:38:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f04f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df92480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f04f2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df91680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f04f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df92480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57152/0 (socket says 172.21.15.17:57152) 2023-10-05T15:38:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.762+0000 7f04f259c700 1 -- 172.21.15.17:0/1185980508 learned_addr learned my addr 172.21.15.17:0/1185980508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df92ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04e37fe700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f04dc0a1500 0x7f04dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f259c700 1 -- 172.21.15.17:0/1185980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 msgr2=0x55e69df92ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f259c700 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df92ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f259c700 1 -- 172.21.15.17:0/1185980508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 msgr2=0x55e69df91680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f259c700 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df91680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f259c700 1 -- 172.21.15.17:0/1185980508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69dd0ede0 con 0x55e69df91bc0 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f04dc0a1500 0x7f04dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04e37fe700 1 -- 172.21.15.17:0/2117703037 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f04e80cddf0 con 0x7f04f4074e70 2023-10-05T15:38:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.763+0000 7f04f259c700 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df92480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04e40115a0 tx=0x7f04e40118b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6018618540f4ea42 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.764+0000 7f04e0ff9700 1 -- 172.21.15.17:0/1185980508 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4004230 con 0x55e69df91bc0 2023-10-05T15:38:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.764+0000 7f04e0ff9700 1 -- 172.21.15.17:0/1185980508 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e4004390 con 0x55e69df91bc0 2023-10-05T15:38:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.764+0000 7f04e0ff9700 1 -- 172.21.15.17:0/1185980508 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4019820 con 0x55e69df91bc0 2023-10-05T15:38:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 -- 172.21.15.17:0/1185980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 msgr2=0x55e69df92480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f04dc0a1500 0x7f04dc0a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009540 tx=0x7f04ec004ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df92480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f04e40115a0 tx=0x7f04e40118b0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 -- 172.21.15.17:0/1185980508 shutdown_connections 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df92ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df91680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 --2- 172.21.15.17:0/1185980508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df92480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 -- 172.21.15.17:0/1185980508 >> 172.21.15.17:0/1185980508 conn(0x55e69df05260 msgr2=0x55e69df8c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 -- 172.21.15.17:0/1185980508 shutdown_connections 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 -- 172.21.15.17:0/1185980508 wait complete. 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.765+0000 7f050c933b80 1 -- start start 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 Processor -- start 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df9af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df9b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69dfa2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dee3e30 con 0x55e69df91260 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69de80710 con 0x55e69df91bc0 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69de803b0 con 0x55e69df92a60 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f050c933b80 10 client.0 _ll_register_callbacks cb 0x55e69dcdd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f04f259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df9af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f04f259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df9af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34644/0 (socket says 172.21.15.17:34644) 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f04f259c700 1 -- 172.21.15.17:0/3286271364 learned_addr learned my addr 172.21.15.17:0/3286271364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.766+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df9b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69dfa2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f259c700 1 -- 172.21.15.17:0/3286271364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 msgr2=0x55e69dfa2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f259c700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69dfa2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f259c700 1 -- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 msgr2=0x55e69df9b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f259c700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df9b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f259c700 1 -- 172.21.15.17:0/3286271364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e4009d90 con 0x55e69df91260 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df9b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69dfa2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04f259c700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df9af90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f04e401b040 tx=0x7f04e4003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46510f93ce6849dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.767+0000 7f04d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f04d9ffb700 1 -- 172.21.15.17:0/3286271364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4005040 con 0x55e69df91260 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e69df83f10 con 0x55e69df91260 2023-10-05T15:38:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f04d9ffb700 1 -- 172.21.15.17:0/3286271364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f04e40051a0 con 0x55e69df91260 2023-10-05T15:38:31.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f04d9ffb700 1 -- 172.21.15.17:0/3286271364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04e40053a0 con 0x55e69df91260 2023-10-05T15:38:31.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f050c933b80 10 client.16146 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55e69dcf7c60 con 0x55e69df91260 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.768+0000 7f04d9ffb700 1 -- 172.21.15.17:0/3286271364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e69df83f10 con 0x55e69df91260 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f04d9ffb700 1 -- 172.21.15.17:0/3286271364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f04e4021040 con 0x55e69df91260 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f050c933b80 10 client.16146 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f050c933b80 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f050c933b80 20 client.16146 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f050c933b80 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dfa6de0 0x55e69dfa9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f050c933b80 4 client.16146 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e69dedce10 con 0x55e69dfa6de0 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.769+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dfa6de0 0x55e69dfa9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dfa6de0 0x55e69dfa9200 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c791b95d42172df server_cookie=1725fe5922236a1f in_seq=0 out_seq=0 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f04d9ffb700 10 client.16146 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f04d9ffb700 1 -- 172.21.15.17:0/3286271364 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e69dedce10 con 0x55e69dfa6de0 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f04d9ffb700 10 client.16146 handle_command_reply: tid=0 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f050c933b80 1 client.16146 shutdown 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 msgr2=0x55e69df9af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.770+0000 7f050c933b80 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df9af90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f04e401b040 tx=0x7f04e4003eb0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 shutdown_connections 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dfa6de0 0x55e69dfa9200 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69dfa2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91260 0x55e69df9af90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 --2- 172.21.15.17:0/3286271364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91bc0 0x55e69df9b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 >> 172.21.15.17:0/3286271364 conn(0x55e69df05260 msgr2=0x55e69df8bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f04d9ffb700 0 client.16146 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 shutdown_connections 2023-10-05T15:38:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 1 -- 172.21.15.17:0/3286271364 wait complete. 2023-10-05T15:38:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.771+0000 7f050c933b80 20 client.16146 trim_cache size 0 max 16384 2023-10-05T15:38:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.796+0000 7f050c933b80 1 Processor -- start 2023-10-05T15:38:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.796+0000 7f050c933b80 1 -- start start 2023-10-05T15:38:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f050c933b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df98e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f050c933b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91bc0 0x55e69dfa24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f050c933b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df95970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f050c933b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dd64920 con 0x55e69df91bc0 2023-10-05T15:38:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f050c933b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dfa4180 con 0x55e69df91260 2023-10-05T15:38:31.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f050c933b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69df88a20 con 0x55e69df92a60 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f04f1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91bc0 0x55e69dfa24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f04f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df98e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f04f1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91bc0 0x55e69dfa24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34654/0 (socket says 172.21.15.17:34654) 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f04f1d9b700 1 -- 172.21.15.17:0/1270868651 learned_addr learned my addr 172.21.15.17:0/1270868651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.797+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df95970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04f259c700 1 -- 172.21.15.17:0/1270868651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 msgr2=0x55e69df95970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04f259c700 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df95970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04f259c700 1 -- 172.21.15.17:0/1270868651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91bc0 msgr2=0x55e69dfa24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04f259c700 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91bc0 0x55e69dfa24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04f259c700 1 -- 172.21.15.17:0/1270868651 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e69dd35250 con 0x55e69df91260 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04f259c700 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df98e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04e4004360 tx=0x7f04e40094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77180cb9bba26ae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04e17fa700 1 -- 172.21.15.17:0/1270868651 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4003c40 con 0x55e69df91260 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04e17fa700 1 -- 172.21.15.17:0/1270868651 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e4019490 con 0x55e69df91260 2023-10-05T15:38:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.798+0000 7f04e17fa700 1 -- 172.21.15.17:0/1270868651 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40052a0 con 0x55e69df91260 2023-10-05T15:38:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 -- 172.21.15.17:0/1270868651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 msgr2=0x55e69df98e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df98e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04e4004360 tx=0x7f04e40094b0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 -- 172.21.15.17:0/1270868651 shutdown_connections 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df92a60 0x55e69df95970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df98e10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 --2- 172.21.15.17:0/1270868651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df91bc0 0x55e69dfa24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 -- 172.21.15.17:0/1270868651 >> 172.21.15.17:0/1270868651 conn(0x55e69df05260 msgr2=0x55e69df99cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 -- 172.21.15.17:0/1270868651 shutdown_connections 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.799+0000 7f050c933b80 1 -- 172.21.15.17:0/1270868651 wait complete. 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 -- start start 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 Processor -- start 2023-10-05T15:38:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df9dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df91bc0 0x55e69df9e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df92a60 0x55e69dfa1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dfa1750 con 0x55e69df92a60 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dfa18c0 con 0x55e69df91260 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e69dfa1a80 con 0x55e69df91bc0 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.800+0000 7f050c933b80 10 client.0 _ll_register_callbacks cb 0x7f04ec009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df9dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df9dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57174/0 (socket says 172.21.15.17:57174) 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 -- 172.21.15.17:0/1992752580 learned_addr learned my addr 172.21.15.17:0/1992752580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df91bc0 0x55e69df9e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f2d9d700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df92a60 0x55e69dfa1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 -- 172.21.15.17:0/1992752580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df91bc0 msgr2=0x55e69df9e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df91bc0 0x55e69df9e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 -- 172.21.15.17:0/1992752580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df92a60 msgr2=0x55e69dfa1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df92a60 0x55e69dfa1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 -- 172.21.15.17:0/1992752580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e69dcf7c60 con 0x55e69df91260 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04f259c700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df9dcb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f04e401b010 tx=0x7f04e4003e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d764fc20f03931f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.801+0000 7f04d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f04d9ffb700 1 -- 172.21.15.17:0/1992752580 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4019770 con 0x55e69df91260 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f04d9ffb700 1 -- 172.21.15.17:0/1992752580 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f04e4000e40 con 0x55e69df91260 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04e4004390 con 0x55e69df91260 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f04d9ffb700 1 -- 172.21.15.17:0/1992752580 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04e4019a10 con 0x55e69df91260 2023-10-05T15:38:31.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f050c933b80 10 client.25946 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55e69dd0d2b0 con 0x55e69df91260 2023-10-05T15:38:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.802+0000 7f04d9ffb700 1 -- 172.21.15.17:0/1992752580 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e4004390 con 0x55e69df91260 2023-10-05T15:38:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f04d9ffb700 1 -- 172.21.15.17:0/1992752580 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f04e4011920 con 0x55e69df91260 2023-10-05T15:38:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f050c933b80 10 client.25946 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f050c933b80 10 client.25946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:31.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f050c933b80 20 client.25946 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f050c933b80 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dffb080 0x55e69dffd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f050c933b80 4 client.25946 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e69dedcb30 con 0x55e69dffb080 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.803+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dffb080 0x55e69dffd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f04f1d9b700 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dffb080 0x55e69dffd470 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb57af3e061cb33 server_cookie=9990f2300fd6faf0 in_seq=0 out_seq=0 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f04d9ffb700 10 client.25946 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f04d9ffb700 1 -- 172.21.15.17:0/1992752580 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e69dedcb30 con 0x55e69dffb080 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f04d9ffb700 10 client.25946 handle_command_reply: tid=0 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 client.25946 shutdown 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 msgr2=0x55e69df9dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df9dcb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f04e401b010 tx=0x7f04e4003e20 comp rx=0 tx=0).stop 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 shutdown_connections 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e69dffb080 0x55e69dffd470 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e69df92a60 0x55e69dfa1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e69df91260 0x55e69df9dcb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 --2- 172.21.15.17:0/1992752580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e69df91bc0 0x55e69df9e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f04d9ffb700 0 client.25946 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 >> 172.21.15.17:0/1992752580 conn(0x55e69df05260 msgr2=0x55e69df98e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 shutdown_connections 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.804+0000 7f050c933b80 1 -- 172.21.15.17:0/1992752580 wait complete. 2023-10-05T15:38:31.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f050c933b80 20 client.25946 trim_cache size 0 max 16384 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:38:31.811 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f04dc0a1500 msgr2=0x7f04dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f04dc0a1500 0x7f04dc0a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009540 tx=0x7f04ec004ad0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 msgr2=0x7f04f4199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f4199290 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009fd0 tx=0x7f04e800b840 comp rx=0 tx=0).stop 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 shutdown_connections 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f04dc0a1500 0x7f04dc0a39c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4108e00 0x7f04f41a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04f4073890 0x7f04f4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 --2- 172.21.15.17:0/2117703037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04f4074e70 0x7f04f4199290 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:31.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 >> 172.21.15.17:0/2117703037 conn(0x7f04f40fc460 msgr2=0x7f04f40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:31.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 shutdown_connections 2023-10-05T15:38:31.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:38:31.805+0000 7f04f8fff700 1 -- 172.21.15.17:0/2117703037 wait complete. 2023-10-05T15:38:31.829 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:38:31.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:31 smithi017 ceph-mon[129107]: pgmap v427: 129 pgs: 129 active+clean; 788 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 31 MiB/s wr, 44 op/s 2023-10-05T15:38:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:31 smithi167 ceph-mon[133366]: pgmap v427: 129 pgs: 129 active+clean; 788 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 31 MiB/s wr, 44 op/s 2023-10-05T15:38:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:31 smithi079 ceph-mon[132936]: pgmap v427: 129 pgs: 129 active+clean; 788 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 31 MiB/s wr, 44 op/s 2023-10-05T15:38:33.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:33 smithi017 ceph-mon[129107]: pgmap v428: 129 pgs: 129 active+clean; 792 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 41 op/s 2023-10-05T15:38:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:33 smithi167 ceph-mon[133366]: pgmap v428: 129 pgs: 129 active+clean; 792 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 41 op/s 2023-10-05T15:38:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:33 smithi079 ceph-mon[132936]: pgmap v428: 129 pgs: 129 active+clean; 792 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 41 op/s 2023-10-05T15:38:35.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:35 smithi017 ceph-mon[129107]: pgmap v429: 129 pgs: 129 active+clean; 844 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 29 MiB/s wr, 47 op/s 2023-10-05T15:38:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:35 smithi167 ceph-mon[133366]: pgmap v429: 129 pgs: 129 active+clean; 844 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 29 MiB/s wr, 47 op/s 2023-10-05T15:38:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:35 smithi079 ceph-mon[132936]: pgmap v429: 129 pgs: 129 active+clean; 844 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 29 MiB/s wr, 47 op/s 2023-10-05T15:38:37.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:37 smithi017 ceph-mon[129107]: pgmap v430: 129 pgs: 129 active+clean; 874 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-10-05T15:38:37.963 INFO:teuthology.orchestra.run.smithi017.stderr:done. 2023-10-05T15:38:37.970 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-10-05T15:38:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:37 smithi167 ceph-mon[133366]: pgmap v430: 129 pgs: 129 active+clean; 874 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-10-05T15:38:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:37 smithi079 ceph-mon[132936]: pgmap v430: 129 pgs: 129 active+clean; 874 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-10-05T15:38:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:starting vacuum...end. 2023-10-05T15:38:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 -- 172.21.15.17:0/404249522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 msgr2=0x7f28c4076f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 --2- 172.21.15.17:0/404249522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 0x7f28c4076f30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f28b40098f0 tx=0x7f28b4009c00 comp rx=0 tx=0).stop 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 -- 172.21.15.17:0/404249522 shutdown_connections 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 --2- 172.21.15.17:0/404249522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4077470 0x7f28c4077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 --2- 172.21.15.17:0/404249522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4075870 0x7f28c4075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 --2- 172.21.15.17:0/404249522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 0x7f28c4076f30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 -- 172.21.15.17:0/404249522 >> 172.21.15.17:0/404249522 conn(0x7f28c40fe6a0 msgr2=0x7f28c4100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.129+0000 7f28c8dff700 1 -- 172.21.15.17:0/404249522 shutdown_connections 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.130+0000 7f28c8dff700 1 -- 172.21.15.17:0/404249522 wait complete. 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.131+0000 7f28c8dff700 1 Processor -- start 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.132+0000 7f28c8dff700 1 -- start start 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.133+0000 7f28c8dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4075870 0x7f28c410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.133+0000 7f28c8dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 0x7f28c410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.133+0000 7f28c8dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 0x7f28c410eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.133+0000 7f28c8dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c410f510 con 0x7f28c4076ab0 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.133+0000 7f28c8dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c410f680 con 0x7f28c4077470 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.133+0000 7f28c8dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c410f840 con 0x7f28c4075870 2023-10-05T15:38:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 0x7f28c410eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 0x7f28c410eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:42456/0 (socket says 172.21.15.17:42456) 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 -- 172.21.15.17:0/4260432195 learned_addr learned my addr 172.21.15.17:0/4260432195 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c259c700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4075870 0x7f28c410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 0x7f28c410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 -- 172.21.15.17:0/4260432195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4075870 msgr2=0x7f28c410da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4075870 0x7f28c410da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 -- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 msgr2=0x7f28c410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 0x7f28c410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.134+0000 7f28c2d9d700 1 -- 172.21.15.17:0/4260432195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0095f0 con 0x7f28c4077470 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.135+0000 7f28c2d9d700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 0x7f28c410eeb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28ac007ee0 tx=0x7f28ac00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.135+0000 7f28c259c700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4075870 0x7f28c410da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.135+0000 7f28bb7fe700 1 -- 172.21.15.17:0/4260432195 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac017070 con 0x7f28c4077470 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.135+0000 7f28bb7fe700 1 -- 172.21.15.17:0/4260432195 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28ac00f040 con 0x7f28c4077470 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.135+0000 7f28bb7fe700 1 -- 172.21.15.17:0/4260432195 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac005710 con 0x7f28c4077470 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.135+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b4009520 con 0x7f28c4077470 2023-10-05T15:38:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.136+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c41100f0 con 0x7f28c4077470 2023-10-05T15:38:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.142+0000 7f28bb7fe700 1 -- 172.21.15.17:0/4260432195 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f28ac005870 con 0x7f28c4077470 2023-10-05T15:38:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.143+0000 7f28dc80ab80 1 Processor -- start 2023-10-05T15:38:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.143+0000 7f28dc80ab80 1 -- start start 2023-10-05T15:38:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e64942e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6495450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 0x55a8e649c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e63fc400 con 0x55a8e6494fd0 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e63edbc0 con 0x55a8e6495990 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e63eb4e0 con 0x55a8e6493ec0 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 0x55a8e649c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 0x55a8e649c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:42460/0 (socket says 172.21.15.17:42460) 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1167183019 learned_addr learned my addr 172.21.15.17:0/1167183019 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28c259c700 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6495450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.144+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e64942e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.145+0000 7f28c259c700 1 -- 172.21.15.17:0/1167183019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 msgr2=0x55a8e64942e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.145+0000 7f28bb7fe700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28b00a1500 0x7f28b00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28bb7fe700 1 -- 172.21.15.17:0/4260432195 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28ac0cc850 con 0x7f28c4077470 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c259c700 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e64942e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c259c700 1 -- 172.21.15.17:0/1167183019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 msgr2=0x55a8e649c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c259c700 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 0x55a8e649c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c259c700 1 -- 172.21.15.17:0/1167183019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e6211d80 con 0x55a8e6494fd0 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 0x55a8e649c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c2d9d700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28b00a1500 0x7f28b00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.146+0000 7f28c259c700 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6495450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f28bc005fd0 tx=0x7f28bc0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a9063b2b0eb632 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.147+0000 7f28c2d9d700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28b00a1500 0x7f28b00a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f28ac099470 tx=0x7f28ac095ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.147+0000 7f28b8ff9700 1 -- 172.21.15.17:0/1167183019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc004830 con 0x55a8e6494fd0 2023-10-05T15:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.147+0000 7f28b8ff9700 1 -- 172.21.15.17:0/1167183019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28bc004e20 con 0x55a8e6494fd0 2023-10-05T15:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.148+0000 7f28b8ff9700 1 -- 172.21.15.17:0/1167183019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0126b0 con 0x55a8e6494fd0 2023-10-05T15:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1167183019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 msgr2=0x55a8e6495450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6495450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f28bc005fd0 tx=0x7f28bc0116c0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1167183019 shutdown_connections 2023-10-05T15:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6495990 0x55a8e649c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e64942e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1167183019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6495450 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1167183019 >> 172.21.15.17:0/1167183019 conn(0x55a8e6408200 msgr2=0x55a8e648ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1167183019 shutdown_connections 2023-10-05T15:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.149+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1167183019 wait complete. 2023-10-05T15:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.150+0000 7f28dc80ab80 1 -- start start 2023-10-05T15:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.150+0000 7f28dc80ab80 1 Processor -- start 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e649dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e649e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6495990 0x55a8e64a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e63e6dd0 con 0x55a8e6495990 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e63836b0 con 0x55a8e6494fd0 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e6383350 con 0x55a8e6493ec0 2023-10-05T15:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.151+0000 7f28dc80ab80 10 client.0 _ll_register_callbacks cb 0x55a8e61e07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.152+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e649dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.152+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e649dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:46280/0 (socket says 172.21.15.17:46280) 2023-10-05T15:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.152+0000 7f28c1d9b700 1 -- 172.21.15.17:0/3976297817 learned_addr learned my addr 172.21.15.17:0/3976297817 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.152+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6495990 0x55a8e64a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.152+0000 7f28c259c700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e649e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28c1d9b700 1 -- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 msgr2=0x55a8e649e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e649e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28c1d9b700 1 -- 172.21.15.17:0/3976297817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6495990 msgr2=0x55a8e64a51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6495990 0x55a8e64a51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28c1d9b700 1 -- 172.21.15.17:0/3976297817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc009b90 con 0x55a8e6493ec0 2023-10-05T15:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e649dc60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28b400f9d0 tx=0x7f28b4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80ca3b9db6f923ad server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.153+0000 7f28a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.154+0000 7f28a9ffb700 1 -- 172.21.15.17:0/3976297817 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400b560 con 0x55a8e6493ec0 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.154+0000 7f28a9ffb700 1 -- 172.21.15.17:0/3976297817 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28b400b6c0 con 0x55a8e6493ec0 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.154+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8e6486d50 con 0x55a8e6493ec0 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.154+0000 7f28a9ffb700 1 -- 172.21.15.17:0/3976297817 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28b400b880 con 0x55a8e6493ec0 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.154+0000 7f28dc80ab80 10 client.25954 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.154+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a8e61fac00 con 0x55a8e6493ec0 2023-10-05T15:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.155+0000 7f28a9ffb700 1 -- 172.21.15.17:0/3976297817 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a8e6486d50 con 0x55a8e6493ec0 2023-10-05T15:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.155+0000 7f28a9ffb700 1 -- 172.21.15.17:0/3976297817 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f28b4015020 con 0x55a8e6493ec0 2023-10-05T15:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.155+0000 7f28dc80ab80 10 client.25954 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.156+0000 7f28dc80ab80 10 client.25954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.156+0000 7f28dc80ab80 20 client.25954 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.156+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e64a9b60 0x55a8e64abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.156+0000 7f28dc80ab80 4 client.25954 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.156+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8e63dfdb0 con 0x55a8e64a9b60 2023-10-05T15:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.156+0000 7f28c259c700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e64a9b60 0x55a8e64abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.157+0000 7f28a9ffb700 10 client.25954 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.157+0000 7f28c259c700 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e64a9b60 0x55a8e64abf80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e6b311b651e07c6 server_cookie=f57179e1042f2bf0 in_seq=0 out_seq=0 2023-10-05T15:38:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.158+0000 7f28a9ffb700 1 -- 172.21.15.17:0/3976297817 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a8e63dfdb0 con 0x55a8e64a9b60 2023-10-05T15:38:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.158+0000 7f28a9ffb700 10 client.25954 handle_command_reply: tid=0 2023-10-05T15:38:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.158+0000 7f28dc80ab80 1 client.25954 shutdown 2023-10-05T15:38:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.158+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 msgr2=0x55a8e649dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.158+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e649dc60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28b400f9d0 tx=0x7f28b4009260 comp rx=0 tx=0).stop 2023-10-05T15:38:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 shutdown_connections 2023-10-05T15:38:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e64a9b60 0x55a8e64abf80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6495990 0x55a8e64a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6493ec0 0x55a8e649dc60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/3976297817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e649e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 >> 172.21.15.17:0/3976297817 conn(0x55a8e6408200 msgr2=0x55a8e648e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28a9ffb700 0 client.25954 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 shutdown_connections 2023-10-05T15:38:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.159+0000 7f28dc80ab80 1 -- 172.21.15.17:0/3976297817 wait complete. 2023-10-05T15:38:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.160+0000 7f28dc80ab80 20 client.25954 trim_cache size 0 max 16384 2023-10-05T15:38:39.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.184+0000 7f28dc80ab80 1 Processor -- start 2023-10-05T15:38:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 -- start start 2023-10-05T15:38:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 0x55a8e6498990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6498ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e62678c0 con 0x55a8e6494fd0 2023-10-05T15:38:39.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e64a9970 con 0x55a8e6493ec0 2023-10-05T15:38:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e6494740 con 0x55a8e6495990 2023-10-05T15:38:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 0x55a8e6498990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 0x55a8e6498990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:42468/0 (socket says 172.21.15.17:42468) 2023-10-05T15:38:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1243860679 learned_addr learned my addr 172.21.15.17:0/1243860679 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28c259c700 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6498ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.185+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.186+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1243860679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 msgr2=0x55a8e64a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.186+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.186+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1243860679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 msgr2=0x55a8e6498ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.186+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6498ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.186+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1243860679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e62381f0 con 0x55a8e6493ec0 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.186+0000 7f28c259c700 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6498ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.187+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 0x55a8e6498990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28b4005a60 tx=0x7f28b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2fb9a7dbd015ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:39.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.187+0000 7f28b97fa700 1 -- 172.21.15.17:0/1243860679 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4005b80 con 0x55a8e6493ec0 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.187+0000 7f28b97fa700 1 -- 172.21.15.17:0/1243860679 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28b401d070 con 0x55a8e6493ec0 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.187+0000 7f28b97fa700 1 -- 172.21.15.17:0/1243860679 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400b920 con 0x55a8e6493ec0 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.188+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1243860679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 msgr2=0x55a8e6498990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.188+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 0x55a8e6498990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28b4005a60 tx=0x7f28b4009c00 comp rx=0 tx=0).stop 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1243860679 shutdown_connections 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6493ec0 0x55a8e6498990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1243860679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6494fd0 0x55a8e6498ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1243860679 >> 172.21.15.17:0/1243860679 conn(0x55a8e6408200 msgr2=0x55a8e649be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1243860679 shutdown_connections 2023-10-05T15:38:39.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.189+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1243860679 wait complete. 2023-10-05T15:38:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.190+0000 7f28dc80ab80 1 -- start start 2023-10-05T15:38:39.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.190+0000 7f28dc80ab80 1 Processor -- start 2023-10-05T15:38:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6493ec0 0x55a8e64a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e64a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e64a48f0 con 0x55a8e6493ec0 2023-10-05T15:38:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e64a4a60 con 0x55a8e6494fd0 2023-10-05T15:38:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e64a4c20 con 0x55a8e6495990 2023-10-05T15:38:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.191+0000 7f28dc80ab80 10 client.0 _ll_register_callbacks cb 0x7f28bc0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:39.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.192+0000 7f28c259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e64a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.192+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6493ec0 0x55a8e64a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.192+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6493ec0 0x55a8e64a0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38120/0 (socket says 172.21.15.17:38120) 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.192+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1166198069 learned_addr learned my addr 172.21.15.17:0/1166198069 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.192+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.193+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 msgr2=0x55a8e64a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.193+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e64a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.193+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1166198069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6493ec0 msgr2=0x55a8e64a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.193+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6493ec0 0x55a8e64a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.193+0000 7f28c1d9b700 1 -- 172.21.15.17:0/1166198069 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc01e040 con 0x55a8e6495990 2023-10-05T15:38:39.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.193+0000 7f28c259c700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e64a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.194+0000 7f28c1d9b700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a43b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28b400fea0 tx=0x7f28b4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da0ba6477d781751 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.194+0000 7f28a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:38:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.194+0000 7f28a9ffb700 1 -- 172.21.15.17:0/1166198069 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4017600 con 0x55a8e6495990 2023-10-05T15:38:39.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.194+0000 7f28a9ffb700 1 -- 172.21.15.17:0/1166198069 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28b4000e40 con 0x55a8e6495990 2023-10-05T15:38:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.194+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f28bc004e20 con 0x55a8e6495990 2023-10-05T15:38:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.195+0000 7f28a9ffb700 1 -- 172.21.15.17:0/1166198069 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28b4017760 con 0x55a8e6495990 2023-10-05T15:38:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.195+0000 7f28dc80ab80 10 client.25960 fetch_fsmap learned FSMap version 32 2023-10-05T15:38:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.195+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55a8e61fac00 con 0x55a8e6495990 2023-10-05T15:38:39.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.195+0000 7f28a9ffb700 1 -- 172.21.15.17:0/1166198069 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28bc004e20 con 0x55a8e6495990 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.195+0000 7f28a9ffb700 1 -- 172.21.15.17:0/1166198069 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f28b4015040 con 0x55a8e6495990 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28dc80ab80 10 client.25960 fetch_fsmap finished waiting for FSMap version 32 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28dc80ab80 10 client.25960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28dc80ab80 20 client.25960 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e650f560 0x55a8e6511980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28dc80ab80 4 client.25960 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a8e63dfad0 con 0x55a8e650f560 2023-10-05T15:38:39.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.196+0000 7f28c259c700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e650f560 0x55a8e6511980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.197+0000 7f28c259c700 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e650f560 0x55a8e6511980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f86317b481eef60 server_cookie=d3a5ca9c049dceae in_seq=0 out_seq=0 2023-10-05T15:38:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.197+0000 7f28a9ffb700 10 client.25960 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.222+0000 7f28a9ffb700 1 -- 172.21.15.17:0/1166198069 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a8e63dfad0 con 0x55a8e650f560 2023-10-05T15:38:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.222+0000 7f28a9ffb700 10 client.25960 handle_command_reply: tid=0 2023-10-05T15:38:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.222+0000 7f28dc80ab80 1 client.25960 shutdown 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 msgr2=0x55a8e64a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a43b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28b400fea0 tx=0x7f28b4000bc0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 shutdown_connections 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a8e650f560 0x55a8e6511980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e6495990 0x55a8e64a43b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a8e6493ec0 0x55a8e64a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 --2- 172.21.15.17:0/1166198069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e6494fd0 0x55a8e64a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 >> 172.21.15.17:0/1166198069 conn(0x55a8e6408200 msgr2=0x55a8e649c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28a9ffb700 0 client.25960 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 shutdown_connections 2023-10-05T15:38:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.223+0000 7f28dc80ab80 1 -- 172.21.15.17:0/1166198069 wait complete. 2023-10-05T15:38:39.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.225+0000 7f28dc80ab80 20 client.25960 trim_cache size 0 max 16384 2023-10-05T15:38:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:38:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:38:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:38:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:38:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.225+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28b00a1500 msgr2=0x7f28b00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.225+0000 7f28c8dff700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28b00a1500 0x7f28b00a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f28ac099470 tx=0x7f28ac095ab0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.225+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 msgr2=0x7f28c410eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.225+0000 7f28c8dff700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 0x7f28c410eeb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28ac007ee0 tx=0x7f28ac00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 shutdown_connections 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28b00a1500 0x7f28b00a39c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c4077470 0x7f28c410eeb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28c4075870 0x7f28c410da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 --2- 172.21.15.17:0/4260432195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28c4076ab0 0x7f28c410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 >> 172.21.15.17:0/4260432195 conn(0x7f28c40fe6a0 msgr2=0x7f28c4100370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 shutdown_connections 2023-10-05T15:38:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:39.226+0000 7f28c8dff700 1 -- 172.21.15.17:0/4260432195 wait complete. 2023-10-05T15:38:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:39 smithi167 ceph-mon[133366]: pgmap v431: 129 pgs: 129 active+clean; 906 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-10-05T15:38:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:39 smithi079 ceph-mon[132936]: pgmap v431: 129 pgs: 129 active+clean; 906 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-10-05T15:38:40.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:39 smithi017 ceph-mon[129107]: pgmap v431: 129 pgs: 129 active+clean; 906 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-10-05T15:38:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:41 smithi167 ceph-mon[133366]: pgmap v432: 129 pgs: 129 active+clean; 954 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-10-05T15:38:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:41 smithi079 ceph-mon[132936]: pgmap v432: 129 pgs: 129 active+clean; 954 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-10-05T15:38:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:41 smithi017 ceph-mon[129107]: pgmap v432: 129 pgs: 129 active+clean; 954 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 27 MiB/s wr, 47 op/s 2023-10-05T15:38:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 5.0 s, 480.8 tps, lat 185.321 ms stddev 323.735 2023-10-05T15:38:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:43 smithi167 ceph-mon[133366]: pgmap v433: 129 pgs: 129 active+clean; 958 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 21 MiB/s wr, 43 op/s 2023-10-05T15:38:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:43 smithi079 ceph-mon[132936]: pgmap v433: 129 pgs: 129 active+clean; 958 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 21 MiB/s wr, 43 op/s 2023-10-05T15:38:44.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:43 smithi017 ceph-mon[129107]: pgmap v433: 129 pgs: 129 active+clean; 958 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 21 MiB/s wr, 43 op/s 2023-10-05T15:38:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:45 smithi167 ceph-mon[133366]: pgmap v434: 129 pgs: 129 active+clean; 946 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 101 op/s 2023-10-05T15:38:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:45 smithi079 ceph-mon[132936]: pgmap v434: 129 pgs: 129 active+clean; 946 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 101 op/s 2023-10-05T15:38:46.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:45 smithi017 ceph-mon[129107]: pgmap v434: 129 pgs: 129 active+clean; 946 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 25 MiB/s wr, 101 op/s 2023-10-05T15:38:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:47 smithi167 ceph-mon[133366]: pgmap v435: 129 pgs: 129 active+clean; 944 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 109 op/s 2023-10-05T15:38:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:47 smithi079 ceph-mon[132936]: pgmap v435: 129 pgs: 129 active+clean; 944 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 109 op/s 2023-10-05T15:38:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 10.0 s, 690.8 tps, lat 140.289 ms stddev 192.380 2023-10-05T15:38:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:47 smithi017 ceph-mon[129107]: pgmap v435: 129 pgs: 129 active+clean; 944 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 109 op/s 2023-10-05T15:38:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:49 smithi167 ceph-mon[133366]: pgmap v436: 129 pgs: 129 active+clean; 970 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 164 op/s 2023-10-05T15:38:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:49 smithi079 ceph-mon[132936]: pgmap v436: 129 pgs: 129 active+clean; 970 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 164 op/s 2023-10-05T15:38:50.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:49 smithi017 ceph-mon[129107]: pgmap v436: 129 pgs: 129 active+clean; 970 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 164 op/s 2023-10-05T15:38:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:51 smithi167 ceph-mon[133366]: pgmap v437: 129 pgs: 129 active+clean; 975 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 215 op/s 2023-10-05T15:38:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:51 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:38:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:51 smithi079 ceph-mon[132936]: pgmap v437: 129 pgs: 129 active+clean; 975 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 215 op/s 2023-10-05T15:38:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:51 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:38:52.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:51 smithi017 ceph-mon[129107]: pgmap v437: 129 pgs: 129 active+clean; 975 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 20 MiB/s wr, 215 op/s 2023-10-05T15:38:52.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:51 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 -- 172.21.15.17:0/3085826152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 msgr2=0x7fb120104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 --2- 172.21.15.17:0/3085826152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 0x7fb120104560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb114009990 tx=0x7fb114009ca0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 -- 172.21.15.17:0/3085826152 shutdown_connections 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 --2- 172.21.15.17:0/3085826152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb120104aa0 0x7fb120104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 --2- 172.21.15.17:0/3085826152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1200ff760 0x7fb120101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 --2- 172.21.15.17:0/3085826152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 0x7fb120104560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 -- 172.21.15.17:0/3085826152 >> 172.21.15.17:0/3085826152 conn(0x7fb1200fb340 msgr2=0x7fb1200fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 -- 172.21.15.17:0/3085826152 shutdown_connections 2023-10-05T15:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.462+0000 7fb124dff700 1 -- 172.21.15.17:0/3085826152 wait complete. 2023-10-05T15:38:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.463+0000 7fb124dff700 1 Processor -- start 2023-10-05T15:38:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.463+0000 7fb124dff700 1 -- start start 2023-10-05T15:38:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb124dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 0x7fb12006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb124dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 0x7fb12006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb124dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb120104aa0 0x7fb120070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb124dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120071310 con 0x7fb120104aa0 2023-10-05T15:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb124dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120071480 con 0x7fb1201020d0 2023-10-05T15:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb124dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120071640 con 0x7fb1200ff760 2023-10-05T15:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb11e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 0x7fb12006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb11e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 0x7fb12006f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:56660/0 (socket says 172.21.15.17:56660) 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb11e59c700 1 -- 172.21.15.17:0/3715435386 learned_addr learned my addr 172.21.15.17:0/3715435386 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.464+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 0x7fb12006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb11e59c700 1 -- 172.21.15.17:0/3715435386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 msgr2=0x7fb12006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb11e59c700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 0x7fb12006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb11e59c700 1 -- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb120104aa0 msgr2=0x7fb120070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb11e59c700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb120104aa0 0x7fb120070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb11e59c700 1 -- 172.21.15.17:0/3715435386 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140095f0 con 0x7fb1200ff760 2023-10-05T15:38:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb11e59c700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 0x7fb12006f8a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb11000e9a0 tx=0x7fb11000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.465+0000 7fb10f7fe700 1 -- 172.21.15.17:0/3715435386 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11000cbd0 con 0x7fb1200ff760 2023-10-05T15:38:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.466+0000 7fb10f7fe700 1 -- 172.21.15.17:0/3715435386 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb11000cd30 con 0x7fb1200ff760 2023-10-05T15:38:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.466+0000 7fb10f7fe700 1 -- 172.21.15.17:0/3715435386 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110018680 con 0x7fb1200ff760 2023-10-05T15:38:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.466+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb120071920 con 0x7fb1200ff760 2023-10-05T15:38:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.466+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1200720d0 con 0x7fb1200ff760 2023-10-05T15:38:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.470+0000 7fb10f7fe700 1 -- 172.21.15.17:0/3715435386 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb110010430 con 0x7fb1200ff760 2023-10-05T15:38:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.473+0000 7fb10f7fe700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1080a15d0 0x7fb1080a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.473+0000 7fb10f7fe700 1 -- 172.21.15.17:0/3715435386 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb110014070 con 0x7fb1200ff760 2023-10-05T15:38:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.473+0000 7fb138750b80 1 Processor -- start 2023-10-05T15:38:52.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 -- start start 2023-10-05T15:38:52.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1080a15d0 0x7fb1080a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e6c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e6d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e74220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954dd4400 con 0x558954e6bec0 2023-10-05T15:38:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954dc5bc0 con 0x558954e6cfd0 2023-10-05T15:38:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb138750b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954dc34e0 con 0x558954e6d990 2023-10-05T15:38:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.474+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e6d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e6c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e6d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37640/0 (socket says 172.21.15.17:37640) 2023-10-05T15:38:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 -- 172.21.15.17:0/2834615884 learned_addr learned my addr 172.21.15.17:0/2834615884 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e74220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 -- 172.21.15.17:0/2834615884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 msgr2=0x558954e74220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e74220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 -- 172.21.15.17:0/2834615884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 msgr2=0x558954e6c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e6c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.475+0000 7fb11dd9b700 1 -- 172.21.15.17:0/2834615884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558954be9d80 con 0x558954e6cfd0 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.476+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e74220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:38:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.476+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e6d450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb114009990 tx=0x7fb114005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d71d1a6992f10c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.476+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1080a15d0 0x7fb1080a3a90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb114005cd0 tx=0x7fb11401c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.476+0000 7fb10cff9700 1 -- 172.21.15.17:0/2834615884 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140040d0 con 0x558954e6cfd0 2023-10-05T15:38:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.476+0000 7fb10cff9700 1 -- 172.21.15.17:0/2834615884 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb114003d00 con 0x558954e6cfd0 2023-10-05T15:38:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.476+0000 7fb10cff9700 1 -- 172.21.15.17:0/2834615884 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114004870 con 0x558954e6cfd0 2023-10-05T15:38:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 -- 172.21.15.17:0/2834615884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 msgr2=0x558954e6d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e6d450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb114009990 tx=0x7fb114005280 comp rx=0 tx=0).stop 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 -- 172.21.15.17:0/2834615884 shutdown_connections 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e74220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e6c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 --2- 172.21.15.17:0/2834615884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e6d450 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.477+0000 7fb138750b80 1 -- 172.21.15.17:0/2834615884 >> 172.21.15.17:0/2834615884 conn(0x558954de0200 msgr2=0x558954e66bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.478+0000 7fb138750b80 1 -- 172.21.15.17:0/2834615884 shutdown_connections 2023-10-05T15:38:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.478+0000 7fb138750b80 1 -- 172.21.15.17:0/2834615884 wait complete. 2023-10-05T15:38:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.478+0000 7fb138750b80 1 -- start start 2023-10-05T15:38:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.479+0000 7fb138750b80 1 Processor -- start 2023-10-05T15:38:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.480+0000 7fb138750b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e75b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.480+0000 7fb138750b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e76050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb138750b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e7d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb138750b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954dbedd0 con 0x558954e6bec0 2023-10-05T15:38:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb138750b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954d5b6b0 con 0x558954e6cfd0 2023-10-05T15:38:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb138750b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954d5b350 con 0x558954e6d990 2023-10-05T15:38:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb138750b80 10 client.0 _ll_register_callbacks cb 0x558954bb87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e76050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e76050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37652/0 (socket says 172.21.15.17:37652) 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb11dd9b700 1 -- 172.21.15.17:0/133493953 learned_addr learned my addr 172.21.15.17:0/133493953 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.481+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11e59c700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e75b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11ed9d700 1 -- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 msgr2=0x558954e76050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e76050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11ed9d700 1 -- 172.21.15.17:0/133493953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 msgr2=0x558954e75b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e75b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11ed9d700 1 -- 172.21.15.17:0/133493953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11800e140 con 0x558954e6d990 2023-10-05T15:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e7d090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb118004660 tx=0x7fb118004970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70488579916e84d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.482+0000 7fb105ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.483+0000 7fb105ffb700 1 -- 172.21.15.17:0/133493953 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800e940 con 0x558954e6d990 2023-10-05T15:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.483+0000 7fb105ffb700 1 -- 172.21.15.17:0/133493953 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb11800eaa0 con 0x558954e6d990 2023-10-05T15:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.483+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558954e5ed50 con 0x558954e6d990 2023-10-05T15:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.483+0000 7fb105ffb700 1 -- 172.21.15.17:0/133493953 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb11800ec60 con 0x558954e6d990 2023-10-05T15:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.483+0000 7fb138750b80 10 client.25972 fetch_fsmap learned FSMap version 33 2023-10-05T15:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.483+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fb120105a50 con 0x558954e6d990 2023-10-05T15:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.484+0000 7fb105ffb700 1 -- 172.21.15.17:0/133493953 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558954e5ed50 con 0x558954e6d990 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.484+0000 7fb105ffb700 1 -- 172.21.15.17:0/133493953 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb118015c80 con 0x558954e6d990 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb138750b80 10 client.25972 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb138750b80 10 client.25972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb138750b80 20 client.25972 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb138750b80 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954e81a50 0x558954e83e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb138750b80 4 client.25972 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558954db7db0 con 0x558954e81a50 2023-10-05T15:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.485+0000 7fb11e59c700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954e81a50 0x558954e83e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.486+0000 7fb11e59c700 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954e81a50 0x558954e83e70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24aecd160d7a3349 server_cookie=a4affb432874a07c in_seq=0 out_seq=0 2023-10-05T15:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.486+0000 7fb105ffb700 10 client.25972 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.486+0000 7fb105ffb700 1 -- 172.21.15.17:0/133493953 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558954db7db0 con 0x558954e81a50 2023-10-05T15:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.486+0000 7fb105ffb700 10 client.25972 handle_command_reply: tid=0 2023-10-05T15:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.486+0000 7fb138750b80 1 client.25972 shutdown 2023-10-05T15:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 msgr2=0x558954e7d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e7d090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb118004660 tx=0x7fb118004970 comp rx=0 tx=0).stop 2023-10-05T15:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 shutdown_connections 2023-10-05T15:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954e81a50 0x558954e83e70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6d990 0x558954e7d090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6bec0 0x558954e75b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 --2- 172.21.15.17:0/133493953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6cfd0 0x558954e76050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb105ffb700 0 client.25972 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 >> 172.21.15.17:0/133493953 conn(0x558954de0200 msgr2=0x558954e66250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 shutdown_connections 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.487+0000 7fb138750b80 1 -- 172.21.15.17:0/133493953 wait complete. 2023-10-05T15:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.488+0000 7fb138750b80 20 client.25972 trim_cache size 0 max 16384 2023-10-05T15:38:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.510+0000 7fb138750b80 1 Processor -- start 2023-10-05T15:38:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.510+0000 7fb138750b80 1 -- start start 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb138750b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 0x558954e747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb138750b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6cfd0 0x558954e7cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb138750b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6d990 0x558954e73dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb138750b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954c3f8c0 con 0x558954e6d990 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb138750b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954e7d560 con 0x558954e6bec0 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb138750b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954e6de90 con 0x558954e6cfd0 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb11e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 0x558954e747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6cfd0 0x558954e7cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb11e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 0x558954e747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37668/0 (socket says 172.21.15.17:37668) 2023-10-05T15:38:52.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6cfd0 0x558954e7cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:56678/0 (socket says 172.21.15.17:56678) 2023-10-05T15:38:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.511+0000 7fb11e59c700 1 -- 172.21.15.17:0/1839197292 learned_addr learned my addr 172.21.15.17:0/1839197292 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6d990 0x558954e73dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11e59c700 1 -- 172.21.15.17:0/1839197292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6cfd0 msgr2=0x558954e7cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11e59c700 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6cfd0 0x558954e7cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11e59c700 1 -- 172.21.15.17:0/1839197292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6d990 msgr2=0x558954e73dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11e59c700 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6d990 0x558954e73dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11e59c700 1 -- 172.21.15.17:0/1839197292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558954bd2c00 con 0x558954e6bec0 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6d990 0x558954e73dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb11e59c700 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 0x558954e747f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c5b0 tx=0x7fb1100cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc803b8f5b91ead server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb10d7fa700 1 -- 172.21.15.17:0/1839197292 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1100b6070 con 0x558954e6bec0 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb10d7fa700 1 -- 172.21.15.17:0/1839197292 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb11009e450 con 0x558954e6bec0 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.512+0000 7fb10d7fa700 1 -- 172.21.15.17:0/1839197292 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1100cd1b0 con 0x558954e6bec0 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 -- 172.21.15.17:0/1839197292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 msgr2=0x558954e747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 0x558954e747f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c5b0 tx=0x7fb1100cc040 comp rx=0 tx=0).stop 2023-10-05T15:38:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 -- 172.21.15.17:0/1839197292 shutdown_connections 2023-10-05T15:38:52.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6d990 0x558954e73dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6bec0 0x558954e747f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 --2- 172.21.15.17:0/1839197292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6cfd0 0x558954e7cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.513+0000 7fb138750b80 1 -- 172.21.15.17:0/1839197292 >> 172.21.15.17:0/1839197292 conn(0x558954de0200 msgr2=0x558954e88790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.514+0000 7fb138750b80 1 -- 172.21.15.17:0/1839197292 shutdown_connections 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.514+0000 7fb138750b80 1 -- 172.21.15.17:0/1839197292 wait complete. 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.514+0000 7fb138750b80 1 -- start start 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.514+0000 7fb138750b80 1 Processor -- start 2023-10-05T15:38:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6bec0 0x558954e7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 0x558954e7b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6d990 0x558954e7c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954e7c940 con 0x558954e6cfd0 2023-10-05T15:38:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954e7cab0 con 0x558954e6d990 2023-10-05T15:38:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558954e7cc70 con 0x558954e6bec0 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb138750b80 10 client.0 _ll_register_callbacks cb 0x7fb118003da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.515+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 0x558954e7b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 0x558954e7b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33030/0 (socket says 172.21.15.17:33030) 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 -- 172.21.15.17:0/4060208609 learned_addr learned my addr 172.21.15.17:0/4060208609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11ed9d700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6d990 0x558954e7c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11e59c700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6bec0 0x558954e7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 -- 172.21.15.17:0/4060208609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6bec0 msgr2=0x558954e7aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6bec0 0x558954e7aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 -- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6d990 msgr2=0x558954e7c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6d990 0x558954e7c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 -- 172.21.15.17:0/4060208609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1200720d0 con 0x558954e6cfd0 2023-10-05T15:38:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb11dd9b700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 0x558954e7b3f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb11400b2e0 tx=0x7fb11400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc21feb507412ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:38:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.516+0000 7fb105ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:38:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb105ffb700 1 -- 172.21.15.17:0/4060208609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114037040 con 0x558954e6cfd0 2023-10-05T15:38:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb105ffb700 1 -- 172.21.15.17:0/4060208609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb11403c480 con 0x558954e6cfd0 2023-10-05T15:38:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb114003d00 con 0x558954e6cfd0 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb105ffb700 1 -- 172.21.15.17:0/4060208609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb11403c640 con 0x558954e6cfd0 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb138750b80 10 client.16182 fetch_fsmap learned FSMap version 33 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x558954c101f0 con 0x558954e6cfd0 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.517+0000 7fb105ffb700 1 -- 172.21.15.17:0/4060208609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb114003d00 con 0x558954e6cfd0 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb105ffb700 1 -- 172.21.15.17:0/4060208609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb114044070 con 0x558954e6cfd0 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb138750b80 10 client.16182 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb138750b80 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb138750b80 20 client.16182 populate_metadata read hostname 'smithi017' 2023-10-05T15:38:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb138750b80 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954ed65f0 0x558954ed8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:38:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb138750b80 4 client.16182 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:38:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558954db7ad0 con 0x558954ed65f0 2023-10-05T15:38:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.518+0000 7fb11e59c700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954ed65f0 0x558954ed8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:38:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.519+0000 7fb11e59c700 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954ed65f0 0x558954ed8a10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe4d38fc867f8579 server_cookie=7a51d001b918ec4b in_seq=0 out_seq=0 2023-10-05T15:38:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.519+0000 7fb105ffb700 10 client.16182 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.537+0000 7fb105ffb700 1 -- 172.21.15.17:0/4060208609 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558954db7ad0 con 0x558954ed65f0 2023-10-05T15:38:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.537+0000 7fb105ffb700 10 client.16182 handle_command_reply: tid=0 2023-10-05T15:38:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.538+0000 7fb138750b80 1 client.16182 shutdown 2023-10-05T15:38:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.538+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 msgr2=0x558954e7b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.538+0000 7fb138750b80 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 0x558954e7b3f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb11400b2e0 tx=0x7fb11400be10 comp rx=0 tx=0).stop 2023-10-05T15:38:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 shutdown_connections 2023-10-05T15:38:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558954ed65f0 0x558954ed8a10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558954e6d990 0x558954e7c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb105ffb700 0 client.16182 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558954e6bec0 0x558954e7aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 --2- 172.21.15.17:0/4060208609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558954e6cfd0 0x558954e7b3f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 >> 172.21.15.17:0/4060208609 conn(0x558954de0200 msgr2=0x558954e747f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 shutdown_connections 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 1 -- 172.21.15.17:0/4060208609 wait complete. 2023-10-05T15:38:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.542+0000 7fb138750b80 20 client.16182 trim_cache size 0 max 16384 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.543+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1080a15d0 msgr2=0x7fb1080a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.543+0000 7fb124dff700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1080a15d0 0x7fb1080a3a90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb114005cd0 tx=0x7fb11401c000 comp rx=0 tx=0).stop 2023-10-05T15:38:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.543+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 msgr2=0x7fb12006f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.543+0000 7fb124dff700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 0x7fb12006f8a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb11000e9a0 tx=0x7fb11000ed60 comp rx=0 tx=0).stop 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.544+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 shutdown_connections 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.544+0000 7fb124dff700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb1080a15d0 0x7fb1080a3a90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.544+0000 7fb124dff700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb120104aa0 0x7fb120070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.544+0000 7fb124dff700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1200ff760 0x7fb12006f8a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.544+0000 7fb124dff700 1 --2- 172.21.15.17:0/3715435386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1201020d0 0x7fb12006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:38:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.544+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 >> 172.21.15.17:0/3715435386 conn(0x7fb1200fb340 msgr2=0x7fb120100410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:38:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.548+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 shutdown_connections 2023-10-05T15:38:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:38:52.548+0000 7fb124dff700 1 -- 172.21.15.17:0/3715435386 wait complete. 2023-10-05T15:38:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 15.0 s, 593.4 tps, lat 145.316 ms stddev 184.575 2023-10-05T15:38:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:53 smithi167 ceph-mon[133366]: pgmap v438: 129 pgs: 129 active+clean; 999 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 18 MiB/s wr, 238 op/s 2023-10-05T15:38:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:53 smithi079 ceph-mon[132936]: pgmap v438: 129 pgs: 129 active+clean; 999 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 18 MiB/s wr, 238 op/s 2023-10-05T15:38:54.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:53 smithi017 ceph-mon[129107]: pgmap v438: 129 pgs: 129 active+clean; 999 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 18 MiB/s wr, 238 op/s 2023-10-05T15:38:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:55 smithi167 ceph-mon[133366]: pgmap v439: 129 pgs: 129 active+clean; 1019 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 20 MiB/s wr, 278 op/s 2023-10-05T15:38:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:55 smithi079 ceph-mon[132936]: pgmap v439: 129 pgs: 129 active+clean; 1019 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 20 MiB/s wr, 278 op/s 2023-10-05T15:38:56.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:55 smithi017 ceph-mon[129107]: pgmap v439: 129 pgs: 129 active+clean; 1019 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 20 MiB/s wr, 278 op/s 2023-10-05T15:38:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:57 smithi167 ceph-mon[133366]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 17 MiB/s wr, 246 op/s 2023-10-05T15:38:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:57 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:38:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:57 smithi079 ceph-mon[132936]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 17 MiB/s wr, 246 op/s 2023-10-05T15:38:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:57 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:38:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 20.0 s, 683.4 tps, lat 144.653 ms stddev 200.159 2023-10-05T15:38:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:57 smithi017 ceph-mon[129107]: pgmap v440: 129 pgs: 129 active+clean; 1.0 GiB data, 953 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 17 MiB/s wr, 246 op/s 2023-10-05T15:38:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:57 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:39:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:59 smithi167 ceph-mon[133366]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 291 op/s 2023-10-05T15:39:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:39:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:39:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:38:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:39:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:59 smithi079 ceph-mon[132936]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 291 op/s 2023-10-05T15:39:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:39:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:39:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:38:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:39:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:59 smithi017 ceph-mon[129107]: pgmap v441: 129 pgs: 129 active+clean; 1.0 GiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 19 MiB/s wr, 291 op/s 2023-10-05T15:39:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:39:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:39:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:38:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:39:01.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:39:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:01 smithi167 ceph-mon[133366]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 17 MiB/s wr, 312 op/s 2023-10-05T15:39:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:01 smithi079 ceph-mon[132936]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 17 MiB/s wr, 312 op/s 2023-10-05T15:39:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 -- 172.21.15.17:0/2659629294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c103110 msgr2=0x7f816c103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 --2- 172.21.15.17:0/2659629294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c103110 0x7f816c103530 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81680099c0 tx=0x7f8168009cd0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 -- 172.21.15.17:0/2659629294 shutdown_connections 2023-10-05T15:39:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 --2- 172.21.15.17:0/2659629294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c104ca0 0x7f816c10b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 --2- 172.21.15.17:0/2659629294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c103110 0x7f816c103530 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 --2- 172.21.15.17:0/2659629294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f816c104300 0x7f816c104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 -- 172.21.15.17:0/2659629294 >> 172.21.15.17:0/2659629294 conn(0x7f816c0fe660 msgr2=0x7f816c100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:02.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 -- 172.21.15.17:0/2659629294 shutdown_connections 2023-10-05T15:39:02.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.158+0000 7f8173bff700 1 -- 172.21.15.17:0/2659629294 wait complete. 2023-10-05T15:39:02.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 Processor -- start 2023-10-05T15:39:02.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 -- start start 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 0x7f816c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c104300 0x7f816c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f816c104ca0 0x7f816c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1a08e0 con 0x7f816c104ca0 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1a0a50 con 0x7f816c104300 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.160+0000 7f8173bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c1a0c10 con 0x7f816c103110 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 0x7f816c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 0x7f816c198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:56790/0 (socket says 172.21.15.17:56790) 2023-10-05T15:39:02.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 -- 172.21.15.17:0/597298791 learned_addr learned my addr 172.21.15.17:0/597298791 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817119a700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c104300 0x7f816c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817219c700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f816c104ca0 0x7f816c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 -- 172.21.15.17:0/597298791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c104300 msgr2=0x7f816c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c104300 0x7f816c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 -- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f816c104ca0 msgr2=0x7f816c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f816c104ca0 0x7f816c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 -- 172.21.15.17:0/597298791 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c009520 con 0x7f816c103110 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817119a700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c104300 0x7f816c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:39:02.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.161+0000 7f817199b700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 0x7f816c198da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8168000c00 tx=0x7f816800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.162+0000 7f8162ffd700 1 -- 172.21.15.17:0/597298791 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816801d070 con 0x7f816c103110 2023-10-05T15:39:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.162+0000 7f8162ffd700 1 -- 172.21.15.17:0/597298791 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816800fe70 con 0x7f816c103110 2023-10-05T15:39:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.162+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81680095f0 con 0x7f816c103110 2023-10-05T15:39:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.162+0000 7f8162ffd700 1 -- 172.21.15.17:0/597298791 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680173f0 con 0x7f816c103110 2023-10-05T15:39:02.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.162+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c1a1180 con 0x7f816c103110 2023-10-05T15:39:02.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.166+0000 7f8162ffd700 1 -- 172.21.15.17:0/597298791 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8168022470 con 0x7f816c103110 2023-10-05T15:39:02.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.168+0000 7f81874f2b80 1 Processor -- start 2023-10-05T15:39:02.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.168+0000 7f81874f2b80 1 -- start start 2023-10-05T15:39:02.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.168+0000 7f8162ffd700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f81580a1500 0x7f81580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.168+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff91680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f8162ffd700 1 -- 172.21.15.17:0/597298791 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f81680ce2e0 con 0x7f816c103110 2023-10-05T15:39:02.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff92480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff92ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f81874f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4fef9460 con 0x559d4ff91bc0 2023-10-05T15:39:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f81874f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4feeac20 con 0x559d4ff91260 2023-10-05T15:39:02.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f81874f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4fee8540 con 0x559d4ff92a60 2023-10-05T15:39:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff91680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff91680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34604/0 (socket says 172.21.15.17:34604) 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 -- 172.21.15.17:0/590714700 learned_addr learned my addr 172.21.15.17:0/590714700 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817219c700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f81580a1500 0x7f81580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 -- 172.21.15.17:0/590714700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 msgr2=0x559d4ff92ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817219c700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff92ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817119a700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff92480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff92ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 -- 172.21.15.17:0/590714700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 msgr2=0x559d4ff92480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff92480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817199b700 1 -- 172.21.15.17:0/590714700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d4fd0ede0 con 0x559d4ff91260 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.169+0000 7f817219c700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff92ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:39:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.170+0000 7f817119a700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff92480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.170+0000 7f817199b700 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff91680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81680a3180 tx=0x7f816809af70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc4c1e58e18b1f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.170+0000 7f8157fff700 1 -- 172.21.15.17:0/590714700 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680cbea0 con 0x559d4ff91260 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.170+0000 7f8157fff700 1 -- 172.21.15.17:0/590714700 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816809bab0 con 0x559d4ff91260 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.170+0000 7f8157fff700 1 -- 172.21.15.17:0/590714700 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816809f120 con 0x559d4ff91260 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 -- 172.21.15.17:0/590714700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 msgr2=0x559d4ff91680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f817219c700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f81580a1500 0x7f81580a39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x559d4ff92240 tx=0x7f8164009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff91680 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f81680a3180 tx=0x7f816809af70 comp rx=0 tx=0).stop 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 -- 172.21.15.17:0/590714700 shutdown_connections 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff92ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff91680 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 --2- 172.21.15.17:0/590714700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff92480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 -- 172.21.15.17:0/590714700 >> 172.21.15.17:0/590714700 conn(0x559d4ff05260 msgr2=0x559d4ff8c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 -- 172.21.15.17:0/590714700 shutdown_connections 2023-10-05T15:39:02.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.171+0000 7f81874f2b80 1 -- 172.21.15.17:0/590714700 wait complete. 2023-10-05T15:39:02.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 -- start start 2023-10-05T15:39:02.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 Processor -- start 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff9b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ffa2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4fee3e30 con 0x559d4ff91bc0 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4fe80710 con 0x559d4ff91260 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4fe803b0 con 0x559d4ff92a60 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.172+0000 7f81874f2b80 10 client.0 _ll_register_callbacks cb 0x559d4fcdd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34612/0 (socket says 172.21.15.17:34612) 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 -- 172.21.15.17:0/1375179565 learned_addr learned my addr 172.21.15.17:0/1375179565 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817219c700 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ffa2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 -- 172.21.15.17:0/1375179565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 msgr2=0x559d4ffa2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ffa2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 -- 172.21.15.17:0/1375179565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 msgr2=0x559d4ff9b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff9b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 -- 172.21.15.17:0/1375179565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c1a1180 con 0x559d4ff91260 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f817199b700 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9aba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8168024000 tx=0x7f816809bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8bba6ae6c8d4b37 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.173+0000 7f81557fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81557fa700 1 -- 172.21.15.17:0/1375179565 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680cbea0 con 0x559d4ff91260 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d4ff83f10 con 0x559d4ff91260 2023-10-05T15:39:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81557fa700 1 -- 172.21.15.17:0/1375179565 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f816809b810 con 0x559d4ff91260 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81557fa700 1 -- 172.21.15.17:0/1375179565 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f816809a8a0 con 0x559d4ff91260 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 10 client.25994 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x559d4fcf7c60 con 0x559d4ff91260 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81557fa700 1 -- 172.21.15.17:0/1375179565 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d4ff83f10 con 0x559d4ff91260 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81557fa700 1 -- 172.21.15.17:0/1375179565 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f81680971a0 con 0x559d4ff91260 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 10 client.25994 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 10 client.25994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 20 client.25994 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.174+0000 7f81874f2b80 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d4ffa64c0 0x559d4ffa88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.175+0000 7f81874f2b80 4 client.25994 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.175+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d4fedce10 con 0x559d4ffa64c0 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.175+0000 7f817119a700 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d4ffa64c0 0x559d4ffa88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.175+0000 7f81557fa700 10 client.25994 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.175+0000 7f817119a700 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d4ffa64c0 0x559d4ffa88e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88373ff325b42c82 server_cookie=e6c0bbf253e6e8c8 in_seq=0 out_seq=0 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.176+0000 7f81557fa700 1 -- 172.21.15.17:0/1375179565 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559d4fedce10 con 0x559d4ffa64c0 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.176+0000 7f81557fa700 10 client.25994 handle_command_reply: tid=0 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.176+0000 7f81874f2b80 1 client.25994 shutdown 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 msgr2=0x559d4ff9aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9aba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8168024000 tx=0x7f816809bc20 comp rx=0 tx=0).stop 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 shutdown_connections 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d4ffa64c0 0x559d4ffa88e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ffa2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9aba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 --2- 172.21.15.17:0/1375179565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ff9b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 >> 172.21.15.17:0/1375179565 conn(0x559d4ff05260 msgr2=0x559d4ff8bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81557fa700 0 client.25994 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 shutdown_connections 2023-10-05T15:39:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 1 -- 172.21.15.17:0/1375179565 wait complete. 2023-10-05T15:39:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.177+0000 7f81874f2b80 20 client.25994 trim_cache size 0 max 16384 2023-10-05T15:39:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:01 smithi017 ceph-mon[129107]: pgmap v442: 129 pgs: 129 active+clean; 1.0 GiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 17 MiB/s wr, 312 op/s 2023-10-05T15:39:02.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.196+0000 7f81874f2b80 1 Processor -- start 2023-10-05T15:39:02.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 -- start start 2023-10-05T15:39:02.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ffa20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff95890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4fd64920 con 0x559d4ff91bc0 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4ff9a050 con 0x559d4ff91260 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f81874f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4ff8d7b0 con 0x559d4ff92a60 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34616/0 (socket says 172.21.15.17:34616) 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f817199b700 1 -- 172.21.15.17:0/4291989573 learned_addr learned my addr 172.21.15.17:0/4291989573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f817119a700 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ffa20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.197+0000 7f817219c700 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff95890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817199b700 1 -- 172.21.15.17:0/4291989573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 msgr2=0x559d4ff95890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817199b700 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff95890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817199b700 1 -- 172.21.15.17:0/4291989573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 msgr2=0x559d4ffa20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817199b700 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ffa20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817199b700 1 -- 172.21.15.17:0/4291989573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d4fd35250 con 0x559d4ff91260 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817119a700 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ffa20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f817199b700 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9a250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f816809b0b0 tx=0x7f8168099960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3de300bf10a521 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f8160bff700 1 -- 172.21.15.17:0/4291989573 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680cbea0 con 0x559d4ff91260 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f8160bff700 1 -- 172.21.15.17:0/4291989573 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81680a3720 con 0x559d4ff91260 2023-10-05T15:39:02.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.198+0000 7f8160bff700 1 -- 172.21.15.17:0/4291989573 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680a3220 con 0x559d4ff91260 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 -- 172.21.15.17:0/4291989573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 msgr2=0x559d4ff9a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9a250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f816809b0b0 tx=0x7f8168099960 comp rx=0 tx=0).stop 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 -- 172.21.15.17:0/4291989573 shutdown_connections 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff92a60 0x559d4ff95890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9a250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 --2- 172.21.15.17:0/4291989573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff91bc0 0x559d4ffa20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 -- 172.21.15.17:0/4291989573 >> 172.21.15.17:0/4291989573 conn(0x559d4ff05260 msgr2=0x559d4ffad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 -- 172.21.15.17:0/4291989573 shutdown_connections 2023-10-05T15:39:02.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.199+0000 7f81874f2b80 1 -- 172.21.15.17:0/4291989573 wait complete. 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 -- start start 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 Processor -- start 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff91bc0 0x559d4ff9ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff92a60 0x559d4ffa0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4ffa1430 con 0x559d4ff92a60 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4ffa15a0 con 0x559d4ff91260 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4ffa1760 con 0x559d4ff91bc0 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.200+0000 7f81874f2b80 10 client.0 _ll_register_callbacks cb 0x7f816809b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff92a60 0x559d4ffa0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817199b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff92a60 0x559d4ffa0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54378/0 (socket says 172.21.15.17:54378) 2023-10-05T15:39:02.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817219c700 1 -- 172.21.15.17:0/160423330 learned_addr learned my addr 172.21.15.17:0/160423330 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:02.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817119a700 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff91bc0 0x559d4ff9ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817199b700 1 -- 172.21.15.17:0/160423330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff91bc0 msgr2=0x559d4ff9ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.201+0000 7f817199b700 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff91bc0 0x559d4ff9ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f817199b700 1 -- 172.21.15.17:0/160423330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff92a60 msgr2=0x559d4ffa0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f817199b700 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff92a60 0x559d4ffa0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f817199b700 1 -- 172.21.15.17:0/160423330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d4fcf7c60 con 0x559d4ff91260 2023-10-05T15:39:02.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f817199b700 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f816809b0b0 tx=0x7f816809bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c2b6bed5cd4ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81557fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81557fa700 1 -- 172.21.15.17:0/160423330 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680cbea0 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81557fa700 1 -- 172.21.15.17:0/160423330 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f816809aaa0 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d4fedcb30 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81557fa700 1 -- 172.21.15.17:0/160423330 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81680a3720 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81874f2b80 10 client.26000 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.202+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x559d4fd0d2b0 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81557fa700 1 -- 172.21.15.17:0/160423330 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d4fedcb30 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81557fa700 1 -- 172.21.15.17:0/160423330 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f81680b9380 con 0x559d4ff91260 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81874f2b80 10 client.26000 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81874f2b80 10 client.26000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:02.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81874f2b80 20 client.26000 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81874f2b80 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d50002fd0 0x559d500053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81874f2b80 4 client.26000 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559d4fd2ff70 con 0x559d50002fd0 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.203+0000 7f817119a700 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d50002fd0 0x559d500053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f817119a700 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d50002fd0 0x559d500053c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5f13cd369df8da3 server_cookie=b3f1cae7bebc24d5 in_seq=0 out_seq=0 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81557fa700 10 client.26000 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81557fa700 1 -- 172.21.15.17:0/160423330 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559d4fd2ff70 con 0x559d50002fd0 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81557fa700 10 client.26000 handle_command_reply: tid=0 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81874f2b80 1 client.26000 shutdown 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 msgr2=0x559d4ff9d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81874f2b80 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f816809b0b0 tx=0x7f816809bc20 comp rx=0 tx=0).stop 2023-10-05T15:39:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 shutdown_connections 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.204+0000 7f81874f2b80 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559d50002fd0 0x559d500053c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d4ff92a60 0x559d4ffa0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81557fa700 0 client.26000 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559d4ff91260 0x559d4ff9d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 1 --2- 172.21.15.17:0/160423330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d4ff91bc0 0x559d4ff9ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 >> 172.21.15.17:0/160423330 conn(0x559d4ff05260 msgr2=0x559d4ff95890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 shutdown_connections 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 1 -- 172.21.15.17:0/160423330 wait complete. 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.205+0000 7f81874f2b80 20 client.26000 trim_cache size 0 max 16384 2023-10-05T15:39:02.210 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:39:02.211 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f81580a1500 msgr2=0x7f81580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f81580a1500 0x7f81580a39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x559d4ff92240 tx=0x7f8164009920 comp rx=0 tx=0).stop 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 msgr2=0x7f816c198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 0x7f816c198da0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8168000c00 tx=0x7f816800fa00 comp rx=0 tx=0).stop 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 shutdown_connections 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f81580a1500 0x7f81580a39c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f816c104ca0 0x7f816c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f816c103110 0x7f816c198da0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 --2- 172.21.15.17:0/597298791 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f816c104300 0x7f816c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 >> 172.21.15.17:0/597298791 conn(0x7f816c0fe660 msgr2=0x7f816c1009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 shutdown_connections 2023-10-05T15:39:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:02.206+0000 7f8173bff700 1 -- 172.21.15.17:0/597298791 wait complete. 2023-10-05T15:39:02.227 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:39:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 25.0 s, 449.2 tps, lat 256.263 ms stddev 302.163 2023-10-05T15:39:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:03 smithi167 ceph-mon[133366]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 299 op/s 2023-10-05T15:39:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:03 smithi079 ceph-mon[132936]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 299 op/s 2023-10-05T15:39:04.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:03 smithi017 ceph-mon[129107]: pgmap v443: 129 pgs: 129 active+clean; 1.0 GiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 299 op/s 2023-10-05T15:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.805+0000 7fee1c1ff700 1 -- 172.21.15.17:0/3156448406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 msgr2=0x7fee1410f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.805+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/3156448406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 0x7fee1410f1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee04009990 tx=0x7fee04009ca0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 -- 172.21.15.17:0/3156448406 shutdown_connections 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/3156448406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/3156448406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee14107eb0 0x7fee141082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/3156448406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 0x7fee1410f1f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 -- 172.21.15.17:0/3156448406 >> 172.21.15.17:0/3156448406 conn(0x7fee1406dd10 msgr2=0x7fee14070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 -- 172.21.15.17:0/3156448406 shutdown_connections 2023-10-05T15:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.806+0000 7fee1c1ff700 1 -- 172.21.15.17:0/3156448406 wait complete. 2023-10-05T15:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 Processor -- start 2023-10-05T15:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 -- start start 2023-10-05T15:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee14107eb0 0x7fee141091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 0x7fee141096e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1410ad40 con 0x7fee14107eb0 2023-10-05T15:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1410aeb0 con 0x7fee14108810 2023-10-05T15:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.808+0000 7fee1c1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1410b070 con 0x7fee1410f730 2023-10-05T15:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.809+0000 7fee1a79c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.809+0000 7fee1979a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 0x7fee141096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.809+0000 7fee1a79c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:34968/0 (socket says 172.21.15.17:34968) 2023-10-05T15:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.809+0000 7fee1a79c700 1 -- 172.21.15.17:0/1541772779 learned_addr learned my addr 172.21.15.17:0/1541772779 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.809+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee14107eb0 0x7fee141091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.809+0000 7fee1a79c700 1 -- 172.21.15.17:0/1541772779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 msgr2=0x7fee141096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.810+0000 7fee1a79c700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 0x7fee141096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.810+0000 7fee1a79c700 1 -- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee14107eb0 msgr2=0x7fee141091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.810+0000 7fee1a79c700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee14107eb0 0x7fee141091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.810+0000 7fee1a79c700 1 -- 172.21.15.17:0/1541772779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040095f0 con 0x7fee1410f730 2023-10-05T15:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.810+0000 7fee1a79c700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14109c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00b780 tx=0x7fee0c00ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.810+0000 7fee0affd700 1 -- 172.21.15.17:0/1541772779 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c010860 con 0x7fee1410f730 2023-10-05T15:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.811+0000 7fee0affd700 1 -- 172.21.15.17:0/1541772779 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee0c010e50 con 0x7fee1410f730 2023-10-05T15:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.811+0000 7fee0affd700 1 -- 172.21.15.17:0/1541772779 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c007370 con 0x7fee1410f730 2023-10-05T15:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.811+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee141ade90 con 0x7fee1410f730 2023-10-05T15:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.812+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee141ae2e0 con 0x7fee1410f730 2023-10-05T15:39:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.817+0000 7fee0affd700 1 -- 172.21.15.17:0/1541772779 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fee0c0109c0 con 0x7fee1410f730 2023-10-05T15:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.820+0000 7fee0affd700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fee000a1650 0x7fee000a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.820+0000 7fee0affd700 1 -- 172.21.15.17:0/1541772779 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fee0c0cc710 con 0x7fee1410f730 2023-10-05T15:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.822+0000 7fee2fbb9b80 1 Processor -- start 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.822+0000 7fee2fbb9b80 1 -- start start 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.823+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9373ec0 0x5555d93742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.823+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 0x5555d9375450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.823+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9375990 0x5555d937c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.823+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d92dc400 con 0x5555d9375990 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.823+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d92cdbc0 con 0x5555d9374fd0 2023-10-05T15:39:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.823+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d92cb4e0 con 0x5555d9373ec0 2023-10-05T15:39:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 0x5555d9375450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 0x5555d9375450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56334/0 (socket says 172.21.15.17:56334) 2023-10-05T15:39:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 -- 172.21.15.17:0/462671624 learned_addr learned my addr 172.21.15.17:0/462671624 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 -- 172.21.15.17:0/462671624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9373ec0 msgr2=0x5555d93742e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9373ec0 0x5555d93742e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 -- 172.21.15.17:0/462671624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9375990 msgr2=0x5555d937c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9375990 0x5555d937c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.824+0000 7fee1979a700 1 -- 172.21.15.17:0/462671624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d90f1d80 con 0x5555d9374fd0 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.825+0000 7fee1979a700 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 0x5555d9375450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee04009990 tx=0x7fee04005e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e6c606160a9877 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.825+0000 7fedfffff700 1 -- 172.21.15.17:0/462671624 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0401d070 con 0x5555d9374fd0 2023-10-05T15:39:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.825+0000 7fedfffff700 1 -- 172.21.15.17:0/462671624 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee0401e040 con 0x5555d9374fd0 2023-10-05T15:39:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.826+0000 7fedfffff700 1 -- 172.21.15.17:0/462671624 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04004880 con 0x5555d9374fd0 2023-10-05T15:39:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/462671624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 msgr2=0x5555d9375450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 0x5555d9375450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee04009990 tx=0x7fee04005e90 comp rx=0 tx=0).stop 2023-10-05T15:39:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fee000a1650 0x7fee000a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/462671624 shutdown_connections 2023-10-05T15:39:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9375990 0x5555d937c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9373ec0 0x5555d93742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/462671624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9374fd0 0x5555d9375450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.827+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/462671624 >> 172.21.15.17:0/462671624 conn(0x5555d92e8200 msgr2=0x5555d936ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.830+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/462671624 shutdown_connections 2023-10-05T15:39:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.831+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/462671624 wait complete. 2023-10-05T15:39:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.831+0000 7fee2fbb9b80 1 -- start start 2023-10-05T15:39:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.832+0000 7fee2fbb9b80 1 Processor -- start 2023-10-05T15:39:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.832+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.832+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d938f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.832+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9396130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d92c6dd0 con 0x5555d9373ec0 2023-10-05T15:39:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d92636b0 con 0x5555d9375990 2023-10-05T15:39:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d9263350 con 0x5555d9374fd0 2023-10-05T15:39:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee2fbb9b80 10 client.0 _ll_register_callbacks cb 0x5555d90c07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee19f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee1a79c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9396130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee1a79c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9396130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56350/0 (socket says 172.21.15.17:56350) 2023-10-05T15:39:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee1a79c700 1 -- 172.21.15.17:0/1503560860 learned_addr learned my addr 172.21.15.17:0/1503560860 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.833+0000 7fee1979a700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d938f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee19f9b700 1 -- 172.21.15.17:0/1503560860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 msgr2=0x5555d938f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d938f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee19f9b700 1 -- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 msgr2=0x5555d9396130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9396130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee19f9b700 1 -- 172.21.15.17:0/1503560860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee14112450 con 0x5555d9373ec0 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee1a79c700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9396130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.834+0000 7fee1979a700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d938f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.835+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938ebb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fee1410aab0 tx=0x7fee10004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be50fc7874a66e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.835+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fee000a1650 0x7fee000a3b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fee10009fd0 tx=0x7fee10009db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.835+0000 7fedfd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:39:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.835+0000 7fedfd7fa700 1 -- 172.21.15.17:0/1503560860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100178a0 con 0x5555d9373ec0 2023-10-05T15:39:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.835+0000 7fedfd7fa700 1 -- 172.21.15.17:0/1503560860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fee10017a00 con 0x5555d9373ec0 2023-10-05T15:39:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.835+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555d9366d50 con 0x5555d9373ec0 2023-10-05T15:39:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.836+0000 7fedfd7fa700 1 -- 172.21.15.17:0/1503560860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee10017c00 con 0x5555d9373ec0 2023-10-05T15:39:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.838+0000 7fee2fbb9b80 10 client.16200 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.838+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5555d90dac00 con 0x5555d9373ec0 2023-10-05T15:39:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.838+0000 7fedfd7fa700 1 -- 172.21.15.17:0/1503560860 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5555d9366d50 con 0x5555d9373ec0 2023-10-05T15:39:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fedfd7fa700 1 -- 172.21.15.17:0/1503560860 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fee10022a60 con 0x5555d9373ec0 2023-10-05T15:39:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee2fbb9b80 10 client.16200 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee2fbb9b80 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee2fbb9b80 20 client.16200 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d939abb0 0x5555d939cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee2fbb9b80 4 client.16200 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555d92bfdb0 con 0x5555d939abb0 2023-10-05T15:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.839+0000 7fee1979a700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d939abb0 0x5555d939cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.840+0000 7fee1979a700 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d939abb0 0x5555d939cfd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6e9b62fb7ef03c server_cookie=d2f720e571485bba in_seq=0 out_seq=0 2023-10-05T15:39:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.841+0000 7fedfd7fa700 10 client.16200 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.841+0000 7fedfd7fa700 1 -- 172.21.15.17:0/1503560860 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5555d92bfdb0 con 0x5555d939abb0 2023-10-05T15:39:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.841+0000 7fedfd7fa700 10 client.16200 handle_command_reply: tid=0 2023-10-05T15:39:05.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.841+0000 7fee2fbb9b80 1 client.16200 shutdown 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 msgr2=0x5555d938ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938ebb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fee1410aab0 tx=0x7fee10004800 comp rx=0 tx=0).stop 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 shutdown_connections 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d939abb0 0x5555d939cfd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9396130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938ebb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1503560860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d938f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.842+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 >> 172.21.15.17:0/1503560860 conn(0x5555d92e8200 msgr2=0x5555d936e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.846+0000 7fedfd7fa700 0 client.16200 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.846+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 shutdown_connections 2023-10-05T15:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.847+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1503560860 wait complete. 2023-10-05T15:39:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.848+0000 7fee2fbb9b80 20 client.16200 trim_cache size 0 max 16384 2023-10-05T15:39:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.873+0000 7fee2fbb9b80 1 Processor -- start 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.874+0000 7fee2fbb9b80 1 -- start start 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.875+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.875+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d93960f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.875+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9378950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.875+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d91478c0 con 0x5555d9373ec0 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.875+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d9378490 con 0x5555d9375990 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.875+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d93794c0 con 0x5555d9374fd0 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.877+0000 7fee19f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.877+0000 7fee1a79c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9378950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.877+0000 7fee19f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50944/0 (socket says 172.21.15.17:50944) 2023-10-05T15:39:05.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.877+0000 7fee19f9b700 1 -- 172.21.15.17:0/1034371445 learned_addr learned my addr 172.21.15.17:0/1034371445 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.877+0000 7fee1979a700 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d93960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.878+0000 7fee19f9b700 1 -- 172.21.15.17:0/1034371445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 msgr2=0x5555d93960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.878+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d93960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.878+0000 7fee19f9b700 1 -- 172.21.15.17:0/1034371445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 msgr2=0x5555d9378950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.878+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9378950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.878+0000 7fee19f9b700 1 -- 172.21.15.17:0/1034371445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d91181f0 con 0x5555d9373ec0 2023-10-05T15:39:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.878+0000 7fee19f9b700 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938d870 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fee10018fd0 tx=0x7fee10009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74356230e8af349c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.879+0000 7fee08ff9700 1 -- 172.21.15.17:0/1034371445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100091e0 con 0x5555d9373ec0 2023-10-05T15:39:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.879+0000 7fee08ff9700 1 -- 172.21.15.17:0/1034371445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee100044b0 con 0x5555d9373ec0 2023-10-05T15:39:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.879+0000 7fee08ff9700 1 -- 172.21.15.17:0/1034371445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10017b40 con 0x5555d9373ec0 2023-10-05T15:39:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.880+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1034371445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 msgr2=0x5555d938d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.880+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938d870 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fee10018fd0 tx=0x7fee10009990 comp rx=0 tx=0).stop 2023-10-05T15:39:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.882+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1034371445 shutdown_connections 2023-10-05T15:39:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.882+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9375990 0x5555d9378950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.882+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9373ec0 0x5555d938d870 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.882+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/1034371445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9374fd0 0x5555d93960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.882+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1034371445 >> 172.21.15.17:0/1034371445 conn(0x5555d92e8200 msgr2=0x5555d939cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:05.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.883+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1034371445 shutdown_connections 2023-10-05T15:39:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.883+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/1034371445 wait complete. 2023-10-05T15:39:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.884+0000 7fee2fbb9b80 1 -- start start 2023-10-05T15:39:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.884+0000 7fee2fbb9b80 1 Processor -- start 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 0x5555d9393860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9374fd0 0x5555d9393da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9375990 0x5555d9394db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d93952f0 con 0x5555d9374fd0 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d9395460 con 0x5555d9373ec0 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d9395620 con 0x5555d9375990 2023-10-05T15:39:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.885+0000 7fee2fbb9b80 10 client.0 _ll_register_callbacks cb 0x7fee1001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 0x5555d9393860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 0x5555d9393860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56360/0 (socket says 172.21.15.17:56360) 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 -- 172.21.15.17:0/934016141 learned_addr learned my addr 172.21.15.17:0/934016141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee1979a700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9374fd0 0x5555d9393da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee1a79c700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9375990 0x5555d9394db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 -- 172.21.15.17:0/934016141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9375990 msgr2=0x5555d9394db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9375990 0x5555d9394db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 -- 172.21.15.17:0/934016141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9374fd0 msgr2=0x5555d9393da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9374fd0 0x5555d9393da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.886+0000 7fee19f9b700 1 -- 172.21.15.17:0/934016141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555d90dac00 con 0x5555d9373ec0 2023-10-05T15:39:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.887+0000 7fee19f9b700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 0x5555d9393860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee10023ff0 tx=0x7fee10017f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87fb79d3fe0b0a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.887+0000 7fedfd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.887+0000 7fedfd7fa700 1 -- 172.21.15.17:0/934016141 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100046a0 con 0x5555d9373ec0 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.887+0000 7fedfd7fa700 1 -- 172.21.15.17:0/934016141 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fee10022410 con 0x5555d9373ec0 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.887+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee0401e040 con 0x5555d9373ec0 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.888+0000 7fedfd7fa700 1 -- 172.21.15.17:0/934016141 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee100225d0 con 0x5555d9373ec0 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.888+0000 7fee2fbb9b80 10 client.26018 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.888+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5555d90f0250 con 0x5555d9373ec0 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.888+0000 7fedfd7fa700 1 -- 172.21.15.17:0/934016141 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee10049020 con 0x5555d9373ec0 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fedfd7fa700 1 -- 172.21.15.17:0/934016141 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fee10032900 con 0x5555d9373ec0 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee2fbb9b80 10 client.26018 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee2fbb9b80 10 client.26018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee2fbb9b80 20 client.26018 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d93ef120 0x5555d93f1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee2fbb9b80 4 client.26018 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:39:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5555d92bfad0 con 0x5555d93ef120 2023-10-05T15:39:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.889+0000 7fee1979a700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d93ef120 0x5555d93f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.891+0000 7fee1979a700 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d93ef120 0x5555d93f1540 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e81d75f82be5c1ea server_cookie=b4a207a520c26b2b in_seq=0 out_seq=0 2023-10-05T15:39:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.891+0000 7fedfd7fa700 10 client.26018 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.909+0000 7fedfd7fa700 1 -- 172.21.15.17:0/934016141 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5555d92bfad0 con 0x5555d93ef120 2023-10-05T15:39:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.909+0000 7fedfd7fa700 10 client.26018 handle_command_reply: tid=0 2023-10-05T15:39:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.910+0000 7fee2fbb9b80 1 client.26018 shutdown 2023-10-05T15:39:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.910+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 msgr2=0x5555d9393860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.910+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 0x5555d9393860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee10023ff0 tx=0x7fee10017f90 comp rx=0 tx=0).stop 2023-10-05T15:39:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 shutdown_connections 2023-10-05T15:39:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5555d93ef120 0x5555d93f1540 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555d9375990 0x5555d9394db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555d9373ec0 0x5555d9393860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fee2fbb9b80 1 --2- 172.21.15.17:0/934016141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5555d9374fd0 0x5555d9393da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 >> 172.21.15.17:0/934016141 conn(0x5555d92e8200 msgr2=0x5555d938d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.911+0000 7fedfd7fa700 0 client.26018 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.912+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 shutdown_connections 2023-10-05T15:39:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.912+0000 7fee2fbb9b80 1 -- 172.21.15.17:0/934016141 wait complete. 2023-10-05T15:39:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.913+0000 7fee2fbb9b80 20 client.26018 trim_cache size 0 max 16384 2023-10-05T15:39:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:39:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:39:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:39:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:39:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fee000a1650 msgr2=0x7fee000a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fee000a1650 0x7fee000a3b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fee10009fd0 tx=0x7fee10009db0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 msgr2=0x7fee14109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14109c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00b780 tx=0x7fee0c00ba90 comp rx=0 tx=0).stop 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 shutdown_connections 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fee000a1650 0x7fee000a3b10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fee1410f730 0x7fee14109c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee14107eb0 0x7fee141091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 --2- 172.21.15.17:0/1541772779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14108810 0x7fee141096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.914+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 >> 172.21.15.17:0/1541772779 conn(0x7fee1406dd10 msgr2=0x7fee1406f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.915+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 shutdown_connections 2023-10-05T15:39:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:05.915+0000 7fee1c1ff700 1 -- 172.21.15.17:0/1541772779 wait complete. 2023-10-05T15:39:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:05 smithi167 ceph-mon[133366]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 490 op/s 2023-10-05T15:39:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:05 smithi079 ceph-mon[132936]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 490 op/s 2023-10-05T15:39:06.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:05 smithi017 ceph-mon[129107]: pgmap v444: 129 pgs: 129 active+clean; 1.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 17 MiB/s wr, 490 op/s 2023-10-05T15:39:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:07 smithi167 ceph-mon[133366]: pgmap v445: 129 pgs: 129 active+clean; 1.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 514 op/s 2023-10-05T15:39:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:07 smithi079 ceph-mon[132936]: pgmap v445: 129 pgs: 129 active+clean; 1.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 514 op/s 2023-10-05T15:39:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 30.0 s, 603.2 tps, lat 169.949 ms stddev 211.090 2023-10-05T15:39:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:07 smithi017 ceph-mon[129107]: pgmap v445: 129 pgs: 129 active+clean; 1.1 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 514 op/s 2023-10-05T15:39:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:09 smithi167 ceph-mon[133366]: pgmap v446: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 621 op/s 2023-10-05T15:39:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:09 smithi079 ceph-mon[132936]: pgmap v446: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 621 op/s 2023-10-05T15:39:10.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:09 smithi017 ceph-mon[129107]: pgmap v446: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 15 MiB/s wr, 621 op/s 2023-10-05T15:39:11.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:10 smithi167 ceph-mon[133366]: pgmap v447: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 692 op/s 2023-10-05T15:39:11.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:10 smithi079 ceph-mon[132936]: pgmap v447: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 692 op/s 2023-10-05T15:39:11.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:10 smithi017 ceph-mon[129107]: pgmap v447: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 14 MiB/s wr, 692 op/s 2023-10-05T15:39:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 35.0 s, 636.0 tps, lat 153.577 ms stddev 197.061 2023-10-05T15:39:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:13 smithi167 ceph-mon[133366]: pgmap v448: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 681 op/s 2023-10-05T15:39:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:13 smithi079 ceph-mon[132936]: pgmap v448: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 681 op/s 2023-10-05T15:39:14.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:13 smithi017 ceph-mon[129107]: pgmap v448: 129 pgs: 129 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 681 op/s 2023-10-05T15:39:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:15 smithi167 ceph-mon[133366]: pgmap v449: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 915 op/s 2023-10-05T15:39:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:15 smithi079 ceph-mon[132936]: pgmap v449: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 915 op/s 2023-10-05T15:39:16.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:15 smithi017 ceph-mon[129107]: pgmap v449: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 915 op/s 2023-10-05T15:39:17.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:17 smithi017 ceph-mon[129107]: pgmap v450: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 730 op/s 2023-10-05T15:39:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:17 smithi167 ceph-mon[133366]: pgmap v450: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 730 op/s 2023-10-05T15:39:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:17 smithi079 ceph-mon[132936]: pgmap v450: 129 pgs: 129 active+clean; 1.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 730 op/s 2023-10-05T15:39:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 40.0 s, 507.8 tps, lat 167.763 ms stddev 217.452 2023-10-05T15:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.144+0000 7fe837fff700 1 -- 172.21.15.17:0/1234931449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104ca0 msgr2=0x7fe83010b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.144+0000 7fe837fff700 1 --2- 172.21.15.17:0/1234931449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104ca0 0x7fe83010b550 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe82000b0a0 tx=0x7fe82000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 -- 172.21.15.17:0/1234931449 shutdown_connections 2023-10-05T15:39:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 --2- 172.21.15.17:0/1234931449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104ca0 0x7fe83010b550 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 --2- 172.21.15.17:0/1234931449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe830103110 0x7fe830103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 --2- 172.21.15.17:0/1234931449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104300 0x7fe830104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 -- 172.21.15.17:0/1234931449 >> 172.21.15.17:0/1234931449 conn(0x7fe8300fe660 msgr2=0x7fe830100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 -- 172.21.15.17:0/1234931449 shutdown_connections 2023-10-05T15:39:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.145+0000 7fe837fff700 1 -- 172.21.15.17:0/1234931449 wait complete. 2023-10-05T15:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.146+0000 7fe837fff700 1 Processor -- start 2023-10-05T15:39:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 -- start start 2023-10-05T15:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe830103110 0x7fe830198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104300 0x7fe830199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 0x7fe83019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83019a910 con 0x7fe830103110 2023-10-05T15:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83019aa80 con 0x7fe830104ca0 2023-10-05T15:39:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.147+0000 7fe837fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83019ac40 con 0x7fe830104300 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 0x7fe83019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe830103110 0x7fe830198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 0x7fe83019a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36588/0 (socket says 172.21.15.17:36588) 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 -- 172.21.15.17:0/1834747805 learned_addr learned my addr 172.21.15.17:0/1834747805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83559a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104300 0x7fe830199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 -- 172.21.15.17:0/1834747805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104300 msgr2=0x7fe830199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104300 0x7fe830199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 -- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe830103110 msgr2=0x7fe830198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe830103110 0x7fe830198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.148+0000 7fe83659c700 1 -- 172.21.15.17:0/1834747805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009d00 con 0x7fe830104ca0 2023-10-05T15:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.149+0000 7fe83659c700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 0x7fe83019a2b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe82000d010 tx=0x7fe82000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.149+0000 7fe82effd700 1 -- 172.21.15.17:0/1834747805 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000e040 con 0x7fe830104ca0 2023-10-05T15:39:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.149+0000 7fe82effd700 1 -- 172.21.15.17:0/1834747805 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe820003e10 con 0x7fe830104ca0 2023-10-05T15:39:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.149+0000 7fe82effd700 1 -- 172.21.15.17:0/1834747805 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200052a0 con 0x7fe830104ca0 2023-10-05T15:39:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.149+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83019aec0 con 0x7fe830104ca0 2023-10-05T15:39:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.150+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8300754d0 con 0x7fe830104ca0 2023-10-05T15:39:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.155+0000 7fe82effd700 1 -- 172.21.15.17:0/1834747805 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe82001d480 con 0x7fe830104ca0 2023-10-05T15:39:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.155+0000 7fe84b94cb80 1 Processor -- start 2023-10-05T15:39:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.156+0000 7fe84b94cb80 1 -- start start 2023-10-05T15:39:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6656ec0 0x5646e66572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6658450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6658990 0x5646e665f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65bf400 con 0x5646e6658990 2023-10-05T15:39:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65b0bc0 con 0x5646e6657fd0 2023-10-05T15:39:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65ae4e0 con 0x5646e6656ec0 2023-10-05T15:39:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6658450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe83559a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6656ec0 0x5646e66572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6658450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36592/0 (socket says 172.21.15.17:36592) 2023-10-05T15:39:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.157+0000 7fe835d9b700 1 -- 172.21.15.17:0/2832183048 learned_addr learned my addr 172.21.15.17:0/2832183048 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe83559a700 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6658990 0x5646e665f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe835d9b700 1 -- 172.21.15.17:0/2832183048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6656ec0 msgr2=0x5646e66572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe835d9b700 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6656ec0 0x5646e66572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe835d9b700 1 -- 172.21.15.17:0/2832183048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6658990 msgr2=0x5646e665f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe835d9b700 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6658990 0x5646e665f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe835d9b700 1 -- 172.21.15.17:0/2832183048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e63d4d80 con 0x5646e6657fd0 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe83559a700 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6658990 0x5646e665f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.158+0000 7fe835d9b700 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6658450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe828009910 tx=0x7fe828009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6df8fece348fc58 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.159+0000 7fe82effd700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe8180a15d0 0x7fe8180a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.159+0000 7fe82effd700 1 -- 172.21.15.17:0/1834747805 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe8200ce190 con 0x7fe830104ca0 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.159+0000 7fe817fff700 1 -- 172.21.15.17:0/2832183048 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828019050 con 0x5646e6657fd0 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.159+0000 7fe817fff700 1 -- 172.21.15.17:0/2832183048 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe82801a040 con 0x5646e6657fd0 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.159+0000 7fe817fff700 1 -- 172.21.15.17:0/2832183048 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82801e4c0 con 0x5646e6657fd0 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe83559a700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe8180a15d0 0x7fe8180a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2832183048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 msgr2=0x5646e6658450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6658450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe828009910 tx=0x7fe828009260 comp rx=0 tx=0).stop 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2832183048 shutdown_connections 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6658990 0x5646e665f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6656ec0 0x5646e66572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2832183048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6658450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2832183048 >> 172.21.15.17:0/2832183048 conn(0x5646e65cb200 msgr2=0x5646e6651bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.160+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2832183048 shutdown_connections 2023-10-05T15:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.161+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2832183048 wait complete. 2023-10-05T15:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.161+0000 7fe83559a700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe8180a15d0 0x7fe8180a3a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5646e6656c60 tx=0x7fe824013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.161+0000 7fe84b94cb80 1 -- start start 2023-10-05T15:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 Processor -- start 2023-10-05T15:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6660b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6661050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6668090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65a9dd0 con 0x5646e6657fd0 2023-10-05T15:39:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e65466b0 con 0x5646e6656ec0 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e6546350 con 0x5646e6658990 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.162+0000 7fe84b94cb80 10 client.0 _ll_register_callbacks cb 0x5646e63a37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6660b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6660b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36606/0 (socket says 172.21.15.17:36606) 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 -- 172.21.15.17:0/2502401336 learned_addr learned my addr 172.21.15.17:0/2502401336 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe83559a700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6661050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe83659c700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6668090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 -- 172.21.15.17:0/2502401336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 msgr2=0x5646e6668090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6668090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 -- 172.21.15.17:0/2502401336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 msgr2=0x5646e6661050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6661050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.163+0000 7fe835d9b700 1 -- 172.21.15.17:0/2502401336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280095c0 con 0x5646e6656ec0 2023-10-05T15:39:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.164+0000 7fe835d9b700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6660b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe828016010 tx=0x7fe8280042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f470a987cf55662f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.164+0000 7fe8157fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.164+0000 7fe8157fa700 1 -- 172.21.15.17:0/2502401336 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8280044e0 con 0x5646e6656ec0 2023-10-05T15:39:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.164+0000 7fe8157fa700 1 -- 172.21.15.17:0/2502401336 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe828005ce0 con 0x5646e6656ec0 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.164+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646e6649d50 con 0x5646e6656ec0 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe8157fa700 1 -- 172.21.15.17:0/2502401336 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe828019020 con 0x5646e6656ec0 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe84b94cb80 10 client.26030 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5646e63bdc00 con 0x5646e6656ec0 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe8157fa700 1 -- 172.21.15.17:0/2502401336 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5646e6649d50 con 0x5646e6656ec0 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe8157fa700 1 -- 172.21.15.17:0/2502401336 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe82801e4c0 con 0x5646e6656ec0 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe84b94cb80 10 client.26030 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.165+0000 7fe84b94cb80 10 client.26030 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.166+0000 7fe84b94cb80 20 client.26030 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.166+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e666c8a0 0x5646e666ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.166+0000 7fe84b94cb80 4 client.26030 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.166+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646e65a2db0 con 0x5646e666c8a0 2023-10-05T15:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.166+0000 7fe83559a700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e666c8a0 0x5646e666ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.167+0000 7fe83559a700 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e666c8a0 0x5646e666ecc0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=762fe5ecac82c0b server_cookie=5cc9c390916720b1 in_seq=0 out_seq=0 2023-10-05T15:39:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.167+0000 7fe8157fa700 10 client.26030 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.167+0000 7fe8157fa700 1 -- 172.21.15.17:0/2502401336 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5646e65a2db0 con 0x5646e666c8a0 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.167+0000 7fe8157fa700 10 client.26030 handle_command_reply: tid=0 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 client.26030 shutdown 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 msgr2=0x5646e6660b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6660b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe828016010 tx=0x7fe8280042f0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 shutdown_connections 2023-10-05T15:39:19.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e666c8a0 0x5646e666ecc0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6668090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6660b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/2502401336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6661050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 >> 172.21.15.17:0/2502401336 conn(0x5646e65cb200 msgr2=0x5646e6651250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.168+0000 7fe8157fa700 0 client.26030 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.169+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 shutdown_connections 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.169+0000 7fe84b94cb80 1 -- 172.21.15.17:0/2502401336 wait complete. 2023-10-05T15:39:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.169+0000 7fe84b94cb80 20 client.26030 trim_cache size 0 max 16384 2023-10-05T15:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 Processor -- start 2023-10-05T15:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 -- start start 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6656ec0 0x5646e66601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6667fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e665ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e642a8c0 con 0x5646e6656ec0 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e6657770 con 0x5646e6657fd0 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.193+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e66684f0 con 0x5646e6658990 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e665ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e665ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57080/0 (socket says 172.21.15.17:57080) 2023-10-05T15:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 -- 172.21.15.17:0/3087873314 learned_addr learned my addr 172.21.15.17:0/3087873314 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe835d9b700 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6656ec0 0x5646e66601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83559a700 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6667fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 -- 172.21.15.17:0/3087873314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 msgr2=0x5646e6667fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6667fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 -- 172.21.15.17:0/3087873314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6656ec0 msgr2=0x5646e66601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6656ec0 0x5646e66601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 -- 172.21.15.17:0/3087873314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646e63fb1f0 con 0x5646e6658990 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe835d9b700 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6656ec0 0x5646e66601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:39:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.194+0000 7fe83659c700 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e665ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe820009fd0 tx=0x7fe82009af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=532e202225c80bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.195+0000 7fe82cff9700 1 -- 172.21.15.17:0/3087873314 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82009b840 con 0x5646e6658990 2023-10-05T15:39:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.195+0000 7fe82cff9700 1 -- 172.21.15.17:0/3087873314 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8200aee90 con 0x5646e6658990 2023-10-05T15:39:19.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.195+0000 7fe82cff9700 1 -- 172.21.15.17:0/3087873314 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82009b3a0 con 0x5646e6658990 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 -- 172.21.15.17:0/3087873314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 msgr2=0x5646e665ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e665ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe820009fd0 tx=0x7fe82009af90 comp rx=0 tx=0).stop 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 -- 172.21.15.17:0/3087873314 shutdown_connections 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e665ee00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6656ec0 0x5646e66601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/3087873314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6657fd0 0x5646e6667fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 -- 172.21.15.17:0/3087873314 >> 172.21.15.17:0/3087873314 conn(0x5646e65cb200 msgr2=0x5646e665f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 -- 172.21.15.17:0/3087873314 shutdown_connections 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.196+0000 7fe84b94cb80 1 -- 172.21.15.17:0/3087873314 wait complete. 2023-10-05T15:39:19.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.197+0000 7fe84b94cb80 1 -- start start 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.197+0000 7fe84b94cb80 1 Processor -- start 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6665af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6666030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6667040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e6667580 con 0x5646e6657fd0 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e66676f0 con 0x5646e6656ec0 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646e66678b0 con 0x5646e6658990 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe84b94cb80 10 client.0 _ll_register_callbacks cb 0x7fe824009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe83659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6667040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe83559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6666030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe83659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6667040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57092/0 (socket says 172.21.15.17:57092) 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe83659c700 1 -- 172.21.15.17:0/4269917275 learned_addr learned my addr 172.21.15.17:0/4269917275 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.198+0000 7fe835d9b700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6665af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83659c700 1 -- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 msgr2=0x5646e6665af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83659c700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6665af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83659c700 1 -- 172.21.15.17:0/4269917275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 msgr2=0x5646e6666030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83659c700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6666030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83659c700 1 -- 172.21.15.17:0/4269917275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82001de70 con 0x5646e6658990 2023-10-05T15:39:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83559a700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6666030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:39:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe835d9b700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6665af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe83659c700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6667040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe820097640 tx=0x7fe82009f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86764f7968e07b17 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.199+0000 7fe8157fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe8157fa700 1 -- 172.21.15.17:0/4269917275 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82009b840 con 0x5646e6658990 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe8157fa700 1 -- 172.21.15.17:0/4269917275 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe82009b140 con 0x5646e6658990 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe82801a040 con 0x5646e6658990 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe8157fa700 1 -- 172.21.15.17:0/4269917275 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82000be10 con 0x5646e6658990 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe84b94cb80 10 client.26020 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5646e63d3250 con 0x5646e6658990 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe8157fa700 1 -- 172.21.15.17:0/4269917275 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe82801a040 con 0x5646e6658990 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe8157fa700 1 -- 172.21.15.17:0/4269917275 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe8200a2fb0 con 0x5646e6658990 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe84b94cb80 10 client.26020 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.200+0000 7fe84b94cb80 10 client.26020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.201+0000 7fe84b94cb80 20 client.26020 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.201+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e66c0ef0 0x5646e66c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.201+0000 7fe84b94cb80 4 client.26020 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.201+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646e65a2ad0 con 0x5646e66c0ef0 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.201+0000 7fe835d9b700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e66c0ef0 0x5646e66c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.202+0000 7fe835d9b700 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e66c0ef0 0x5646e66c32e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d842ca6eb0e8bf68 server_cookie=2a9f040ab109398d in_seq=0 out_seq=0 2023-10-05T15:39:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.202+0000 7fe8157fa700 10 client.26020 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:19.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe8157fa700 1 -- 172.21.15.17:0/4269917275 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646e65a2ad0 con 0x5646e66c0ef0 2023-10-05T15:39:19.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe8157fa700 10 client.26020 handle_command_reply: tid=0 2023-10-05T15:39:19.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 client.26020 shutdown 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 msgr2=0x5646e6667040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6667040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe820097640 tx=0x7fe82009f120 comp rx=0 tx=0).stop 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 shutdown_connections 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5646e66c0ef0 0x5646e66c32e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5646e6658990 0x5646e6667040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646e6656ec0 0x5646e6665af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 --2- 172.21.15.17:0/4269917275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5646e6657fd0 0x5646e6666030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.222+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 >> 172.21.15.17:0/4269917275 conn(0x5646e65cb200 msgr2=0x5646e665f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.223+0000 7fe8157fa700 0 client.26020 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.223+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 shutdown_connections 2023-10-05T15:39:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.223+0000 7fe84b94cb80 1 -- 172.21.15.17:0/4269917275 wait complete. 2023-10-05T15:39:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.223+0000 7fe84b94cb80 20 client.26020 trim_cache size 0 max 16384 2023-10-05T15:39:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:39:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:39:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:39:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe8180a15d0 msgr2=0x7fe8180a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe8180a15d0 0x7fe8180a3a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5646e6656c60 tx=0x7fe824013040 comp rx=0 tx=0).stop 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 msgr2=0x7fe83019a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 0x7fe83019a2b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe82000d010 tx=0x7fe82000bce0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 shutdown_connections 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe8180a15d0 0x7fe8180a3a90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe830104ca0 0x7fe83019a2b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe830103110 0x7fe830198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 --2- 172.21.15.17:0/1834747805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe830104300 0x7fe830199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 >> 172.21.15.17:0/1834747805 conn(0x7fe8300fe660 msgr2=0x7fe830100900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 shutdown_connections 2023-10-05T15:39:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:19.224+0000 7fe837fff700 1 -- 172.21.15.17:0/1834747805 wait complete. 2023-10-05T15:39:19.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:19 smithi017 ceph-mon[129107]: pgmap v451: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 806 op/s 2023-10-05T15:39:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:19 smithi167 ceph-mon[133366]: pgmap v451: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 806 op/s 2023-10-05T15:39:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:19 smithi079 ceph-mon[132936]: pgmap v451: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 806 op/s 2023-10-05T15:39:21.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:21 smithi017 ceph-mon[129107]: pgmap v452: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 817 op/s 2023-10-05T15:39:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:21 smithi167 ceph-mon[133366]: pgmap v452: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 817 op/s 2023-10-05T15:39:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:21 smithi079 ceph-mon[132936]: pgmap v452: 129 pgs: 129 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 15 MiB/s wr, 817 op/s 2023-10-05T15:39:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 45.0 s, 572.0 tps, lat 204.416 ms stddev 295.493 2023-10-05T15:39:23.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:23 smithi017 ceph-mon[129107]: pgmap v453: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-05T15:39:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:23 smithi167 ceph-mon[133366]: pgmap v453: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-05T15:39:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:23 smithi079 ceph-mon[132936]: pgmap v453: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-05T15:39:25.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:25 smithi017 ceph-mon[129107]: pgmap v454: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 881 op/s 2023-10-05T15:39:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:25 smithi167 ceph-mon[133366]: pgmap v454: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 881 op/s 2023-10-05T15:39:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:25 smithi079 ceph-mon[132936]: pgmap v454: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 881 op/s 2023-10-05T15:39:27.946 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:27 smithi017 ceph-mon[129107]: pgmap v455: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 685 op/s 2023-10-05T15:39:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:27 smithi167 ceph-mon[133366]: pgmap v455: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 685 op/s 2023-10-05T15:39:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:27 smithi079 ceph-mon[132936]: pgmap v455: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 685 op/s 2023-10-05T15:39:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 50.0 s, 547.2 tps, lat 176.857 ms stddev 202.905 2023-10-05T15:39:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:29 smithi167 ceph-mon[133366]: pgmap v456: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 13 MiB/s wr, 769 op/s 2023-10-05T15:39:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:29 smithi079 ceph-mon[132936]: pgmap v456: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 13 MiB/s wr, 769 op/s 2023-10-05T15:39:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:29 smithi017 ceph-mon[129107]: pgmap v456: 129 pgs: 129 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 13 MiB/s wr, 769 op/s 2023-10-05T15:39:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:31 smithi167 ceph-mon[133366]: pgmap v457: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 778 op/s 2023-10-05T15:39:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:31 smithi079 ceph-mon[132936]: pgmap v457: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 778 op/s 2023-10-05T15:39:32.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:31 smithi017 ceph-mon[129107]: pgmap v457: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 13 MiB/s wr, 778 op/s 2023-10-05T15:39:32.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:39:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.482+0000 7f2e349ff700 1 -- 172.21.15.17:0/2746394789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e30108e00 msgr2=0x7f2e3010b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.482+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2746394789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e30108e00 0x7f2e3010b270 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098f0 tx=0x7f2e20009c00 comp rx=0 tx=0).stop 2023-10-05T15:39:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.484+0000 7f2e349ff700 1 -- 172.21.15.17:0/2746394789 shutdown_connections 2023-10-05T15:39:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.484+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2746394789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e30108e00 0x7f2e3010b270 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.484+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2746394789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30074e90 0x7f2e300732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.484+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2746394789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e300738b0 0x7f2e30073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.484+0000 7f2e349ff700 1 -- 172.21.15.17:0/2746394789 >> 172.21.15.17:0/2746394789 conn(0x7f2e300fc4c0 msgr2=0x7f2e300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.486+0000 7f2e349ff700 1 -- 172.21.15.17:0/2746394789 shutdown_connections 2023-10-05T15:39:32.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.486+0000 7f2e349ff700 1 -- 172.21.15.17:0/2746394789 wait complete. 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.488+0000 7f2e349ff700 1 Processor -- start 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.488+0000 7f2e349ff700 1 -- start start 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e349ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e300738b0 0x7f2e3019d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e349ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e30074e90 0x7f2e3019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e349ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 0x7f2e3019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e349ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3019eca0 con 0x7f2e300738b0 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e349ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3019ee10 con 0x7f2e30108e00 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e349ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3019efd0 con 0x7f2e30074e90 2023-10-05T15:39:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 0x7f2e3019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 0x7f2e3019e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60778/0 (socket says 172.21.15.17:60778) 2023-10-05T15:39:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/2470227542 learned_addr learned my addr 172.21.15.17:0/2470227542 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.489+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e30074e90 0x7f2e3019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.490+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/2470227542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e30074e90 msgr2=0x7f2e3019d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.490+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e30074e90 0x7f2e3019d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.490+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e300738b0 msgr2=0x7f2e3019d280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:39:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.490+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e300738b0 0x7f2e3019d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.490+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/2470227542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009520 con 0x7f2e30108e00 2023-10-05T15:39:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.490+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 0x7f2e3019e640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b2e0 tx=0x7f2e2000b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.491+0000 7f2e1f7fe700 1 -- 172.21.15.17:0/2470227542 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001c070 con 0x7f2e30108e00 2023-10-05T15:39:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.491+0000 7f2e1f7fe700 1 -- 172.21.15.17:0/2470227542 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e2000bc90 con 0x7f2e30108e00 2023-10-05T15:39:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.491+0000 7f2e1f7fe700 1 -- 172.21.15.17:0/2470227542 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20004b30 con 0x7f2e30108e00 2023-10-05T15:39:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.491+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3019f250 con 0x7f2e30108e00 2023-10-05T15:39:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.492+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3006a8d0 con 0x7f2e30108e00 2023-10-05T15:39:32.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.500+0000 7f2e4838cb80 1 Processor -- start 2023-10-05T15:39:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.502+0000 7f2e1f7fe700 1 -- 172.21.15.17:0/2470227542 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2e20020070 con 0x7f2e30108e00 2023-10-05T15:39:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.502+0000 7f2e4838cb80 1 -- start start 2023-10-05T15:39:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.503+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 0x5563571e5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571ec220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55635714c400 con 0x5563571e3ec0 2023-10-05T15:39:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55635713dbc0 con 0x5563571e5990 2023-10-05T15:39:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55635713b4e0 con 0x5563571e4fd0 2023-10-05T15:39:32.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e2e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 0x5563571e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e2e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 0x5563571e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54940/0 (socket says 172.21.15.17:54940) 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.504+0000 7f2e2e59c700 1 -- 172.21.15.17:0/2506640726 learned_addr learned my addr 172.21.15.17:0/2506640726 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2e59c700 1 -- 172.21.15.17:0/2506640726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 msgr2=0x5563571ec220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571ec220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2e59c700 1 -- 172.21.15.17:0/2506640726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 msgr2=0x5563571e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2e59c700 1 -- 172.21.15.17:0/2506640726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556356f61d80 con 0x5563571e4fd0 2023-10-05T15:39:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571ec220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:39:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.505+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 0x5563571e5450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009c70 tx=0x7f2e28009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ed6b572890910e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.506+0000 7f2e1cff9700 1 -- 172.21.15.17:0/2506640726 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28004bb0 con 0x5563571e4fd0 2023-10-05T15:39:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.506+0000 7f2e1f7fe700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2e180a1680 0x7f2e180a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.506+0000 7f2e1cff9700 1 -- 172.21.15.17:0/2506640726 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e2800f040 con 0x5563571e4fd0 2023-10-05T15:39:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.506+0000 7f2e1cff9700 1 -- 172.21.15.17:0/2506640726 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280133f0 con 0x5563571e4fd0 2023-10-05T15:39:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.506+0000 7f2e1f7fe700 1 -- 172.21.15.17:0/2470227542 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2e200ce140 con 0x7f2e30108e00 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.507+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2e180a1680 0x7f2e180a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.507+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2506640726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 msgr2=0x5563571e5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.507+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 0x5563571e5450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009c70 tx=0x7f2e28009f80 comp rx=0 tx=0).stop 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2506640726 shutdown_connections 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571ec220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2506640726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e4fd0 0x5563571e5450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2506640726 >> 172.21.15.17:0/2506640726 conn(0x556357158200 msgr2=0x5563571debb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2e180a1680 0x7f2e180a3b40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5563571e3c60 tx=0x7f2e24009480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.508+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2506640726 shutdown_connections 2023-10-05T15:39:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.509+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2506640726 wait complete. 2023-10-05T15:39:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.509+0000 7f2e4838cb80 1 -- start start 2023-10-05T15:39:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 Processor -- start 2023-10-05T15:39:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e3ec0 0x5563571edb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e4fd0 0x5563571ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556357136dd0 con 0x5563571e4fd0 2023-10-05T15:39:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563570d36b0 con 0x5563571e5990 2023-10-05T15:39:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563570d3350 con 0x5563571e3ec0 2023-10-05T15:39:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.510+0000 7f2e4838cb80 10 client.0 _ll_register_callbacks cb 0x556356f307a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.511+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.511+0000 7f2e2e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e3ec0 0x5563571edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.511+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60806/0 (socket says 172.21.15.17:60806) 2023-10-05T15:39:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.511+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/1900976930 learned_addr learned my addr 172.21.15.17:0/1900976930 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e2e59c700 1 -- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 msgr2=0x5563571f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e2e59c700 1 -- 172.21.15.17:0/1900976930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e4fd0 msgr2=0x5563571ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e4fd0 0x5563571ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e2e59c700 1 -- 172.21.15.17:0/1900976930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e280098a0 con 0x5563571e3ec0 2023-10-05T15:39:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e3ec0 0x5563571edb50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2e28015040 tx=0x7f2e28004f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5544dde5e376348c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.512+0000 7f2e15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:39:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.514+0000 7f2e15ffb700 1 -- 172.21.15.17:0/1900976930 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28005230 con 0x5563571e3ec0 2023-10-05T15:39:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.514+0000 7f2e15ffb700 1 -- 172.21.15.17:0/1900976930 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2e28005390 con 0x5563571e3ec0 2023-10-05T15:39:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.514+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563571d6d50 con 0x5563571e3ec0 2023-10-05T15:39:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.515+0000 7f2e15ffb700 1 -- 172.21.15.17:0/1900976930 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e28005550 con 0x5563571e3ec0 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.515+0000 7f2e4838cb80 10 client.26029 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.515+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x556356f4ac00 con 0x5563571e3ec0 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e15ffb700 1 -- 172.21.15.17:0/1900976930 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563571d6d50 con 0x5563571e3ec0 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e15ffb700 1 -- 172.21.15.17:0/1900976930 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2e28013480 con 0x5563571e3ec0 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e4838cb80 10 client.26029 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e4838cb80 10 client.26029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e4838cb80 20 client.26029 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635720a9e0 0x55635720ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e4838cb80 4 client.26029 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.516+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55635712fdb0 con 0x55635720a9e0 2023-10-05T15:39:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.517+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635720a9e0 0x55635720ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.518+0000 7f2e15ffb700 10 client.26029 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.518+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635720a9e0 0x55635720ce00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5204d3bc2dbfc312 server_cookie=bef13adca2dc68b in_seq=0 out_seq=0 2023-10-05T15:39:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.519+0000 7f2e15ffb700 1 -- 172.21.15.17:0/1900976930 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55635712fdb0 con 0x55635720a9e0 2023-10-05T15:39:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.519+0000 7f2e15ffb700 10 client.26029 handle_command_reply: tid=0 2023-10-05T15:39:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.519+0000 7f2e4838cb80 1 client.26029 shutdown 2023-10-05T15:39:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e3ec0 msgr2=0x5563571edb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e3ec0 0x5563571edb50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2e28015040 tx=0x7f2e28004f10 comp rx=0 tx=0).stop 2023-10-05T15:39:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 shutdown_connections 2023-10-05T15:39:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635720a9e0 0x55635720ce00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e5990 0x5563571f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e3ec0 0x5563571edb50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/1900976930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e4fd0 0x5563571ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 >> 172.21.15.17:0/1900976930 conn(0x556357158200 msgr2=0x5563571de250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e15ffb700 0 client.26029 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 shutdown_connections 2023-10-05T15:39:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.520+0000 7f2e4838cb80 1 -- 172.21.15.17:0/1900976930 wait complete. 2023-10-05T15:39:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.521+0000 7f2e4838cb80 20 client.26029 trim_cache size 0 max 16384 2023-10-05T15:39:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.551+0000 7f2e4838cb80 1 Processor -- start 2023-10-05T15:39:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 -- start start 2023-10-05T15:39:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563572068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563571ed720 con 0x5563571e3ec0 2023-10-05T15:39:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556356fb78c0 con 0x5563571e4fd0 2023-10-05T15:39:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.552+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563571e02f0 con 0x5563571e5990 2023-10-05T15:39:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.553+0000 7f2e2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.553+0000 7f2e2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60822/0 (socket says 172.21.15.17:60822) 2023-10-05T15:39:32.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.553+0000 7f2e2dd9b700 1 -- 172.21.15.17:0/2885993167 learned_addr learned my addr 172.21.15.17:0/2885993167 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.553+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.553+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563572068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e2dd9b700 1 -- 172.21.15.17:0/2885993167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 msgr2=0x5563571ebd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571ebd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e2dd9b700 1 -- 172.21.15.17:0/2885993167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 msgr2=0x5563572068b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563572068b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e2dd9b700 1 -- 172.21.15.17:0/2885993167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556356f881f0 con 0x5563571e4fd0 2023-10-05T15:39:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e2dd9b700 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f5090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009760 tx=0x7f2e24004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83243ded742cc137 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e1d7fa700 1 -- 172.21.15.17:0/2885993167 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24006dc0 con 0x5563571e4fd0 2023-10-05T15:39:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.554+0000 7f2e1d7fa700 1 -- 172.21.15.17:0/2885993167 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e24010bf0 con 0x5563571e4fd0 2023-10-05T15:39:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.555+0000 7f2e1d7fa700 1 -- 172.21.15.17:0/2885993167 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24021a10 con 0x5563571e4fd0 2023-10-05T15:39:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2885993167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 msgr2=0x5563571f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f5090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009760 tx=0x7f2e24004770 comp rx=0 tx=0).stop 2023-10-05T15:39:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2885993167 shutdown_connections 2023-10-05T15:39:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563572068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/2885993167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f5090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2885993167 >> 172.21.15.17:0/2885993167 conn(0x556357158200 msgr2=0x55635720c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2885993167 shutdown_connections 2023-10-05T15:39:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.556+0000 7f2e4838cb80 1 -- 172.21.15.17:0/2885993167 wait complete. 2023-10-05T15:39:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.557+0000 7f2e4838cb80 1 -- start start 2023-10-05T15:39:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.559+0000 7f2e4838cb80 1 Processor -- start 2023-10-05T15:39:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563571f3f50 con 0x5563571e3ec0 2023-10-05T15:39:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563571f40c0 con 0x5563571e4fd0 2023-10-05T15:39:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563571f4280 con 0x5563571e5990 2023-10-05T15:39:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.560+0000 7f2e4838cb80 10 client.0 _ll_register_callbacks cb 0x7f2e28009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571f3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54976/0 (socket says 172.21.15.17:54976) 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/3300431917 learned_addr learned my addr 172.21.15.17:0/3300431917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 msgr2=0x5563571f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/3300431917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 msgr2=0x5563571f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.561+0000 7f2e2ed9d700 1 -- 172.21.15.17:0/3300431917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556356f60250 con 0x5563571e5990 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.562+0000 7f2e2ed9d700 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571f3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e2009b080 tx=0x7f2e20009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96e9dfc34d4abe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.562+0000 7f2e15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.562+0000 7f2e15ffb700 1 -- 172.21.15.17:0/3300431917 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20029510 con 0x5563571e5990 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.562+0000 7f2e15ffb700 1 -- 172.21.15.17:0/3300431917 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2e200aee40 con 0x5563571e5990 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.562+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e2800f040 con 0x5563571e5990 2023-10-05T15:39:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.563+0000 7f2e15ffb700 1 -- 172.21.15.17:0/3300431917 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e2009f240 con 0x5563571e5990 2023-10-05T15:39:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.563+0000 7f2e4838cb80 10 client.26035 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.563+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55635702ea20 con 0x5563571e5990 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e15ffb700 1 -- 172.21.15.17:0/3300431917 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e200a7020 con 0x5563571e5990 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e15ffb700 1 -- 172.21.15.17:0/3300431917 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2e2009a5e0 con 0x5563571e5990 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e4838cb80 10 client.26035 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e4838cb80 10 client.26035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e4838cb80 20 client.26035 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635725ec70 0x556357261090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e4838cb80 4 client.26035 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:39:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.567+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55635712fad0 con 0x55635725ec70 2023-10-05T15:39:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.568+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635725ec70 0x556357261090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.568+0000 7f2e2e59c700 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635725ec70 0x556357261090 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edbdfba970b6417f server_cookie=392305706fe8e1ed in_seq=0 out_seq=0 2023-10-05T15:39:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.568+0000 7f2e15ffb700 10 client.26035 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.585+0000 7f54e65ff700 1 -- 172.21.15.17:0/4098095975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 msgr2=0x7f54e0107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.585+0000 7f54e65ff700 1 --2- 172.21.15.17:0/4098095975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e0107930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f54d40099c0 tx=0x7f54d4009cd0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e15ffb700 1 -- 172.21.15.17:0/3300431917 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55635712fad0 con 0x55635725ec70 2023-10-05T15:39:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e15ffb700 10 client.26035 handle_command_reply: tid=0 2023-10-05T15:39:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 client.26035 shutdown 2023-10-05T15:39:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f54e65ff700 1 -- 172.21.15.17:0/4098095975 shutdown_connections 2023-10-05T15:39:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f54e65ff700 1 --2- 172.21.15.17:0/4098095975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e01090a0 0x7f54e010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f54e65ff700 1 --2- 172.21.15.17:0/4098095975 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e0107930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f54e65ff700 1 --2- 172.21.15.17:0/4098095975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e0108700 0x7f54e0108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f54e65ff700 1 -- 172.21.15.17:0/4098095975 >> 172.21.15.17:0/4098095975 conn(0x7f54e0076480 msgr2=0x7f54e00788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 msgr2=0x5563571f3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571f3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e2009b080 tx=0x7f2e20009260 comp rx=0 tx=0).stop 2023-10-05T15:39:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f54e65ff700 1 -- 172.21.15.17:0/4098095975 shutdown_connections 2023-10-05T15:39:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 shutdown_connections 2023-10-05T15:39:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55635725ec70 0x556357261090 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563571e5990 0x5563571f3a10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563571e3ec0 0x5563571f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 --2- 172.21.15.17:0/3300431917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563571e4fd0 0x5563571f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.586+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 >> 172.21.15.17:0/3300431917 conn(0x556357158200 msgr2=0x5563572068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.587+0000 7f2e15ffb700 0 client.26035 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.587+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 shutdown_connections 2023-10-05T15:39:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.587+0000 7f2e4838cb80 1 -- 172.21.15.17:0/3300431917 wait complete. 2023-10-05T15:39:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.587+0000 7f2e4838cb80 20 client.26035 trim_cache size 0 max 16384 2023-10-05T15:39:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.587+0000 7f54e65ff700 1 -- 172.21.15.17:0/4098095975 wait complete. 2023-10-05T15:39:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:39:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:39:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:39:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.588+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2e180a1680 msgr2=0x7f2e180a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.588+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2e180a1680 0x7f2e180a3b40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5563571e3c60 tx=0x7f2e24009480 comp rx=0 tx=0).stop 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.588+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 msgr2=0x7f2e3019e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.588+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 0x7f2e3019e640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b2e0 tx=0x7f2e2000b630 comp rx=0 tx=0).stop 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 shutdown_connections 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2e180a1680 0x7f2e180a3b40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e30108e00 0x7f2e3019e640 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e300738b0 0x7f2e3019d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 --2- 172.21.15.17:0/2470227542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e30074e90 0x7f2e3019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 >> 172.21.15.17:0/2470227542 conn(0x7f2e300fc4c0 msgr2=0x7f2e300fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 shutdown_connections 2023-10-05T15:39:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f2e349ff700 1 -- 172.21.15.17:0/2470227542 wait complete. 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.589+0000 7f54e65ff700 1 Processor -- start 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.590+0000 7f54e65ff700 1 -- start start 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54e65ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54e65ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e0108700 0x7f54e019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54e65ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e01090a0 0x7f54e01a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54e65ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01a4d60 con 0x7f54e01090a0 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54e65ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01a4ea0 con 0x7f54e0107510 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54e65ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e01a5030 con 0x7f54e0108700 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54dffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e019d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54dffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e019d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60858/0 (socket says 172.21.15.17:60858) 2023-10-05T15:39:32.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.591+0000 7f54dffff700 1 -- 172.21.15.17:0/2190413160 learned_addr learned my addr 172.21.15.17:0/2190413160 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.592+0000 7f54df7fe700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e0108700 0x7f54e019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.592+0000 7f54dffff700 1 -- 172.21.15.17:0/2190413160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e0108700 msgr2=0x7f54e019d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.592+0000 7f54dffff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e0108700 0x7f54e019d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.592+0000 7f54dffff700 1 -- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e01090a0 msgr2=0x7f54e01a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.592+0000 7f54dffff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e01090a0 0x7f54e01a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.592+0000 7f54dffff700 1 -- 172.21.15.17:0/2190413160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40095f0 con 0x7f54e0107510 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.594+0000 7f54dffff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e019d1e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54d40098e0 tx=0x7f54d4009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.594+0000 7f54df7fe700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e0108700 0x7f54e019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.595+0000 7f54dd7fa700 1 -- 172.21.15.17:0/2190413160 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d401d070 con 0x7f54e0107510 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.595+0000 7f54dd7fa700 1 -- 172.21.15.17:0/2190413160 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54d4004100 con 0x7f54e0107510 2023-10-05T15:39:32.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.595+0000 7f54dd7fa700 1 -- 172.21.15.17:0/2190413160 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4005290 con 0x7f54e0107510 2023-10-05T15:39:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.595+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e01a52b0 con 0x7f54e0107510 2023-10-05T15:39:32.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.595+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e01a5620 con 0x7f54e0107510 2023-10-05T15:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.603+0000 7f54dd7fa700 1 -- 172.21.15.17:0/2190413160 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f54d4004980 con 0x7f54e0107510 2023-10-05T15:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 Processor -- start 2023-10-05T15:39:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 -- start start 2023-10-05T15:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 0x5557eaa83680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa84480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa84a60 0x5557eaa84ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea9eb460 con 0x5557eaa84a60 2023-10-05T15:39:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea9dcc20 con 0x5557eaa83260 2023-10-05T15:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.604+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea9da540 con 0x5557eaa83bc0 2023-10-05T15:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.605+0000 7f54dffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa84480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.605+0000 7f54dffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa84480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:55012/0 (socket says 172.21.15.17:55012) 2023-10-05T15:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.605+0000 7f54dffff700 1 -- 172.21.15.17:0/1402353230 learned_addr learned my addr 172.21.15.17:0/1402353230 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.605+0000 7f54df7fe700 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa84a60 0x5557eaa84ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.606+0000 7f54dffff700 1 -- 172.21.15.17:0/1402353230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 msgr2=0x5557eaa83680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.606+0000 7f54dffff700 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 0x5557eaa83680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.606+0000 7f54dffff700 1 -- 172.21.15.17:0/1402353230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa84a60 msgr2=0x5557eaa84ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.606+0000 7f54dffff700 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa84a60 0x5557eaa84ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.606+0000 7f54dffff700 1 -- 172.21.15.17:0/1402353230 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ea800de0 con 0x5557eaa83bc0 2023-10-05T15:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.607+0000 7f54dffff700 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa84480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f54d40d1e00 tx=0x7f54d40d63c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a61b041bd6ebfa05 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.608+0000 7f54dd7fa700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54c80a15d0 0x7f54c80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.608+0000 7f54dd7fa700 1 -- 172.21.15.17:0/2190413160 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54d40cdec0 con 0x7f54e0107510 2023-10-05T15:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.608+0000 7f54c67fc700 1 -- 172.21.15.17:0/1402353230 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4097210 con 0x5557eaa83bc0 2023-10-05T15:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.608+0000 7f54c67fc700 1 -- 172.21.15.17:0/1402353230 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54d409aca0 con 0x5557eaa83bc0 2023-10-05T15:39:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.608+0000 7f54c67fc700 1 -- 172.21.15.17:0/1402353230 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d409a830 con 0x5557eaa83bc0 2023-10-05T15:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.609+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1402353230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 msgr2=0x5557eaa84480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.609+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa84480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f54d40d1e00 tx=0x7f54d40d63c0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54c80a15d0 0x7f54c80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1402353230 shutdown_connections 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa84a60 0x5557eaa84ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 0x5557eaa83680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1402353230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa84480 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1402353230 >> 172.21.15.17:0/1402353230 conn(0x5557ea9f7260 msgr2=0x5557eaa7e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.610+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1402353230 shutdown_connections 2023-10-05T15:39:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.611+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1402353230 wait complete. 2023-10-05T15:39:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.611+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54c80a15d0 0x7f54c80a3a90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f54d800aa90 tx=0x7f54d8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.611+0000 7f54f9f77b80 1 -- start start 2023-10-05T15:39:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.612+0000 7f54f9f77b80 1 Processor -- start 2023-10-05T15:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa8cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83bc0 0x5557eaa8d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa942a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea9d5e30 con 0x5557eaa83260 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea972710 con 0x5557eaa83bc0 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea9723b0 con 0x5557eaa84a60 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54f9f77b80 10 client.0 _ll_register_callbacks cb 0x5557ea7cf800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54dffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa8cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54dffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa8cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32824/0 (socket says 172.21.15.17:32824) 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.613+0000 7f54dffff700 1 -- 172.21.15.17:0/3547135342 learned_addr learned my addr 172.21.15.17:0/3547135342 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54df7fe700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83bc0 0x5557eaa8d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54df7fe700 1 -- 172.21.15.17:0/3547135342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 msgr2=0x5557eaa942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54df7fe700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa942a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54df7fe700 1 -- 172.21.15.17:0/3547135342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 msgr2=0x5557eaa8cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54df7fe700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa8cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.614+0000 7f54df7fe700 1 -- 172.21.15.17:0/3547135342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e01a5620 con 0x5557eaa83bc0 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.615+0000 7f54df7fe700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83bc0 0x5557eaa8d260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f54d000b870 tx=0x7f54d000bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e1881899d612b8b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.615+0000 7f54bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.615+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3547135342 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0003e50 con 0x5557eaa83bc0 2023-10-05T15:39:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.615+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3547135342 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54d001b440 con 0x5557eaa83bc0 2023-10-05T15:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.615+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557eaa75f10 con 0x5557eaa83bc0 2023-10-05T15:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.616+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3547135342 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54d001b600 con 0x5557eaa83bc0 2023-10-05T15:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.616+0000 7f54f9f77b80 10 client.26063 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.616+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5557ea7e9c60 con 0x5557eaa83bc0 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3547135342 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5557eaa75f10 con 0x5557eaa83bc0 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3547135342 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f54d0011830 con 0x5557eaa83bc0 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54f9f77b80 10 client.26063 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54f9f77b80 10 client.26063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54f9f77b80 20 client.26063 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaaa9c10 0x5557eaaac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54f9f77b80 4 client.26063 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.617+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557ea9cee10 con 0x5557eaaa9c10 2023-10-05T15:39:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.618+0000 7f54dffff700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaaa9c10 0x5557eaaac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.620+0000 7f54dffff700 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaaa9c10 0x5557eaaac030 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa30fb2642afc6bf server_cookie=95a6a080064e4a0c in_seq=0 out_seq=0 2023-10-05T15:39:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.620+0000 7f54bf7fe700 10 client.26063 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.621+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3547135342 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557ea9cee10 con 0x5557eaaa9c10 2023-10-05T15:39:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.621+0000 7f54bf7fe700 10 client.26063 handle_command_reply: tid=0 2023-10-05T15:39:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.621+0000 7f54f9f77b80 1 client.26063 shutdown 2023-10-05T15:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.621+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83bc0 msgr2=0x5557eaa8d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.621+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83bc0 0x5557eaa8d260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f54d000b870 tx=0x7f54d000bb80 comp rx=0 tx=0).stop 2023-10-05T15:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 shutdown_connections 2023-10-05T15:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaaa9c10 0x5557eaaac030 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa8cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3547135342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83bc0 0x5557eaa8d260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 >> 172.21.15.17:0/3547135342 conn(0x5557ea9f7260 msgr2=0x5557eaa7df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54bf7fe700 0 client.26063 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.622+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 shutdown_connections 2023-10-05T15:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.623+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3547135342 wait complete. 2023-10-05T15:39:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.624+0000 7f54f9f77b80 20 client.26063 trim_cache size 0 max 16384 2023-10-05T15:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 Processor -- start 2023-10-05T15:39:32.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 -- start start 2023-10-05T15:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 0x5557eaa8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 0x5557eaa94260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa8d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557eaa8c8f0 con 0x5557eaa83bc0 2023-10-05T15:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ea856920 con 0x5557eaa83260 2023-10-05T15:39:32.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.663+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557eaaa9750 con 0x5557eaa84a60 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.664+0000 7f54df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 0x5557eaa94260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.664+0000 7f54df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 0x5557eaa94260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32826/0 (socket says 172.21.15.17:32826) 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.664+0000 7f54df7fe700 1 -- 172.21.15.17:0/1871777302 learned_addr learned my addr 172.21.15.17:0/1871777302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54df7fe700 1 -- 172.21.15.17:0/1871777302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 msgr2=0x5557eaa8d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa8d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54df7fe700 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa8d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54df7fe700 1 -- 172.21.15.17:0/1871777302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 msgr2=0x5557eaa8ccf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:39:32.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54df7fe700 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 0x5557eaa8ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54df7fe700 1 -- 172.21.15.17:0/1871777302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ea827250 con 0x5557eaa83bc0 2023-10-05T15:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.665+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa8d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.666+0000 7f54df7fe700 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 0x5557eaa94260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f54d000f3f0 tx=0x7f54d000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7638dd65478e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.667+0000 7f54c6ffd700 1 -- 172.21.15.17:0/1871777302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0011440 con 0x5557eaa83bc0 2023-10-05T15:39:32.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.667+0000 7f54c6ffd700 1 -- 172.21.15.17:0/1871777302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54d0005030 con 0x5557eaa83bc0 2023-10-05T15:39:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.667+0000 7f54c6ffd700 1 -- 172.21.15.17:0/1871777302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0004990 con 0x5557eaa83bc0 2023-10-05T15:39:32.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.668+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1871777302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 msgr2=0x5557eaa94260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.668+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 0x5557eaa94260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f54d000f3f0 tx=0x7f54d000b630 comp rx=0 tx=0).stop 2023-10-05T15:39:32.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.669+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1871777302 shutdown_connections 2023-10-05T15:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.669+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa84a60 0x5557eaa8d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.669+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa83260 0x5557eaa8ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.669+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/1871777302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83bc0 0x5557eaa94260 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.669+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1871777302 >> 172.21.15.17:0/1871777302 conn(0x5557ea9f7260 msgr2=0x5557eaa8af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.671+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1871777302 shutdown_connections 2023-10-05T15:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.672+0000 7f54f9f77b80 1 -- 172.21.15.17:0/1871777302 wait complete. 2023-10-05T15:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.672+0000 7f54f9f77b80 1 -- start start 2023-10-05T15:39:32.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.672+0000 7f54f9f77b80 1 Processor -- start 2023-10-05T15:39:32.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa93bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa84a60 0x5557eaa921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557eaa928a0 con 0x5557eaa83260 2023-10-05T15:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557eaa929e0 con 0x5557eaa84a60 2023-10-05T15:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557eaa92ba0 con 0x5557eaa83bc0 2023-10-05T15:39:32.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.676+0000 7f54f9f77b80 10 client.0 _ll_register_callbacks cb 0x7f54d0004220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.677+0000 7f54dffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa93bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.677+0000 7f54dffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa93bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32832/0 (socket says 172.21.15.17:32832) 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.677+0000 7f54dffff700 1 -- 172.21.15.17:0/3815188318 learned_addr learned my addr 172.21.15.17:0/3815188318 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.677+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa84a60 0x5557eaa921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.677+0000 7f54df7fe700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54e4b9c700 1 -- 172.21.15.17:0/3815188318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 msgr2=0x5557eaa940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54e4b9c700 1 -- 172.21.15.17:0/3815188318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 msgr2=0x5557eaa93bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa93bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54e4b9c700 1 -- 172.21.15.17:0/3815188318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557ea7e9c60 con 0x5557eaa84a60 2023-10-05T15:39:32.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54e4b9c700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa84a60 0x5557eaa921c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54d800c690 tx=0x7f54d8004c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fabaf38424b5471 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3815188318 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d800dd90 con 0x5557eaa84a60 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3815188318 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f54d8013070 con 0x5557eaa84a60 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.678+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54d409aca0 con 0x5557eaa84a60 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.679+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3815188318 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54d8025440 con 0x5557eaa84a60 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.679+0000 7f54f9f77b80 10 client.26066 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.679+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5557ea7ff2b0 con 0x5557eaa84a60 2023-10-05T15:39:32.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.679+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3815188318 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54d409aca0 con 0x5557eaa84a60 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3815188318 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f54d80255a0 con 0x5557eaa84a60 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54f9f77b80 10 client.26066 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54f9f77b80 10 client.26066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54f9f77b80 20 client.26066 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaafef70 0x5557eab01390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54f9f77b80 4 client.26066 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:39:32.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.680+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5557ea9ceb30 con 0x5557eaafef70 2023-10-05T15:39:32.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.681+0000 7f54dffff700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaafef70 0x5557eab01390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.682+0000 7f54dffff700 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaafef70 0x5557eab01390 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1891f50bcace7d6 server_cookie=8d2aa0259e47d7af in_seq=0 out_seq=0 2023-10-05T15:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.682+0000 7f54bf7fe700 10 client.26066 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.683+0000 7f54bf7fe700 1 -- 172.21.15.17:0/3815188318 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5557ea9ceb30 con 0x5557eaafef70 2023-10-05T15:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.683+0000 7f54bf7fe700 10 client.26066 handle_command_reply: tid=0 2023-10-05T15:39:32.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.683+0000 7f54f9f77b80 1 client.26066 shutdown 2023-10-05T15:39:32.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.683+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa84a60 msgr2=0x5557eaa921c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.683+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa84a60 0x5557eaa921c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54d800c690 tx=0x7f54d8004c50 comp rx=0 tx=0).stop 2023-10-05T15:39:32.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 shutdown_connections 2023-10-05T15:39:32.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5557eaafef70 0x5557eab01390 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5557eaa84a60 0x5557eaa921c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557eaa83260 0x5557eaa93bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 --2- 172.21.15.17:0/3815188318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5557eaa83bc0 0x5557eaa940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 >> 172.21.15.17:0/3815188318 conn(0x5557ea9f7260 msgr2=0x5557eaa8ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54bf7fe700 0 client.26066 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 shutdown_connections 2023-10-05T15:39:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.684+0000 7f54f9f77b80 1 -- 172.21.15.17:0/3815188318 wait complete. 2023-10-05T15:39:32.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.685+0000 7f54f9f77b80 20 client.26066 trim_cache size 0 max 16384 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:39:32.688 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.687+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54c80a15d0 msgr2=0x7f54c80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.687+0000 7f54e65ff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54c80a15d0 0x7f54c80a3a90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f54d800aa90 tx=0x7f54d8009250 comp rx=0 tx=0).stop 2023-10-05T15:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.687+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 msgr2=0x7f54e019d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:32.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.687+0000 7f54e65ff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e019d1e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54d40098e0 tx=0x7f54d4009580 comp rx=0 tx=0).stop 2023-10-05T15:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.688+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 shutdown_connections 2023-10-05T15:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.688+0000 7f54e65ff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f54c80a15d0 0x7f54c80a3a90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.688+0000 7f54e65ff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54e01090a0 0x7f54e01a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.688+0000 7f54e65ff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54e0107510 0x7f54e019d1e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.688+0000 7f54e65ff700 1 --2- 172.21.15.17:0/2190413160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e0108700 0x7f54e019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:32.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.688+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 >> 172.21.15.17:0/2190413160 conn(0x7f54e0076480 msgr2=0x7f54e0078800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.689+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 shutdown_connections 2023-10-05T15:39:32.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:39:32.689+0000 7f54e65ff700 1 -- 172.21.15.17:0/2190413160 wait complete. 2023-10-05T15:39:32.724 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:39:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 55.0 s, 591.8 tps, lat 151.968 ms stddev 97.426 2023-10-05T15:39:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:33 smithi167 ceph-mon[133366]: pgmap v458: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 677 op/s 2023-10-05T15:39:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:33 smithi079 ceph-mon[132936]: pgmap v458: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 677 op/s 2023-10-05T15:39:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:33 smithi017 ceph-mon[129107]: pgmap v458: 129 pgs: 129 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 11 MiB/s wr, 677 op/s 2023-10-05T15:39:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:35 smithi167 ceph-mon[133366]: pgmap v459: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 888 op/s 2023-10-05T15:39:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:35 smithi079 ceph-mon[132936]: pgmap v459: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 888 op/s 2023-10-05T15:39:36.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:35 smithi017 ceph-mon[129107]: pgmap v459: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 888 op/s 2023-10-05T15:39:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:37 smithi167 ceph-mon[133366]: pgmap v460: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 718 op/s 2023-10-05T15:39:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:37 smithi079 ceph-mon[132936]: pgmap v460: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 718 op/s 2023-10-05T15:39:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 60.0 s, 580.8 tps, lat 184.450 ms stddev 221.985 2023-10-05T15:39:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:37 smithi017 ceph-mon[129107]: pgmap v460: 129 pgs: 129 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 718 op/s 2023-10-05T15:39:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:39 smithi167 ceph-mon[133366]: pgmap v461: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 703 op/s 2023-10-05T15:39:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:39 smithi079 ceph-mon[132936]: pgmap v461: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 703 op/s 2023-10-05T15:39:40.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:39 smithi017 ceph-mon[129107]: pgmap v461: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 703 op/s 2023-10-05T15:39:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:41 smithi167 ceph-mon[133366]: pgmap v462: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 728 op/s 2023-10-05T15:39:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:41 smithi079 ceph-mon[132936]: pgmap v462: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 728 op/s 2023-10-05T15:39:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:41 smithi017 ceph-mon[129107]: pgmap v462: 129 pgs: 129 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 728 op/s 2023-10-05T15:39:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 65.0 s, 496.6 tps, lat 211.605 ms stddev 252.252 2023-10-05T15:39:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:43 smithi167 ceph-mon[133366]: pgmap v463: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 636 op/s 2023-10-05T15:39:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:43 smithi079 ceph-mon[132936]: pgmap v463: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 636 op/s 2023-10-05T15:39:44.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:43 smithi017 ceph-mon[129107]: pgmap v463: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 636 op/s 2023-10-05T15:39:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.847+0000 7f5ba5bff700 1 -- 172.21.15.17:0/1003502857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0103150 msgr2=0x7f5ba0103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.847+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/1003502857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0103150 0x7f5ba0103570 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b940098f0 tx=0x7f5b94009c00 comp rx=0 tx=0).stop 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 -- 172.21.15.17:0/1003502857 shutdown_connections 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/1003502857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba010b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/1003502857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0103150 0x7f5ba0103570 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/1003502857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba0104340 0x7f5ba01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 -- 172.21.15.17:0/1003502857 >> 172.21.15.17:0/1003502857 conn(0x7f5ba00fe6a0 msgr2=0x7f5ba0100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 -- 172.21.15.17:0/1003502857 shutdown_connections 2023-10-05T15:39:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.848+0000 7f5ba5bff700 1 -- 172.21.15.17:0/1003502857 wait complete. 2023-10-05T15:39:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.849+0000 7f5ba5bff700 1 Processor -- start 2023-10-05T15:39:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 -- start start 2023-10-05T15:39:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba0103150 0x7f5ba0071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0104340 0x7f5ba00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba0072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00704f0 con 0x7f5ba0104ce0 2023-10-05T15:39:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0070660 con 0x7f5ba0103150 2023-10-05T15:39:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.850+0000 7f5ba5bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0070820 con 0x7f5ba0104340 2023-10-05T15:39:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.851+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba0072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.851+0000 7f5b9ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba0072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46676/0 (socket says 172.21.15.17:46676) 2023-10-05T15:39:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.851+0000 7f5b9ffff700 1 -- 172.21.15.17:0/163017010 learned_addr learned my addr 172.21.15.17:0/163017010 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.851+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba0103150 0x7f5ba0071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.852+0000 7f5b9ffff700 1 -- 172.21.15.17:0/163017010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0104340 msgr2=0x7f5ba00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.852+0000 7f5b9ffff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0104340 0x7f5ba00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.852+0000 7f5b9ffff700 1 -- 172.21.15.17:0/163017010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba0103150 msgr2=0x7f5ba0071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.852+0000 7f5b9ffff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba0103150 0x7f5ba0071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.852+0000 7f5b9ffff700 1 -- 172.21.15.17:0/163017010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94009520 con 0x7f5ba0104ce0 2023-10-05T15:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.852+0000 7f5b9ffff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba0072630 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c110 tx=0x7f5b9800c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.853+0000 7f5b9cff9700 1 -- 172.21.15.17:0/163017010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98017070 con 0x7f5ba0104ce0 2023-10-05T15:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.853+0000 7f5b9cff9700 1 -- 172.21.15.17:0/163017010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b9800e050 con 0x7f5ba0104ce0 2023-10-05T15:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.853+0000 7f5b9cff9700 1 -- 172.21.15.17:0/163017010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98007880 con 0x7f5ba0104ce0 2023-10-05T15:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.853+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba0070aa0 con 0x7f5ba0104ce0 2023-10-05T15:39:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.853+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba0070fb0 con 0x7f5ba0104ce0 2023-10-05T15:39:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.860+0000 7f5b9cff9700 1 -- 172.21.15.17:0/163017010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5b9800cad0 con 0x7f5ba0104ce0 2023-10-05T15:39:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.860+0000 7f5bb95f5b80 1 Processor -- start 2023-10-05T15:39:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.861+0000 7f5bb95f5b80 1 -- start start 2023-10-05T15:39:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228400ec0 0x5572284012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228401fd0 0x557228402450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228409220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557228369400 con 0x557228401fd0 2023-10-05T15:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55722835abc0 con 0x557228400ec0 2023-10-05T15:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572283584e0 con 0x557228402990 2023-10-05T15:39:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228401fd0 0x557228402450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228401fd0 0x557228402450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46680/0 (socket says 172.21.15.17:46680) 2023-10-05T15:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.862+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/4134138808 learned_addr learned my addr 172.21.15.17:0/4134138808 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228400ec0 0x5572284012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9cff9700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5b880a1580 0x7f5b880a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228409220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9cff9700 1 -- 172.21.15.17:0/163017010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5b980cc8d0 con 0x7f5ba0104ce0 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 -- 172.21.15.17:0/4134138808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 msgr2=0x557228409220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228409220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 -- 172.21.15.17:0/4134138808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228401fd0 msgr2=0x557228402450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228401fd0 0x557228402450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.863+0000 7f5b9effd700 1 -- 172.21.15.17:0/4134138808 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55722817ed80 con 0x557228400ec0 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.864+0000 7f5b9effd700 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228400ec0 0x5572284012e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b90001ea0 tx=0x7f5b90009e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0de6b30b1283441 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.864+0000 7f5b9ffff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5b880a1580 0x7f5b880a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.864+0000 7f5b85ffb700 1 -- 172.21.15.17:0/4134138808 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90015e00 con 0x557228400ec0 2023-10-05T15:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.864+0000 7f5b85ffb700 1 -- 172.21.15.17:0/4134138808 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b90007110 con 0x557228400ec0 2023-10-05T15:39:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.864+0000 7f5b85ffb700 1 -- 172.21.15.17:0/4134138808 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90004ac0 con 0x557228400ec0 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.865+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/4134138808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228400ec0 msgr2=0x5572284012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.865+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228400ec0 0x5572284012e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b90001ea0 tx=0x7f5b90009e30 comp rx=0 tx=0).stop 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.865+0000 7f5b9ffff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5b880a1580 0x7f5b880a3a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5b980a1650 tx=0x7f5b98006260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.865+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/4134138808 shutdown_connections 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.865+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228409220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.865+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228400ec0 0x5572284012e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.866+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/4134138808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228401fd0 0x557228402450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.866+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/4134138808 >> 172.21.15.17:0/4134138808 conn(0x557228375200 msgr2=0x5572283fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.866+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/4134138808 shutdown_connections 2023-10-05T15:39:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.866+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/4134138808 wait complete. 2023-10-05T15:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.866+0000 7f5bb95f5b80 1 -- start start 2023-10-05T15:39:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.867+0000 7f5bb95f5b80 1 Processor -- start 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x5572284120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557228353dd0 con 0x557228402990 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572282f06b0 con 0x557228401fd0 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572282f0350 con 0x557228400ec0 2023-10-05T15:39:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5bb95f5b80 10 client.0 _ll_register_callbacks cb 0x55722814d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:59952/0 (socket says 172.21.15.17:59952) 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/176700038 learned_addr learned my addr 172.21.15.17:0/176700038 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.868+0000 7f5b9effd700 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.869+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/176700038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 msgr2=0x55722840ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.869+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.869+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/176700038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 msgr2=0x5572284120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.869+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x5572284120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.869+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/176700038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b90001ce0 con 0x557228401fd0 2023-10-05T15:39:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.870+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840b070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009810 tx=0x7f5b9400f8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a75cec216db41f0c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.870+0000 7f5b7effd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:39:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.870+0000 7f5b7effd700 1 -- 172.21.15.17:0/176700038 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9401d040 con 0x557228401fd0 2023-10-05T15:39:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.870+0000 7f5b7effd700 1 -- 172.21.15.17:0/176700038 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5b94005670 con 0x557228401fd0 2023-10-05T15:39:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.870+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572283f3d50 con 0x557228401fd0 2023-10-05T15:39:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.871+0000 7f5b7effd700 1 -- 172.21.15.17:0/176700038 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b9400b560 con 0x557228401fd0 2023-10-05T15:39:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.871+0000 7f5bb95f5b80 10 client.26075 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.871+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x557228167c00 con 0x557228401fd0 2023-10-05T15:39:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.871+0000 7f5b7effd700 1 -- 172.21.15.17:0/176700038 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5572283f3d50 con 0x557228401fd0 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5b7effd700 1 -- 172.21.15.17:0/176700038 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5b94020070 con 0x557228401fd0 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5bb95f5b80 10 client.26075 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5bb95f5b80 10 client.26075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5bb95f5b80 20 client.26075 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557228416a00 0x557228418e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5bb95f5b80 4 client.26075 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.872+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55722834cdb0 con 0x557228416a00 2023-10-05T15:39:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.873+0000 7f5b9effd700 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557228416a00 0x557228418e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.874+0000 7f5b9effd700 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557228416a00 0x557228418e20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4da1dacac3c03443 server_cookie=54b6d86f8d9cfc39 in_seq=0 out_seq=0 2023-10-05T15:39:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.874+0000 7f5b7effd700 10 client.26075 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.875+0000 7f5b7effd700 1 -- 172.21.15.17:0/176700038 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7f5b90024730 con 0x557228416a00 2023-10-05T15:39:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.875+0000 7f5b7effd700 10 client.26075 handle_command_reply: tid=0 2023-10-05T15:39:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.875+0000 7f5bb95f5b80 1 client.26075 shutdown 2023-10-05T15:39:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.875+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 msgr2=0x55722840b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.875+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840b070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009810 tx=0x7f5b9400f8e0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 shutdown_connections 2023-10-05T15:39:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557228416a00 0x557228418e20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x5572284120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/176700038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840b070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 >> 172.21.15.17:0/176700038 conn(0x557228375200 msgr2=0x5572283fb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.876+0000 7f5b7effd700 0 client.26075 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.877+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 shutdown_connections 2023-10-05T15:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.877+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/176700038 wait complete. 2023-10-05T15:39:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.877+0000 7f5bb95f5b80 20 client.26075 trim_cache size 0 max 16384 2023-10-05T15:39:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 Processor -- start 2023-10-05T15:39:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 -- start start 2023-10-05T15:39:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228400ec0 0x557228408e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x557228412070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228418a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55722840a700 con 0x557228400ec0 2023-10-05T15:39:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.907+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572281d48c0 con 0x557228401fd0 2023-10-05T15:39:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.908+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557228413d20 con 0x557228402990 2023-10-05T15:39:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.908+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x557228412070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.908+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x557228412070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:59954/0 (socket says 172.21.15.17:59954) 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.908+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/835927976 learned_addr learned my addr 172.21.15.17:0/835927976 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.908+0000 7f5b9effd700 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228400ec0 0x557228408e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.908+0000 7f5b9effd700 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228418a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.909+0000 7f5b9effd700 1 -- 172.21.15.17:0/835927976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 msgr2=0x557228412070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.909+0000 7f5b9effd700 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x557228412070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.909+0000 7f5b9effd700 1 -- 172.21.15.17:0/835927976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228400ec0 msgr2=0x557228408e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.909+0000 7f5b9effd700 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228400ec0 0x557228408e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.909+0000 7f5b9effd700 1 -- 172.21.15.17:0/835927976 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572281a51f0 con 0x557228402990 2023-10-05T15:39:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.909+0000 7f5b9effd700 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228418a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557228419700 tx=0x7f5b90007820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb304dc853e4a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.910+0000 7f5b867fc700 1 -- 172.21.15.17:0/835927976 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9001e070 con 0x557228402990 2023-10-05T15:39:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.910+0000 7f5b867fc700 1 -- 172.21.15.17:0/835927976 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b90020070 con 0x557228402990 2023-10-05T15:39:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.910+0000 7f5b867fc700 1 -- 172.21.15.17:0/835927976 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900196d0 con 0x557228402990 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/835927976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 msgr2=0x557228418a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228418a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x557228419700 tx=0x7f5b90007820 comp rx=0 tx=0).stop 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/835927976 shutdown_connections 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228402990 0x557228418a10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228400ec0 0x557228408e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/835927976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x557228412070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/835927976 >> 172.21.15.17:0/835927976 conn(0x557228375200 msgr2=0x5572284097f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.911+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/835927976 shutdown_connections 2023-10-05T15:39:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.912+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/835927976 wait complete. 2023-10-05T15:39:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.912+0000 7f5bb95f5b80 1 -- start start 2023-10-05T15:39:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.912+0000 7f5bb95f5b80 1 Processor -- start 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x557228411070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572284115b0 con 0x557228402990 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557228411720 con 0x557228401fd0 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572284118e0 con 0x557228400ec0 2023-10-05T15:39:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.913+0000 7f5bb95f5b80 10 client.0 _ll_register_callbacks cb 0x7f5b9400f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.914+0000 7f5b9effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x557228411070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.914+0000 7f5b9effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x557228411070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46708/0 (socket says 172.21.15.17:46708) 2023-10-05T15:39:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.914+0000 7f5b9effd700 1 -- 172.21.15.17:0/3411549396 learned_addr learned my addr 172.21.15.17:0/3411549396 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.914+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9effd700 1 -- 172.21.15.17:0/3411549396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 msgr2=0x55722840db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9effd700 1 -- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 msgr2=0x55722840e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9effd700 1 -- 172.21.15.17:0/3411549396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55722817ed80 con 0x557228402990 2023-10-05T15:39:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.915+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:39:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x557228411070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5b900153d0 tx=0x7f5b90007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a4b34689593dbb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5b7effd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:39:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5b7effd700 1 -- 172.21.15.17:0/3411549396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9001e030 con 0x557228402990 2023-10-05T15:39:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5b7effd700 1 -- 172.21.15.17:0/3411549396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5b90007480 con 0x557228402990 2023-10-05T15:39:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b90007110 con 0x557228402990 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5b7effd700 1 -- 172.21.15.17:0/3411549396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b90007640 con 0x557228402990 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5bb95f5b80 10 client.16260 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.916+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55722817d250 con 0x557228402990 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.917+0000 7f5b7effd700 1 -- 172.21.15.17:0/3411549396 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b90007110 con 0x557228402990 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.917+0000 7f5b7effd700 1 -- 172.21.15.17:0/3411549396 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5b90038070 con 0x557228402990 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.918+0000 7f5bb95f5b80 10 client.16260 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.918+0000 7f5bb95f5b80 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.918+0000 7f5bb95f5b80 20 client.16260 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.918+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55722847c090 0x55722847e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.918+0000 7f5bb95f5b80 4 client.16260 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:39:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.918+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55722834cad0 con 0x55722847c090 2023-10-05T15:39:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.919+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55722847c090 0x55722847e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.921+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55722847c090 0x55722847e4b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e936b657e9237ecb server_cookie=ba6e968c7b043689 in_seq=0 out_seq=0 2023-10-05T15:39:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.921+0000 7f5b7effd700 10 client.16260 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.941+0000 7f5b7effd700 1 -- 172.21.15.17:0/3411549396 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55722834cad0 con 0x55722847c090 2023-10-05T15:39:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.941+0000 7f5b7effd700 10 client.16260 handle_command_reply: tid=0 2023-10-05T15:39:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.941+0000 7f5bb95f5b80 1 client.16260 shutdown 2023-10-05T15:39:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.942+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 msgr2=0x557228411070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.942+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x557228411070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5b900153d0 tx=0x7f5b90007040 comp rx=0 tx=0).stop 2023-10-05T15:39:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 shutdown_connections 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55722847c090 0x55722847e4b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557228402990 0x557228411070 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557228400ec0 0x55722840db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 --2- 172.21.15.17:0/3411549396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557228401fd0 0x55722840e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 >> 172.21.15.17:0/3411549396 conn(0x557228375200 msgr2=0x557228408e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5b7effd700 0 client.16260 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 shutdown_connections 2023-10-05T15:39:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 1 -- 172.21.15.17:0/3411549396 wait complete. 2023-10-05T15:39:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.945+0000 7f5bb95f5b80 20 client.16260 trim_cache size 0 max 16384 2023-10-05T15:39:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:39:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:39:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:39:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.946+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5b880a1580 msgr2=0x7f5b880a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.946+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5b880a1580 0x7f5b880a3a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5b980a1650 tx=0x7f5b98006260 comp rx=0 tx=0).stop 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.946+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 msgr2=0x7f5ba0072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.946+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba0072630 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800c110 tx=0x7f5b9800c420 comp rx=0 tx=0).stop 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.947+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 shutdown_connections 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.947+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5b880a1580 0x7f5b880a3a40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.947+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0104ce0 0x7f5ba0072630 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.947+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ba0103150 0x7f5ba0071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.947+0000 7f5ba5bff700 1 --2- 172.21.15.17:0/163017010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0104340 0x7f5ba00720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.947+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 >> 172.21.15.17:0/163017010 conn(0x7f5ba00fe6a0 msgr2=0x7f5ba0100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.949+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 shutdown_connections 2023-10-05T15:39:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:45.950+0000 7f5ba5bff700 1 -- 172.21.15.17:0/163017010 wait complete. 2023-10-05T15:39:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:45 smithi167 ceph-mon[133366]: pgmap v464: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 803 op/s 2023-10-05T15:39:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:45 smithi079 ceph-mon[132936]: pgmap v464: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 803 op/s 2023-10-05T15:39:46.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:45 smithi017 ceph-mon[129107]: pgmap v464: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 803 op/s 2023-10-05T15:39:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:47 smithi167 ceph-mon[133366]: pgmap v465: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.3 MiB/s wr, 579 op/s 2023-10-05T15:39:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:47 smithi079 ceph-mon[132936]: pgmap v465: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.3 MiB/s wr, 579 op/s 2023-10-05T15:39:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 70.0 s, 518.4 tps, lat 195.771 ms stddev 290.932 2023-10-05T15:39:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:47 smithi017 ceph-mon[129107]: pgmap v465: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.3 MiB/s wr, 579 op/s 2023-10-05T15:39:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:49 smithi167 ceph-mon[133366]: pgmap v466: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.4 MiB/s wr, 616 op/s 2023-10-05T15:39:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:49 smithi079 ceph-mon[132936]: pgmap v466: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.4 MiB/s wr, 616 op/s 2023-10-05T15:39:50.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:49 smithi017 ceph-mon[129107]: pgmap v466: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.4 MiB/s wr, 616 op/s 2023-10-05T15:39:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:51 smithi167 ceph-mon[133366]: pgmap v467: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 721 op/s 2023-10-05T15:39:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:51 smithi079 ceph-mon[132936]: pgmap v467: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 721 op/s 2023-10-05T15:39:52.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:51 smithi017 ceph-mon[129107]: pgmap v467: 129 pgs: 129 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 721 op/s 2023-10-05T15:39:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 75.0 s, 540.8 tps, lat 161.462 ms stddev 56.052 2023-10-05T15:39:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:53 smithi167 ceph-mon[133366]: pgmap v468: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 595 op/s 2023-10-05T15:39:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:53 smithi079 ceph-mon[132936]: pgmap v468: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 595 op/s 2023-10-05T15:39:54.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:53 smithi017 ceph-mon[129107]: pgmap v468: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 595 op/s 2023-10-05T15:39:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:55 smithi167 ceph-mon[133366]: pgmap v469: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 851 op/s 2023-10-05T15:39:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:55 smithi079 ceph-mon[132936]: pgmap v469: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 851 op/s 2023-10-05T15:39:56.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:55 smithi017 ceph-mon[129107]: pgmap v469: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 12 MiB/s wr, 851 op/s 2023-10-05T15:39:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:57 smithi167 ceph-mon[133366]: pgmap v470: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.0 MiB/s wr, 665 op/s 2023-10-05T15:39:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:57 smithi079 ceph-mon[132936]: pgmap v470: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.0 MiB/s wr, 665 op/s 2023-10-05T15:39:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 80.0 s, 691.3 tps, lat 162.897 ms stddev 202.192 2023-10-05T15:39:58.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:57 smithi017 ceph-mon[129107]: pgmap v470: 129 pgs: 129 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.0 MiB/s wr, 665 op/s 2023-10-05T15:39:59.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.215+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/4042847519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 msgr2=0x7f2c4810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.215+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/4042847519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4810f950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800b0d0 tx=0x7f2c3800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/4042847519 shutdown_connections 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/4042847519 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4810f950 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/4042847519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c48107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/4042847519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 0x7f2c48108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/4042847519 >> 172.21.15.17:0/4042847519 conn(0x7f2c480764b0 msgr2=0x7f2c480788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/4042847519 shutdown_connections 2023-10-05T15:39:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.216+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/4042847519 wait complete. 2023-10-05T15:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 Processor -- start 2023-10-05T15:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 -- start start 2023-10-05T15:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c4819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 0x7f2c4819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4819ec70 con 0x7f2c48108700 2023-10-05T15:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4819ede0 con 0x7f2c481090a0 2023-10-05T15:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.218+0000 7f2c4f1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4819efa0 con 0x7f2c48107510 2023-10-05T15:39:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4cf9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c4819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4d79c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4cf9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c4819d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:46844/0 (socket says 172.21.15.17:46844) 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4cf9b700 1 -- 172.21.15.17:0/1959728617 learned_addr learned my addr 172.21.15.17:0/1959728617 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4d79c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50820/0 (socket says 172.21.15.17:50820) 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1959728617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 msgr2=0x7f2c4819d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c4819d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 msgr2=0x7f2c4819d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.219+0000 7f2c47fff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 0x7f2c4819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 0x7f2c4819d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1959728617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c38009d00 con 0x7f2c481090a0 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c4819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c47fff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 0x7f2c4819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4819e610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009fd0 tx=0x7f2c3800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c45ffb700 1 -- 172.21.15.17:0/1959728617 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800e040 con 0x7f2c481090a0 2023-10-05T15:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c45ffb700 1 -- 172.21.15.17:0/1959728617 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c38004e60 con 0x7f2c481090a0 2023-10-05T15:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.220+0000 7f2c45ffb700 1 -- 172.21.15.17:0/1959728617 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3801d6d0 con 0x7f2c481090a0 2023-10-05T15:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.221+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4819f220 con 0x7f2c481090a0 2023-10-05T15:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.221+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c481a5a40 con 0x7f2c481090a0 2023-10-05T15:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.227+0000 7f2c62a6fb80 1 Processor -- start 2023-10-05T15:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.228+0000 7f2c45ffb700 1 -- 172.21.15.17:0/1959728617 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2c38005030 con 0x7f2c481090a0 2023-10-05T15:39:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.228+0000 7f2c62a6fb80 1 -- start start 2023-10-05T15:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a87450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a8e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638479ee400 con 0x563847a87990 2023-10-05T15:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638479dfbc0 con 0x563847a86fd0 2023-10-05T15:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638479dd4e0 con 0x563847a85ec0 2023-10-05T15:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c47fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c4cf9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a87450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c47fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a862e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:46850/0 (socket says 172.21.15.17:46850) 2023-10-05T15:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.229+0000 7f2c47fff700 1 -- 172.21.15.17:0/1705017021 learned_addr learned my addr 172.21.15.17:0/1705017021 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c47fff700 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a8e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c47fff700 1 -- 172.21.15.17:0/1705017021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 msgr2=0x563847a87450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c47fff700 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a87450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c47fff700 1 -- 172.21.15.17:0/1705017021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 msgr2=0x563847a8e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c47fff700 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a8e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c47fff700 1 -- 172.21.15.17:0/1705017021 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563847803d80 con 0x563847a85ec0 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.230+0000 7f2c45ffb700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2c340a1500 0x7f2c340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.231+0000 7f2c45ffb700 1 -- 172.21.15.17:0/1959728617 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c380ce3c0 con 0x7f2c481090a0 2023-10-05T15:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.231+0000 7f2c47fff700 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a862e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c30015660 tx=0x7f2c30009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6da8a512ff77f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.231+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2c340a1500 0x7f2c340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.232+0000 7f2c3effd700 1 -- 172.21.15.17:0/1705017021 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30015e80 con 0x563847a85ec0 2023-10-05T15:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.232+0000 7f2c3effd700 1 -- 172.21.15.17:0/1705017021 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c300178a0 con 0x563847a85ec0 2023-10-05T15:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.232+0000 7f2c3effd700 1 -- 172.21.15.17:0/1705017021 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30016830 con 0x563847a85ec0 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2c340a1500 0x7f2c340a39c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2c400096b0 tx=0x7f2c40009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1705017021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 msgr2=0x563847a862e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a862e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2c30015660 tx=0x7f2c30009260 comp rx=0 tx=0).stop 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1705017021 shutdown_connections 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a8e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a862e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1705017021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a87450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1705017021 >> 172.21.15.17:0/1705017021 conn(0x5638479fa200 msgr2=0x563847a80bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1705017021 shutdown_connections 2023-10-05T15:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.233+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1705017021 wait complete. 2023-10-05T15:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.234+0000 7f2c62a6fb80 1 -- start start 2023-10-05T15:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.234+0000 7f2c62a6fb80 1 Processor -- start 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a85ec0 0x563847a8fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a86fd0 0x563847a90170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638479d8dd0 con 0x563847a86fd0 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638479756b0 con 0x563847a85ec0 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563847975350 con 0x563847a87990 2023-10-05T15:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.235+0000 7f2c62a6fb80 10 client.0 _ll_register_callbacks cb 0x5638477d27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.236+0000 7f2c4d79c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.236+0000 7f2c4d79c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:46858/0 (socket says 172.21.15.17:46858) 2023-10-05T15:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.236+0000 7f2c4d79c700 1 -- 172.21.15.17:0/4176141697 learned_addr learned my addr 172.21.15.17:0/4176141697 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.236+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a85ec0 0x563847a8fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.236+0000 7f2c47fff700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a86fd0 0x563847a90170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.237+0000 7f2c4d79c700 1 -- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a85ec0 msgr2=0x563847a8fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.237+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a85ec0 0x563847a8fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.237+0000 7f2c4d79c700 1 -- 172.21.15.17:0/4176141697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a86fd0 msgr2=0x563847a90170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.237+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a86fd0 0x563847a90170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.237+0000 7f2c4d79c700 1 -- 172.21.15.17:0/4176141697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c30015340 con 0x563847a87990 2023-10-05T15:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.238+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a971b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c38097870 tx=0x7f2c3809b230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b07057c57d6631c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.238+0000 7f2c27fff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.238+0000 7f2c27fff700 1 -- 172.21.15.17:0/4176141697 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3809b370 con 0x563847a87990 2023-10-05T15:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.238+0000 7f2c27fff700 1 -- 172.21.15.17:0/4176141697 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c3809f4c0 con 0x563847a87990 2023-10-05T15:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.238+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563847a78d50 con 0x563847a87990 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.238+0000 7f2c27fff700 1 -- 172.21.15.17:0/4176141697 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c380a3670 con 0x563847a87990 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 10 client.26074 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5638477ecc00 con 0x563847a87990 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c27fff700 1 -- 172.21.15.17:0/4176141697 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563847a78d50 con 0x563847a87990 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c27fff700 1 -- 172.21.15.17:0/4176141697 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2c3809b5d0 con 0x563847a87990 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 10 client.26074 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 10 client.26074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 20 client.26074 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847a9b930 0x563847a9dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 4 client.26074 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.239+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638479d1db0 con 0x563847a9b930 2023-10-05T15:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.240+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847a9b930 0x563847a9dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.241+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847a9b930 0x563847a9dd50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39479061ad92a062 server_cookie=7310ad424b7cdaff in_seq=0 out_seq=0 2023-10-05T15:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.242+0000 7f2c27fff700 10 client.26074 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.242+0000 7f2c27fff700 1 -- 172.21.15.17:0/4176141697 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5638479d1db0 con 0x563847a9b930 2023-10-05T15:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.242+0000 7f2c27fff700 10 client.26074 handle_command_reply: tid=0 2023-10-05T15:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 client.26074 shutdown 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 msgr2=0x563847a971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a971b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c38097870 tx=0x7f2c3809b230 comp rx=0 tx=0).stop 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 shutdown_connections 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847a9b930 0x563847a9dd50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a971b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a85ec0 0x563847a8fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/4176141697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a86fd0 0x563847a90170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 >> 172.21.15.17:0/4176141697 conn(0x5638479fa200 msgr2=0x563847a80250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:59.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.243+0000 7f2c27fff700 0 client.26074 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.244+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 shutdown_connections 2023-10-05T15:39:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.244+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/4176141697 wait complete. 2023-10-05T15:39:59.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.244+0000 7f2c62a6fb80 20 client.26074 trim_cache size 0 max 16384 2023-10-05T15:39:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.275+0000 7f2c62a6fb80 1 Processor -- start 2023-10-05T15:39:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 -- start start 2023-10-05T15:39:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a85ec0 0x563847a8de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a97170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a97920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638478598c0 con 0x563847a85ec0 2023-10-05T15:39:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563847a8f0e0 con 0x563847a86fd0 2023-10-05T15:39:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.276+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563847a8f7d0 con 0x563847a87990 2023-10-05T15:39:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.277+0000 7f2c47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a97170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.277+0000 7f2c47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a97170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50836/0 (socket says 172.21.15.17:50836) 2023-10-05T15:39:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.277+0000 7f2c47fff700 1 -- 172.21.15.17:0/3015309014 learned_addr learned my addr 172.21.15.17:0/3015309014 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.277+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a85ec0 0x563847a8de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.277+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a97920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.278+0000 7f2c47fff700 1 -- 172.21.15.17:0/3015309014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 msgr2=0x563847a97920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.278+0000 7f2c47fff700 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a97920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.278+0000 7f2c47fff700 1 -- 172.21.15.17:0/3015309014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a85ec0 msgr2=0x563847a8de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.278+0000 7f2c47fff700 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a85ec0 0x563847a8de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.278+0000 7f2c47fff700 1 -- 172.21.15.17:0/3015309014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56384782a1f0 con 0x563847a86fd0 2023-10-05T15:39:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.279+0000 7f2c47fff700 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a97170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x563847a85c60 tx=0x7f2c30016370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0b0870ca8512c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.279+0000 7f2c3f7fe700 1 -- 172.21.15.17:0/3015309014 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30015e50 con 0x563847a86fd0 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.279+0000 7f2c3f7fe700 1 -- 172.21.15.17:0/3015309014 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c30009e90 con 0x563847a86fd0 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.279+0000 7f2c3f7fe700 1 -- 172.21.15.17:0/3015309014 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c300167a0 con 0x563847a86fd0 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.280+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/3015309014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 msgr2=0x563847a97170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.280+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a97170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x563847a85c60 tx=0x7f2c30016370 comp rx=0 tx=0).stop 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/3015309014 shutdown_connections 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a87990 0x563847a97920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a85ec0 0x563847a8de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/3015309014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a97170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/3015309014 >> 172.21.15.17:0/3015309014 conn(0x5638479fa200 msgr2=0x563847a8e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/3015309014 shutdown_connections 2023-10-05T15:39:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/3015309014 wait complete. 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.281+0000 7f2c62a6fb80 1 -- start start 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.282+0000 7f2c62a6fb80 1 Processor -- start 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.282+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a92a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.282+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a92f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c62a6fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a95eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563847a963f0 con 0x563847a87990 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563847a96560 con 0x563847a86fd0 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c62a6fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563847a96720 con 0x563847a85ec0 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c62a6fb80 10 client.0 _ll_register_callbacks cb 0x5638477d27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a92f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c4d79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a95eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c4d79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a95eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39086/0 (socket says 172.21.15.17:39086) 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1445441072 learned_addr learned my addr 172.21.15.17:0/1445441072 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.283+0000 7f2c47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a92f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50846/0 (socket says 172.21.15.17:50846) 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.284+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a92a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.284+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1445441072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 msgr2=0x563847a92a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.284+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a92a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.284+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 msgr2=0x563847a92f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.284+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a92f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.284+0000 7f2c4d79c700 1 -- 172.21.15.17:0/1445441072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563847803d80 con 0x563847a87990 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.285+0000 7f2c4d79c700 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a95eb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2c38097d90 tx=0x7f2c380099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa4299e94c383aa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.285+0000 7f2c27fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:39:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.286+0000 7f2c27fff700 1 -- 172.21.15.17:0/1445441072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3809b7d0 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.286+0000 7f2c27fff700 1 -- 172.21.15.17:0/1445441072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2c3809f4c0 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.286+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c300178a0 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.286+0000 7f2c27fff700 1 -- 172.21.15.17:0/1445441072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c3809aa70 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c62a6fb80 10 client.16272 fetch_fsmap learned FSMap version 33 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x563847802250 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c27fff700 1 -- 172.21.15.17:0/1445441072 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c300178a0 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c27fff700 1 -- 172.21.15.17:0/1445441072 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2c38065020 con 0x563847a87990 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c62a6fb80 10 client.16272 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c62a6fb80 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.287+0000 7f2c62a6fb80 20 client.16272 populate_metadata read hostname 'smithi017' 2023-10-05T15:39:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.288+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847b00af0 0x563847b02f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.288+0000 7f2c62a6fb80 4 client.16272 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.288+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5638479d1ad0 con 0x563847b00af0 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.289+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847b00af0 0x563847b02f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.292+0000 7f2c4cf9b700 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847b00af0 0x563847b02f10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d81edee745005398 server_cookie=50d1daa7bf8e8610 in_seq=0 out_seq=0 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.292+0000 7f2c27fff700 10 client.16272 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.319+0000 7f2c27fff700 1 -- 172.21.15.17:0/1445441072 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5638479d1ad0 con 0x563847b00af0 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.319+0000 7f2c27fff700 10 client.16272 handle_command_reply: tid=0 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.319+0000 7f2c62a6fb80 1 client.16272 shutdown 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 msgr2=0x563847a95eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a95eb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2c38097d90 tx=0x7f2c380099d0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 shutdown_connections 2023-10-05T15:39:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563847b00af0 0x563847b02f10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563847a87990 0x563847a95eb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563847a85ec0 0x563847a92a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 --2- 172.21.15.17:0/1445441072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563847a86fd0 0x563847a92f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 >> 172.21.15.17:0/1445441072 conn(0x5638479fa200 msgr2=0x563847a8de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.321+0000 7f2c27fff700 0 client.16272 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.325+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 shutdown_connections 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.325+0000 7f2c62a6fb80 1 -- 172.21.15.17:0/1445441072 wait complete. 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.328+0000 7f2c62a6fb80 20 client.16272 trim_cache size 0 max 16384 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:39:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:39:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:39:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:39:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.336+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2c340a1500 msgr2=0x7f2c340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.336+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2c340a1500 0x7f2c340a39c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2c400096b0 tx=0x7f2c40009260 comp rx=0 tx=0).stop 2023-10-05T15:39:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.336+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 msgr2=0x7f2c4819e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.336+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4819e610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009fd0 tx=0x7f2c3800bcd0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.341+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 shutdown_connections 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.341+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2c340a1500 0x7f2c340a39c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.341+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c481090a0 0x7f2c4819e610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.341+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c48107510 0x7f2c4819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.341+0000 7f2c4f1ff700 1 --2- 172.21.15.17:0/1959728617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c48108700 0x7f2c4819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.341+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 >> 172.21.15.17:0/1959728617 conn(0x7f2c480764b0 msgr2=0x7f2c4810bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.346+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 shutdown_connections 2023-10-05T15:39:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:39:59.346+0000 7f2c4f1ff700 1 -- 172.21.15.17:0/1959728617 wait complete. 2023-10-05T15:40:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:59 smithi167 ceph-mon[133366]: pgmap v471: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 758 op/s 2023-10-05T15:40:00.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:39:59 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:40:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:59 smithi079 ceph-mon[132936]: pgmap v471: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 758 op/s 2023-10-05T15:40:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:39:59 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:40:00.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:59 smithi017 ceph-mon[129107]: pgmap v471: 129 pgs: 129 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 758 op/s 2023-10-05T15:40:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:39:59 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:40:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:00 smithi167 ceph-mon[133366]: overall HEALTH_OK 2023-10-05T15:40:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:40:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:40:01.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:00 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:40:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:00 smithi079 ceph-mon[132936]: overall HEALTH_OK 2023-10-05T15:40:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:40:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:40:01.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:00 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:40:01.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:00 smithi017 ceph-mon[129107]: overall HEALTH_OK 2023-10-05T15:40:01.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:40:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:40:01.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:00 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:40:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:01 smithi167 ceph-mon[133366]: pgmap v472: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-05T15:40:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:01 smithi079 ceph-mon[132936]: pgmap v472: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-05T15:40:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:01 smithi017 ceph-mon[129107]: pgmap v472: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-05T15:40:02.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:40:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:02 smithi167 ceph-mon[133366]: pgmap v473: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.4 MiB/s wr, 712 op/s 2023-10-05T15:40:03.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 -- 172.21.15.17:0/1566048602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c4107510 msgr2=0x7ff8c4107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/1566048602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c4107510 0x7ff8c4107930 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009920 tx=0x7ff8bc009c30 comp rx=0 tx=0).stop 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 -- 172.21.15.17:0/1566048602 shutdown_connections 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/1566048602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8c41090a0 0x7ff8c410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/1566048602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c4107510 0x7ff8c4107930 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/1566048602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c4108700 0x7ff8c4108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 -- 172.21.15.17:0/1566048602 >> 172.21.15.17:0/1566048602 conn(0x7ff8c4076480 msgr2=0x7ff8c40788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 -- 172.21.15.17:0/1566048602 shutdown_connections 2023-10-05T15:40:03.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.090+0000 7ff8c9dff700 1 -- 172.21.15.17:0/1566048602 wait complete. 2023-10-05T15:40:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.092+0000 7ff8c9dff700 1 Processor -- start 2023-10-05T15:40:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.092+0000 7ff8c9dff700 1 -- start start 2023-10-05T15:40:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.092+0000 7ff8c9dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c4107510 0x7ff8c407f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.092+0000 7ff8c9dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8c4108700 0x7ff8c407fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c9dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 0x7ff8c4080ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c9dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c4081080 con 0x7ff8c41090a0 2023-10-05T15:40:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c9dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40811f0 con 0x7ff8c4107510 2023-10-05T15:40:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c9dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40813b0 con 0x7ff8c4108700 2023-10-05T15:40:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 0x7ff8c4080ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 0x7ff8c4080ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39106/0 (socket says 172.21.15.17:39106) 2023-10-05T15:40:03.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.093+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2476502904 learned_addr learned my addr 172.21.15.17:0/2476502904 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c4107510 0x7ff8c407f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8c4108700 0x7ff8c407fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2476502904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8c4108700 msgr2=0x7ff8c407fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8c4108700 0x7ff8c407fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2476502904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c4107510 msgr2=0x7ff8c407f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c4107510 0x7ff8c407f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.094+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2476502904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009520 con 0x7ff8c41090a0 2023-10-05T15:40:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.095+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 0x7ff8c4080ab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e940 tx=0x7ff8b400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:03.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.095+0000 7ff8c0ff9700 1 -- 172.21.15.17:0/2476502904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40097b0 con 0x7ff8c41090a0 2023-10-05T15:40:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.095+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c4081630 con 0x7ff8c41090a0 2023-10-05T15:40:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.096+0000 7ff8c0ff9700 1 -- 172.21.15.17:0/2476502904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8b400ee90 con 0x7ff8c41090a0 2023-10-05T15:40:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.096+0000 7ff8c0ff9700 1 -- 172.21.15.17:0/2476502904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4005450 con 0x7ff8c41090a0 2023-10-05T15:40:03.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.096+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c4081b40 con 0x7ff8c41090a0 2023-10-05T15:40:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:02 smithi079 ceph-mon[132936]: pgmap v473: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.4 MiB/s wr, 712 op/s 2023-10-05T15:40:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.103+0000 7ff8dd7bab80 1 Processor -- start 2023-10-05T15:40:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.104+0000 7ff8c0ff9700 1 -- 172.21.15.17:0/2476502904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff8b4004750 con 0x7ff8c41090a0 2023-10-05T15:40:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.104+0000 7ff8dd7bab80 1 -- start start 2023-10-05T15:40:03.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc48680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 0x55f78fc49480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc49a60 0x55f78fc49ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fbb0460 con 0x55f78fc48260 2023-10-05T15:40:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fba1c20 con 0x55f78fc48bc0 2023-10-05T15:40:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fb9f540 con 0x55f78fc49a60 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 0x55f78fc49480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 0x55f78fc49480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50870/0 (socket says 172.21.15.17:50870) 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.105+0000 7ff8c37fe700 1 -- 172.21.15.17:0/29497394 learned_addr learned my addr 172.21.15.17:0/29497394 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc49a60 0x55f78fc49ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c37fe700 1 -- 172.21.15.17:0/29497394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc49a60 msgr2=0x55f78fc49ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc49a60 0x55f78fc49ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c37fe700 1 -- 172.21.15.17:0/29497394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 msgr2=0x55f78fc48680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc48680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.106+0000 7ff8c37fe700 1 -- 172.21.15.17:0/29497394 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f78f9c5de0 con 0x55f78fc48bc0 2023-10-05T15:40:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.107+0000 7ff8c0ff9700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8a40a1550 0x7ff8a40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.108+0000 7ff8c0ff9700 1 -- 172.21.15.17:0/2476502904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff8b4014070 con 0x7ff8c41090a0 2023-10-05T15:40:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.108+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8a40a1550 0x7ff8a40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.108+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 0x55f78fc49480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4108560 tx=0x7ff8bc005b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e63aaf9594d40002 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.109+0000 7ff8b9ffb700 1 -- 172.21.15.17:0/29497394 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc01c040 con 0x55f78fc48bc0 2023-10-05T15:40:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.109+0000 7ff8b9ffb700 1 -- 172.21.15.17:0/29497394 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8bc00f6e0 con 0x55f78fc48bc0 2023-10-05T15:40:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.109+0000 7ff8b9ffb700 1 -- 172.21.15.17:0/29497394 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0055f0 con 0x55f78fc48bc0 2023-10-05T15:40:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/29497394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 msgr2=0x55f78fc49480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 0x55f78fc49480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4108560 tx=0x7ff8bc005b40 comp rx=0 tx=0).stop 2023-10-05T15:40:03.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8a40a1550 0x7ff8a40a3a10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0094a0 tx=0x7ff8ac0091b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/29497394 shutdown_connections 2023-10-05T15:40:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc49a60 0x55f78fc49ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc48680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/29497394 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48bc0 0x55f78fc49480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.110+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/29497394 >> 172.21.15.17:0/29497394 conn(0x55f78fbbc260 msgr2=0x55f78fc43140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.111+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/29497394 shutdown_connections 2023-10-05T15:40:03.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.111+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/29497394 wait complete. 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.112+0000 7ff8dd7bab80 1 -- start start 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.112+0000 7ff8dd7bab80 1 Processor -- start 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc51f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fb9ae30 con 0x55f78fc48260 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fb37710 con 0x55f78fc49a60 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fb373b0 con 0x55f78fc48bc0 2023-10-05T15:40:03.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.113+0000 7ff8dd7bab80 10 client.0 _ll_register_callbacks cb 0x55f78f994800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50882/0 (socket says 172.21.15.17:50882) 2023-10-05T15:40:03.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2403586598 learned_addr learned my addr 172.21.15.17:0/2403586598 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc51f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2403586598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 msgr2=0x55f78fc524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2403586598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 msgr2=0x55f78fc51f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc51f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.114+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2403586598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c41102a0 con 0x55f78fc49a60 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.115+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc594e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40a2090 tx=0x7ff8b400ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d6edc90dd044bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.115+0000 7ff8b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:03.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.115+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2403586598 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b409e170 con 0x55f78fc49a60 2023-10-05T15:40:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.115+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2403586598 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff8b4094e40 con 0x55f78fc49a60 2023-10-05T15:40:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.115+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f78fc3af10 con 0x55f78fc49a60 2023-10-05T15:40:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2403586598 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8b40b7070 con 0x55f78fc49a60 2023-10-05T15:40:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8dd7bab80 10 client.26108 fetch_fsmap learned FSMap version 33 2023-10-05T15:40:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f78f9aec60 con 0x55f78fc49a60 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2403586598 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f78fc3af10 con 0x55f78fc49a60 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2403586598 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff8b4099720 con 0x55f78fc49a60 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8dd7bab80 10 client.26108 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8dd7bab80 10 client.26108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.116+0000 7ff8dd7bab80 20 client.26108 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.117+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fc5ddc0 0x55f78fc601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.117+0000 7ff8dd7bab80 4 client.26108 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.117+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f78fb93e10 con 0x55f78fc5ddc0 2023-10-05T15:40:03.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.117+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fc5ddc0 0x55f78fc601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.118+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fc5ddc0 0x55f78fc601e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7e60dfbe1d1c34 server_cookie=4d63ef410252c1c5 in_seq=0 out_seq=0 2023-10-05T15:40:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.118+0000 7ff8b2ffd700 10 client.26108 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.119+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2403586598 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f78fb93e10 con 0x55f78fc5ddc0 2023-10-05T15:40:03.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.119+0000 7ff8b2ffd700 10 client.26108 handle_command_reply: tid=0 2023-10-05T15:40:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.119+0000 7ff8dd7bab80 1 client.26108 shutdown 2023-10-05T15:40:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.119+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 msgr2=0x55f78fc594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.119+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc594e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40a2090 tx=0x7ff8b400ccc0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 shutdown_connections 2023-10-05T15:40:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fc5ddc0 0x55f78fc601e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc594e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48260 0x55f78fc51f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2403586598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 >> 172.21.15.17:0/2403586598 conn(0x55f78fbbc260 msgr2=0x55f78fc42f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.120+0000 7ff8b2ffd700 0 client.26108 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.121+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 shutdown_connections 2023-10-05T15:40:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.121+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2403586598 wait complete. 2023-10-05T15:40:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.121+0000 7ff8dd7bab80 20 client.26108 trim_cache size 0 max 16384 2023-10-05T15:40:03.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 Processor -- start 2023-10-05T15:40:03.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 -- start start 2023-10-05T15:40:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48260 0x55f78fc5fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc59400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc49a60 0x55f78fc42f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fc51b30 con 0x55f78fc49a60 2023-10-05T15:40:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fa1b920 con 0x55f78fc48260 2023-10-05T15:40:03.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.155+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fc47ee0 con 0x55f78fc48bc0 2023-10-05T15:40:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.156+0000 7ff8c2ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc59400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.156+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc49a60 0x55f78fc42f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.156+0000 7ff8c2ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc59400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:46910/0 (socket says 172.21.15.17:46910) 2023-10-05T15:40:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.156+0000 7ff8c2ffd700 1 -- 172.21.15.17:0/631882382 learned_addr learned my addr 172.21.15.17:0/631882382 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.157+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48260 0x55f78fc5fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.157+0000 7ff8c2ffd700 1 -- 172.21.15.17:0/631882382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48260 msgr2=0x55f78fc5fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.157+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48260 0x55f78fc5fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.157+0000 7ff8c2ffd700 1 -- 172.21.15.17:0/631882382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc49a60 msgr2=0x55f78fc42f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.157+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc49a60 0x55f78fc42f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.157+0000 7ff8c2ffd700 1 -- 172.21.15.17:0/631882382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f78f9ec250 con 0x55f78fc48bc0 2023-10-05T15:40:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.158+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc59400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac019800 tx=0x7ff8ac017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31dd32fb9b0825a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.158+0000 7ff8ba7fc700 1 -- 172.21.15.17:0/631882382 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac01a6f0 con 0x55f78fc48bc0 2023-10-05T15:40:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.158+0000 7ff8ba7fc700 1 -- 172.21.15.17:0/631882382 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8ac00f040 con 0x55f78fc48bc0 2023-10-05T15:40:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.158+0000 7ff8ba7fc700 1 -- 172.21.15.17:0/631882382 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac026b80 con 0x55f78fc48bc0 2023-10-05T15:40:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/631882382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 msgr2=0x55f78fc59400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc59400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac019800 tx=0x7ff8ac017000 comp rx=0 tx=0).stop 2023-10-05T15:40:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/631882382 shutdown_connections 2023-10-05T15:40:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc49a60 0x55f78fc42f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc48260 0x55f78fc5fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/631882382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48bc0 0x55f78fc59400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.159+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/631882382 >> 172.21.15.17:0/631882382 conn(0x55f78fbbc260 msgr2=0x55f78fc41bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.160+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/631882382 shutdown_connections 2023-10-05T15:40:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.160+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/631882382 wait complete. 2023-10-05T15:40:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.160+0000 7ff8dd7bab80 1 -- start start 2023-10-05T15:40:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.161+0000 7ff8dd7bab80 1 Processor -- start 2023-10-05T15:40:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48260 0x55f78fc57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48bc0 0x55f78fc575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fc58b10 con 0x55f78fc48bc0 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fc58c80 con 0x55f78fc49a60 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f78fc58e40 con 0x55f78fc48260 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8dd7bab80 10 client.0 _ll_register_callbacks cb 0x7ff8b4099e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50900/0 (socket says 172.21.15.17:50900) 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.162+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2854573615 learned_addr learned my addr 172.21.15.17:0/2854573615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c2ffd700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48bc0 0x55f78fc575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48260 0x55f78fc57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2854573615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48260 msgr2=0x55f78fc57080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48260 0x55f78fc57080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2854573615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48bc0 msgr2=0x55f78fc575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48bc0 0x55f78fc575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c3fff700 1 -- 172.21.15.17:0/2854573615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac0194e0 con 0x55f78fc49a60 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8c3fff700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc585d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4098580 tx=0x7ff8b409a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b2be9cbd37d57b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.163+0000 7ff8b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.164+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2854573615 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40b7070 con 0x55f78fc49a60 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.164+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2854573615 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff8b4094e40 con 0x55f78fc49a60 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.164+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8bc00f6e0 con 0x55f78fc49a60 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2854573615 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8b409e170 con 0x55f78fc49a60 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 10 client.26114 fetch_fsmap learned FSMap version 33 2023-10-05T15:40:03.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55f78f9c42b0 con 0x55f78fc49a60 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2854573615 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8bc00f6e0 con 0x55f78fc49a60 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2854573615 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff8b4096020 con 0x55f78fc49a60 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 10 client.26114 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 10 client.26114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 20 client.26114 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fcb25e0 0x55f78fcb4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 4 client.26114 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:40:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.165+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f78fb93b30 con 0x55f78fcb25e0 2023-10-05T15:40:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.168+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fcb25e0 0x55f78fcb4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.169+0000 7ff8c37fe700 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fcb25e0 0x55f78fcb4a00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261f40f883489bbc server_cookie=bdd68b512951c9fa in_seq=0 out_seq=0 2023-10-05T15:40:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.169+0000 7ff8b2ffd700 10 client.26114 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.170+0000 7ff8b2ffd700 1 -- 172.21.15.17:0/2854573615 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f78fb93b30 con 0x55f78fcb25e0 2023-10-05T15:40:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.170+0000 7ff8b2ffd700 10 client.26114 handle_command_reply: tid=0 2023-10-05T15:40:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.170+0000 7ff8dd7bab80 1 client.26114 shutdown 2023-10-05T15:40:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.170+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 msgr2=0x55f78fc585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.170+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc585d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4098580 tx=0x7ff8b409a130 comp rx=0 tx=0).stop 2023-10-05T15:40:03.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 shutdown_connections 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55f78fcb25e0 0x55f78fcb4a00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f78fc49a60 0x55f78fc585d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f78fc48260 0x55f78fc57080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 --2- 172.21.15.17:0/2854573615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f78fc48bc0 0x55f78fc575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 >> 172.21.15.17:0/2854573615 conn(0x55f78fbbc260 msgr2=0x55f78fc4fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8b2ffd700 0 client.26114 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.171+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 shutdown_connections 2023-10-05T15:40:03.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.172+0000 7ff8dd7bab80 1 -- 172.21.15.17:0/2854573615 wait complete. 2023-10-05T15:40:03.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:40:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:40:03.174 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:40:03.175 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.172+0000 7ff8dd7bab80 20 client.26114 trim_cache size 0 max 16384 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.173+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8a40a1550 msgr2=0x7ff8a40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.173+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8a40a1550 0x7ff8a40a3a10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0094a0 tx=0x7ff8ac0091b0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.173+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 msgr2=0x7ff8c4080ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.173+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 0x7ff8c4080ab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400e940 tx=0x7ff8b400ec50 comp rx=0 tx=0).stop 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 shutdown_connections 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff8a40a1550 0x7ff8a40a3a10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8c41090a0 0x7ff8c4080ab0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c4107510 0x7ff8c407f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 --2- 172.21.15.17:0/2476502904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8c4108700 0x7ff8c407fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:03.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 >> 172.21.15.17:0/2476502904 conn(0x7ff8c4076480 msgr2=0x7ff8c40787c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:03.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 shutdown_connections 2023-10-05T15:40:03.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:03.174+0000 7ff8c9dff700 1 -- 172.21.15.17:0/2476502904 wait complete. 2023-10-05T15:40:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 85.0 s, 548.0 tps, lat 181.583 ms stddev 241.720 2023-10-05T15:40:03.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:02 smithi017 ceph-mon[129107]: pgmap v473: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.4 MiB/s wr, 712 op/s 2023-10-05T15:40:03.206 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:40:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:05 smithi167 ceph-mon[133366]: pgmap v474: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 886 op/s 2023-10-05T15:40:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:05 smithi079 ceph-mon[132936]: pgmap v474: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 886 op/s 2023-10-05T15:40:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:05 smithi017 ceph-mon[129107]: pgmap v474: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 886 op/s 2023-10-05T15:40:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:07 smithi167 ceph-mon[133366]: pgmap v475: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.1 MiB/s wr, 639 op/s 2023-10-05T15:40:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:07 smithi079 ceph-mon[132936]: pgmap v475: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.1 MiB/s wr, 639 op/s 2023-10-05T15:40:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 90.0 s, 492.6 tps, lat 204.720 ms stddev 304.271 2023-10-05T15:40:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:07 smithi017 ceph-mon[129107]: pgmap v475: 129 pgs: 129 active+clean; 1.2 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.1 MiB/s wr, 639 op/s 2023-10-05T15:40:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:09 smithi167 ceph-mon[133366]: pgmap v476: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 773 op/s 2023-10-05T15:40:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:09 smithi079 ceph-mon[132936]: pgmap v476: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 773 op/s 2023-10-05T15:40:10.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:09 smithi017 ceph-mon[129107]: pgmap v476: 129 pgs: 129 active+clean; 1.2 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 773 op/s 2023-10-05T15:40:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:11 smithi167 ceph-mon[133366]: pgmap v477: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 804 op/s 2023-10-05T15:40:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:11 smithi079 ceph-mon[132936]: pgmap v477: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 804 op/s 2023-10-05T15:40:12.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:11 smithi017 ceph-mon[129107]: pgmap v477: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 804 op/s 2023-10-05T15:40:12.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 -- 172.21.15.17:0/2362361204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580fed90 msgr2=0x7faa580ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 --2- 172.21.15.17:0/2362361204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580fed90 0x7faa580ff1b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faa48009990 tx=0x7faa48009ca0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 -- 172.21.15.17:0/2362361204 shutdown_connections 2023-10-05T15:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 --2- 172.21.15.17:0/2362361204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa58100880 0x7faa58105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 --2- 172.21.15.17:0/2362361204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580fed90 0x7faa580ff1b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 --2- 172.21.15.17:0/2362361204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa580ffec0 0x7faa58100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 -- 172.21.15.17:0/2362361204 >> 172.21.15.17:0/2362361204 conn(0x7faa580fa690 msgr2=0x7faa580fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.606+0000 7faa5dfff700 1 -- 172.21.15.17:0/2362361204 shutdown_connections 2023-10-05T15:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.607+0000 7faa5dfff700 1 -- 172.21.15.17:0/2362361204 wait complete. 2023-10-05T15:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.609+0000 7faa5dfff700 1 Processor -- start 2023-10-05T15:40:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.609+0000 7faa5dfff700 1 -- start start 2023-10-05T15:40:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.609+0000 7faa5dfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 0x7faa5819d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa5dfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580ffec0 0x7faa5819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa5dfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa58100880 0x7faa5819e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa5dfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5819ebc0 con 0x7faa58100880 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa5dfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5819ed30 con 0x7faa580ffec0 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa5dfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5819eef0 con 0x7faa580fed90 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa577fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 0x7faa5819d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa577fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 0x7faa5819d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:56966/0 (socket says 172.21.15.17:56966) 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.610+0000 7faa577fe700 1 -- 172.21.15.17:0/3055119023 learned_addr learned my addr 172.21.15.17:0/3055119023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.611+0000 7faa56ffd700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580ffec0 0x7faa5819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.611+0000 7faa577fe700 1 -- 172.21.15.17:0/3055119023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580ffec0 msgr2=0x7faa5819d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.611+0000 7faa577fe700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580ffec0 0x7faa5819d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.611+0000 7faa577fe700 1 -- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa58100880 msgr2=0x7faa5819e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.611+0000 7faa577fe700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa58100880 0x7faa5819e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.611+0000 7faa577fe700 1 -- 172.21.15.17:0/3055119023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480095f0 con 0x7faa580fed90 2023-10-05T15:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.612+0000 7faa577fe700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 0x7faa5819d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c010 tx=0x7faa48005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.612+0000 7faa54ff9700 1 -- 172.21.15.17:0/3055119023 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4801d070 con 0x7faa580fed90 2023-10-05T15:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.612+0000 7faa54ff9700 1 -- 172.21.15.17:0/3055119023 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa480040c0 con 0x7faa580fed90 2023-10-05T15:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.612+0000 7faa54ff9700 1 -- 172.21.15.17:0/3055119023 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800fd20 con 0x7faa580fed90 2023-10-05T15:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.613+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5819f170 con 0x7faa580fed90 2023-10-05T15:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.613+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5806aab0 con 0x7faa580fed90 2023-10-05T15:40:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.620+0000 7faa54ff9700 1 -- 172.21.15.17:0/3055119023 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faa4800f460 con 0x7faa580fed90 2023-10-05T15:40:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.620+0000 7faa719cdb80 1 Processor -- start 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.620+0000 7faa719cdb80 1 -- start start 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.621+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e5057422e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.621+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505743450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.621+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505743990 0x55e50574a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.621+0000 7faa719cdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5056aa400 con 0x55e505742fd0 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.621+0000 7faa719cdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e50569bbc0 con 0x55e505741ec0 2023-10-05T15:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.621+0000 7faa719cdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5056994e0 con 0x55e505743990 2023-10-05T15:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.622+0000 7faa57fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e5057422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.622+0000 7faa57fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e5057422e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46692/0 (socket says 172.21.15.17:46692) 2023-10-05T15:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.622+0000 7faa57fff700 1 -- 172.21.15.17:0/30774995 learned_addr learned my addr 172.21.15.17:0/30774995 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.622+0000 7faa577fe700 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505743450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.622+0000 7faa56ffd700 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505743990 0x55e50574a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa57fff700 1 -- 172.21.15.17:0/30774995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505743990 msgr2=0x55e50574a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa57fff700 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505743990 0x55e50574a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa57fff700 1 -- 172.21.15.17:0/30774995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 msgr2=0x55e505743450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa57fff700 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505743450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa57fff700 1 -- 172.21.15.17:0/30774995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5054bfd80 con 0x55e505741ec0 2023-10-05T15:40:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa54ff9700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa400a1600 0x7faa400a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa54ff9700 1 -- 172.21.15.17:0/3055119023 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faa480ce210 con 0x7faa580fed90 2023-10-05T15:40:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.623+0000 7faa57fff700 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e5057422e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa5000d190 tx=0x7faa5000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed42b2cbb705989 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.624+0000 7faa577fe700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa400a1600 0x7faa400a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.624+0000 7faa3dffb700 1 -- 172.21.15.17:0/30774995 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50013620 con 0x55e505741ec0 2023-10-05T15:40:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.624+0000 7faa3dffb700 1 -- 172.21.15.17:0/30774995 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa5000de20 con 0x55e505741ec0 2023-10-05T15:40:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.624+0000 7faa3dffb700 1 -- 172.21.15.17:0/30774995 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50012a60 con 0x55e505741ec0 2023-10-05T15:40:12.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 -- 172.21.15.17:0/30774995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 msgr2=0x55e5057422e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa577fe700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa400a1600 0x7faa400a3ac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faa480976c0 tx=0x7faa48009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e5057422e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa5000d190 tx=0x7faa5000d4a0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 -- 172.21.15.17:0/30774995 shutdown_connections 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505743990 0x55e50574a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e5057422e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 --2- 172.21.15.17:0/30774995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505743450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 -- 172.21.15.17:0/30774995 >> 172.21.15.17:0/30774995 conn(0x55e5056b6200 msgr2=0x55e50573cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.625+0000 7faa719cdb80 1 -- 172.21.15.17:0/30774995 shutdown_connections 2023-10-05T15:40:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.626+0000 7faa719cdb80 1 -- 172.21.15.17:0/30774995 wait complete. 2023-10-05T15:40:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.626+0000 7faa719cdb80 1 -- start start 2023-10-05T15:40:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.627+0000 7faa719cdb80 1 Processor -- start 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.627+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505741ec0 0x55e50574bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.627+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e50574c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.628+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505753080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.628+0000 7faa719cdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e505694dd0 con 0x55e505741ec0 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.628+0000 7faa719cdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5056316b0 con 0x55e505743990 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.628+0000 7faa719cdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e505631350 con 0x55e505742fd0 2023-10-05T15:40:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.628+0000 7faa719cdb80 10 client.0 _ll_register_callbacks cb 0x55e50548e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.629+0000 7faa56ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e50574c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.629+0000 7faa57fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505753080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.629+0000 7faa57fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505753080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46694/0 (socket says 172.21.15.17:46694) 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.629+0000 7faa57fff700 1 -- 172.21.15.17:0/455433270 learned_addr learned my addr 172.21.15.17:0/455433270 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.629+0000 7faa57fff700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505741ec0 0x55e50574bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa56ffd700 1 -- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 msgr2=0x55e505753080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa56ffd700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505753080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa56ffd700 1 -- 172.21.15.17:0/455433270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505741ec0 msgr2=0x55e50574bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa56ffd700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505741ec0 0x55e50574bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa56ffd700 1 -- 172.21.15.17:0/455433270 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50008c90 con 0x55e505742fd0 2023-10-05T15:40:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa57fff700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505741ec0 0x55e50574bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa56ffd700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e50574c040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00bea0 tx=0x7faa4c0116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdedb230a8e7b73d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.630+0000 7faa36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.631+0000 7faa36ffd700 1 -- 172.21.15.17:0/455433270 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c004020 con 0x55e505742fd0 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.631+0000 7faa36ffd700 1 -- 172.21.15.17:0/455433270 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faa4c004180 con 0x55e505742fd0 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.631+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e505734d50 con 0x55e505742fd0 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.631+0000 7faa36ffd700 1 -- 172.21.15.17:0/455433270 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa4c004340 con 0x55e505742fd0 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.631+0000 7faa719cdb80 10 client.26104 fetch_fsmap learned FSMap version 33 2023-10-05T15:40:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.631+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e5054a8c00 con 0x55e505742fd0 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa36ffd700 1 -- 172.21.15.17:0/455433270 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e505734d50 con 0x55e505742fd0 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa36ffd700 1 -- 172.21.15.17:0/455433270 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7faa4c01b5a0 con 0x55e505742fd0 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa719cdb80 10 client.26104 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa719cdb80 10 client.26104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa719cdb80 20 client.26104 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa719cdb80 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e505768ac0 0x55e50576aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa719cdb80 4 client.26104 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:40:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.632+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e50568ddb0 con 0x55e505768ac0 2023-10-05T15:40:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.633+0000 7faa57fff700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e505768ac0 0x55e50576aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.633+0000 7faa57fff700 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e505768ac0 0x55e50576aee0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385cf687dd0b2f9 server_cookie=cb0e163567732cbd in_seq=0 out_seq=0 2023-10-05T15:40:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.633+0000 7faa36ffd700 10 client.26104 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.634+0000 7faa36ffd700 1 -- 172.21.15.17:0/455433270 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e50568ddb0 con 0x55e505768ac0 2023-10-05T15:40:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.634+0000 7faa36ffd700 10 client.26104 handle_command_reply: tid=0 2023-10-05T15:40:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.635+0000 7faa719cdb80 1 client.26104 shutdown 2023-10-05T15:40:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 msgr2=0x55e50574c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e50574c040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00bea0 tx=0x7faa4c0116c0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 shutdown_connections 2023-10-05T15:40:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e505768ac0 0x55e50576aee0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505753080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505741ec0 0x55e50574bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 --2- 172.21.15.17:0/455433270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e50574c040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 >> 172.21.15.17:0/455433270 conn(0x55e5056b6200 msgr2=0x55e50573c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa36ffd700 0 client.26104 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.637+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 shutdown_connections 2023-10-05T15:40:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.638+0000 7faa719cdb80 1 -- 172.21.15.17:0/455433270 wait complete. 2023-10-05T15:40:12.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.638+0000 7faa719cdb80 20 client.26104 trim_cache size 0 max 16384 2023-10-05T15:40:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.665+0000 7faa719cdb80 1 Processor -- start 2023-10-05T15:40:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.666+0000 7faa719cdb80 1 -- start start 2023-10-05T15:40:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.666+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e50574a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.666+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e505753040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.666+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505743990 0x55e505746980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.667+0000 7faa719cdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5055158c0 con 0x55e505743990 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.667+0000 7faa719cdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e505737200 con 0x55e505741ec0 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.667+0000 7faa719cdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e505742da0 con 0x55e505742fd0 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.667+0000 7faa57fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e50574a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.667+0000 7faa57fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e50574a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46696/0 (socket says 172.21.15.17:46696) 2023-10-05T15:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.667+0000 7faa57fff700 1 -- 172.21.15.17:0/338264071 learned_addr learned my addr 172.21.15.17:0/338264071 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.668+0000 7faa57fff700 1 -- 172.21.15.17:0/338264071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 msgr2=0x55e505753040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.668+0000 7faa57fff700 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e505753040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.668+0000 7faa57fff700 1 -- 172.21.15.17:0/338264071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505743990 msgr2=0x55e505746980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.668+0000 7faa57fff700 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505743990 0x55e505746980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.668+0000 7faa57fff700 1 -- 172.21.15.17:0/338264071 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5054e61f0 con 0x55e505741ec0 2023-10-05T15:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.668+0000 7faa57fff700 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e50574a7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa5000b020 tx=0x7faa500089c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64e9b1b8c1b02c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.669+0000 7faa3e7fc700 1 -- 172.21.15.17:0/338264071 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50024070 con 0x55e505741ec0 2023-10-05T15:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.669+0000 7faa3e7fc700 1 -- 172.21.15.17:0/338264071 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa50025040 con 0x55e505741ec0 2023-10-05T15:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.669+0000 7faa3e7fc700 1 -- 172.21.15.17:0/338264071 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50012630 con 0x55e505741ec0 2023-10-05T15:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 -- 172.21.15.17:0/338264071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 msgr2=0x55e50574a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e50574a7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa5000b020 tx=0x7faa500089c0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 -- 172.21.15.17:0/338264071 shutdown_connections 2023-10-05T15:40:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505743990 0x55e505746980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505741ec0 0x55e50574a7f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 --2- 172.21.15.17:0/338264071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505742fd0 0x55e505753040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.670+0000 7faa719cdb80 1 -- 172.21.15.17:0/338264071 >> 172.21.15.17:0/338264071 conn(0x55e5056b6200 msgr2=0x55e50576aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.671+0000 7faa719cdb80 1 -- 172.21.15.17:0/338264071 shutdown_connections 2023-10-05T15:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.671+0000 7faa719cdb80 1 -- 172.21.15.17:0/338264071 wait complete. 2023-10-05T15:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.671+0000 7faa719cdb80 1 -- start start 2023-10-05T15:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.672+0000 7faa719cdb80 1 Processor -- start 2023-10-05T15:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 0x55e505750dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505751310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505752320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e505752860 con 0x55e505742fd0 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5057529d0 con 0x55e505743990 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e505752b90 con 0x55e505741ec0 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.673+0000 7faa719cdb80 10 client.0 _ll_register_callbacks cb 0x7faa4c00b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 0x55e505750dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa56ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505751310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 0x55e505750dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57010/0 (socket says 172.21.15.17:57010) 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 -- 172.21.15.17:0/2288619164 learned_addr learned my addr 172.21.15.17:0/2288619164 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505752320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 -- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 msgr2=0x55e505752320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505752320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 -- 172.21.15.17:0/2288619164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 msgr2=0x55e505751310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505751310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.675+0000 7faa57fff700 1 -- 172.21.15.17:0/2288619164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5054bfd80 con 0x55e505741ec0 2023-10-05T15:40:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.676+0000 7faa57fff700 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 0x55e505750dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa5002c000 tx=0x7faa5001f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b9434176f9b35b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.676+0000 7faa36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:40:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.676+0000 7faa36ffd700 1 -- 172.21.15.17:0/2288619164 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50024070 con 0x55e505741ec0 2023-10-05T15:40:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.676+0000 7faa36ffd700 1 -- 172.21.15.17:0/2288619164 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faa50027da0 con 0x55e505741ec0 2023-10-05T15:40:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.676+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa5000de20 con 0x55e505741ec0 2023-10-05T15:40:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.677+0000 7faa36ffd700 1 -- 172.21.15.17:0/2288619164 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa50012590 con 0x55e505741ec0 2023-10-05T15:40:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.677+0000 7faa719cdb80 10 client.26107 fetch_fsmap learned FSMap version 33 2023-10-05T15:40:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.677+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e5054be250 con 0x55e505741ec0 2023-10-05T15:40:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.677+0000 7faa36ffd700 1 -- 172.21.15.17:0/2288619164 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa5000de20 con 0x55e505741ec0 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa36ffd700 1 -- 172.21.15.17:0/2288619164 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 33) v1 ==== 7914+0+0 (secure 0 0 0) 0x7faa500041e0 con 0x55e505741ec0 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa719cdb80 10 client.26107 fetch_fsmap finished waiting for FSMap version 33 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa719cdb80 10 client.26107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa719cdb80 20 client.26107 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa719cdb80 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e5057bd650 0x55e5057bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa719cdb80 4 client.26107 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.678+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e50568dad0 con 0x55e5057bd650 2023-10-05T15:40:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.679+0000 7faa56ffd700 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e5057bd650 0x55e5057bfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.680+0000 7faa56ffd700 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e5057bd650 0x55e5057bfa70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921046e78cff56c9 server_cookie=c31f969411329b6b in_seq=0 out_seq=0 2023-10-05T15:40:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.680+0000 7faa36ffd700 10 client.26107 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:12.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa36ffd700 1 -- 172.21.15.17:0/2288619164 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e50568dad0 con 0x55e5057bd650 2023-10-05T15:40:12.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa36ffd700 10 client.26107 handle_command_reply: tid=0 2023-10-05T15:40:12.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 client.26107 shutdown 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 msgr2=0x55e505750dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 0x55e505750dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa5002c000 tx=0x7faa5001f040 comp rx=0 tx=0).stop 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 shutdown_connections 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55e5057bd650 0x55e5057bfa70 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e505743990 0x55e505752320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa36ffd700 0 client.26107 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:12.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e505741ec0 0x55e505750dd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 --2- 172.21.15.17:0/2288619164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e505742fd0 0x55e505751310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.699+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 >> 172.21.15.17:0/2288619164 conn(0x55e5056b6200 msgr2=0x55e50574a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.700+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 shutdown_connections 2023-10-05T15:40:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.700+0000 7faa719cdb80 1 -- 172.21.15.17:0/2288619164 wait complete. 2023-10-05T15:40:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.700+0000 7faa719cdb80 20 client.26107 trim_cache size 0 max 16384 2023-10-05T15:40:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:40:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:40:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:40:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:40:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa400a1600 msgr2=0x7faa400a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa400a1600 0x7faa400a3ac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faa480976c0 tx=0x7faa48009310 comp rx=0 tx=0).stop 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 msgr2=0x7faa5819d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 0x7faa5819d1a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c010 tx=0x7faa48005740 comp rx=0 tx=0).stop 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 shutdown_connections 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faa400a1600 0x7faa400a3ac0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa58100880 0x7faa5819e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa580fed90 0x7faa5819d1a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 --2- 172.21.15.17:0/3055119023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa580ffec0 0x7faa5819d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 >> 172.21.15.17:0/3055119023 conn(0x7faa580fa690 msgr2=0x7faa580fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 shutdown_connections 2023-10-05T15:40:12.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:12.701+0000 7faa5dfff700 1 -- 172.21.15.17:0/3055119023 wait complete. 2023-10-05T15:40:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 95.0 s, 640.4 tps, lat 150.415 ms stddev 49.969 2023-10-05T15:40:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:13 smithi167 ceph-mon[133366]: pgmap v478: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 699 op/s 2023-10-05T15:40:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:13 smithi079 ceph-mon[132936]: pgmap v478: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 699 op/s 2023-10-05T15:40:14.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:13 smithi017 ceph-mon[129107]: pgmap v478: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 699 op/s 2023-10-05T15:40:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:15 smithi167 ceph-mon[133366]: pgmap v479: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 848 op/s 2023-10-05T15:40:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:15 smithi079 ceph-mon[132936]: pgmap v479: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 848 op/s 2023-10-05T15:40:16.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:15 smithi017 ceph-mon[129107]: pgmap v479: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 848 op/s 2023-10-05T15:40:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:17 smithi167 ceph-mon[133366]: pgmap v480: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 724 op/s 2023-10-05T15:40:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:17 smithi079 ceph-mon[132936]: pgmap v480: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 724 op/s 2023-10-05T15:40:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 100.0 s, 401.6 tps, lat 257.141 ms stddev 315.589 2023-10-05T15:40:18.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:17 smithi017 ceph-mon[129107]: pgmap v480: 129 pgs: 129 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 724 op/s 2023-10-05T15:40:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:19 smithi167 ceph-mon[133366]: pgmap v481: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 791 op/s 2023-10-05T15:40:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:19 smithi079 ceph-mon[132936]: pgmap v481: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 791 op/s 2023-10-05T15:40:20.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:19 smithi017 ceph-mon[129107]: pgmap v481: 129 pgs: 129 active+clean; 1.3 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 791 op/s 2023-10-05T15:40:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:21 smithi167 ceph-mon[133366]: pgmap v482: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 757 op/s 2023-10-05T15:40:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:21 smithi079 ceph-mon[132936]: pgmap v482: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 757 op/s 2023-10-05T15:40:22.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:21 smithi017 ceph-mon[129107]: pgmap v482: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 757 op/s 2023-10-05T15:40:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:22 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:23.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:22 smithi167 ceph-mon[133366]: pgmap v483: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.9 MiB/s wr, 638 op/s 2023-10-05T15:40:23.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:22 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:23.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:22 smithi079 ceph-mon[132936]: pgmap v483: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.9 MiB/s wr, 638 op/s 2023-10-05T15:40:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 105.0 s, 665.6 tps, lat 149.848 ms stddev 68.330 2023-10-05T15:40:23.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:22 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:23.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:22 smithi017 ceph-mon[129107]: pgmap v483: 129 pgs: 129 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.9 MiB/s wr, 638 op/s 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.927+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3852882364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc100eb0 msgr2=0x7f4dbc1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.927+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3852882364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc1012d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009990 tx=0x7f4db8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3852882364 shutdown_connections 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3852882364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dbc102a50 0x7f4dbc109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3852882364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc1012d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3852882364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc102090 0x7f4dbc102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3852882364 >> 172.21.15.17:0/3852882364 conn(0x7f4dbc0fc430 msgr2=0x7f4dbc0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3852882364 shutdown_connections 2023-10-05T15:40:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.928+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3852882364 wait complete. 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.929+0000 7f4dc45ff700 1 Processor -- start 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.929+0000 7f4dc45ff700 1 -- start start 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc45ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc45ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc102090 0x7f4dbc0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc45ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dbc102a50 0x7f4dbc073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc45ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc074e40 con 0x7f4dbc102090 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc45ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc074fb0 con 0x7f4dbc102a50 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc45ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc075170 con 0x7f4dbc100eb0 2023-10-05T15:40:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50202/0 (socket says 172.21.15.17:50202) 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc239b700 1 -- 172.21.15.17:0/3641491158 learned_addr learned my addr 172.21.15.17:0/3641491158 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc2b9c700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dbc102a50 0x7f4dbc073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.930+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc102090 0x7f4dbc0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc239b700 1 -- 172.21.15.17:0/3641491158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dbc102a50 msgr2=0x7f4dbc073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc239b700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dbc102a50 0x7f4dbc073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc239b700 1 -- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc102090 msgr2=0x7f4dbc0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc239b700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc102090 0x7f4dbc0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc239b700 1 -- 172.21.15.17:0/3641491158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80095f0 con 0x7f4dbc100eb0 2023-10-05T15:40:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc102090 0x7f4dbc0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:40:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4dc239b700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc0732a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4db80098e0 tx=0x7f4db80039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.931+0000 7f4db37fe700 1 -- 172.21.15.17:0/3641491158 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db801d070 con 0x7f4dbc100eb0 2023-10-05T15:40:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.932+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc1a54f0 con 0x7f4dbc100eb0 2023-10-05T15:40:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.932+0000 7f4db37fe700 1 -- 172.21.15.17:0/3641491158 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4db800be50 con 0x7f4dbc100eb0 2023-10-05T15:40:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.932+0000 7f4db37fe700 1 -- 172.21.15.17:0/3641491158 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8004ad0 con 0x7f4dbc100eb0 2023-10-05T15:40:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.932+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc1a5910 con 0x7f4dbc100eb0 2023-10-05T15:40:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.935+0000 7f4db37fe700 1 -- 172.21.15.17:0/3641491158 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4db800b9c0 con 0x7f4dbc100eb0 2023-10-05T15:40:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.936+0000 7f4dd7eebb80 1 Processor -- start 2023-10-05T15:40:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 -- start start 2023-10-05T15:40:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c5312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c532450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c539220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c499400 con 0x560f6c530ec0 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c48abc0 con 0x560f6c531fd0 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c4884e0 con 0x560f6c532990 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.937+0000 7f4db37fe700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4da80a1500 0x7f4da80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c532450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4db37fe700 1 -- 172.21.15.17:0/3641491158 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4db80ce180 con 0x7f4dbc100eb0 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c539220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c532450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46018/0 (socket says 172.21.15.17:46018) 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc239b700 1 -- 172.21.15.17:0/342070420 learned_addr learned my addr 172.21.15.17:0/342070420 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc2b9c700 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c5312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc2b9c700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4da80a1500 0x7f4da80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 -- 172.21.15.17:0/342070420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 msgr2=0x560f6c532450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c532450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 -- 172.21.15.17:0/342070420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 msgr2=0x560f6c5312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c5312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 -- 172.21.15.17:0/342070420 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f6c2aed80 con 0x560f6c532990 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc239b700 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c532450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.938+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c539220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc100bd0 tx=0x7f4dac0117a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e7819f0c43a355 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.939+0000 7f4dc2b9c700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4da80a1500 0x7f4da80a39c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ec0 tx=0x7f4db400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.939+0000 7f4db0bfe700 1 -- 172.21.15.17:0/342070420 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0042f0 con 0x560f6c532990 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.939+0000 7f4db0bfe700 1 -- 172.21.15.17:0/342070420 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dac004450 con 0x560f6c532990 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.939+0000 7f4db0bfe700 1 -- 172.21.15.17:0/342070420 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0056c0 con 0x560f6c532990 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.939+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/342070420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 msgr2=0x560f6c539220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.939+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c539220 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc100bd0 tx=0x7f4dac0117a0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/342070420 shutdown_connections 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c539220 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c5312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/342070420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c532450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/342070420 >> 172.21.15.17:0/342070420 conn(0x560f6c4a5200 msgr2=0x560f6c52bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/342070420 shutdown_connections 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/342070420 wait complete. 2023-10-05T15:40:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.940+0000 7f4dd7eebb80 1 -- start start 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 Processor -- start 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c542050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c483dd0 con 0x560f6c531fd0 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c4206b0 con 0x560f6c530ec0 2023-10-05T15:40:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c420350 con 0x560f6c532990 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.941+0000 7f4dd7eebb80 10 client.0 _ll_register_callbacks cb 0x560f6c27d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46022/0 (socket says 172.21.15.17:46022) 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 -- 172.21.15.17:0/2350681021 learned_addr learned my addr 172.21.15.17:0/2350681021 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc2b9c700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c542050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 -- 172.21.15.17:0/2350681021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 msgr2=0x560f6c542050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c542050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 -- 172.21.15.17:0/2350681021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 msgr2=0x560f6c53b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 -- 172.21.15.17:0/2350681021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac009c90 con 0x560f6c530ec0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4dc239b700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53aad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005f50 tx=0x7f4db8099fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7813b0ea493ae6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.942+0000 7f4da5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4da5ffb700 1 -- 172.21.15.17:0/2350681021 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db809a820 con 0x560f6c530ec0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4da5ffb700 1 -- 172.21.15.17:0/2350681021 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4db8005250 con 0x560f6c530ec0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f6c523d50 con 0x560f6c530ec0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4da5ffb700 1 -- 172.21.15.17:0/2350681021 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4db800bc70 con 0x560f6c530ec0 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4dd7eebb80 10 client.26144 fetch_fsmap learned FSMap version 34 2023-10-05T15:40:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560f6c297c00 con 0x560f6c530ec0 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.943+0000 7f4da5ffb700 1 -- 172.21.15.17:0/2350681021 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560f6c523d50 con 0x560f6c530ec0 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4da5ffb700 1 -- 172.21.15.17:0/2350681021 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f4db80b9240 con 0x560f6c530ec0 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dd7eebb80 10 client.26144 fetch_fsmap finished waiting for FSMap version 34 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dd7eebb80 10 client.26144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dd7eebb80 20 client.26144 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c546650 0x560f6c548a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dd7eebb80 4 client.26144 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f6c47cdb0 con 0x560f6c546650 2023-10-05T15:40:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.944+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c546650 0x560f6c548a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.945+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c546650 0x560f6c548a70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bb6d10f2fea5c9 server_cookie=f9c4234410c1cffd in_seq=0 out_seq=0 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.945+0000 7f4da5ffb700 10 client.26144 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4da5ffb700 1 -- 172.21.15.17:0/2350681021 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560f6c47cdb0 con 0x560f6c546650 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4da5ffb700 10 client.26144 handle_command_reply: tid=0 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 client.26144 shutdown 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 msgr2=0x560f6c53aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53aad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4db8005f50 tx=0x7f4db8099fe0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 shutdown_connections 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c546650 0x560f6c548a70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c542050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53aad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/2350681021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4da5ffb700 0 client.26144 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.946+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 >> 172.21.15.17:0/2350681021 conn(0x560f6c4a5200 msgr2=0x560f6c52b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.947+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 shutdown_connections 2023-10-05T15:40:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.947+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/2350681021 wait complete. 2023-10-05T15:40:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.947+0000 7f4dd7eebb80 20 client.26144 trim_cache size 0 max 16384 2023-10-05T15:40:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.975+0000 7f4dd7eebb80 1 Processor -- start 2023-10-05T15:40:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.975+0000 7f4dd7eebb80 1 -- start start 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c53a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c541fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c5357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c3048c0 con 0x560f6c530ec0 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c546190 con 0x560f6c531fd0 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c538a80 con 0x560f6c532990 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c53a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dc1b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c541fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c53a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44738/0 (socket says 172.21.15.17:44738) 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dc1b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c541fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46038/0 (socket says 172.21.15.17:46038) 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.976+0000 7f4dc239b700 1 -- 172.21.15.17:0/4259831688 learned_addr learned my addr 172.21.15.17:0/4259831688 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.977+0000 7f4dc1b9a700 1 -- 172.21.15.17:0/4259831688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 msgr2=0x560f6c5357e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.977+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c5357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.977+0000 7f4dc1b9a700 1 -- 172.21.15.17:0/4259831688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 msgr2=0x560f6c53a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.977+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c53a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.977+0000 7f4dc1b9a700 1 -- 172.21.15.17:0/4259831688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f6c2d51f0 con 0x560f6c531fd0 2023-10-05T15:40:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.979+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c541fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dac000c00 tx=0x7f4dac005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d17c254d172473 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.980+0000 7f4db13ff700 1 -- 172.21.15.17:0/4259831688 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac004270 con 0x560f6c531fd0 2023-10-05T15:40:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.980+0000 7f4db13ff700 1 -- 172.21.15.17:0/4259831688 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dac0281b0 con 0x560f6c531fd0 2023-10-05T15:40:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.980+0000 7f4db13ff700 1 -- 172.21.15.17:0/4259831688 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac003680 con 0x560f6c531fd0 2023-10-05T15:40:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/4259831688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 msgr2=0x560f6c541fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c541fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dac000c00 tx=0x7f4dac005e00 comp rx=0 tx=0).stop 2023-10-05T15:40:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/4259831688 shutdown_connections 2023-10-05T15:40:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c5357e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c530ec0 0x560f6c53a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/4259831688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c531fd0 0x560f6c541fe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.981+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/4259831688 >> 172.21.15.17:0/4259831688 conn(0x560f6c4a5200 msgr2=0x560f6c54d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.984+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/4259831688 shutdown_connections 2023-10-05T15:40:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.984+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/4259831688 wait complete. 2023-10-05T15:40:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.984+0000 7f4dd7eebb80 1 -- start start 2023-10-05T15:40:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.985+0000 7f4dd7eebb80 1 Processor -- start 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c541000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c541540 con 0x560f6c531fd0 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c5416b0 con 0x560f6c530ec0 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6c541820 con 0x560f6c532990 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dd7eebb80 10 client.0 _ll_register_callbacks cb 0x560f6c27d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.986+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.987+0000 7f4dc239b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46040/0 (socket says 172.21.15.17:46040) 2023-10-05T15:40:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.987+0000 7f4dc239b700 1 -- 172.21.15.17:0/1572606078 learned_addr learned my addr 172.21.15.17:0/1572606078 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4dc239b700 1 -- 172.21.15.17:0/1572606078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 msgr2=0x560f6c541000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:40:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4dc239b700 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c541000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4dc239b700 1 -- 172.21.15.17:0/1572606078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 msgr2=0x560f6c53fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4dc239b700 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4dc239b700 1 -- 172.21.15.17:0/1572606078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac01d040 con 0x560f6c530ec0 2023-10-05T15:40:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4dc239b700 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53fab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4db8099480 tx=0x7f4db809ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2b2d9d92d3779b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4da5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4da5ffb700 1 -- 172.21.15.17:0/1572606078 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db809b830 con 0x560f6c530ec0 2023-10-05T15:40:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.988+0000 7f4da5ffb700 1 -- 172.21.15.17:0/1572606078 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4db8005250 con 0x560f6c530ec0 2023-10-05T15:40:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.989+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4dac004450 con 0x560f6c530ec0 2023-10-05T15:40:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.989+0000 7f4da5ffb700 1 -- 172.21.15.17:0/1572606078 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4db800bc70 con 0x560f6c530ec0 2023-10-05T15:40:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.990+0000 7f4dd7eebb80 10 client.26150 fetch_fsmap learned FSMap version 34 2023-10-05T15:40:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.990+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560f6c2ad250 con 0x560f6c530ec0 2023-10-05T15:40:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.990+0000 7f4da5ffb700 1 -- 172.21.15.17:0/1572606078 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dac004450 con 0x560f6c530ec0 2023-10-05T15:40:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.990+0000 7f4da5ffb700 1 -- 172.21.15.17:0/1572606078 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 34) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f4db80a10c0 con 0x560f6c530ec0 2023-10-05T15:40:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dd7eebb80 10 client.26150 fetch_fsmap finished waiting for FSMap version 34 2023-10-05T15:40:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dd7eebb80 10 client.26150 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dd7eebb80 20 client.26150 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c5abc10 0x560f6c5ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dd7eebb80 4 client.26150 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:40:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560f6c47cad0 con 0x560f6c5abc10 2023-10-05T15:40:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.991+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c5abc10 0x560f6c5ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.992+0000 7f4dc1b9a700 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c5abc10 0x560f6c5ae000 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08b38ed8663638e server_cookie=53b4d775bc8906a in_seq=0 out_seq=0 2023-10-05T15:40:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:25.992+0000 7f4da5ffb700 10 client.26150 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.006+0000 7f4da5ffb700 1 -- 172.21.15.17:0/1572606078 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560f6c47cad0 con 0x560f6c5abc10 2023-10-05T15:40:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.006+0000 7f4da5ffb700 10 client.26150 handle_command_reply: tid=0 2023-10-05T15:40:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.006+0000 7f4dd7eebb80 1 client.26150 shutdown 2023-10-05T15:40:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 msgr2=0x560f6c53fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53fab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4db8099480 tx=0x7f4db809ada0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 shutdown_connections 2023-10-05T15:40:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560f6c5abc10 0x560f6c5ae000 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f6c532990 0x560f6c541000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560f6c530ec0 0x560f6c53fab0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 --2- 172.21.15.17:0/1572606078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560f6c531fd0 0x560f6c53fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 >> 172.21.15.17:0/1572606078 conn(0x560f6c4a5200 msgr2=0x560f6c5357e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4da5ffb700 0 client.26150 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 shutdown_connections 2023-10-05T15:40:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.007+0000 7f4dd7eebb80 1 -- 172.21.15.17:0/1572606078 wait complete. 2023-10-05T15:40:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.008+0000 7f4dd7eebb80 20 client.26150 trim_cache size 0 max 16384 2023-10-05T15:40:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:40:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:40:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:40:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:40:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4da80a1500 msgr2=0x7f4da80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4da80a1500 0x7f4da80a39c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ec0 tx=0x7f4db400b040 comp rx=0 tx=0).stop 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 msgr2=0x7f4dbc0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc0732a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4db80098e0 tx=0x7f4db80039f0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 shutdown_connections 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4da80a1500 0x7f4da80a39c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dbc102a50 0x7f4dbc073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc100eb0 0x7f4dbc0732a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 --2- 172.21.15.17:0/3641491158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4dbc102090 0x7f4dbc0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 >> 172.21.15.17:0/3641491158 conn(0x7f4dbc0fc430 msgr2=0x7f4dbc0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.009+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 shutdown_connections 2023-10-05T15:40:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:26.010+0000 7f4dc45ff700 1 -- 172.21.15.17:0/3641491158 wait complete. 2023-10-05T15:40:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:25 smithi167 ceph-mon[133366]: pgmap v484: 129 pgs: 129 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 817 op/s 2023-10-05T15:40:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:25 smithi079 ceph-mon[132936]: pgmap v484: 129 pgs: 129 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 817 op/s 2023-10-05T15:40:26.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:25 smithi017 ceph-mon[129107]: pgmap v484: 129 pgs: 129 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 817 op/s 2023-10-05T15:40:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:27 smithi167 ceph-mon[133366]: pgmap v485: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2023-10-05T15:40:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:27 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:27 smithi079 ceph-mon[132936]: pgmap v485: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2023-10-05T15:40:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:27 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 110.0 s, 474.0 tps, lat 209.647 ms stddev 247.479 2023-10-05T15:40:28.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:27 smithi017 ceph-mon[129107]: pgmap v485: 129 pgs: 129 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2023-10-05T15:40:28.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:27 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:29 smithi167 ceph-mon[133366]: pgmap v486: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.2 MiB/s wr, 684 op/s 2023-10-05T15:40:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:29 smithi079 ceph-mon[132936]: pgmap v486: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.2 MiB/s wr, 684 op/s 2023-10-05T15:40:30.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:29 smithi017 ceph-mon[129107]: pgmap v486: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.2 MiB/s wr, 684 op/s 2023-10-05T15:40:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:31 smithi167 ceph-mon[133366]: pgmap v487: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 687 op/s 2023-10-05T15:40:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:31 smithi079 ceph-mon[132936]: pgmap v487: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 687 op/s 2023-10-05T15:40:32.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:31 smithi017 ceph-mon[129107]: pgmap v487: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 687 op/s 2023-10-05T15:40:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 115.0 s, 696.6 tps, lat 144.310 ms stddev 49.172 2023-10-05T15:40:33.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:40:33.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.566+0000 7f9593dff700 1 -- 172.21.15.17:0/3656981079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c10d4c0 msgr2=0x7f958c10f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.566+0000 7f9593dff700 1 --2- 172.21.15.17:0/3656981079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c10d4c0 0x7f958c10f8b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098f0 tx=0x7f957c009c00 comp rx=0 tx=0).stop 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 -- 172.21.15.17:0/3656981079 shutdown_connections 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 --2- 172.21.15.17:0/3656981079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c10d4c0 0x7f958c10f8b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 --2- 172.21.15.17:0/3656981079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c074ef0 0x7f958c073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 --2- 172.21.15.17:0/3656981079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c073910 0x7f958c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 -- 172.21.15.17:0/3656981079 >> 172.21.15.17:0/3656981079 conn(0x7f958c0fc460 msgr2=0x7f958c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 -- 172.21.15.17:0/3656981079 shutdown_connections 2023-10-05T15:40:33.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.567+0000 7f9593dff700 1 -- 172.21.15.17:0/3656981079 wait complete. 2023-10-05T15:40:33.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.569+0000 7f9593dff700 1 Processor -- start 2023-10-05T15:40:33.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.569+0000 7f9593dff700 1 -- start start 2023-10-05T15:40:33.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f9593dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c073910 0x7f958c109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f9593dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 0x7f958c10a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f9593dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c10d4c0 0x7f958c1ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f9593dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c10d1c0 con 0x7f958c073910 2023-10-05T15:40:33.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f9593dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c10d330 con 0x7f958c10d4c0 2023-10-05T15:40:33.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f9593dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c1ad840 con 0x7f958c074ef0 2023-10-05T15:40:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.570+0000 7f959139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 0x7f958c10a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f959139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 0x7f958c10a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50236/0 (socket says 172.21.15.17:50236) 2023-10-05T15:40:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f959139a700 1 -- 172.21.15.17:0/268124993 learned_addr learned my addr 172.21.15.17:0/268124993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:33.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f9591b9b700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c073910 0x7f958c109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f959239c700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c10d4c0 0x7f958c1ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f9591b9b700 1 -- 172.21.15.17:0/268124993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 msgr2=0x7f958c10a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f9591b9b700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 0x7f958c10a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f9591b9b700 1 -- 172.21.15.17:0/268124993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c10d4c0 msgr2=0x7f958c1ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f9591b9b700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c10d4c0 0x7f958c1ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f9591b9b700 1 -- 172.21.15.17:0/268124993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009520 con 0x7f958c073910 2023-10-05T15:40:33.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.571+0000 7f959139a700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 0x7f958c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:40:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.572+0000 7f9591b9b700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c073910 0x7f958c109ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9584006fd0 tx=0x7f958400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.573+0000 7f9582ffd700 1 -- 172.21.15.17:0/268124993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584011830 con 0x7f958c073910 2023-10-05T15:40:33.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.573+0000 7f9582ffd700 1 -- 172.21.15.17:0/268124993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f958400be30 con 0x7f958c073910 2023-10-05T15:40:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.573+0000 7f9582ffd700 1 -- 172.21.15.17:0/268124993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584010be0 con 0x7f958c073910 2023-10-05T15:40:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.573+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c1adaf0 con 0x7f958c073910 2023-10-05T15:40:33.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.573+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c1adfb0 con 0x7f958c073910 2023-10-05T15:40:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.582+0000 7f95a7733b80 1 Processor -- start 2023-10-05T15:40:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 -- start start 2023-10-05T15:40:33.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b38a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38abc0 0x56510b38b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 0x56510b38bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b2f2460 con 0x56510b38ba60 2023-10-05T15:40:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b2e3c20 con 0x56510b38abc0 2023-10-05T15:40:33.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f95a7733b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b2e1540 con 0x56510b38a260 2023-10-05T15:40:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.583+0000 7f959139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 0x56510b38bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 0x56510b38bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44762/0 (socket says 172.21.15.17:44762) 2023-10-05T15:40:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 -- 172.21.15.17:0/550540499 learned_addr learned my addr 172.21.15.17:0/550540499 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959239c700 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b38a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 -- 172.21.15.17:0/550540499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 msgr2=0x56510b38a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b38a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 -- 172.21.15.17:0/550540499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38abc0 msgr2=0x56510b38b480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:40:33.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38abc0 0x56510b38b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 -- 172.21.15.17:0/550540499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56510b107de0 con 0x56510b38ba60 2023-10-05T15:40:33.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.584+0000 7f959139a700 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 0x56510b38bee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9588003f40 tx=0x7f95880099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b2658f658d450e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:33.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.585+0000 7f9582ffd700 1 -- 172.21.15.17:0/268124993 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9584010dc0 con 0x7f958c073910 2023-10-05T15:40:33.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.585+0000 7f9577fff700 1 -- 172.21.15.17:0/550540499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880048d0 con 0x56510b38ba60 2023-10-05T15:40:33.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.585+0000 7f9577fff700 1 -- 172.21.15.17:0/550540499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f958800f040 con 0x56510b38ba60 2023-10-05T15:40:33.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.585+0000 7f9577fff700 1 -- 172.21.15.17:0/550540499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958800e8b0 con 0x56510b38ba60 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 -- 172.21.15.17:0/550540499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 msgr2=0x56510b38bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 0x56510b38bee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9588003f40 tx=0x7f95880099e0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 -- 172.21.15.17:0/550540499 shutdown_connections 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38ba60 0x56510b38bee0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b38a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 --2- 172.21.15.17:0/550540499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38abc0 0x56510b38b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.586+0000 7f95a7733b80 1 -- 172.21.15.17:0/550540499 >> 172.21.15.17:0/550540499 conn(0x56510b2fe260 msgr2=0x56510b385140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:33.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.587+0000 7f9582ffd700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95780a1600 0x7f95780a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.588+0000 7f9582ffd700 1 -- 172.21.15.17:0/268124993 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f95840cc990 con 0x7f958c073910 2023-10-05T15:40:33.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.589+0000 7f959139a700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95780a1600 0x7f95780a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.590+0000 7f95a7733b80 1 -- 172.21.15.17:0/550540499 shutdown_connections 2023-10-05T15:40:33.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.591+0000 7f959139a700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95780a1600 0x7f95780a3ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9588003f10 tx=0x7f9588000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:33.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.591+0000 7f95a7733b80 1 -- 172.21.15.17:0/550540499 wait complete. 2023-10-05T15:40:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.592+0000 7f95a7733b80 1 -- start start 2023-10-05T15:40:33.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.593+0000 7f95a7733b80 1 Processor -- start 2023-10-05T15:40:33.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b394620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b2dce30 con 0x56510b38abc0 2023-10-05T15:40:33.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b279710 con 0x56510b38ba60 2023-10-05T15:40:33.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b2793b0 con 0x56510b38a260 2023-10-05T15:40:33.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f95a7733b80 10 client.0 _ll_register_callbacks cb 0x56510b0d6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f959239c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f959239c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46062/0 (socket says 172.21.15.17:46062) 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.594+0000 7f959239c700 1 -- 172.21.15.17:0/2899710147 learned_addr learned my addr 172.21.15.17:0/2899710147 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f9591b9b700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f959139a700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b394620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f9591b9b700 1 -- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 msgr2=0x56510b39b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f9591b9b700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f9591b9b700 1 -- 172.21.15.17:0/2899710147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 msgr2=0x56510b394620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f9591b9b700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b394620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.595+0000 7f9591b9b700 1 -- 172.21.15.17:0/2899710147 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9588003bf0 con 0x56510b38a260 2023-10-05T15:40:33.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f9591b9b700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3940e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9584009fd0 tx=0x7f9584099290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20fba9f9d0ba73c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95757fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95757fa700 1 -- 172.21.15.17:0/2899710147 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95840b92b0 con 0x56510b38a260 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95757fa700 1 -- 172.21.15.17:0/2899710147 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f95840998b0 con 0x56510b38a260 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56510b37cf10 con 0x56510b38a260 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f959139a700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b394620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95757fa700 1 -- 172.21.15.17:0/2899710147 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f958409da00 con 0x56510b38a260 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95a7733b80 10 client.26131 fetch_fsmap learned FSMap version 35 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.596+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x56510b0f0c60 con 0x56510b38a260 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95757fa700 1 -- 172.21.15.17:0/2899710147 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56510b37cf10 con 0x56510b38a260 2023-10-05T15:40:33.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95757fa700 1 -- 172.21.15.17:0/2899710147 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 35) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f95840a17b0 con 0x56510b38a260 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95a7733b80 10 client.26131 fetch_fsmap finished waiting for FSMap version 35 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95a7733b80 10 client.26131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95a7733b80 20 client.26131 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95a7733b80 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b3b0ef0 0x56510b3b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95a7733b80 4 client.26131 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.597+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56510b2d5e10 con 0x56510b3b0ef0 2023-10-05T15:40:33.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.598+0000 7f959139a700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b3b0ef0 0x56510b3b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.599+0000 7f959139a700 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b3b0ef0 0x56510b3b3310 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316d58f03e1f7d05 server_cookie=7bb1703b0dba692d in_seq=0 out_seq=0 2023-10-05T15:40:33.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.599+0000 7f95757fa700 10 client.26131 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:33.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.600+0000 7f95757fa700 1 -- 172.21.15.17:0/2899710147 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56510b2d5e10 con 0x56510b3b0ef0 2023-10-05T15:40:33.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.600+0000 7f95757fa700 10 client.26131 handle_command_reply: tid=0 2023-10-05T15:40:33.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.600+0000 7f95a7733b80 1 client.26131 shutdown 2023-10-05T15:40:33.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 msgr2=0x56510b3940e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3940e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9584009fd0 tx=0x7f9584099290 comp rx=0 tx=0).stop 2023-10-05T15:40:33.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 shutdown_connections 2023-10-05T15:40:33.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b3b0ef0 0x56510b3b3310 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3940e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 --2- 172.21.15.17:0/2899710147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b394620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 >> 172.21.15.17:0/2899710147 conn(0x56510b2fe260 msgr2=0x56510b384ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:33.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.601+0000 7f95757fa700 0 client.26131 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:33.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.603+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 shutdown_connections 2023-10-05T15:40:33.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.603+0000 7f95a7733b80 1 -- 172.21.15.17:0/2899710147 wait complete. 2023-10-05T15:40:33.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.603+0000 7f95a7733b80 20 client.26131 trim_cache size 0 max 16384 2023-10-05T15:40:33.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.634+0000 7f95a7733b80 1 Processor -- start 2023-10-05T15:40:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.636+0000 7f95a7733b80 1 -- start start 2023-10-05T15:40:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.636+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.636+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b39b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.637+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b38eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.637+0000 7f95a7733b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b393cb0 con 0x56510b38abc0 2023-10-05T15:40:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.637+0000 7f95a7733b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b15d920 con 0x56510b38ba60 2023-10-05T15:40:33.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.637+0000 7f95a7733b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b393590 con 0x56510b38a260 2023-10-05T15:40:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.637+0000 7f959139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b39b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f9591b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b39b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44790/0 (socket says 172.21.15.17:44790) 2023-10-05T15:40:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959139a700 1 -- 172.21.15.17:0/1253817895 learned_addr learned my addr 172.21.15.17:0/1253817895 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:33.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959239c700 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b38eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959239c700 1 -- 172.21.15.17:0/1253817895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 msgr2=0x56510b3b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959239c700 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959239c700 1 -- 172.21.15.17:0/1253817895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 msgr2=0x56510b39b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959239c700 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b39b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.638+0000 7f959239c700 1 -- 172.21.15.17:0/1253817895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56510b381140 con 0x56510b38ba60 2023-10-05T15:40:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.639+0000 7f959239c700 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b38eb30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56510b3842e0 tx=0x7f957c005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb203cc83676fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.640+0000 7f9580bff700 1 -- 172.21.15.17:0/1253817895 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c00f890 con 0x56510b38ba60 2023-10-05T15:40:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.640+0000 7f9580bff700 1 -- 172.21.15.17:0/1253817895 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f957c01d040 con 0x56510b38ba60 2023-10-05T15:40:33.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.640+0000 7f9580bff700 1 -- 172.21.15.17:0/1253817895 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c005680 con 0x56510b38ba60 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 -- 172.21.15.17:0/1253817895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 msgr2=0x56510b38eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b38eb30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x56510b3842e0 tx=0x7f957c005d20 comp rx=0 tx=0).stop 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 -- 172.21.15.17:0/1253817895 shutdown_connections 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b38eb30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38a260 0x56510b3b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 --2- 172.21.15.17:0/1253817895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38abc0 0x56510b39b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.641+0000 7f95a7733b80 1 -- 172.21.15.17:0/1253817895 >> 172.21.15.17:0/1253817895 conn(0x56510b2fe260 msgr2=0x56510b392c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.642+0000 7f95a7733b80 1 -- 172.21.15.17:0/1253817895 shutdown_connections 2023-10-05T15:40:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.642+0000 7f95a7733b80 1 -- 172.21.15.17:0/1253817895 wait complete. 2023-10-05T15:40:33.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.642+0000 7f95a7733b80 1 -- start start 2023-10-05T15:40:33.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 Processor -- start 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38a260 0x56510b399830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38abc0 0x56510b399d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b39aa00 con 0x56510b38a260 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b39ab70 con 0x56510b38ba60 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510b39ad30 con 0x56510b38abc0 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.643+0000 7f95a7733b80 10 client.0 _ll_register_callbacks cb 0x7f9584099680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38abc0 0x56510b399d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38abc0 0x56510b399d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50272/0 (socket says 172.21.15.17:50272) 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959139a700 1 -- 172.21.15.17:0/312636473 learned_addr learned my addr 172.21.15.17:0/312636473 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:33.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959239c700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f9591b9b700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38a260 0x56510b399830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959239c700 1 -- 172.21.15.17:0/312636473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38abc0 msgr2=0x56510b399d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959239c700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38abc0 0x56510b399d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959239c700 1 -- 172.21.15.17:0/312636473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38a260 msgr2=0x56510b399830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959239c700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38a260 0x56510b399830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.644+0000 7f959239c700 1 -- 172.21.15.17:0/312636473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c110260 con 0x56510b38ba60 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.645+0000 7f9591b9b700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38a260 0x56510b399830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.645+0000 7f959239c700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39a2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f957c00a010 tx=0x7f957c00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ed13e625b92cf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.645+0000 7f95757fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.645+0000 7f95757fa700 1 -- 172.21.15.17:0/312636473 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c00f890 con 0x56510b38ba60 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.646+0000 7f95757fa700 1 -- 172.21.15.17:0/312636473 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f957c003880 con 0x56510b38ba60 2023-10-05T15:40:33.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.646+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f958800f040 con 0x56510b38ba60 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.646+0000 7f95757fa700 1 -- 172.21.15.17:0/312636473 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f957c005090 con 0x56510b38ba60 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.646+0000 7f95a7733b80 10 client.26165 fetch_fsmap learned FSMap version 35 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.646+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x56510b12e250 con 0x56510b38ba60 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95757fa700 1 -- 172.21.15.17:0/312636473 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f958800f040 con 0x56510b38ba60 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95757fa700 1 -- 172.21.15.17:0/312636473 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f957c02a040 con 0x56510b38ba60 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95a7733b80 10 client.26165 fetch_fsmap finished waiting for FSMap version 35 2023-10-05T15:40:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95a7733b80 10 client.26165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:33.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95a7733b80 20 client.26165 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:33.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95a7733b80 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b4054f0 0x56510b407910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:33.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95a7733b80 4 client.26165 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:40:33.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.647+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56510b2d5b30 con 0x56510b4054f0 2023-10-05T15:40:33.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.648+0000 7f9591b9b700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b4054f0 0x56510b407910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.649+0000 7f9591b9b700 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b4054f0 0x56510b407910 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5684f7270ce9c59e server_cookie=ba3e890156322b2a in_seq=0 out_seq=0 2023-10-05T15:40:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.649+0000 7f95757fa700 10 client.26165 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.649+0000 7f95757fa700 1 -- 172.21.15.17:0/312636473 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56510b2d5b30 con 0x56510b4054f0 2023-10-05T15:40:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.649+0000 7f95757fa700 10 client.26165 handle_command_reply: tid=0 2023-10-05T15:40:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.649+0000 7f95a7733b80 1 client.26165 shutdown 2023-10-05T15:40:33.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 msgr2=0x56510b39a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39a2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f957c00a010 tx=0x7f957c00b790 comp rx=0 tx=0).stop 2023-10-05T15:40:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 shutdown_connections 2023-10-05T15:40:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56510b4054f0 0x56510b407910 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56510b38ba60 0x56510b39a2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56510b38a260 0x56510b399830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 --2- 172.21.15.17:0/312636473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56510b38abc0 0x56510b399d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 >> 172.21.15.17:0/312636473 conn(0x56510b2fe260 msgr2=0x56510b3b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.650+0000 7f95757fa700 0 client.26165 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.651+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 shutdown_connections 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.651+0000 7f95a7733b80 1 -- 172.21.15.17:0/312636473 wait complete. 2023-10-05T15:40:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.651+0000 7f95a7733b80 20 client.26165 trim_cache size 0 max 16384 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:40:33.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:40:33.656 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:40:33.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.653+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95780a1600 msgr2=0x7f95780a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.653+0000 7f9593dff700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95780a1600 0x7f95780a3ac0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9588003f10 tx=0x7f9588000f40 comp rx=0 tx=0).stop 2023-10-05T15:40:33.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.653+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c073910 msgr2=0x7f958c109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:33.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.653+0000 7f9593dff700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c073910 0x7f958c109ba0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9584006fd0 tx=0x7f958400b730 comp rx=0 tx=0).stop 2023-10-05T15:40:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.654+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 shutdown_connections 2023-10-05T15:40:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.654+0000 7f9593dff700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95780a1600 0x7f95780a3ac0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.654+0000 7f9593dff700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f958c10d4c0 0x7f958c1ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.654+0000 7f9593dff700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f958c073910 0x7f958c109ba0 secure :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9584006fd0 tx=0x7f958400b730 comp rx=0 tx=0).stop 2023-10-05T15:40:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.654+0000 7f9593dff700 1 --2- 172.21.15.17:0/268124993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f958c074ef0 0x7f958c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.654+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 >> 172.21.15.17:0/268124993 conn(0x7f958c0fc460 msgr2=0x7f958c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.656+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 shutdown_connections 2023-10-05T15:40:33.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:40:33.657+0000 7f9593dff700 1 -- 172.21.15.17:0/268124993 wait complete. 2023-10-05T15:40:33.689 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:40:33.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:33 smithi017 ceph-mon[129107]: pgmap v488: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2023-10-05T15:40:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:33 smithi167 ceph-mon[133366]: pgmap v488: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2023-10-05T15:40:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:33 smithi079 ceph-mon[132936]: pgmap v488: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2023-10-05T15:40:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:35 smithi167 ceph-mon[133366]: pgmap v489: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 854 op/s 2023-10-05T15:40:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:35 smithi079 ceph-mon[132936]: pgmap v489: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 854 op/s 2023-10-05T15:40:36.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:35 smithi017 ceph-mon[129107]: pgmap v489: 129 pgs: 129 active+clean; 1.3 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 854 op/s 2023-10-05T15:40:38.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:37 smithi167 ceph-mon[133366]: pgmap v490: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.1 MiB/s wr, 671 op/s 2023-10-05T15:40:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:37 smithi079 ceph-mon[132936]: pgmap v490: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.1 MiB/s wr, 671 op/s 2023-10-05T15:40:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 120.0 s, 555.4 tps, lat 179.470 ms stddev 236.336 2023-10-05T15:40:38.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:37 smithi017 ceph-mon[129107]: pgmap v490: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.1 MiB/s wr, 671 op/s 2023-10-05T15:40:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.249+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2282503847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 msgr2=0x7f7a3810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.249+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2282503847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a3810d670 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009990 tx=0x7f7a28009ca0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.250+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2282503847 shutdown_connections 2023-10-05T15:40:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.250+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2282503847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a3810d670 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.250+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2282503847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a38107eb0 0x7f7a3810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.250+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2282503847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a3810a820 0x7f7a3810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.250+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2282503847 >> 172.21.15.17:0/2282503847 conn(0x7f7a3806dd10 msgr2=0x7f7a38070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.251+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2282503847 shutdown_connections 2023-10-05T15:40:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.251+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2282503847 wait complete. 2023-10-05T15:40:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.253+0000 7f7a3cbff700 1 Processor -- start 2023-10-05T15:40:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.254+0000 7f7a3cbff700 1 -- start start 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a3cbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a38107eb0 0x7f7a381a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a3cbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a3810a820 0x7f7a381a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a3cbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a381a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a3cbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381a7260 con 0x7f7a38107eb0 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a3cbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381a73d0 con 0x7f7a3810a820 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a3cbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381a7590 con 0x7f7a3810d1f0 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a3810a820 0x7f7a381a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a3810a820 0x7f7a381a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55814/0 (socket says 172.21.15.17:55814) 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a35d9b700 1 -- 172.21.15.17:0/2604097056 learned_addr learned my addr 172.21.15.17:0/2604097056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.255+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a381a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a3659c700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a38107eb0 0x7f7a381a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a36d9d700 1 -- 172.21.15.17:0/2604097056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a3810a820 msgr2=0x7f7a381a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a3810a820 0x7f7a381a5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a36d9d700 1 -- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a38107eb0 msgr2=0x7f7a381a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a38107eb0 0x7f7a381a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a36d9d700 1 -- 172.21.15.17:0/2604097056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280095f0 con 0x7f7a3810d1f0 2023-10-05T15:40:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.256+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a381a6c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a28005950 tx=0x7f7a2800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.257+0000 7f7a2f7fe700 1 -- 172.21.15.17:0/2604097056 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2801d070 con 0x7f7a3810d1f0 2023-10-05T15:40:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.257+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a381a7810 con 0x7f7a3810d1f0 2023-10-05T15:40:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.257+0000 7f7a2f7fe700 1 -- 172.21.15.17:0/2604097056 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a2800bd70 con 0x7f7a3810d1f0 2023-10-05T15:40:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.257+0000 7f7a2f7fe700 1 -- 172.21.15.17:0/2604097056 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28004110 con 0x7f7a3810d1f0 2023-10-05T15:40:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.257+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a381ae030 con 0x7f7a3810d1f0 2023-10-05T15:40:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.262+0000 7f7a5047fb80 1 Processor -- start 2023-10-05T15:40:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.266+0000 7f7a2f7fe700 1 -- 172.21.15.17:0/2604097056 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7a280038b0 con 0x7f7a3810d1f0 2023-10-05T15:40:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a2f7fe700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7a1c0a15d0 0x7f7a1c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 -- start start 2023-10-05T15:40:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a2f7fe700 1 -- 172.21.15.17:0/2604097056 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7a280cde50 con 0x7f7a3810d1f0 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c44512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4451fd0 0x5562c4452450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 0x5562c4459220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c43b9400 con 0x5562c4451fd0 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c43aabc0 con 0x5562c4452990 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.269+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c43a84e0 con 0x5562c4450ec0 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7a1c0a15d0 0x7f7a1c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 0x5562c4459220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 0x5562c4459220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55830/0 (socket says 172.21.15.17:55830) 2023-10-05T15:40:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 -- 172.21.15.17:0/3184110281 learned_addr learned my addr 172.21.15.17:0/3184110281 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a3659c700 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c44512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 -- 172.21.15.17:0/3184110281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 msgr2=0x5562c44512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c44512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 -- 172.21.15.17:0/3184110281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4451fd0 msgr2=0x5562c4452450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4451fd0 0x5562c4452450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.270+0000 7f7a36d9d700 1 -- 172.21.15.17:0/3184110281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562c41ced80 con 0x5562c4452990 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.271+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 0x5562c4459220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a2809aeb0 tx=0x7f7a2809ab30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf90d063fa823a98 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.271+0000 7f7a2cff9700 1 -- 172.21.15.17:0/3184110281 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2809af20 con 0x5562c4452990 2023-10-05T15:40:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.271+0000 7f7a2cff9700 1 -- 172.21.15.17:0/3184110281 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a2809f070 con 0x5562c4452990 2023-10-05T15:40:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.271+0000 7f7a2cff9700 1 -- 172.21.15.17:0/3184110281 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2809a670 con 0x5562c4452990 2023-10-05T15:40:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.272+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3184110281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 msgr2=0x5562c4459220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.272+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 0x5562c4459220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7a2809aeb0 tx=0x7f7a2809ab30 comp rx=0 tx=0).stop 2023-10-05T15:40:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.272+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7a1c0a15d0 0x7f7a1c0a3a90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400ae90 tx=0x7f7a2400a8a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.276+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3184110281 shutdown_connections 2023-10-05T15:40:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.276+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4452990 0x5562c4459220 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.276+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c44512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.276+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3184110281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4451fd0 0x5562c4452450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.276+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3184110281 >> 172.21.15.17:0/3184110281 conn(0x5562c43c5200 msgr2=0x5562c444bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.277+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3184110281 shutdown_connections 2023-10-05T15:40:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.277+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3184110281 wait complete. 2023-10-05T15:40:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.278+0000 7f7a5047fb80 1 -- start start 2023-10-05T15:40:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.278+0000 7f7a5047fb80 1 Processor -- start 2023-10-05T15:40:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c445acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c4461cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c43a3dd0 con 0x5562c4452990 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c43406b0 con 0x5562c4451fd0 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c4340350 con 0x5562c4450ec0 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a5047fb80 10 client.0 _ll_register_callbacks cb 0x5562c419d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c445acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c445acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55842/0 (socket says 172.21.15.17:55842) 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.279+0000 7f7a35d9b700 1 -- 172.21.15.17:0/2498846846 learned_addr learned my addr 172.21.15.17:0/2498846846 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a35d9b700 1 -- 172.21.15.17:0/2498846846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 msgr2=0x5562c445a770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a35d9b700 1 -- 172.21.15.17:0/2498846846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 msgr2=0x5562c4461cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c4461cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a35d9b700 1 -- 172.21.15.17:0/2498846846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a381ae030 con 0x5562c4451fd0 2023-10-05T15:40:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c445acb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a24012a30 tx=0x7f7a24004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c38355f6b91b7e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.280+0000 7f7a19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.281+0000 7f7a19ffb700 1 -- 172.21.15.17:0/2498846846 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012ea0 con 0x5562c4451fd0 2023-10-05T15:40:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.281+0000 7f7a19ffb700 1 -- 172.21.15.17:0/2498846846 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7a2400ec50 con 0x5562c4451fd0 2023-10-05T15:40:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.281+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562c4443d50 con 0x5562c4451fd0 2023-10-05T15:40:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.282+0000 7f7a19ffb700 1 -- 172.21.15.17:0/2498846846 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a2400aaa0 con 0x5562c4451fd0 2023-10-05T15:40:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.282+0000 7f7a5047fb80 10 client.26174 fetch_fsmap learned FSMap version 35 2023-10-05T15:40:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.282+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5562c41b7c00 con 0x5562c4451fd0 2023-10-05T15:40:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.282+0000 7f7a19ffb700 1 -- 172.21.15.17:0/2498846846 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562c4443d50 con 0x5562c4451fd0 2023-10-05T15:40:39.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.282+0000 7f7a19ffb700 1 -- 172.21.15.17:0/2498846846 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7a2401a070 con 0x5562c4451fd0 2023-10-05T15:40:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.284+0000 7f7a5047fb80 10 client.26174 fetch_fsmap finished waiting for FSMap version 35 2023-10-05T15:40:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.284+0000 7f7a5047fb80 10 client.26174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.284+0000 7f7a5047fb80 20 client.26174 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.284+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c4466600 0x5562c4468a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.284+0000 7f7a5047fb80 4 client.26174 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:40:39.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.284+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562c439cdb0 con 0x5562c4466600 2023-10-05T15:40:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.285+0000 7f7a3659c700 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c4466600 0x5562c4468a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.286+0000 7f7a19ffb700 10 client.26174 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.286+0000 7f7a3659c700 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c4466600 0x5562c4468a20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca6029ae3523765f server_cookie=dafb930308f678fa in_seq=0 out_seq=0 2023-10-05T15:40:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.287+0000 7f7a19ffb700 1 -- 172.21.15.17:0/2498846846 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5562c439cdb0 con 0x5562c4466600 2023-10-05T15:40:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.287+0000 7f7a19ffb700 10 client.26174 handle_command_reply: tid=0 2023-10-05T15:40:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.287+0000 7f7a5047fb80 1 client.26174 shutdown 2023-10-05T15:40:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 msgr2=0x5562c445acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c445acb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a24012a30 tx=0x7f7a24004750 comp rx=0 tx=0).stop 2023-10-05T15:40:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 shutdown_connections 2023-10-05T15:40:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c4466600 0x5562c4468a20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c4461cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a19ffb700 0 client.26174 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/2498846846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c445acb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 >> 172.21.15.17:0/2498846846 conn(0x5562c43c5200 msgr2=0x5562c444b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.288+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 shutdown_connections 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.289+0000 7f7a5047fb80 1 -- 172.21.15.17:0/2498846846 wait complete. 2023-10-05T15:40:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.289+0000 7f7a5047fb80 20 client.26174 trim_cache size 0 max 16384 2023-10-05T15:40:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.315+0000 7f7a5047fb80 1 Processor -- start 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.315+0000 7f7a5047fb80 1 -- start start 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c445aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c42248c0 con 0x5562c4452990 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c439cdb0 con 0x5562c4451fd0 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c4459c20 con 0x5562c4450ec0 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a3659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55848/0 (socket says 172.21.15.17:55848) 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a35d9b700 1 -- 172.21.15.17:0/1977954011 learned_addr learned my addr 172.21.15.17:0/1977954011 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.316+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c445aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a35d9b700 1 -- 172.21.15.17:0/1977954011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 msgr2=0x5562c445a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a35d9b700 1 -- 172.21.15.17:0/1977954011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 msgr2=0x5562c445aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c445aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a35d9b700 1 -- 172.21.15.17:0/1977954011 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562c41f51f0 con 0x5562c4451fd0 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c445aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:40:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.317+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7a2401e500 tx=0x7f7a24005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe6aca7430a0e7b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.318+0000 7f7a2d7fa700 1 -- 172.21.15.17:0/1977954011 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2401e970 con 0x5562c4451fd0 2023-10-05T15:40:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.319+0000 7f7a2d7fa700 1 -- 172.21.15.17:0/1977954011 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a2400ac50 con 0x5562c4451fd0 2023-10-05T15:40:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.319+0000 7f7a2d7fa700 1 -- 172.21.15.17:0/1977954011 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240276c0 con 0x5562c4451fd0 2023-10-05T15:40:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 -- 172.21.15.17:0/1977954011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 msgr2=0x5562c4461cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7a2401e500 tx=0x7f7a24005e50 comp rx=0 tx=0).stop 2023-10-05T15:40:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 -- 172.21.15.17:0/1977954011 shutdown_connections 2023-10-05T15:40:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4452990 0x5562c445aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4450ec0 0x5562c445a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/1977954011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461cb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 -- 172.21.15.17:0/1977954011 >> 172.21.15.17:0/1977954011 conn(0x5562c43c5200 msgr2=0x5562c4455660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 -- 172.21.15.17:0/1977954011 shutdown_connections 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.320+0000 7f7a5047fb80 1 -- 172.21.15.17:0/1977954011 wait complete. 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.321+0000 7f7a5047fb80 1 -- start start 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.321+0000 7f7a5047fb80 1 Processor -- start 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4450ec0 0x5562c44615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4452990 0x5562c445fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c44601e0 con 0x5562c4450ec0 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c4460320 con 0x5562c4451fd0 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562c44604e0 con 0x5562c4452990 2023-10-05T15:40:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a5047fb80 10 client.0 _ll_register_callbacks cb 0x7f7a24012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a3659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4450ec0 0x5562c44615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55862/0 (socket says 172.21.15.17:55862) 2023-10-05T15:40:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.322+0000 7f7a35d9b700 1 -- 172.21.15.17:0/3225085209 learned_addr learned my addr 172.21.15.17:0/3225085209 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.323+0000 7f7a36d9d700 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4452990 0x5562c445fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.323+0000 7f7a35d9b700 1 -- 172.21.15.17:0/3225085209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4452990 msgr2=0x5562c445fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.323+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4452990 0x5562c445fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.323+0000 7f7a35d9b700 1 -- 172.21.15.17:0/3225085209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4450ec0 msgr2=0x5562c44615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.323+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4450ec0 0x5562c44615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.323+0000 7f7a35d9b700 1 -- 172.21.15.17:0/3225085209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562c41b7c00 con 0x5562c4451fd0 2023-10-05T15:40:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.326+0000 7f7a35d9b700 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400b010 tx=0x7f7a2400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe458974957471c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.326+0000 7f7a19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:40:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.326+0000 7f7a19ffb700 1 -- 172.21.15.17:0/3225085209 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24005440 con 0x5562c4451fd0 2023-10-05T15:40:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.326+0000 7f7a19ffb700 1 -- 172.21.15.17:0/3225085209 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7a240055a0 con 0x5562c4451fd0 2023-10-05T15:40:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.327+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562c439cad0 con 0x5562c4451fd0 2023-10-05T15:40:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.328+0000 7f7a19ffb700 1 -- 172.21.15.17:0/3225085209 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a2400ac50 con 0x5562c4451fd0 2023-10-05T15:40:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.328+0000 7f7a5047fb80 10 client.26180 fetch_fsmap learned FSMap version 35 2023-10-05T15:40:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.328+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5562c41cd250 con 0x5562c4451fd0 2023-10-05T15:40:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.328+0000 7f7a19ffb700 1 -- 172.21.15.17:0/3225085209 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562c439cad0 con 0x5562c4451fd0 2023-10-05T15:40:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.328+0000 7f7a19ffb700 1 -- 172.21.15.17:0/3225085209 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 35) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7a2401a070 con 0x5562c4451fd0 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a5047fb80 10 client.26180 fetch_fsmap finished waiting for FSMap version 35 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a5047fb80 10 client.26180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a5047fb80 20 client.26180 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c44bb490 0x5562c44bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a5047fb80 4 client.26180 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5562c41eff10 con 0x5562c44bb490 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.329+0000 7f7a3659c700 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c44bb490 0x5562c44bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.330+0000 7f7a3659c700 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c44bb490 0x5562c44bd8b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d99407dba54cd7 server_cookie=e637eb69a9a4c747 in_seq=0 out_seq=0 2023-10-05T15:40:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.330+0000 7f7a19ffb700 10 client.26180 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.347+0000 7f7a19ffb700 1 -- 172.21.15.17:0/3225085209 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5562c41eff10 con 0x5562c44bb490 2023-10-05T15:40:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.347+0000 7f7a19ffb700 10 client.26180 handle_command_reply: tid=0 2023-10-05T15:40:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.347+0000 7f7a5047fb80 1 client.26180 shutdown 2023-10-05T15:40:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.347+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 msgr2=0x5562c4461af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.347+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400b010 tx=0x7f7a2400ec80 comp rx=0 tx=0).stop 2023-10-05T15:40:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 shutdown_connections 2023-10-05T15:40:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5562c44bb490 0x5562c44bd8b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562c4452990 0x5562c445fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5562c4450ec0 0x5562c44615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 --2- 172.21.15.17:0/3225085209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5562c4451fd0 0x5562c4461af0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 >> 172.21.15.17:0/3225085209 conn(0x5562c43c5200 msgr2=0x5562c445a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a19ffb700 0 client.26180 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 shutdown_connections 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.348+0000 7f7a5047fb80 1 -- 172.21.15.17:0/3225085209 wait complete. 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.350+0000 7f7a5047fb80 20 client.26180 trim_cache size 0 max 16384 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:40:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:40:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.351+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7a1c0a15d0 msgr2=0x7f7a1c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.351+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7a1c0a15d0 0x7f7a1c0a3a90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400ae90 tx=0x7f7a2400a8a0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.351+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 msgr2=0x7f7a381a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.351+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a381a6c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a28005950 tx=0x7f7a2800f690 comp rx=0 tx=0).stop 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 shutdown_connections 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7a1c0a15d0 0x7f7a1c0a3a90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a3810d1f0 0x7f7a381a6c00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a38107eb0 0x7f7a381a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 --2- 172.21.15.17:0/2604097056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a3810a820 0x7f7a381a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 >> 172.21.15.17:0/2604097056 conn(0x7f7a3806dd10 msgr2=0x7f7a3810c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 shutdown_connections 2023-10-05T15:40:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:39.353+0000 7f7a3cbff700 1 -- 172.21.15.17:0/2604097056 wait complete. 2023-10-05T15:40:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:39 smithi167 ceph-mon[133366]: pgmap v491: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 741 op/s 2023-10-05T15:40:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:39 smithi079 ceph-mon[132936]: pgmap v491: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 741 op/s 2023-10-05T15:40:40.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:39 smithi017 ceph-mon[129107]: pgmap v491: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.8 MiB/s wr, 741 op/s 2023-10-05T15:40:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:41 smithi167 ceph-mon[133366]: pgmap v492: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 796 op/s 2023-10-05T15:40:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:41 smithi079 ceph-mon[132936]: pgmap v492: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 796 op/s 2023-10-05T15:40:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:41 smithi017 ceph-mon[129107]: pgmap v492: 129 pgs: 129 active+clean; 1.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 796 op/s 2023-10-05T15:40:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 125.0 s, 542.8 tps, lat 185.086 ms stddev 50.775 2023-10-05T15:40:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:43 smithi167 ceph-mon[133366]: pgmap v493: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 683 op/s 2023-10-05T15:40:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:43 smithi079 ceph-mon[132936]: pgmap v493: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 683 op/s 2023-10-05T15:40:44.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:43 smithi017 ceph-mon[129107]: pgmap v493: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 683 op/s 2023-10-05T15:40:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:45 smithi167 ceph-mon[133366]: pgmap v494: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 872 op/s 2023-10-05T15:40:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:45 smithi079 ceph-mon[132936]: pgmap v494: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 872 op/s 2023-10-05T15:40:46.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:45 smithi017 ceph-mon[129107]: pgmap v494: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 872 op/s 2023-10-05T15:40:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:47 smithi167 ceph-mon[133366]: pgmap v495: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2023-10-05T15:40:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:47 smithi079 ceph-mon[132936]: pgmap v495: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2023-10-05T15:40:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 130.0 s, 494.4 tps, lat 202.791 ms stddev 260.310 2023-10-05T15:40:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:47 smithi017 ceph-mon[129107]: pgmap v495: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 637 op/s 2023-10-05T15:40:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:49 smithi167 ceph-mon[133366]: pgmap v496: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 731 op/s 2023-10-05T15:40:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:49 smithi079 ceph-mon[132936]: pgmap v496: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 731 op/s 2023-10-05T15:40:50.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:49 smithi017 ceph-mon[129107]: pgmap v496: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 731 op/s 2023-10-05T15:40:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:51 smithi167 ceph-mon[133366]: pgmap v497: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.9 MiB/s wr, 729 op/s 2023-10-05T15:40:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:51 smithi079 ceph-mon[132936]: pgmap v497: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.9 MiB/s wr, 729 op/s 2023-10-05T15:40:52.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:51 smithi017 ceph-mon[129107]: pgmap v497: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.9 MiB/s wr, 729 op/s 2023-10-05T15:40:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 -- 172.21.15.17:0/140536765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca601042a0 msgr2=0x7fca60106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 --2- 172.21.15.17:0/140536765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca601042a0 0x7fca60106690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca54009990 tx=0x7fca54009ca0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 -- 172.21.15.17:0/140536765 shutdown_connections 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 --2- 172.21.15.17:0/140536765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60106bd0 0x7fca60109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 --2- 172.21.15.17:0/140536765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60101970 0x7fca60103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 --2- 172.21.15.17:0/140536765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca601042a0 0x7fca60106690 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.604+0000 7fca65bff700 1 -- 172.21.15.17:0/140536765 >> 172.21.15.17:0/140536765 conn(0x7fca600fb340 msgr2=0x7fca600fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.605+0000 7fca65bff700 1 -- 172.21.15.17:0/140536765 shutdown_connections 2023-10-05T15:40:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.605+0000 7fca65bff700 1 -- 172.21.15.17:0/140536765 wait complete. 2023-10-05T15:40:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.606+0000 7fca65bff700 1 Processor -- start 2023-10-05T15:40:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 -- start start 2023-10-05T15:40:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 0x7fca600ff920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca601042a0 0x7fca600ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60106bd0 0x7fca601003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca601014c0 con 0x7fca601042a0 2023-10-05T15:40:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca60101630 con 0x7fca60106bd0 2023-10-05T15:40:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.607+0000 7fca65bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca601017f0 con 0x7fca60101970 2023-10-05T15:40:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 0x7fca600ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 0x7fca600ff920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33876/0 (socket says 172.21.15.17:33876) 2023-10-05T15:40:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5f7fe700 1 -- 172.21.15.17:0/69399323 learned_addr learned my addr 172.21.15.17:0/69399323 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5effd700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca601042a0 0x7fca600ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5ffff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60106bd0 0x7fca601003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5effd700 1 -- 172.21.15.17:0/69399323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 msgr2=0x7fca600ff920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5effd700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 0x7fca600ff920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5effd700 1 -- 172.21.15.17:0/69399323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60106bd0 msgr2=0x7fca601003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5effd700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60106bd0 0x7fca601003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5effd700 1 -- 172.21.15.17:0/69399323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca540095f0 con 0x7fca601042a0 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.608+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 0x7fca600ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca5ffff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60106bd0 0x7fca601003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca5effd700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca601042a0 0x7fca600ffe60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca54009990 tx=0x7fca54005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca5cff9700 1 -- 172.21.15.17:0/69399323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5401d070 con 0x7fca601042a0 2023-10-05T15:40:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca5cff9700 1 -- 172.21.15.17:0/69399323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca54003f80 con 0x7fca601042a0 2023-10-05T15:40:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca5cff9700 1 -- 172.21.15.17:0/69399323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54022b10 con 0x7fca601042a0 2023-10-05T15:40:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca601a5450 con 0x7fca601042a0 2023-10-05T15:40:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.609+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca601a5820 con 0x7fca601042a0 2023-10-05T15:40:52.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.615+0000 7fca5cff9700 1 -- 172.21.15.17:0/69399323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fca54003af0 con 0x7fca601042a0 2023-10-05T15:40:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.617+0000 7fca7956db80 1 Processor -- start 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca5cff9700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fca480a1650 0x7fca480a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 -- start start 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca5cff9700 1 -- 172.21.15.17:0/69399323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fca540ce6a0 con 0x7fca601042a0 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac252e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac26450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aab8d400 con 0x55d1aac25fd0 2023-10-05T15:40:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aab7ebc0 con 0x55d1aac24ec0 2023-10-05T15:40:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca7956db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aab7c4e0 con 0x55d1aac26990 2023-10-05T15:40:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.618+0000 7fca5ffff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fca480a1650 0x7fca480a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac26450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac26450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40576/0 (socket says 172.21.15.17:40576) 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 -- 172.21.15.17:0/4056254887 learned_addr learned my addr 172.21.15.17:0/4056254887 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac252e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5ffff700 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 -- 172.21.15.17:0/4056254887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 msgr2=0x55d1aac2d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 -- 172.21.15.17:0/4056254887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 msgr2=0x55d1aac252e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac252e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.619+0000 7fca5effd700 1 -- 172.21.15.17:0/4056254887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1aa9a2d80 con 0x55d1aac25fd0 2023-10-05T15:40:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.620+0000 7fca5effd700 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac26450 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca54005920 tx=0x7fca5409b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1afe1cc5d65ae11 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.620+0000 7fca45ffb700 1 -- 172.21.15.17:0/4056254887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54003da0 con 0x55d1aac25fd0 2023-10-05T15:40:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.620+0000 7fca45ffb700 1 -- 172.21.15.17:0/4056254887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5409bd50 con 0x55d1aac25fd0 2023-10-05T15:40:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.620+0000 7fca45ffb700 1 -- 172.21.15.17:0/4056254887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca540cbeb0 con 0x55d1aac25fd0 2023-10-05T15:40:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 -- 172.21.15.17:0/4056254887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 msgr2=0x55d1aac26450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac26450 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca54005920 tx=0x7fca5409b550 comp rx=0 tx=0).stop 2023-10-05T15:40:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca5ffff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fca480a1650 0x7fca480a3b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fca58009fc0 tx=0x7fca580093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 -- 172.21.15.17:0/4056254887 shutdown_connections 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac252e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 --2- 172.21.15.17:0/4056254887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac26450 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 -- 172.21.15.17:0/4056254887 >> 172.21.15.17:0/4056254887 conn(0x55d1aab99200 msgr2=0x55d1aac1fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.621+0000 7fca7956db80 1 -- 172.21.15.17:0/4056254887 shutdown_connections 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.622+0000 7fca7956db80 1 -- 172.21.15.17:0/4056254887 wait complete. 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.622+0000 7fca7956db80 1 -- start start 2023-10-05T15:40:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 Processor -- start 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac2e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 0x55d1aac2ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac26990 0x55d1aac35dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aab77dd0 con 0x55d1aac26990 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aab146b0 con 0x55d1aac24ec0 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aab14350 con 0x55d1aac25fd0 2023-10-05T15:40:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.623+0000 7fca7956db80 10 client.0 _ll_register_callbacks cb 0x55d1aa9717a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.624+0000 7fca5effd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 0x55d1aac2ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.624+0000 7fca5effd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 0x55d1aac2ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33880/0 (socket says 172.21.15.17:33880) 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.624+0000 7fca5effd700 1 -- 172.21.15.17:0/3714178688 learned_addr learned my addr 172.21.15.17:0/3714178688 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.624+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac2e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.624+0000 7fca5ffff700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac26990 0x55d1aac35dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca5effd700 1 -- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 msgr2=0x55d1aac2e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca5effd700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac2e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca5effd700 1 -- 172.21.15.17:0/3714178688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac26990 msgr2=0x55d1aac35dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca5effd700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac26990 0x55d1aac35dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca5effd700 1 -- 172.21.15.17:0/3714178688 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca601a5820 con 0x55d1aac25fd0 2023-10-05T15:40:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca5effd700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 0x55d1aac2ed80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca5409bf00 tx=0x7fca54005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77ef536c231746f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.625+0000 7fca3effd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:40:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca3effd700 1 -- 172.21.15.17:0/3714178688 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54086160 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca3effd700 1 -- 172.21.15.17:0/3714178688 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fca5409b650 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1aac17d50 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca3effd700 1 -- 172.21.15.17:0/3714178688 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca540a34c0 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca7956db80 10 client.26161 fetch_fsmap learned FSMap version 36 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d1aa98bc00 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca3effd700 1 -- 172.21.15.17:0/3714178688 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d1aac17d50 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.626+0000 7fca3effd700 1 -- 172.21.15.17:0/3714178688 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 36) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fca540b9ac0 con 0x55d1aac25fd0 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca7956db80 10 client.26161 fetch_fsmap finished waiting for FSMap version 36 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca7956db80 10 client.26161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca7956db80 20 client.26161 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca7956db80 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac3a310 0x55d1aac3c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca7956db80 4 client.26161 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1aab70db0 con 0x55d1aac3a310 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.627+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac3a310 0x55d1aac3c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.628+0000 7fca3effd700 10 client.26161 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.628+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac3a310 0x55d1aac3c730 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1abbdfb5ddc929af server_cookie=11e2707f0b05d5b5 in_seq=0 out_seq=0 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.629+0000 7fca3effd700 1 -- 172.21.15.17:0/3714178688 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d1aab70db0 con 0x55d1aac3a310 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.629+0000 7fca3effd700 10 client.26161 handle_command_reply: tid=0 2023-10-05T15:40:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.629+0000 7fca7956db80 1 client.26161 shutdown 2023-10-05T15:40:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 msgr2=0x55d1aac2ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 0x55d1aac2ed80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca5409bf00 tx=0x7fca54005c00 comp rx=0 tx=0).stop 2023-10-05T15:40:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 shutdown_connections 2023-10-05T15:40:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac3a310 0x55d1aac3c730 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac26990 0x55d1aac35dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac2e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 --2- 172.21.15.17:0/3714178688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac25fd0 0x55d1aac2ed80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 >> 172.21.15.17:0/3714178688 conn(0x55d1aab99200 msgr2=0x55d1aac1f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca3effd700 0 client.26161 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 shutdown_connections 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 1 -- 172.21.15.17:0/3714178688 wait complete. 2023-10-05T15:40:52.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.630+0000 7fca7956db80 20 client.26161 trim_cache size 0 max 16384 2023-10-05T15:40:52.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 Processor -- start 2023-10-05T15:40:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 -- start start 2023-10-05T15:40:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac36590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac35d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aa9f88c0 con 0x55d1aac25fd0 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aac17890 con 0x55d1aac24ec0 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca7956db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aac26d70 con 0x55d1aac26990 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca5f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac36590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca5f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac36590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45756/0 (socket says 172.21.15.17:45756) 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.655+0000 7fca5f7fe700 1 -- 172.21.15.17:0/4229146560 learned_addr learned my addr 172.21.15.17:0/4229146560 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5ffff700 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5effd700 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac35d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5f7fe700 1 -- 172.21.15.17:0/4229146560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 msgr2=0x55d1aac2e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5f7fe700 1 -- 172.21.15.17:0/4229146560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 msgr2=0x55d1aac35d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac35d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5f7fe700 1 -- 172.21.15.17:0/4229146560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1aa9c91f0 con 0x55d1aac24ec0 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5ffff700 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.656+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac36590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca60101230 tx=0x7fca500125e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0abf20f6e955ded server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.657+0000 7fca467fc700 1 -- 172.21.15.17:0/4229146560 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50017040 con 0x55d1aac24ec0 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.657+0000 7fca467fc700 1 -- 172.21.15.17:0/4229146560 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5001d970 con 0x55d1aac24ec0 2023-10-05T15:40:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca467fc700 1 -- 172.21.15.17:0/4229146560 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50003b80 con 0x55d1aac24ec0 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 -- 172.21.15.17:0/4229146560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 msgr2=0x55d1aac36590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac36590 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fca60101230 tx=0x7fca500125e0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 -- 172.21.15.17:0/4229146560 shutdown_connections 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac2e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac36590 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 --2- 172.21.15.17:0/4229146560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac35d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 -- 172.21.15.17:0/4229146560 >> 172.21.15.17:0/4229146560 conn(0x55d1aab99200 msgr2=0x55d1aac3c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 -- 172.21.15.17:0/4229146560 shutdown_connections 2023-10-05T15:40:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.658+0000 7fca7956db80 1 -- 172.21.15.17:0/4229146560 wait complete. 2023-10-05T15:40:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 -- start start 2023-10-05T15:40:52.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 Processor -- start 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac31e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac34e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aac35370 con 0x55d1aac25fd0 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aac354e0 con 0x55d1aac24ec0 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.659+0000 7fca7956db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1aac356a0 con 0x55d1aac26990 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca7956db80 10 client.0 _ll_register_callbacks cb 0x7fca5409b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:40:52.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac34e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac34e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33908/0 (socket says 172.21.15.17:33908) 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 -- 172.21.15.17:0/1599309656 learned_addr learned my addr 172.21.15.17:0/1599309656 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5effd700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac31e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 -- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 msgr2=0x55d1aac318d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac318d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 -- 172.21.15.17:0/1599309656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 msgr2=0x55d1aac31e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:40:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac31e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.660+0000 7fca5ffff700 1 -- 172.21.15.17:0/1599309656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca50012450 con 0x55d1aac26990 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.661+0000 7fca5ffff700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac34e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca58018e20 tx=0x7fca58004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3e7547a411b8e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.661+0000 7fca3effd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.661+0000 7fca3effd700 1 -- 172.21.15.17:0/1599309656 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58026430 con 0x55d1aac26990 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.661+0000 7fca3effd700 1 -- 172.21.15.17:0/1599309656 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fca58026590 con 0x55d1aac26990 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.661+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca5409bd50 con 0x55d1aac26990 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca3effd700 1 -- 172.21.15.17:0/1599309656 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca58026750 con 0x55d1aac26990 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 10 client.26167 fetch_fsmap learned FSMap version 36 2023-10-05T15:40:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d1aa9a1250 con 0x55d1aac26990 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca3effd700 1 -- 172.21.15.17:0/1599309656 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5409bd50 con 0x55d1aac26990 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca3effd700 1 -- 172.21.15.17:0/1599309656 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 36) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fca5802e070 con 0x55d1aac26990 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 10 client.26167 fetch_fsmap finished waiting for FSMap version 36 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 10 client.26167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 20 client.26167 populate_metadata read hostname 'smithi017' 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac9ff50 0x55d1aaca2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:40:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 4 client.26167 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:40:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.662+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d1aab70ad0 con 0x55d1aac9ff50 2023-10-05T15:40:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.663+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac9ff50 0x55d1aaca2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:40:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.663+0000 7fca5f7fe700 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac9ff50 0x55d1aaca2370 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdf8f49f4f282b41 server_cookie=d52f044faecf9a4a in_seq=0 out_seq=0 2023-10-05T15:40:52.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.663+0000 7fca3effd700 10 client.26167 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.684+0000 7fca3effd700 1 -- 172.21.15.17:0/1599309656 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d1aab70ad0 con 0x55d1aac9ff50 2023-10-05T15:40:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.684+0000 7fca3effd700 10 client.26167 handle_command_reply: tid=0 2023-10-05T15:40:52.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.684+0000 7fca7956db80 1 client.26167 shutdown 2023-10-05T15:40:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.684+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 msgr2=0x55d1aac34e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.684+0000 7fca7956db80 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac34e30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca58018e20 tx=0x7fca58004b40 comp rx=0 tx=0).stop 2023-10-05T15:40:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 shutdown_connections 2023-10-05T15:40:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d1aac9ff50 0x55d1aaca2370 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d1aac26990 0x55d1aac34e30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1aac24ec0 0x55d1aac318d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 --2- 172.21.15.17:0/1599309656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d1aac25fd0 0x55d1aac31e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 >> 172.21.15.17:0/1599309656 conn(0x55d1aab99200 msgr2=0x55d1aac36590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca3effd700 0 client.26167 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:40:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 shutdown_connections 2023-10-05T15:40:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.685+0000 7fca7956db80 1 -- 172.21.15.17:0/1599309656 wait complete. 2023-10-05T15:40:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.686+0000 7fca7956db80 20 client.26167 trim_cache size 0 max 16384 2023-10-05T15:40:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:40:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:40:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:40:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:40:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.687+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fca480a1650 msgr2=0x7fca480a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.687+0000 7fca65bff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fca480a1650 0x7fca480a3b10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fca58009fc0 tx=0x7fca580093a0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.687+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca601042a0 msgr2=0x7fca600ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:40:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.687+0000 7fca65bff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca601042a0 0x7fca600ffe60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca54009990 tx=0x7fca54005740 comp rx=0 tx=0).stop 2023-10-05T15:40:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 shutdown_connections 2023-10-05T15:40:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fca480a1650 0x7fca480a3b10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca60106bd0 0x7fca601003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca60101970 0x7fca600ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 --2- 172.21.15.17:0/69399323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca601042a0 0x7fca600ffe60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:40:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 >> 172.21.15.17:0/69399323 conn(0x7fca600fb340 msgr2=0x7fca601025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:40:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.688+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 shutdown_connections 2023-10-05T15:40:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:40:52.689+0000 7fca65bff700 1 -- 172.21.15.17:0/69399323 wait complete. 2023-10-05T15:40:53.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:52 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:53.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:52 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 135.0 s, 471.8 tps, lat 211.664 ms stddev 337.267 2023-10-05T15:40:53.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:52 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:54.085 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:53 smithi167 ceph-mon[133366]: pgmap v498: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-05T15:40:54.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:53 smithi079 ceph-mon[132936]: pgmap v498: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-05T15:40:54.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:53 smithi017 ceph-mon[129107]: pgmap v498: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.8 MiB/s wr, 616 op/s 2023-10-05T15:40:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:55 smithi167 ceph-mon[133366]: pgmap v499: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 828 op/s 2023-10-05T15:40:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:55 smithi079 ceph-mon[132936]: pgmap v499: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 828 op/s 2023-10-05T15:40:56.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:55 smithi017 ceph-mon[129107]: pgmap v499: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 828 op/s 2023-10-05T15:40:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:57 smithi167 ceph-mon[133366]: pgmap v500: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 668 op/s 2023-10-05T15:40:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:57 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:57 smithi079 ceph-mon[132936]: pgmap v500: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 668 op/s 2023-10-05T15:40:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:57 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:40:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 140.0 s, 421.8 tps, lat 188.458 ms stddev 275.456 2023-10-05T15:40:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:57 smithi017 ceph-mon[129107]: pgmap v500: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 668 op/s 2023-10-05T15:40:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:57 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:40:59 smithi167 ceph-mon[133366]: pgmap v501: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 726 op/s 2023-10-05T15:41:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:40:59 smithi079 ceph-mon[132936]: pgmap v501: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 726 op/s 2023-10-05T15:41:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:40:59 smithi017 ceph-mon[129107]: pgmap v501: 129 pgs: 129 active+clean; 1.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 726 op/s 2023-10-05T15:41:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:01 smithi167 ceph-mon[133366]: pgmap v502: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 14 MiB/s wr, 702 op/s 2023-10-05T15:41:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:01 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:41:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:01 smithi079 ceph-mon[132936]: pgmap v502: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 14 MiB/s wr, 702 op/s 2023-10-05T15:41:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:01 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:41:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:01 smithi017 ceph-mon[129107]: pgmap v502: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 14 MiB/s wr, 702 op/s 2023-10-05T15:41:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:01 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:41:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:41:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:41:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:41:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:41:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:41:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:41:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 145.0 s, 586.0 tps, lat 206.357 ms stddev 333.497 2023-10-05T15:41:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:41:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:41:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:41:03.690 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:41:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3748527449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc069c30 msgr2=0x7fb3bc108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3748527449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc069c30 0x7fb3bc108120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009990 tx=0x7fb3ac009ca0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3748527449 shutdown_connections 2023-10-05T15:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3748527449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc108820 0x7fb3bc108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3748527449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc069c30 0x7fb3bc108120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3748527449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3bc10bad0 0x7fb3bc10dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.060+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3748527449 >> 172.21.15.17:0/3748527449 conn(0x7fb3bc06e0e0 msgr2=0x7fb3bc070500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.062+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3748527449 shutdown_connections 2023-10-05T15:41:04.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.063+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3748527449 wait complete. 2023-10-05T15:41:04.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.065+0000 7fb3c3bff700 1 Processor -- start 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.065+0000 7fb3c3bff700 1 -- start start 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c3bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc069c30 0x7fb3bc19de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c3bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3bc108820 0x7fb3bc19e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c3bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc10bad0 0x7fb3bc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c3bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc19b170 con 0x7fb3bc108820 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c3bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc19b2e0 con 0x7fb3bc10bad0 2023-10-05T15:41:04.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c3bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc19b4a0 con 0x7fb3bc069c30 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc069c30 0x7fb3bc19de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc10bad0 0x7fb3bc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc10bad0 0x7fb3bc19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36234/0 (socket says 172.21.15.17:36234) 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.066+0000 7fb3c219c700 1 -- 172.21.15.17:0/3894952108 learned_addr learned my addr 172.21.15.17:0/3894952108 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.067+0000 7fb3c199b700 1 -- 172.21.15.17:0/3894952108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc10bad0 msgr2=0x7fb3bc19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.067+0000 7fb3c199b700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc10bad0 0x7fb3bc19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.067+0000 7fb3c199b700 1 -- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3bc108820 msgr2=0x7fb3bc19e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.067+0000 7fb3c199b700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3bc108820 0x7fb3bc19e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.067+0000 7fb3c199b700 1 -- 172.21.15.17:0/3894952108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0095f0 con 0x7fb3bc069c30 2023-10-05T15:41:04.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.067+0000 7fb3c199b700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc069c30 0x7fb3bc19de40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac000c00 tx=0x7fb3ac005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:04.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.068+0000 7fb3b2ffd700 1 -- 172.21.15.17:0/3894952108 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac01d070 con 0x7fb3bc069c30 2023-10-05T15:41:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.068+0000 7fb3b2ffd700 1 -- 172.21.15.17:0/3894952108 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3ac022470 con 0x7fb3bc069c30 2023-10-05T15:41:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.068+0000 7fb3b2ffd700 1 -- 172.21.15.17:0/3894952108 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac00f6c0 con 0x7fb3bc069c30 2023-10-05T15:41:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.068+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc1a12b0 con 0x7fb3bc069c30 2023-10-05T15:41:04.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.069+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1a1760 con 0x7fb3bc069c30 2023-10-05T15:41:04.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.074+0000 7fb3b2ffd700 1 -- 172.21.15.17:0/3894952108 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb3ac022890 con 0x7fb3bc069c30 2023-10-05T15:41:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.077+0000 7fb3d75ffb80 1 Processor -- start 2023-10-05T15:41:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.077+0000 7fb3d75ffb80 1 -- start start 2023-10-05T15:41:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.077+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd6338680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6339480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6339ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd62a0460 con 0x562fd6338bc0 2023-10-05T15:41:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6291c20 con 0x562fd6339a60 2023-10-05T15:41:04.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd628f540 con 0x562fd6338260 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd6338680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd6338680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59678/0 (socket says 172.21.15.17:59678) 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3c219c700 1 -- 172.21.15.17:0/1549970080 learned_addr learned my addr 172.21.15.17:0/1549970080 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3c199b700 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6339480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.078+0000 7fb3c119a700 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6339ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.079+0000 7fb3c119a700 1 -- 172.21.15.17:0/1549970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 msgr2=0x562fd6338680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.079+0000 7fb3c119a700 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd6338680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.079+0000 7fb3c119a700 1 -- 172.21.15.17:0/1549970080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 msgr2=0x562fd6339480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:03 smithi167 ceph-mon[133366]: pgmap v503: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 632 op/s 2023-10-05T15:41:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.081+0000 7fb3c119a700 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6339480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.081+0000 7fb3c119a700 1 -- 172.21.15.17:0/1549970080 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fd60b5de0 con 0x562fd6339a60 2023-10-05T15:41:04.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.082+0000 7fb3b2ffd700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb3a80a15d0 0x7fb3a80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.082+0000 7fb3c119a700 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6339ee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0730b0 tx=0x7fb3b8009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf01dd272acbb40 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:04.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.082+0000 7fb3b2ffd700 1 -- 172.21.15.17:0/3894952108 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb3ac0ce330 con 0x7fb3bc069c30 2023-10-05T15:41:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.083+0000 7fb3a7fff700 1 -- 172.21.15.17:0/1549970080 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800eb00 con 0x562fd6339a60 2023-10-05T15:41:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.083+0000 7fb3a7fff700 1 -- 172.21.15.17:0/1549970080 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3b8004cc0 con 0x562fd6339a60 2023-10-05T15:41:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.083+0000 7fb3a7fff700 1 -- 172.21.15.17:0/1549970080 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80055d0 con 0x562fd6339a60 2023-10-05T15:41:04.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.083+0000 7fb3c219c700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb3a80a15d0 0x7fb3a80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1549970080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 msgr2=0x562fd6339ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6339ee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0730b0 tx=0x7fb3b8009ea0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1549970080 shutdown_connections 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6339ee0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd6338680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1549970080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6339480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.084+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1549970080 >> 172.21.15.17:0/1549970080 conn(0x562fd62ac260 msgr2=0x562fd6333140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:04.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.085+0000 7fb3c219c700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb3a80a15d0 0x7fb3a80a3a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4011480 tx=0x7fb3b400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:04.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.085+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1549970080 shutdown_connections 2023-10-05T15:41:04.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.085+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1549970080 wait complete. 2023-10-05T15:41:04.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.085+0000 7fb3d75ffb80 1 -- start start 2023-10-05T15:41:04.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.086+0000 7fb3d75ffb80 1 Processor -- start 2023-10-05T15:41:04.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338260 0x562fd6342060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd63425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6339a60 0x562fd63495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd628ae30 con 0x562fd6338260 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6227710 con 0x562fd6338bc0 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd62273b0 con 0x562fd6339a60 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3d75ffb80 10 client.0 _ll_register_callbacks cb 0x562fd6084800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3c119a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd63425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3c119a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd63425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36258/0 (socket says 172.21.15.17:36258) 2023-10-05T15:41:04.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.087+0000 7fb3c119a700 1 -- 172.21.15.17:0/289927914 learned_addr learned my addr 172.21.15.17:0/289927914 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:04.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.088+0000 7fb3c219c700 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6339a60 0x562fd63495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.088+0000 7fb3c219c700 1 -- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 msgr2=0x562fd63425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:04.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.088+0000 7fb3c219c700 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd63425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.088+0000 7fb3c219c700 1 -- 172.21.15.17:0/289927914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338260 msgr2=0x562fd6342060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:04.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.088+0000 7fb3c219c700 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338260 0x562fd6342060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.088+0000 7fb3c219c700 1 -- 172.21.15.17:0/289927914 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b80098a0 con 0x562fd6339a60 2023-10-05T15:41:04.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.089+0000 7fb3c219c700 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6339a60 0x562fd63495e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4011bd0 tx=0x7fb3b4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91de6fe6fd94c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:04.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:41:04.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3a57fa700 1 -- 172.21.15.17:0/289927914 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b401c040 con 0x562fd6339a60 2023-10-05T15:41:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3a57fa700 1 -- 172.21.15.17:0/289927914 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb3b4006e40 con 0x562fd6339a60 2023-10-05T15:41:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fd632af10 con 0x562fd6339a60 2023-10-05T15:41:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3a57fa700 1 -- 172.21.15.17:0/289927914 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b400e040 con 0x562fd6339a60 2023-10-05T15:41:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3d75ffb80 10 client.26176 fetch_fsmap learned FSMap version 37 2023-10-05T15:41:04.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.090+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562fd609ec60 con 0x562fd6339a60 2023-10-05T15:41:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.091+0000 7fb3a57fa700 1 -- 172.21.15.17:0/289927914 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562fd632af10 con 0x562fd6339a60 2023-10-05T15:41:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.091+0000 7fb3a57fa700 1 -- 172.21.15.17:0/289927914 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 37) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb3b40213d0 con 0x562fd6339a60 2023-10-05T15:41:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3d75ffb80 10 client.26176 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:41:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3d75ffb80 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3d75ffb80 20 client.26176 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:04.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd634df60 0x562fd6350380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3d75ffb80 4 client.26176 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:04.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fd6283e10 con 0x562fd634df60 2023-10-05T15:41:04.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.092+0000 7fb3c199b700 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd634df60 0x562fd6350380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.093+0000 7fb3c199b700 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd634df60 0x562fd6350380 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71286ce9e56cf5f5 server_cookie=a59bf461ad253fbf in_seq=0 out_seq=0 2023-10-05T15:41:04.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.093+0000 7fb3a57fa700 10 client.26176 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:04.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.095+0000 7fb3a57fa700 1 -- 172.21.15.17:0/289927914 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562fd6283e10 con 0x562fd634df60 2023-10-05T15:41:04.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.095+0000 7fb3a57fa700 10 client.26176 handle_command_reply: tid=0 2023-10-05T15:41:04.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.095+0000 7fb3d75ffb80 1 client.26176 shutdown 2023-10-05T15:41:04.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6339a60 msgr2=0x562fd63495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6339a60 0x562fd63495e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4011bd0 tx=0x7fb3b4004ad0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 shutdown_connections 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd634df60 0x562fd6350380 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6339a60 0x562fd63495e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338260 0x562fd6342060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/289927914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd63425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 >> 172.21.15.17:0/289927914 conn(0x562fd62ac260 msgr2=0x562fd6332f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:04.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.096+0000 7fb3a57fa700 0 client.26176 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:04.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.097+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 shutdown_connections 2023-10-05T15:41:04.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.097+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/289927914 wait complete. 2023-10-05T15:41:04.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.097+0000 7fb3d75ffb80 20 client.26176 trim_cache size 0 max 16384 2023-10-05T15:41:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:03 smithi079 ceph-mon[132936]: pgmap v503: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 632 op/s 2023-10-05T15:41:04.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.131+0000 7fb3d75ffb80 1 Processor -- start 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 -- start start 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd633c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd633cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6339a60 0x562fd63495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6341c30 con 0x562fd6339a60 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd610b920 con 0x562fd6338bc0 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6339310 con 0x562fd6338260 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd633c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.132+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6339a60 0x562fd63495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd633c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59688/0 (socket says 172.21.15.17:59688) 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 -- 172.21.15.17:0/1556750647 learned_addr learned my addr 172.21.15.17:0/1556750647 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 -- 172.21.15.17:0/1556750647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 msgr2=0x562fd633cf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd633cf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 -- 172.21.15.17:0/1556750647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6339a60 msgr2=0x562fd63495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6339a60 0x562fd63495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 -- 172.21.15.17:0/1556750647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fd60dc250 con 0x562fd6338260 2023-10-05T15:41:04.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.133+0000 7fb3c199b700 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd633c9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac022be0 tx=0x7fb3ac0cb960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a864e5cc4f376e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.134+0000 7fb3b0bff700 1 -- 172.21.15.17:0/1556750647 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac09b110 con 0x562fd6338260 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.134+0000 7fb3b0bff700 1 -- 172.21.15.17:0/1556750647 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3ac09ae80 con 0x562fd6338260 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.134+0000 7fb3b0bff700 1 -- 172.21.15.17:0/1556750647 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac09f490 con 0x562fd6338260 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1556750647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 msgr2=0x562fd633c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd633c9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac022be0 tx=0x7fb3ac0cb960 comp rx=0 tx=0).stop 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1556750647 shutdown_connections 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6339a60 0x562fd63495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd633c9d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/1556750647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6338bc0 0x562fd633cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1556750647 >> 172.21.15.17:0/1556750647 conn(0x562fd62ac260 msgr2=0x562fd6340d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:04.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.135+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1556750647 shutdown_connections 2023-10-05T15:41:04.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.136+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/1556750647 wait complete. 2023-10-05T15:41:04.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.136+0000 7fb3d75ffb80 1 -- start start 2023-10-05T15:41:04.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.137+0000 7fb3d75ffb80 1 Processor -- start 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd63473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6347910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6348920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6348e60 con 0x562fd6338bc0 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6348fd0 con 0x562fd6339a60 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6349190 con 0x562fd6338260 2023-10-05T15:41:04.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.138+0000 7fb3d75ffb80 10 client.0 _ll_register_callbacks cb 0x7fb3b40177e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:04.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6348920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6348920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36264/0 (socket says 172.21.15.17:36264) 2023-10-05T15:41:04.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 -- 172.21.15.17:0/2603345450 learned_addr learned my addr 172.21.15.17:0/2603345450 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:04.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 -- 172.21.15.17:0/2603345450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 msgr2=0x562fd63473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:04.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd63473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 -- 172.21.15.17:0/2603345450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 msgr2=0x562fd6347910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6347910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.139+0000 7fb3c219c700 1 -- 172.21.15.17:0/2603345450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1a1760 con 0x562fd6339a60 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.140+0000 7fb3c219c700 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6348920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4004c20 tx=0x7fb3b4017f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b158f697c9f207d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.140+0000 7fb3a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.140+0000 7fb3a57fa700 1 -- 172.21.15.17:0/2603345450 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400e040 con 0x562fd6339a60 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.140+0000 7fb3a57fa700 1 -- 172.21.15.17:0/2603345450 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb3b4021000 con 0x562fd6339a60 2023-10-05T15:41:04.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.140+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3b8004cc0 con 0x562fd6339a60 2023-10-05T15:41:04.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3a57fa700 1 -- 172.21.15.17:0/2603345450 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b4021ee0 con 0x562fd6339a60 2023-10-05T15:41:04.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 10 client.26210 fetch_fsmap learned FSMap version 37 2023-10-05T15:41:04.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x562fd60b42b0 con 0x562fd6339a60 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3a57fa700 1 -- 172.21.15.17:0/2603345450 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3b8004cc0 con 0x562fd6339a60 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3a57fa700 1 -- 172.21.15.17:0/2603345450 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb3b403e070 con 0x562fd6339a60 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 10 client.26210 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 10 client.26210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 20 client.26210 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd63a2df0 0x562fd63a5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 4 client.26210 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.141+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562fd6283b30 con 0x562fd63a2df0 2023-10-05T15:41:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.142+0000 7fb3c199b700 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd63a2df0 0x562fd63a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.142+0000 7fb3c199b700 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd63a2df0 0x562fd63a5230 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adef93165f87c79c server_cookie=6a8f56ff26f55842 in_seq=0 out_seq=0 2023-10-05T15:41:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.142+0000 7fb3a57fa700 10 client.26210 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.143+0000 7fb3a57fa700 1 -- 172.21.15.17:0/2603345450 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562fd6283b30 con 0x562fd63a2df0 2023-10-05T15:41:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.143+0000 7fb3a57fa700 10 client.26210 handle_command_reply: tid=0 2023-10-05T15:41:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.143+0000 7fb3d75ffb80 1 client.26210 shutdown 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 msgr2=0x562fd6348920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6348920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4004c20 tx=0x7fb3b4017f10 comp rx=0 tx=0).stop 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 shutdown_connections 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562fd63a2df0 0x562fd63a5230 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562fd6339a60 0x562fd6348920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562fd6338260 0x562fd63473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 --2- 172.21.15.17:0/2603345450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562fd6338bc0 0x562fd6347910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 >> 172.21.15.17:0/2603345450 conn(0x562fd62ac260 msgr2=0x562fd633c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.144+0000 7fb3a57fa700 0 client.26210 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.145+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 shutdown_connections 2023-10-05T15:41:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.145+0000 7fb3d75ffb80 1 -- 172.21.15.17:0/2603345450 wait complete. 2023-10-05T15:41:04.147 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:41:04.148 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3d75ffb80 20 client.26210 trim_cache size 0 max 16384 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb3a80a15d0 msgr2=0x7fb3a80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb3a80a15d0 0x7fb3a80a3a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4011480 tx=0x7fb3b400b040 comp rx=0 tx=0).stop 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc069c30 msgr2=0x7fb3bc19de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc069c30 0x7fb3bc19de40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac000c00 tx=0x7fb3ac005740 comp rx=0 tx=0).stop 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 shutdown_connections 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb3a80a15d0 0x7fb3a80a3a90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3bc10bad0 0x7fb3bc19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3bc069c30 0x7fb3bc19de40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 --2- 172.21.15.17:0/3894952108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3bc108820 0x7fb3bc19e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.146+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 >> 172.21.15.17:0/3894952108 conn(0x7fb3bc06e0e0 msgr2=0x7fb3bc06ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.147+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 shutdown_connections 2023-10-05T15:41:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:04.147+0000 7fb3c3bff700 1 -- 172.21.15.17:0/3894952108 wait complete. 2023-10-05T15:41:04.174 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:03 smithi017 ceph-mon[129107]: pgmap v503: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 632 op/s 2023-10-05T15:41:04.177 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:41:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 -- 172.21.15.17:0/3099085640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 msgr2=0x7f2720103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 --2- 172.21.15.17:0/3099085640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 0x7f2720103d60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f271c009990 tx=0x7f271c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 -- 172.21.15.17:0/3099085640 shutdown_connections 2023-10-05T15:41:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 --2- 172.21.15.17:0/3099085640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2720106bd0 0x7f2720109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 --2- 172.21.15.17:0/3099085640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 0x7f2720103d60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 --2- 172.21.15.17:0/3099085640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27201042a0 0x7f2720106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.935+0000 7f27285ff700 1 -- 172.21.15.17:0/3099085640 >> 172.21.15.17:0/3099085640 conn(0x7f27200fb340 msgr2=0x7f27200fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.936+0000 7f27285ff700 1 -- 172.21.15.17:0/3099085640 shutdown_connections 2023-10-05T15:41:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.937+0000 7f27285ff700 1 -- 172.21.15.17:0/3099085640 wait complete. 2023-10-05T15:41:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.938+0000 7f27285ff700 1 Processor -- start 2023-10-05T15:41:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.939+0000 7f27285ff700 1 -- start start 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f27285ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 0x7f272010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f27285ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 0x7f272010c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f27285ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720106bd0 0x7f272010d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f27285ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272010db00 con 0x7f2720106bd0 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f27285ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272010dc70 con 0x7f2720101970 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f27285ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272010de30 con 0x7f27201042a0 2023-10-05T15:41:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f2725b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 0x7f272010c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f2725b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 0x7f272010c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59716/0 (socket says 172.21.15.17:59716) 2023-10-05T15:41:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f2725b9a700 1 -- 172.21.15.17:0/704852848 learned_addr learned my addr 172.21.15.17:0/704852848 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.940+0000 7f272639b700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 0x7f272010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2726b9c700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720106bd0 0x7f272010d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2725b9a700 1 -- 172.21.15.17:0/704852848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 msgr2=0x7f272010c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2725b9a700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 0x7f272010c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2725b9a700 1 -- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720106bd0 msgr2=0x7f272010d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2725b9a700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720106bd0 0x7f272010d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2725b9a700 1 -- 172.21.15.17:0/704852848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0095f0 con 0x7f27201042a0 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.941+0000 7f2726b9c700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720106bd0 0x7f272010d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.942+0000 7f2725b9a700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 0x7f272010c5d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f271000b530 tx=0x7f271000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.942+0000 7f27177fe700 1 -- 172.21.15.17:0/704852848 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011830 con 0x7f27201042a0 2023-10-05T15:41:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.942+0000 7f27177fe700 1 -- 172.21.15.17:0/704852848 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2710011e20 con 0x7f27201042a0 2023-10-05T15:41:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.942+0000 7f27177fe700 1 -- 172.21.15.17:0/704852848 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710010dd0 con 0x7f27201042a0 2023-10-05T15:41:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.942+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272010e110 con 0x7f27201042a0 2023-10-05T15:41:05.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.942+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272010e940 con 0x7f27201042a0 2023-10-05T15:41:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.947+0000 7f27177fe700 1 -- 172.21.15.17:0/704852848 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2710011990 con 0x7f27201042a0 2023-10-05T15:41:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.948+0000 7f273beaab80 1 Processor -- start 2023-10-05T15:41:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 -- start start 2023-10-05T15:41:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 0x560e3d0b9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b9990 0x560e3d0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d020400 con 0x560e3d0b7ec0 2023-10-05T15:41:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d011bc0 con 0x560e3d0b9990 2023-10-05T15:41:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.949+0000 7f273beaab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d00f4e0 con 0x560e3d0b8fd0 2023-10-05T15:41:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 0x560e3d0b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 0x560e3d0b9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59724/0 (socket says 172.21.15.17:59724) 2023-10-05T15:41:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 -- 172.21.15.17:0/2284798383 learned_addr learned my addr 172.21.15.17:0/2284798383 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f2726b9c700 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f2725b9a700 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b9990 0x560e3d0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 -- 172.21.15.17:0/2284798383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b9990 msgr2=0x560e3d0c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b9990 0x560e3d0c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 -- 172.21.15.17:0/2284798383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 msgr2=0x560e3d0b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f272639b700 1 -- 172.21.15.17:0/2284798383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e3ce35d80 con 0x560e3d0b8fd0 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f2725b9a700 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b9990 0x560e3d0c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.950+0000 7f27177fe700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f270c0a1500 0x7f270c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.951+0000 7f27177fe700 1 -- 172.21.15.17:0/704852848 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f27100ccbd0 con 0x7f27201042a0 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.951+0000 7f272639b700 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 0x560e3d0b9450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f271c015000 tx=0x7f271c005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bafd5ee8b4d17759 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:05.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.951+0000 7f2726b9c700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f270c0a1500 0x7f270c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.951+0000 7f2714bfe700 1 -- 172.21.15.17:0/2284798383 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c00ba50 con 0x560e3d0b8fd0 2023-10-05T15:41:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.952+0000 7f2714bfe700 1 -- 172.21.15.17:0/2284798383 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271c01e040 con 0x560e3d0b8fd0 2023-10-05T15:41:05.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.952+0000 7f2714bfe700 1 -- 172.21.15.17:0/2284798383 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c004880 con 0x560e3d0b8fd0 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.952+0000 7f273beaab80 1 -- 172.21.15.17:0/2284798383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 msgr2=0x560e3d0b9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.952+0000 7f273beaab80 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 0x560e3d0b9450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f271c015000 tx=0x7f271c005da0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.952+0000 7f2726b9c700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f270c0a1500 0x7f270c0a39c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x560e3d0b7c60 tx=0x7f2718009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 -- 172.21.15.17:0/2284798383 shutdown_connections 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b9990 0x560e3d0c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 --2- 172.21.15.17:0/2284798383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b8fd0 0x560e3d0b9450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 -- 172.21.15.17:0/2284798383 >> 172.21.15.17:0/2284798383 conn(0x560e3d02c200 msgr2=0x560e3d0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 -- 172.21.15.17:0/2284798383 shutdown_connections 2023-10-05T15:41:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 -- 172.21.15.17:0/2284798383 wait complete. 2023-10-05T15:41:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.953+0000 7f273beaab80 1 -- start start 2023-10-05T15:41:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.954+0000 7f273beaab80 1 Processor -- start 2023-10-05T15:41:05.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d00add0 con 0x560e3d0b7ec0 2023-10-05T15:41:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3cfa76b0 con 0x560e3d0b8fd0 2023-10-05T15:41:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3cfa7350 con 0x560e3d0b9990 2023-10-05T15:41:05.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f273beaab80 10 client.0 _ll_register_callbacks cb 0x560e3ce047a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f2726b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f2726b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59736/0 (socket says 172.21.15.17:59736) 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f2726b9c700 1 -- 172.21.15.17:0/2250925098 learned_addr learned my addr 172.21.15.17:0/2250925098 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f2725b9a700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.955+0000 7f272639b700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2726b9c700 1 -- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 msgr2=0x560e3d0c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2726b9c700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2726b9c700 1 -- 172.21.15.17:0/2250925098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 msgr2=0x560e3d0c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2726b9c700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2726b9c700 1 -- 172.21.15.17:0/2250925098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2720109c30 con 0x560e3d0b9990 2023-10-05T15:41:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2726b9c700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c9140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2718016e50 tx=0x7f2718004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3d91247711ee35 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:05.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.956+0000 7f2709ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f2709ffb700 1 -- 172.21.15.17:0/2250925098 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718017890 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f2709ffb700 1 -- 172.21.15.17:0/2250925098 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f27180179f0 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e3d0aad50 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f2709ffb700 1 -- 172.21.15.17:0/2250925098 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2718017bb0 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f273beaab80 10 client.26191 fetch_fsmap learned FSMap version 37 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560e3ce1ec00 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f2709ffb700 1 -- 172.21.15.17:0/2250925098 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e3d0aad50 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f2709ffb700 1 -- 172.21.15.17:0/2250925098 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 37) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f271802c450 con 0x560e3d0b9990 2023-10-05T15:41:05.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f273beaab80 10 client.26191 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:41:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.957+0000 7f273beaab80 10 client.26191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.958+0000 7f273beaab80 20 client.26191 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.958+0000 7f273beaab80 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d0dea40 0x560e3d0e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.958+0000 7f273beaab80 4 client.26191 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.958+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e3d003db0 con 0x560e3d0dea40 2023-10-05T15:41:05.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.958+0000 7f272639b700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d0dea40 0x560e3d0e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.959+0000 7f272639b700 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d0dea40 0x560e3d0e0e60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67476b64e69b6c61 server_cookie=f48cac53acdc579e in_seq=0 out_seq=0 2023-10-05T15:41:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.959+0000 7f2709ffb700 10 client.26191 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f2709ffb700 1 -- 172.21.15.17:0/2250925098 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e3d003db0 con 0x560e3d0dea40 2023-10-05T15:41:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f2709ffb700 10 client.26191 handle_command_reply: tid=0 2023-10-05T15:41:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f273beaab80 1 client.26191 shutdown 2023-10-05T15:41:05.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 msgr2=0x560e3d0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f273beaab80 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c9140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2718016e50 tx=0x7f2718004b40 comp rx=0 tx=0).stop 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 shutdown_connections 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.960+0000 7f273beaab80 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d0dea40 0x560e3d0e0e60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f273beaab80 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c9140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f273beaab80 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f273beaab80 1 --2- 172.21.15.17:0/2250925098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 >> 172.21.15.17:0/2250925098 conn(0x560e3d02c200 msgr2=0x560e3d0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:05.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f2709ffb700 0 client.26191 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 shutdown_connections 2023-10-05T15:41:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.961+0000 7f273beaab80 1 -- 172.21.15.17:0/2250925098 wait complete. 2023-10-05T15:41:05.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.962+0000 7f273beaab80 20 client.26191 trim_cache size 0 max 16384 2023-10-05T15:41:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.990+0000 7f273beaab80 1 Processor -- start 2023-10-05T15:41:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.990+0000 7f273beaab80 1 -- start start 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f273beaab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f273beaab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f273beaab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f273beaab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3ce8b8c0 con 0x560e3d0b7ec0 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f273beaab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d0b2980 con 0x560e3d0b8fd0 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f273beaab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d0c2840 con 0x560e3d0b9990 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f272639b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f2725b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f2725b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36296/0 (socket says 172.21.15.17:36296) 2023-10-05T15:41:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f2725b9a700 1 -- 172.21.15.17:0/714472606 learned_addr learned my addr 172.21.15.17:0/714472606 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.991+0000 7f2726b9c700 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.992+0000 7f2725b9a700 1 -- 172.21.15.17:0/714472606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 msgr2=0x560e3d0b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.992+0000 7f2725b9a700 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.992+0000 7f2725b9a700 1 -- 172.21.15.17:0/714472606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 msgr2=0x560e3d0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.992+0000 7f2725b9a700 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.992+0000 7f2725b9a700 1 -- 172.21.15.17:0/714472606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e3ce5c1f0 con 0x560e3d0b8fd0 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.992+0000 7f2725b9a700 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c9100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f27100cce30 tx=0x7f2710095eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f019ad1e8b1f0d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.993+0000 7f27153ff700 1 -- 172.21.15.17:0/714472606 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710099450 con 0x560e3d0b8fd0 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.993+0000 7f27153ff700 1 -- 172.21.15.17:0/714472606 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2710010510 con 0x560e3d0b8fd0 2023-10-05T15:41:05.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.993+0000 7f27153ff700 1 -- 172.21.15.17:0/714472606 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271009dc40 con 0x560e3d0b8fd0 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 -- 172.21.15.17:0/714472606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 msgr2=0x560e3d0c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c9100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f27100cce30 tx=0x7f2710095eb0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 -- 172.21.15.17:0/714472606 shutdown_connections 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 --2- 172.21.15.17:0/714472606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c9100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 -- 172.21.15.17:0/714472606 >> 172.21.15.17:0/714472606 conn(0x560e3d02c200 msgr2=0x560e3d0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 -- 172.21.15.17:0/714472606 shutdown_connections 2023-10-05T15:41:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.994+0000 7f273beaab80 1 -- 172.21.15.17:0/714472606 wait complete. 2023-10-05T15:41:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.995+0000 7f273beaab80 1 -- start start 2023-10-05T15:41:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.995+0000 7f273beaab80 1 Processor -- start 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d0c81b0 con 0x560e3d0b8fd0 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d0c8320 con 0x560e3d0b7ec0 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3d0c84e0 con 0x560e3d0b9990 2023-10-05T15:41:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.996+0000 7f273beaab80 10 client.0 _ll_register_callbacks cb 0x7f27180167f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36304/0 (socket says 172.21.15.17:36304) 2023-10-05T15:41:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 -- 172.21.15.17:0/1885766431 learned_addr learned my addr 172.21.15.17:0/1885766431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 -- 172.21.15.17:0/1885766431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 msgr2=0x560e3d0c7c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:41:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c7c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:05.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 -- 172.21.15.17:0/1885766431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b8fd0 msgr2=0x560e3d0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.997+0000 7f272639b700 1 -- 172.21.15.17:0/1885766431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272010e940 con 0x560e3d0b7ec0 2023-10-05T15:41:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.998+0000 7f272639b700 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c6720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f271c005e10 tx=0x7f271c005260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f607c1601635d440 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.998+0000 7f2709ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.998+0000 7f2709ffb700 1 -- 172.21.15.17:0/1885766431 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c030150 con 0x560e3d0b7ec0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.998+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f271c01e040 con 0x560e3d0b7ec0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.998+0000 7f2709ffb700 1 -- 172.21.15.17:0/1885766431 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f271c0302b0 con 0x560e3d0b7ec0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f2709ffb700 1 -- 172.21.15.17:0/1885766431 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f271c030470 con 0x560e3d0b7ec0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f273beaab80 10 client.26225 fetch_fsmap learned FSMap version 37 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560e3ce34250 con 0x560e3d0b7ec0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f2709ffb700 1 -- 172.21.15.17:0/1885766431 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f271c01e040 con 0x560e3d0b7ec0 2023-10-05T15:41:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f2709ffb700 1 -- 172.21.15.17:0/1885766431 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f271c004790 con 0x560e3d0b7ec0 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f273beaab80 10 client.26225 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:05.999+0000 7f273beaab80 10 client.26225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.000+0000 7f273beaab80 20 client.26225 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.000+0000 7f273beaab80 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d132c90 0x560e3d1350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.000+0000 7f273beaab80 4 client.26225 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.000+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e3d003ad0 con 0x560e3d132c90 2023-10-05T15:41:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.000+0000 7f2725b9a700 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d132c90 0x560e3d1350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.001+0000 7f2725b9a700 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d132c90 0x560e3d1350b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2b026d3aaf29f0 server_cookie=9b71500a6ab8ed86 in_seq=0 out_seq=0 2023-10-05T15:41:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.001+0000 7f2709ffb700 10 client.26225 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.019+0000 7f2709ffb700 1 -- 172.21.15.17:0/1885766431 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e3d003ad0 con 0x560e3d132c90 2023-10-05T15:41:06.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.019+0000 7f2709ffb700 10 client.26225 handle_command_reply: tid=0 2023-10-05T15:41:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.019+0000 7f273beaab80 1 client.26225 shutdown 2023-10-05T15:41:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.019+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 msgr2=0x560e3d0c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.019+0000 7f273beaab80 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c6720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f271c005e10 tx=0x7f271c005260 comp rx=0 tx=0).stop 2023-10-05T15:41:06.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 shutdown_connections 2023-10-05T15:41:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e3d132c90 0x560e3d1350b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e3d0b9990 0x560e3d0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e3d0b7ec0 0x560e3d0c6720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 --2- 172.21.15.17:0/1885766431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e3d0b8fd0 0x560e3d0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 >> 172.21.15.17:0/1885766431 conn(0x560e3d02c200 msgr2=0x560e3d0c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f2709ffb700 0 client.26225 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 shutdown_connections 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.020+0000 7f273beaab80 1 -- 172.21.15.17:0/1885766431 wait complete. 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.021+0000 7f273beaab80 20 client.26225 trim_cache size 0 max 16384 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:41:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:41:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.021+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f270c0a1500 msgr2=0x7f270c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.021+0000 7f27285ff700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f270c0a1500 0x7f270c0a39c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x560e3d0b7c60 tx=0x7f2718009040 comp rx=0 tx=0).stop 2023-10-05T15:41:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 msgr2=0x7f272010c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 0x7f272010c5d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f271000b530 tx=0x7f271000b8f0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 shutdown_connections 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f270c0a1500 0x7f270c0a39c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2720106bd0 0x7f272010d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2720101970 0x7f272010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 --2- 172.21.15.17:0/704852848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27201042a0 0x7f272010c5d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 >> 172.21.15.17:0/704852848 conn(0x7f27200fb340 msgr2=0x7f2720107000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 shutdown_connections 2023-10-05T15:41:06.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:06.022+0000 7f27285ff700 1 -- 172.21.15.17:0/704852848 wait complete. 2023-10-05T15:41:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:05 smithi167 ceph-mon[133366]: pgmap v504: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 774 op/s 2023-10-05T15:41:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:05 smithi079 ceph-mon[132936]: pgmap v504: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 774 op/s 2023-10-05T15:41:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:05 smithi017 ceph-mon[129107]: pgmap v504: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 774 op/s 2023-10-05T15:41:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:07 smithi167 ceph-mon[133366]: pgmap v505: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 595 op/s 2023-10-05T15:41:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:07 smithi079 ceph-mon[132936]: pgmap v505: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 595 op/s 2023-10-05T15:41:08.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 150.0 s, 560.4 tps, lat 153.338 ms stddev 242.400 2023-10-05T15:41:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:07 smithi017 ceph-mon[129107]: pgmap v505: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 595 op/s 2023-10-05T15:41:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:09 smithi167 ceph-mon[133366]: pgmap v506: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 639 op/s 2023-10-05T15:41:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:09 smithi079 ceph-mon[132936]: pgmap v506: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 639 op/s 2023-10-05T15:41:10.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:09 smithi017 ceph-mon[129107]: pgmap v506: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 639 op/s 2023-10-05T15:41:12.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:11 smithi167 ceph-mon[133366]: pgmap v507: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 654 op/s 2023-10-05T15:41:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:11 smithi079 ceph-mon[132936]: pgmap v507: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 654 op/s 2023-10-05T15:41:12.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:11 smithi017 ceph-mon[129107]: pgmap v507: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 654 op/s 2023-10-05T15:41:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 155.0 s, 556.6 tps, lat 205.087 ms stddev 335.000 2023-10-05T15:41:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:13 smithi167 ceph-mon[133366]: pgmap v508: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 572 op/s 2023-10-05T15:41:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:13 smithi079 ceph-mon[132936]: pgmap v508: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 572 op/s 2023-10-05T15:41:14.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:13 smithi017 ceph-mon[129107]: pgmap v508: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 572 op/s 2023-10-05T15:41:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:15 smithi167 ceph-mon[133366]: pgmap v509: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 724 op/s 2023-10-05T15:41:16.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:15 smithi079 ceph-mon[132936]: pgmap v509: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 724 op/s 2023-10-05T15:41:16.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:15 smithi017 ceph-mon[129107]: pgmap v509: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 724 op/s 2023-10-05T15:41:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:17 smithi167 ceph-mon[133366]: pgmap v510: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 593 op/s 2023-10-05T15:41:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:17 smithi079 ceph-mon[132936]: pgmap v510: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 593 op/s 2023-10-05T15:41:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 160.0 s, 641.8 tps, lat 154.453 ms stddev 226.289 2023-10-05T15:41:18.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:17 smithi017 ceph-mon[129107]: pgmap v510: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 593 op/s 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 -- 172.21.15.17:0/200142555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 msgr2=0x7f85141012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 --2- 172.21.15.17:0/200142555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f85141012d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8504009990 tx=0x7f8504009ca0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 -- 172.21.15.17:0/200142555 shutdown_connections 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 --2- 172.21.15.17:0/200142555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8514102a50 0x7f8514109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 --2- 172.21.15.17:0/200142555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f85141012d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 --2- 172.21.15.17:0/200142555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8514102090 0x7f8514102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.285+0000 7f85199ff700 1 -- 172.21.15.17:0/200142555 >> 172.21.15.17:0/200142555 conn(0x7f85140fc430 msgr2=0x7f85140fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.292+0000 7f85199ff700 1 -- 172.21.15.17:0/200142555 shutdown_connections 2023-10-05T15:41:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.292+0000 7f85199ff700 1 -- 172.21.15.17:0/200142555 wait complete. 2023-10-05T15:41:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.294+0000 7f85199ff700 1 Processor -- start 2023-10-05T15:41:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.294+0000 7f85199ff700 1 -- start start 2023-10-05T15:41:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85199ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f851406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85199ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8514102090 0x7f851406fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85199ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8514102a50 0x7f8514070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85199ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514071320 con 0x7f8514102090 2023-10-05T15:41:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85199ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514071490 con 0x7f8514102a50 2023-10-05T15:41:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85199ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514071650 con 0x7f8514100eb0 2023-10-05T15:41:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f850affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f851406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f850affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f851406f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42766/0 (socket says 172.21.15.17:42766) 2023-10-05T15:41:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f850affd700 1 -- 172.21.15.17:0/4247047380 learned_addr learned my addr 172.21.15.17:0/4247047380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.295+0000 7f85137fe700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8514102a50 0x7f8514070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.296+0000 7f850affd700 1 -- 172.21.15.17:0/4247047380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8514102a50 msgr2=0x7f8514070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.296+0000 7f850affd700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8514102a50 0x7f8514070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.296+0000 7f850affd700 1 -- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8514102090 msgr2=0x7f851406fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.296+0000 7f850affd700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8514102090 0x7f851406fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.296+0000 7f850affd700 1 -- 172.21.15.17:0/4247047380 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040095f0 con 0x7f8514100eb0 2023-10-05T15:41:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.296+0000 7f850affd700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f851406f8b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8504005910 tx=0x7f8504005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.297+0000 7f85189fd700 1 -- 172.21.15.17:0/4247047380 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850401d070 con 0x7f8514100eb0 2023-10-05T15:41:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.297+0000 7f85189fd700 1 -- 172.21.15.17:0/4247047380 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8504022470 con 0x7f8514100eb0 2023-10-05T15:41:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.297+0000 7f85189fd700 1 -- 172.21.15.17:0/4247047380 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400f6c0 con 0x7f8514100eb0 2023-10-05T15:41:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.297+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140718d0 con 0x7f8514100eb0 2023-10-05T15:41:19.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.297+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85140720e0 con 0x7f8514100eb0 2023-10-05T15:41:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.305+0000 7f85189fd700 1 -- 172.21.15.17:0/4247047380 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8504022850 con 0x7f8514100eb0 2023-10-05T15:41:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.308+0000 7f852d321b80 1 Processor -- start 2023-10-05T15:41:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.308+0000 7f852d321b80 1 -- start start 2023-10-05T15:41:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f852d321b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb8a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f852d321b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb8b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f852d321b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb92220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f852d321b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8eaf2400 con 0x558d8eb8b990 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f852d321b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8eae3bc0 con 0x558d8eb8afd0 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f852d321b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8eae14e0 con 0x558d8eb89ec0 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f85189fd700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85000a1500 0x7f85000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f85137fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb8a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f85189fd700 1 -- 172.21.15.17:0/4247047380 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f85040ce750 con 0x7f8514100eb0 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f85137fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb8a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42782/0 (socket says 172.21.15.17:42782) 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f85137fe700 1 -- 172.21.15.17:0/1967559376 learned_addr learned my addr 172.21.15.17:0/1967559376 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.310+0000 7f850affd700 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb8b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.311+0000 7f85137fe700 1 -- 172.21.15.17:0/1967559376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 msgr2=0x558d8eb8b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.311+0000 7f85137fe700 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb8b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.311+0000 7f85137fe700 1 -- 172.21.15.17:0/1967559376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 msgr2=0x558d8eb92220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.311+0000 7f85137fe700 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb92220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.311+0000 7f85137fe700 1 -- 172.21.15.17:0/1967559376 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d8e907d80 con 0x558d8eb89ec0 2023-10-05T15:41:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.311+0000 7f85137fe700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85000a1500 0x7f85000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.312+0000 7f85137fe700 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb8a2e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f850c008540 tx=0x7f850c008850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee349129c17e7c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.313+0000 7f8509ffb700 1 -- 172.21.15.17:0/1967559376 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0165e0 con 0x558d8eb89ec0 2023-10-05T15:41:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.313+0000 7f8509ffb700 1 -- 172.21.15.17:0/1967559376 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f850c00f040 con 0x558d8eb89ec0 2023-10-05T15:41:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.313+0000 7f8509ffb700 1 -- 172.21.15.17:0/1967559376 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c021990 con 0x558d8eb89ec0 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 -- 172.21.15.17:0/1967559376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 msgr2=0x558d8eb8a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb8a2e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f850c008540 tx=0x7f850c008850 comp rx=0 tx=0).stop 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 -- 172.21.15.17:0/1967559376 shutdown_connections 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb92220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb8a2e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 --2- 172.21.15.17:0/1967559376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb8b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f852d321b80 1 -- 172.21.15.17:0/1967559376 >> 172.21.15.17:0/1967559376 conn(0x558d8eafe200 msgr2=0x558d8eb84bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.314+0000 7f85137fe700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85000a1500 0x7f85000a39c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f850c016fd0 tx=0x7f850c021bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.315+0000 7f852d321b80 1 -- 172.21.15.17:0/1967559376 shutdown_connections 2023-10-05T15:41:19.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.316+0000 7f852d321b80 1 -- 172.21.15.17:0/1967559376 wait complete. 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.317+0000 7f852d321b80 1 -- start start 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.318+0000 7f852d321b80 1 Processor -- start 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb93b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb94080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb9b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8eadcdd0 con 0x558d8eb8b990 2023-10-05T15:41:19.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8ea796b0 con 0x558d8eb8afd0 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8ea79350 con 0x558d8eb89ec0 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.319+0000 7f852d321b80 10 client.0 _ll_register_callbacks cb 0x558d8e8d67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.320+0000 7f85137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb9b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.320+0000 7f85137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb9b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48316/0 (socket says 172.21.15.17:48316) 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.320+0000 7f85137fe700 1 -- 172.21.15.17:0/3713273853 learned_addr learned my addr 172.21.15.17:0/3713273853 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.321+0000 7f850affd700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb93b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f85137fe700 1 -- 172.21.15.17:0/3713273853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 msgr2=0x558d8eb93b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f85137fe700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb93b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f85137fe700 1 -- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 msgr2=0x558d8eb94080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:41:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f85137fe700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb94080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f85137fe700 1 -- 172.21.15.17:0/3713273853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c009250 con 0x558d8eb8b990 2023-10-05T15:41:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f850affd700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb93b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:41:19.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.322+0000 7f85137fe700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb9b0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f850c016c30 tx=0x7f850c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7fc8ea16c1da36 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.323+0000 7f84f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:41:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.323+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3713273853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00e050 con 0x558d8eb8b990 2023-10-05T15:41:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.323+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3713273853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f850c028070 con 0x558d8eb8b990 2023-10-05T15:41:19.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.324+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d8eb7cd50 con 0x558d8eb8b990 2023-10-05T15:41:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.324+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3713273853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f850c021950 con 0x558d8eb8b990 2023-10-05T15:41:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.324+0000 7f852d321b80 10 client.16377 fetch_fsmap learned FSMap version 37 2023-10-05T15:41:19.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.324+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558d8e8f0c00 con 0x558d8eb8b990 2023-10-05T15:41:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3713273853 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558d8eb7cd50 con 0x558d8eb8b990 2023-10-05T15:41:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3713273853 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 37) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f850c02b040 con 0x558d8eb8b990 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f852d321b80 10 client.16377 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f852d321b80 10 client.16377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f852d321b80 20 client.16377 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f852d321b80 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8eb9fa40 0x558d8eba1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f852d321b80 4 client.16377 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.326+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d8ead5db0 con 0x558d8eb9fa40 2023-10-05T15:41:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.327+0000 7f850affd700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8eb9fa40 0x558d8eba1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.328+0000 7f850affd700 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8eb9fa40 0x558d8eba1e60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467a4f5d75f9186b server_cookie=944c4dcce9e0c7eb in_seq=0 out_seq=0 2023-10-05T15:41:19.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.328+0000 7f84f2ffd700 10 client.16377 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.331+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3713273853 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d8ead5db0 con 0x558d8eb9fa40 2023-10-05T15:41:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.331+0000 7f84f2ffd700 10 client.16377 handle_command_reply: tid=0 2023-10-05T15:41:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.331+0000 7f852d321b80 1 client.16377 shutdown 2023-10-05T15:41:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 msgr2=0x558d8eb9b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb9b0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f850c016c30 tx=0x7f850c017000 comp rx=0 tx=0).stop 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 shutdown_connections 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8eb9fa40 0x558d8eba1e60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb9b0c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eb93b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 --2- 172.21.15.17:0/3713273853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb94080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 >> 172.21.15.17:0/3713273853 conn(0x558d8eafe200 msgr2=0x558d8eb84250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.333+0000 7f84f2ffd700 0 client.16377 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.334+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 shutdown_connections 2023-10-05T15:41:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.335+0000 7f852d321b80 1 -- 172.21.15.17:0/3713273853 wait complete. 2023-10-05T15:41:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.338+0000 7f852d321b80 20 client.16377 trim_cache size 0 max 16384 2023-10-05T15:41:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.368+0000 7f852d321b80 1 Processor -- start 2023-10-05T15:41:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.368+0000 7f852d321b80 1 -- start start 2023-10-05T15:41:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.368+0000 7f852d321b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eba1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.368+0000 7f852d321b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb9afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f852d321b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f852d321b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8eb93710 con 0x558d8eb8b990 2023-10-05T15:41:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f852d321b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8e95d8c0 con 0x558d8eb8afd0 2023-10-05T15:41:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f852d321b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8eb9b520 con 0x558d8eb89ec0 2023-10-05T15:41:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f85137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f85137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb91d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48322/0 (socket says 172.21.15.17:48322) 2023-10-05T15:41:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f85137fe700 1 -- 172.21.15.17:0/1252512984 learned_addr learned my addr 172.21.15.17:0/1252512984 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.369+0000 7f850affd700 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eba1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.370+0000 7f85137fe700 1 -- 172.21.15.17:0/1252512984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 msgr2=0x558d8eba1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.370+0000 7f85137fe700 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eba1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.370+0000 7f85137fe700 1 -- 172.21.15.17:0/1252512984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 msgr2=0x558d8eb9afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.370+0000 7f85137fe700 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb9afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.370+0000 7f85137fe700 1 -- 172.21.15.17:0/1252512984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d8e92e1f0 con 0x558d8eb8b990 2023-10-05T15:41:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.371+0000 7f85137fe700 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb91d90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f850c018cc0 tx=0x7f850c008850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b18764139b0ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.372+0000 7f850a7fc700 1 -- 172.21.15.17:0/1252512984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00e070 con 0x558d8eb8b990 2023-10-05T15:41:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.372+0000 7f850a7fc700 1 -- 172.21.15.17:0/1252512984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f850c026070 con 0x558d8eb8b990 2023-10-05T15:41:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.372+0000 7f850a7fc700 1 -- 172.21.15.17:0/1252512984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c02d890 con 0x558d8eb8b990 2023-10-05T15:41:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.373+0000 7f852d321b80 1 -- 172.21.15.17:0/1252512984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 msgr2=0x558d8eb91d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.373+0000 7f852d321b80 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb91d90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f850c018cc0 tx=0x7f850c008850 comp rx=0 tx=0).stop 2023-10-05T15:41:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.374+0000 7f852d321b80 1 -- 172.21.15.17:0/1252512984 shutdown_connections 2023-10-05T15:41:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.374+0000 7f852d321b80 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8eb91d90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.374+0000 7f852d321b80 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb89ec0 0x558d8eba1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.374+0000 7f852d321b80 1 --2- 172.21.15.17:0/1252512984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb8afd0 0x558d8eb9afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.374+0000 7f852d321b80 1 -- 172.21.15.17:0/1252512984 >> 172.21.15.17:0/1252512984 conn(0x558d8eafe200 msgr2=0x558d8eba67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.378+0000 7f852d321b80 1 -- 172.21.15.17:0/1252512984 shutdown_connections 2023-10-05T15:41:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.380+0000 7f852d321b80 1 -- 172.21.15.17:0/1252512984 wait complete. 2023-10-05T15:41:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.380+0000 7f852d321b80 1 -- start start 2023-10-05T15:41:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.381+0000 7f852d321b80 1 Processor -- start 2023-10-05T15:41:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 0x558d8eb97f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb8afd0 0x558d8eb984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8ebf1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8ebf1d90 con 0x558d8eb8b990 2023-10-05T15:41:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8ebf1ed0 con 0x558d8eb89ec0 2023-10-05T15:41:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d8ebf2010 con 0x558d8eb8afd0 2023-10-05T15:41:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.382+0000 7f852d321b80 10 client.0 _ll_register_callbacks cb 0x7f850c009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.383+0000 7f850affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 0x558d8eb97f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.383+0000 7f850affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 0x558d8eb97f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56790/0 (socket says 172.21.15.17:56790) 2023-10-05T15:41:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.383+0000 7f850affd700 1 -- 172.21.15.17:0/3250532981 learned_addr learned my addr 172.21.15.17:0/3250532981 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.383+0000 7f85137fe700 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8ebf1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f850affd700 1 -- 172.21.15.17:0/3250532981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb8afd0 msgr2=0x558d8eb984a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f850affd700 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb8afd0 0x558d8eb984a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f850affd700 1 -- 172.21.15.17:0/3250532981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 msgr2=0x558d8ebf1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f850affd700 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8ebf1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f850affd700 1 -- 172.21.15.17:0/3250532981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d8e8f0c00 con 0x558d8eb89ec0 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f850affd700 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 0x558d8eb97f60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f850409b6f0 tx=0x7f85040cbd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac7c181bdc380a36 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.384+0000 7f84f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.385+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3250532981 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850409f8b0 con 0x558d8eb89ec0 2023-10-05T15:41:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.385+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3250532981 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f85040b5060 con 0x558d8eb89ec0 2023-10-05T15:41:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.385+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f850c00f040 con 0x558d8eb89ec0 2023-10-05T15:41:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.385+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3250532981 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85040a3a60 con 0x558d8eb89ec0 2023-10-05T15:41:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.385+0000 7f852d321b80 10 client.26237 fetch_fsmap learned FSMap version 37 2023-10-05T15:41:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.385+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558d8e906250 con 0x558d8eb89ec0 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3250532981 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f850c00f040 con 0x558d8eb89ec0 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3250532981 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 37) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f85040ce450 con 0x558d8eb89ec0 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f852d321b80 10 client.26237 fetch_fsmap finished waiting for FSMap version 37 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f852d321b80 10 client.26237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f852d321b80 20 client.26237 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f852d321b80 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8ebf3750 0x558d8ebf5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f852d321b80 4 client.26237 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:41:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.387+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558d8ead5ad0 con 0x558d8ebf3750 2023-10-05T15:41:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.388+0000 7f8512ffd700 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8ebf3750 0x558d8ebf5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.391+0000 7f8512ffd700 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8ebf3750 0x558d8ebf5b70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86038032079ef976 server_cookie=790f936f76f47127 in_seq=0 out_seq=0 2023-10-05T15:41:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.391+0000 7f84f2ffd700 10 client.26237 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.418+0000 7f84f2ffd700 1 -- 172.21.15.17:0/3250532981 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558d8ead5ad0 con 0x558d8ebf3750 2023-10-05T15:41:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.418+0000 7f84f2ffd700 10 client.26237 handle_command_reply: tid=0 2023-10-05T15:41:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.420+0000 7f852d321b80 1 client.26237 shutdown 2023-10-05T15:41:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 msgr2=0x558d8eb97f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 0x558d8eb97f60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f850409b6f0 tx=0x7f85040cbd80 comp rx=0 tx=0).stop 2023-10-05T15:41:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 shutdown_connections 2023-10-05T15:41:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558d8ebf3750 0x558d8ebf5b70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558d8eb8b990 0x558d8ebf1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558d8eb89ec0 0x558d8eb97f60 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f850409b6f0 tx=0x7f85040cbd80 comp rx=0 tx=0).stop 2023-10-05T15:41:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 --2- 172.21.15.17:0/3250532981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d8eb8afd0 0x558d8eb984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.421+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 >> 172.21.15.17:0/3250532981 conn(0x558d8eafe200 msgr2=0x558d8eba1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.424+0000 7f84f2ffd700 0 client.26237 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.428+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 shutdown_connections 2023-10-05T15:41:19.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.428+0000 7f852d321b80 1 -- 172.21.15.17:0/3250532981 wait complete. 2023-10-05T15:41:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.430+0000 7f852d321b80 20 client.26237 trim_cache size 0 max 16384 2023-10-05T15:41:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:41:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:41:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:41:19.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:41:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.432+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85000a1500 msgr2=0x7f85000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.432+0000 7f85199ff700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85000a1500 0x7f85000a39c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f850c016fd0 tx=0x7f850c021bd0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.432+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 msgr2=0x7f851406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.432+0000 7f85199ff700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f851406f8b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8504005910 tx=0x7f8504005740 comp rx=0 tx=0).stop 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.433+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 shutdown_connections 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.433+0000 7f85199ff700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85000a1500 0x7f85000a39c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.433+0000 7f85199ff700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8514102a50 0x7f8514070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.433+0000 7f85199ff700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8514100eb0 0x7f851406f8b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.433+0000 7f85199ff700 1 --2- 172.21.15.17:0/4247047380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8514102090 0x7f851406fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:19.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.433+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 >> 172.21.15.17:0/4247047380 conn(0x7f85140fc430 msgr2=0x7f8514105700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.434+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 shutdown_connections 2023-10-05T15:41:19.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:19.435+0000 7f85199ff700 1 -- 172.21.15.17:0/4247047380 wait complete. 2023-10-05T15:41:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:19 smithi167 ceph-mon[133366]: pgmap v511: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 624 op/s 2023-10-05T15:41:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:19 smithi079 ceph-mon[132936]: pgmap v511: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 624 op/s 2023-10-05T15:41:20.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:19 smithi017 ceph-mon[129107]: pgmap v511: 129 pgs: 129 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 624 op/s 2023-10-05T15:41:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:21 smithi167 ceph-mon[133366]: pgmap v512: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 688 op/s 2023-10-05T15:41:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:21 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:21 smithi079 ceph-mon[132936]: pgmap v512: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 688 op/s 2023-10-05T15:41:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:21 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:22.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:21 smithi017 ceph-mon[129107]: pgmap v512: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 688 op/s 2023-10-05T15:41:22.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:21 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 165.0 s, 418.6 tps, lat 239.662 ms stddev 307.954 2023-10-05T15:41:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:23 smithi167 ceph-mon[133366]: pgmap v513: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 598 op/s 2023-10-05T15:41:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:23 smithi079 ceph-mon[132936]: pgmap v513: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 598 op/s 2023-10-05T15:41:24.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:23 smithi017 ceph-mon[129107]: pgmap v513: 129 pgs: 129 active+clean; 1.4 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 598 op/s 2023-10-05T15:41:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:25 smithi167 ceph-mon[133366]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 738 op/s 2023-10-05T15:41:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:25 smithi079 ceph-mon[132936]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 738 op/s 2023-10-05T15:41:26.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:25 smithi017 ceph-mon[129107]: pgmap v514: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 738 op/s 2023-10-05T15:41:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:27 smithi167 ceph-mon[133366]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 576 op/s 2023-10-05T15:41:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:27 smithi079 ceph-mon[132936]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 576 op/s 2023-10-05T15:41:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 170.0 s, 406.4 tps, lat 245.648 ms stddev 355.555 2023-10-05T15:41:28.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:27 smithi017 ceph-mon[129107]: pgmap v515: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 576 op/s 2023-10-05T15:41:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:29 smithi167 ceph-mon[133366]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 656 op/s 2023-10-05T15:41:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:29 smithi079 ceph-mon[132936]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 656 op/s 2023-10-05T15:41:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:29 smithi017 ceph-mon[129107]: pgmap v516: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 656 op/s 2023-10-05T15:41:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:31 smithi167 ceph-mon[133366]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 13 MiB/s wr, 677 op/s 2023-10-05T15:41:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:31 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:31 smithi079 ceph-mon[132936]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 13 MiB/s wr, 677 op/s 2023-10-05T15:41:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:31 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:32.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:31 smithi017 ceph-mon[129107]: pgmap v517: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 13 MiB/s wr, 677 op/s 2023-10-05T15:41:32.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:31 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 -- 172.21.15.17:0/3749218545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 msgr2=0x7f9330109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 --2- 172.21.15.17:0/3749218545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330109040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f932800b0a0 tx=0x7f932800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 -- 172.21.15.17:0/3749218545 shutdown_connections 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 --2- 172.21.15.17:0/3749218545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330109040 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 --2- 172.21.15.17:0/3749218545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9330101970 0x7f9330103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 --2- 172.21.15.17:0/3749218545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93301042a0 0x7f9330106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 -- 172.21.15.17:0/3749218545 >> 172.21.15.17:0/3749218545 conn(0x7f93300fb340 msgr2=0x7f93300fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 -- 172.21.15.17:0/3749218545 shutdown_connections 2023-10-05T15:41:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.659+0000 7f9336bff700 1 -- 172.21.15.17:0/3749218545 wait complete. 2023-10-05T15:41:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.660+0000 7f9336bff700 1 Processor -- start 2023-10-05T15:41:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 -- start start 2023-10-05T15:41:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 0x7f9330192040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93301042a0 0x7f9330192580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330193450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9330193ab0 con 0x7f93301042a0 2023-10-05T15:41:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9330193c20 con 0x7f9330106bd0 2023-10-05T15:41:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.661+0000 7f9336bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9330193de0 con 0x7f9330101970 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 0x7f9330192040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 0x7f9330192040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50272/0 (socket says 172.21.15.17:50272) 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 -- 172.21.15.17:0/2974439720 learned_addr learned my addr 172.21.15.17:0/2974439720 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933519c700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330193450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f932ffff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93301042a0 0x7f9330192580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 -- 172.21.15.17:0/2974439720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 msgr2=0x7f9330193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330193450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 -- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93301042a0 msgr2=0x7f9330192580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93301042a0 0x7f9330192580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933499b700 1 -- 172.21.15.17:0/2974439720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328009d00 con 0x7f9330101970 2023-10-05T15:41:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.662+0000 7f933519c700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330193450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:41:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f932ffff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93301042a0 0x7f9330192580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:41:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f933499b700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 0x7f9330192040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f932400d980 tx=0x7f932400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f932dffb700 1 -- 172.21.15.17:0/2974439720 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324004220 con 0x7f9330101970 2023-10-05T15:41:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f932dffb700 1 -- 172.21.15.17:0/2974439720 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9324007640 con 0x7f9330101970 2023-10-05T15:41:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93301940c0 con 0x7f9330101970 2023-10-05T15:41:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9330194870 con 0x7f9330101970 2023-10-05T15:41:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.663+0000 7f932dffb700 1 -- 172.21.15.17:0/2974439720 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240055e0 con 0x7f9330101970 2023-10-05T15:41:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.668+0000 7f932dffb700 1 -- 172.21.15.17:0/2974439720 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9324004380 con 0x7f9330101970 2023-10-05T15:41:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.669+0000 7f934a5bfb80 1 Processor -- start 2023-10-05T15:41:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 -- start start 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a18252e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a1826450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a182d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a178d400 con 0x5591a1824ec0 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a177ebc0 con 0x5591a1826990 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a177c4e0 con 0x5591a1825fd0 2023-10-05T15:41:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f932dffb700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93200a1500 0x7f93200a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.670+0000 7f932ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a182d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a182d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40338/0 (socket says 172.21.15.17:40338) 2023-10-05T15:41:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 -- 172.21.15.17:0/670019322 learned_addr learned my addr 172.21.15.17:0/670019322 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932dffb700 1 -- 172.21.15.17:0/2974439720 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f93240cce50 con 0x7f9330101970 2023-10-05T15:41:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f933519c700 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a18252e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f933499b700 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a1826450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f933519c700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93200a1500 0x7f93200a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 -- 172.21.15.17:0/670019322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 msgr2=0x5591a1826450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a1826450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 -- 172.21.15.17:0/670019322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 msgr2=0x5591a18252e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a18252e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.671+0000 7f932ffff700 1 -- 172.21.15.17:0/670019322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a15a2d80 con 0x5591a1826990 2023-10-05T15:41:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.672+0000 7f933519c700 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a18252e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:41:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.672+0000 7f932ffff700 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a182d220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f931c009d60 tx=0x7f931c0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2779c96ebb79ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.672+0000 7f931affd700 1 -- 172.21.15.17:0/670019322 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c010e10 con 0x5591a1826990 2023-10-05T15:41:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.673+0000 7f931affd700 1 -- 172.21.15.17:0/670019322 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f931c015070 con 0x5591a1826990 2023-10-05T15:41:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.673+0000 7f931affd700 1 -- 172.21.15.17:0/670019322 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c01a5e0 con 0x5591a1826990 2023-10-05T15:41:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.673+0000 7f933519c700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93200a1500 0x7f93200a39c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f932800b780 tx=0x7f9328006210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.673+0000 7f934a5bfb80 1 -- 172.21.15.17:0/670019322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 msgr2=0x5591a182d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.673+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a182d220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f931c009d60 tx=0x7f931c0106b0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 -- 172.21.15.17:0/670019322 shutdown_connections 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a182d220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a18252e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/670019322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a1826450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 -- 172.21.15.17:0/670019322 >> 172.21.15.17:0/670019322 conn(0x5591a1799200 msgr2=0x5591a181fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 -- 172.21.15.17:0/670019322 shutdown_connections 2023-10-05T15:41:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.674+0000 7f934a5bfb80 1 -- 172.21.15.17:0/670019322 wait complete. 2023-10-05T15:41:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.675+0000 7f934a5bfb80 1 -- start start 2023-10-05T15:41:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.675+0000 7f934a5bfb80 1 Processor -- start 2023-10-05T15:41:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a182f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1826990 0x5591a1836120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a1777dd0 con 0x5591a1824ec0 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a17146b0 con 0x5591a1825fd0 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a1714350 con 0x5591a1826990 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f934a5bfb80 10 client.0 _ll_register_callbacks cb 0x5591a15717a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f933499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f933499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54370/0 (socket says 172.21.15.17:54370) 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.676+0000 7f933499b700 1 -- 172.21.15.17:0/307252912 learned_addr learned my addr 172.21.15.17:0/307252912 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.677+0000 7f933499b700 1 -- 172.21.15.17:0/307252912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1826990 msgr2=0x5591a1836120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.677+0000 7f933499b700 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1826990 0x5591a1836120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.677+0000 7f933499b700 1 -- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 msgr2=0x5591a182f0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:41:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.677+0000 7f933499b700 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a182f0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.677+0000 7f933499b700 1 -- 172.21.15.17:0/307252912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9330109c30 con 0x5591a1824ec0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.677+0000 7f933499b700 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182eba0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9324099d00 tx=0x7f932409a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec2a7079fbed886 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f930ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f930ffff700 1 -- 172.21.15.17:0/307252912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240a2100 con 0x5591a1824ec0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f930ffff700 1 -- 172.21.15.17:0/307252912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f93240ca660 con 0x5591a1824ec0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591a1817d50 con 0x5591a1824ec0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f930ffff700 1 -- 172.21.15.17:0/307252912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9324083b20 con 0x5591a1824ec0 2023-10-05T15:41:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f934a5bfb80 10 client.16395 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.678+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f931c009990 con 0x5591a1824ec0 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f930ffff700 1 -- 172.21.15.17:0/307252912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591a1817d50 con 0x5591a1824ec0 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f930ffff700 1 -- 172.21.15.17:0/307252912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9324081020 con 0x5591a1824ec0 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f934a5bfb80 10 client.16395 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f934a5bfb80 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f934a5bfb80 20 client.16395 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a184ba10 0x5591a184de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f934a5bfb80 4 client.16395 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.679+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591a1770db0 con 0x5591a184ba10 2023-10-05T15:41:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.680+0000 7f932ffff700 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a184ba10 0x5591a184de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.680+0000 7f932ffff700 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a184ba10 0x5591a184de30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab57cdaf75d88b9 server_cookie=d73bf9f0683fbe49 in_seq=0 out_seq=0 2023-10-05T15:41:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.680+0000 7f930ffff700 10 client.16395 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.681+0000 7f930ffff700 1 -- 172.21.15.17:0/307252912 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591a1770db0 con 0x5591a184ba10 2023-10-05T15:41:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.681+0000 7f930ffff700 10 client.16395 handle_command_reply: tid=0 2023-10-05T15:41:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.682+0000 7f934a5bfb80 1 client.16395 shutdown 2023-10-05T15:41:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.682+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 msgr2=0x5591a182eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.682+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182eba0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9324099d00 tx=0x7f932409a470 comp rx=0 tx=0).stop 2023-10-05T15:41:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 shutdown_connections 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a184ba10 0x5591a184de30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1826990 0x5591a1836120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182eba0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/307252912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a182f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 >> 172.21.15.17:0/307252912 conn(0x5591a1799200 msgr2=0x5591a181f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f930ffff700 0 client.16395 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 shutdown_connections 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.683+0000 7f934a5bfb80 1 -- 172.21.15.17:0/307252912 wait complete. 2023-10-05T15:41:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.684+0000 7f934a5bfb80 20 client.16395 trim_cache size 0 max 16384 2023-10-05T15:41:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.708+0000 7f934a5bfb80 1 Processor -- start 2023-10-05T15:41:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.708+0000 7f934a5bfb80 1 -- start start 2023-10-05T15:41:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a182d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a18360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a15f88c0 con 0x5591a1824ec0 2023-10-05T15:41:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a1820a00 con 0x5591a1826990 2023-10-05T15:41:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a182e0a0 con 0x5591a1825fd0 2023-10-05T15:41:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f933519c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a18360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f932ffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a182d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f933519c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a18360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40348/0 (socket says 172.21.15.17:40348) 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f933519c700 1 -- 172.21.15.17:0/1735880833 learned_addr learned my addr 172.21.15.17:0/1735880833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f932ffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a182d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50304/0 (socket says 172.21.15.17:50304) 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.709+0000 7f933499b700 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933519c700 1 -- 172.21.15.17:0/1735880833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 msgr2=0x5591a182d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933519c700 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a182d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933519c700 1 -- 172.21.15.17:0/1735880833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 msgr2=0x5591a182cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933519c700 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933519c700 1 -- 172.21.15.17:0/1735880833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591a158bc00 con 0x5591a1826990 2023-10-05T15:41:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f932ffff700 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a182d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:41:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933499b700 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:41:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.710+0000 7f933519c700 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a18360b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f932800b0a0 tx=0x7f9328019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f506ed88df919213 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.711+0000 7f931b7fe700 1 -- 172.21.15.17:0/1735880833 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932800e040 con 0x5591a1826990 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.711+0000 7f931b7fe700 1 -- 172.21.15.17:0/1735880833 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f932800bdf0 con 0x5591a1826990 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.711+0000 7f931b7fe700 1 -- 172.21.15.17:0/1735880833 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280052a0 con 0x5591a1826990 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.711+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1735880833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 msgr2=0x5591a18360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.711+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a18360b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f932800b0a0 tx=0x7f9328019000 comp rx=0 tx=0).stop 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1735880833 shutdown_connections 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1826990 0x5591a18360b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1824ec0 0x5591a182cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1735880833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1825fd0 0x5591a182d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1735880833 >> 172.21.15.17:0/1735880833 conn(0x5591a1799200 msgr2=0x5591a184da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1735880833 shutdown_connections 2023-10-05T15:41:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1735880833 wait complete. 2023-10-05T15:41:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.712+0000 7f934a5bfb80 1 -- start start 2023-10-05T15:41:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.713+0000 7f934a5bfb80 1 Processor -- start 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.713+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1824ec0 0x5591a1833a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.713+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a1833f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f934a5bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1826990 0x5591a1834f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a18354c0 con 0x5591a1826990 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a1835630 con 0x5591a1825fd0 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f934a5bfb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591a18357a0 con 0x5591a1824ec0 2023-10-05T15:41:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f934a5bfb80 10 client.0 _ll_register_callbacks cb 0x7f9324080160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f933519c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1826990 0x5591a1834f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f933519c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1826990 0x5591a1834f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54382/0 (socket says 172.21.15.17:54382) 2023-10-05T15:41:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f933519c700 1 -- 172.21.15.17:0/1765039183 learned_addr learned my addr 172.21.15.17:0/1765039183 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f932ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a1833f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.714+0000 7f933499b700 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1824ec0 0x5591a1833a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f932ffff700 1 -- 172.21.15.17:0/1765039183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1824ec0 msgr2=0x5591a1833a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f932ffff700 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1824ec0 0x5591a1833a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f932ffff700 1 -- 172.21.15.17:0/1765039183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1826990 msgr2=0x5591a1834f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f932ffff700 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1826990 0x5591a1834f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f932ffff700 1 -- 172.21.15.17:0/1765039183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591a15a2d80 con 0x5591a1825fd0 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f932ffff700 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a1833f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f931c011d30 tx=0x7f931c009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e467a1df10f5af server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.715+0000 7f930ffff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.716+0000 7f930ffff700 1 -- 172.21.15.17:0/1765039183 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c020040 con 0x5591a1825fd0 2023-10-05T15:41:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.716+0000 7f930ffff700 1 -- 172.21.15.17:0/1765039183 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f931c017070 con 0x5591a1825fd0 2023-10-05T15:41:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.716+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f931c015070 con 0x5591a1825fd0 2023-10-05T15:41:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.716+0000 7f930ffff700 1 -- 172.21.15.17:0/1765039183 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f931c025580 con 0x5591a1825fd0 2023-10-05T15:41:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f934a5bfb80 10 client.26252 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f932800bb60 con 0x5591a1825fd0 2023-10-05T15:41:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f930ffff700 1 -- 172.21.15.17:0/1765039183 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f931c015070 con 0x5591a1825fd0 2023-10-05T15:41:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f930ffff700 1 -- 172.21.15.17:0/1765039183 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f931c02b020 con 0x5591a1825fd0 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f934a5bfb80 10 client.26252 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f934a5bfb80 10 client.26252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f934a5bfb80 20 client.26252 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.717+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a18b1240 0x5591a18b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.718+0000 7f934a5bfb80 4 client.26252 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.718+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5591a1770ad0 con 0x5591a18b1240 2023-10-05T15:41:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.718+0000 7f933499b700 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a18b1240 0x5591a18b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.719+0000 7f933499b700 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a18b1240 0x5591a18b3660 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24cd86c9cf62bbcb server_cookie=9ee828f2bc129dc9 in_seq=0 out_seq=0 2023-10-05T15:41:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.719+0000 7f930ffff700 10 client.26252 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.735+0000 7f930ffff700 1 -- 172.21.15.17:0/1765039183 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5591a1770ad0 con 0x5591a18b1240 2023-10-05T15:41:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.735+0000 7f930ffff700 10 client.26252 handle_command_reply: tid=0 2023-10-05T15:41:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.735+0000 7f934a5bfb80 1 client.26252 shutdown 2023-10-05T15:41:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 msgr2=0x5591a1833f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a1833f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f931c011d30 tx=0x7f931c009600 comp rx=0 tx=0).stop 2023-10-05T15:41:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 shutdown_connections 2023-10-05T15:41:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5591a18b1240 0x5591a18b3660 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591a1826990 0x5591a1834f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5591a1824ec0 0x5591a1833a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 --2- 172.21.15.17:0/1765039183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5591a1825fd0 0x5591a1833f70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 >> 172.21.15.17:0/1765039183 conn(0x5591a1799200 msgr2=0x5591a182cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f930ffff700 0 client.26252 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 shutdown_connections 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.736+0000 7f934a5bfb80 1 -- 172.21.15.17:0/1765039183 wait complete. 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.737+0000 7f934a5bfb80 20 client.26252 trim_cache size 0 max 16384 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:41:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:41:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:41:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.737+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93200a1500 msgr2=0x7f93200a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.737+0000 7f9336bff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93200a1500 0x7f93200a39c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f932800b780 tx=0x7f9328006210 comp rx=0 tx=0).stop 2023-10-05T15:41:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.737+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 msgr2=0x7f9330192040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.737+0000 7f9336bff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 0x7f9330192040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f932400d980 tx=0x7f932400dc90 comp rx=0 tx=0).stop 2023-10-05T15:41:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 shutdown_connections 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f93200a1500 0x7f93200a39c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9330106bd0 0x7f9330193450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9330101970 0x7f9330192040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 --2- 172.21.15.17:0/2974439720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93301042a0 0x7f9330192580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 >> 172.21.15.17:0/2974439720 conn(0x7f93300fb340 msgr2=0x7f93300fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.738+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 shutdown_connections 2023-10-05T15:41:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:32.739+0000 7f9336bff700 1 -- 172.21.15.17:0/2974439720 wait complete. 2023-10-05T15:41:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 175.0 s, 528.6 tps, lat 189.489 ms stddev 255.272 2023-10-05T15:41:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:33 smithi167 ceph-mon[133366]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 555 op/s 2023-10-05T15:41:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:33 smithi079 ceph-mon[132936]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 555 op/s 2023-10-05T15:41:34.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:41:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:33 smithi017 ceph-mon[129107]: pgmap v518: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 10 MiB/s wr, 555 op/s 2023-10-05T15:41:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 -- 172.21.15.17:0/1211161607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc107510 msgr2=0x7f71fc107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 --2- 172.21.15.17:0/1211161607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc107510 0x7f71fc107930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f71f800b0d0 tx=0x7f71f800b3e0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 -- 172.21.15.17:0/1211161607 shutdown_connections 2023-10-05T15:41:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 --2- 172.21.15.17:0/1211161607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc1090a0 0x7f71fc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 --2- 172.21.15.17:0/1211161607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc107510 0x7f71fc107930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 --2- 172.21.15.17:0/1211161607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 0x7f71fc108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.532+0000 7f72043ff700 1 -- 172.21.15.17:0/1211161607 >> 172.21.15.17:0/1211161607 conn(0x7f71fc076490 msgr2=0x7f71fc0788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:34.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.533+0000 7f72043ff700 1 -- 172.21.15.17:0/1211161607 shutdown_connections 2023-10-05T15:41:34.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.533+0000 7f72043ff700 1 -- 172.21.15.17:0/1211161607 wait complete. 2023-10-05T15:41:34.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.534+0000 7f72043ff700 1 Processor -- start 2023-10-05T15:41:34.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 -- start start 2023-10-05T15:41:34.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc107510 0x7f71fc19d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 0x7f71fc19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 0x7f71fc1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc1a4d40 con 0x7f71fc108700 2023-10-05T15:41:34.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc079700 con 0x7f71fc1090a0 2023-10-05T15:41:34.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.535+0000 7f72043ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc079890 con 0x7f71fc107510 2023-10-05T15:41:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.536+0000 7f720219b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc107510 0x7f71fc19d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.536+0000 7f720299c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 0x7f71fc1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.536+0000 7f720299c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 0x7f71fc1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41238/0 (socket says 172.21.15.17:41238) 2023-10-05T15:41:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.536+0000 7f720299c700 1 -- 172.21.15.17:0/3718230486 learned_addr learned my addr 172.21.15.17:0/3718230486 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.536+0000 7f720219b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc107510 0x7f71fc19d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53462/0 (socket says 172.21.15.17:53462) 2023-10-05T15:41:34.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720199a700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 0x7f71fc19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720299c700 1 -- 172.21.15.17:0/3718230486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc107510 msgr2=0x7f71fc19d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720299c700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc107510 0x7f71fc19d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720299c700 1 -- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 msgr2=0x7f71fc19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720299c700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 0x7f71fc19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720299c700 1 -- 172.21.15.17:0/3718230486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8009d00 con 0x7f71fc1090a0 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720199a700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 0x7f71fc19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.537+0000 7f720299c700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 0x7f71fc1a4770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71f400d980 tx=0x7f71f400dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:34.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.538+0000 7f71f37fe700 1 -- 172.21.15.17:0/3718230486 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4009940 con 0x7f71fc1090a0 2023-10-05T15:41:34.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.538+0000 7f71f37fe700 1 -- 172.21.15.17:0/3718230486 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71f4004830 con 0x7f71fc1090a0 2023-10-05T15:41:34.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.538+0000 7f71f37fe700 1 -- 172.21.15.17:0/3718230486 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f4005410 con 0x7f71fc1090a0 2023-10-05T15:41:34.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.538+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc079b70 con 0x7f71fc1090a0 2023-10-05T15:41:34.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.538+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc07a030 con 0x7f71fc1090a0 2023-10-05T15:41:34.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.545+0000 7f71f37fe700 1 -- 172.21.15.17:0/3718230486 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f71f40049a0 con 0x7f71fc1090a0 2023-10-05T15:41:34.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.545+0000 7f7217cc0b80 1 Processor -- start 2023-10-05T15:41:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 -- start start 2023-10-05T15:41:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eef0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 0x55661eef1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661eef1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ee58460 con 0x55661eef1a60 2023-10-05T15:41:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ee49c20 con 0x55661eef0260 2023-10-05T15:41:34.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.546+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ee47540 con 0x55661eef0bc0 2023-10-05T15:41:34.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.547+0000 7f720219b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 0x55661eef1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.547+0000 7f720219b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 0x55661eef1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53468/0 (socket says 172.21.15.17:53468) 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.547+0000 7f720219b700 1 -- 172.21.15.17:0/350928802 learned_addr learned my addr 172.21.15.17:0/350928802 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.548+0000 7f71f37fe700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71e80a1550 0x7f71e80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f71f37fe700 1 -- 172.21.15.17:0/3718230486 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f71f40cd080 con 0x7f71fc1090a0 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f720199a700 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eef0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f720219b700 1 -- 172.21.15.17:0/350928802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 msgr2=0x55661eef0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f720219b700 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eef0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f720219b700 1 -- 172.21.15.17:0/350928802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 msgr2=0x55661eef1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f720219b700 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661eef1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.549+0000 7f720219b700 1 -- 172.21.15.17:0/350928802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55661ec6dde0 con 0x55661eef0bc0 2023-10-05T15:41:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.550+0000 7f720219b700 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 0x55661eef1480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71fc108560 tx=0x7f71f80090d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1454a5b3b143588a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.550+0000 7f71f0bfe700 1 -- 172.21.15.17:0/350928802 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800e030 con 0x55661eef0bc0 2023-10-05T15:41:34.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.550+0000 7f71f0bfe700 1 -- 172.21.15.17:0/350928802 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71f8003a00 con 0x55661eef0bc0 2023-10-05T15:41:34.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.550+0000 7f71f0bfe700 1 -- 172.21.15.17:0/350928802 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8005580 con 0x55661eef0bc0 2023-10-05T15:41:34.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.551+0000 7f720299c700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71e80a1550 0x7f71e80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.552+0000 7f7217cc0b80 1 -- 172.21.15.17:0/350928802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 msgr2=0x55661eef1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.552+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 0x55661eef1480 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71fc108560 tx=0x7f71f80090d0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.553+0000 7f7217cc0b80 1 -- 172.21.15.17:0/350928802 shutdown_connections 2023-10-05T15:41:34.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.553+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661eef1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.554+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eef0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.554+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/350928802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0bc0 0x55661eef1480 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.554+0000 7f7217cc0b80 1 -- 172.21.15.17:0/350928802 >> 172.21.15.17:0/350928802 conn(0x55661ee64260 msgr2=0x55661eeeb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.554+0000 7f720299c700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71e80a1550 0x7f71e80a3a10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71f4096a10 tx=0x7f71f4004750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.554+0000 7f7217cc0b80 1 -- 172.21.15.17:0/350928802 shutdown_connections 2023-10-05T15:41:34.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.554+0000 7f7217cc0b80 1 -- 172.21.15.17:0/350928802 wait complete. 2023-10-05T15:41:34.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.555+0000 7f7217cc0b80 1 -- start start 2023-10-05T15:41:34.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.555+0000 7f7217cc0b80 1 Processor -- start 2023-10-05T15:41:34.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eefa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef015a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ee42e30 con 0x55661eef0bc0 2023-10-05T15:41:34.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661eddf710 con 0x55661eef0260 2023-10-05T15:41:34.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661eddf3b0 con 0x55661eef1a60 2023-10-05T15:41:34.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f7217cc0b80 10 client.0 _ll_register_callbacks cb 0x55661ec3c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:34.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f720199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f720199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41256/0 (socket says 172.21.15.17:41256) 2023-10-05T15:41:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f720199a700 1 -- 172.21.15.17:0/2032966516 learned_addr learned my addr 172.21.15.17:0/2032966516 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.556+0000 7f720199a700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720219b700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eefa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720199a700 1 -- 172.21.15.17:0/2032966516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 msgr2=0x55661ef015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720199a700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720199a700 1 -- 172.21.15.17:0/2032966516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 msgr2=0x55661eefa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720199a700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eefa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720199a700 1 -- 172.21.15.17:0/2032966516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc1102a0 con 0x55661eef0260 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.557+0000 7f720219b700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eefa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.558+0000 7f720199a700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefa020 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71ec012ef0 tx=0x7f71ec00b580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c8ce7735b644ed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:34.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.558+0000 7f71e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.559+0000 7f71e5ffb700 1 -- 172.21.15.17:0/2032966516 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec010b70 con 0x55661eef0260 2023-10-05T15:41:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.559+0000 7f71e5ffb700 1 -- 172.21.15.17:0/2032966516 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f71ec010cd0 con 0x55661eef0260 2023-10-05T15:41:34.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.559+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55661eee2f10 con 0x55661eef0260 2023-10-05T15:41:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.559+0000 7f71e5ffb700 1 -- 172.21.15.17:0/2032966516 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ec010e90 con 0x55661eef0260 2023-10-05T15:41:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.559+0000 7f7217cc0b80 10 client.26264 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.559+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55661ec56c60 con 0x55661eef0260 2023-10-05T15:41:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f71e5ffb700 1 -- 172.21.15.17:0/2032966516 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55661eee2f10 con 0x55661eef0260 2023-10-05T15:41:34.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f71e5ffb700 1 -- 172.21.15.17:0/2032966516 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f71ec005320 con 0x55661eef0260 2023-10-05T15:41:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f7217cc0b80 10 client.26264 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f7217cc0b80 10 client.26264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f7217cc0b80 20 client.26264 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef05e10 0x55661ef08230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f7217cc0b80 4 client.26264 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:34.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.560+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55661ee3be10 con 0x55661ef05e10 2023-10-05T15:41:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.561+0000 7f720219b700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef05e10 0x55661ef08230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.562+0000 7f720219b700 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef05e10 0x55661ef08230 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bebc4fa37f37e34 server_cookie=de97fc251df98828 in_seq=0 out_seq=0 2023-10-05T15:41:34.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.562+0000 7f71e5ffb700 10 client.26264 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.563+0000 7f71e5ffb700 1 -- 172.21.15.17:0/2032966516 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55661ee3be10 con 0x55661ef05e10 2023-10-05T15:41:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.563+0000 7f71e5ffb700 10 client.26264 handle_command_reply: tid=0 2023-10-05T15:41:34.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.563+0000 7f7217cc0b80 1 client.26264 shutdown 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 msgr2=0x55661eefa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefa020 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71ec012ef0 tx=0x7f71ec00b580 comp rx=0 tx=0).stop 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 shutdown_connections 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef05e10 0x55661ef08230 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefa020 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/2032966516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eefa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f71e5ffb700 0 client.26264 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 >> 172.21.15.17:0/2032966516 conn(0x55661ee64260 msgr2=0x55661eeeaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 shutdown_connections 2023-10-05T15:41:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.564+0000 7f7217cc0b80 1 -- 172.21.15.17:0/2032966516 wait complete. 2023-10-05T15:41:34.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.565+0000 7f7217cc0b80 20 client.26264 trim_cache size 0 max 16384 2023-10-05T15:41:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 Processor -- start 2023-10-05T15:41:34.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 -- start start 2023-10-05T15:41:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 0x55661eef8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0bc0 0x55661ef01560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661ef01dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ecc3920 con 0x55661eef1a60 2023-10-05T15:41:34.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ef03290 con 0x55661eef0bc0 2023-10-05T15:41:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.596+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661eeec270 con 0x55661eef0260 2023-10-05T15:41:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 0x55661eef8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 0x55661eef8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53488/0 (socket says 172.21.15.17:53488) 2023-10-05T15:41:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 -- 172.21.15.17:0/3769735024 learned_addr learned my addr 172.21.15.17:0/3769735024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:34.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720219b700 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0bc0 0x55661ef01560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661ef01dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 -- 172.21.15.17:0/3769735024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0bc0 msgr2=0x55661ef01560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0bc0 0x55661ef01560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 -- 172.21.15.17:0/3769735024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 msgr2=0x55661ef01dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661ef01dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.597+0000 7f720199a700 1 -- 172.21.15.17:0/3769735024 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55661ec94250 con 0x55661eef0260 2023-10-05T15:41:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.598+0000 7f720199a700 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 0x55661eef8ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71ec012ec0 tx=0x7f71ec012a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c951ed111e0198e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.598+0000 7f71f13ff700 1 -- 172.21.15.17:0/3769735024 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec010b70 con 0x55661eef0260 2023-10-05T15:41:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.598+0000 7f71f13ff700 1 -- 172.21.15.17:0/3769735024 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71ec010cd0 con 0x55661eef0260 2023-10-05T15:41:34.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.598+0000 7f71f13ff700 1 -- 172.21.15.17:0/3769735024 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec01fea0 con 0x55661eef0260 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.599+0000 7f7217cc0b80 1 -- 172.21.15.17:0/3769735024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 msgr2=0x55661eef8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.599+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 0x55661eef8ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71ec012ec0 tx=0x7f71ec012a70 comp rx=0 tx=0).stop 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.600+0000 7f7217cc0b80 1 -- 172.21.15.17:0/3769735024 shutdown_connections 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.600+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef1a60 0x55661ef01dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.600+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef0260 0x55661eef8ca0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.600+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/3769735024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0bc0 0x55661ef01560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.600+0000 7f7217cc0b80 1 -- 172.21.15.17:0/3769735024 >> 172.21.15.17:0/3769735024 conn(0x55661ee64260 msgr2=0x55661ef0cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.601+0000 7f7217cc0b80 1 -- 172.21.15.17:0/3769735024 shutdown_connections 2023-10-05T15:41:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.601+0000 7f7217cc0b80 1 -- 172.21.15.17:0/3769735024 wait complete. 2023-10-05T15:41:34.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.601+0000 7f7217cc0b80 1 -- start start 2023-10-05T15:41:34.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.602+0000 7f7217cc0b80 1 Processor -- start 2023-10-05T15:41:34.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eeff410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ef00960 con 0x55661eef0bc0 2023-10-05T15:41:34.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ef00ad0 con 0x55661eef0260 2023-10-05T15:41:34.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55661ef00c90 con 0x55661eef1a60 2023-10-05T15:41:34.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f7217cc0b80 10 client.0 _ll_register_callbacks cb 0x7f71ec0129c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:34.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.603+0000 7f720199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41266/0 (socket says 172.21.15.17:41266) 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 -- 172.21.15.17:0/236618472 learned_addr learned my addr 172.21.15.17:0/236618472 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 -- 172.21.15.17:0/236618472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 msgr2=0x55661ef00420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef00420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 -- 172.21.15.17:0/236618472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 msgr2=0x55661eeff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eeff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.604+0000 7f720199a700 1 -- 172.21.15.17:0/236618472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55661ec56c60 con 0x55661eef0260 2023-10-05T15:41:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.605+0000 7f720199a700 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefeed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71ec022040 tx=0x7f71ec017040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39b9de60ccb1be8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.605+0000 7f71e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.606+0000 7f71e5ffb700 1 -- 172.21.15.17:0/236618472 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03e070 con 0x55661eef0260 2023-10-05T15:41:34.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.606+0000 7f71e5ffb700 1 -- 172.21.15.17:0/236618472 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f71ec000e40 con 0x55661eef0260 2023-10-05T15:41:34.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.606+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71f8003a00 con 0x55661eef0260 2023-10-05T15:41:34.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f71e5ffb700 1 -- 172.21.15.17:0/236618472 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ec00b480 con 0x55661eef0260 2023-10-05T15:41:34.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f7217cc0b80 10 client.26270 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:34.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55661ec6c2b0 con 0x55661eef0260 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f71e5ffb700 1 -- 172.21.15.17:0/236618472 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71f8003a00 con 0x55661eef0260 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f71e5ffb700 1 -- 172.21.15.17:0/236618472 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f71ec041030 con 0x55661eef0260 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f7217cc0b80 10 client.26270 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f7217cc0b80 10 client.26270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.607+0000 7f7217cc0b80 20 client.26270 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.608+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef5a450 0x55661ef5c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:34.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.608+0000 7f7217cc0b80 4 client.26270 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:41:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.608+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55661ee3bb30 con 0x55661ef5a450 2023-10-05T15:41:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.608+0000 7f720219b700 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef5a450 0x55661ef5c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.609+0000 7f720219b700 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef5a450 0x55661ef5c870 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57b88144457ccbe1 server_cookie=66d43504d07a5285 in_seq=0 out_seq=0 2023-10-05T15:41:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.609+0000 7f71e5ffb700 10 client.26270 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:34.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.609+0000 7f71e5ffb700 1 -- 172.21.15.17:0/236618472 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55661ee3bb30 con 0x55661ef5a450 2023-10-05T15:41:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.609+0000 7f71e5ffb700 10 client.26270 handle_command_reply: tid=0 2023-10-05T15:41:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.609+0000 7f7217cc0b80 1 client.26270 shutdown 2023-10-05T15:41:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 msgr2=0x55661eefeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefeed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71ec022040 tx=0x7f71ec017040 comp rx=0 tx=0).stop 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 shutdown_connections 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55661ef5a450 0x55661ef5c870 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55661eef1a60 0x55661ef00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55661eef0260 0x55661eefeed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 --2- 172.21.15.17:0/236618472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55661eef0bc0 0x55661eeff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f71e5ffb700 0 client.26270 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.610+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 >> 172.21.15.17:0/236618472 conn(0x55661ee64260 msgr2=0x55661eef8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.611+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 shutdown_connections 2023-10-05T15:41:34.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.611+0000 7f7217cc0b80 1 -- 172.21.15.17:0/236618472 wait complete. 2023-10-05T15:41:34.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.612+0000 7f7217cc0b80 20 client.26270 trim_cache size 0 max 16384 2023-10-05T15:41:34.614 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:41:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:41:34.614 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:41:34.615 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:41:34.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71e80a1550 msgr2=0x7f71e80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71e80a1550 0x7f71e80a3a10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71f4096a10 tx=0x7f71f4004750 comp rx=0 tx=0).stop 2023-10-05T15:41:34.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 msgr2=0x7f71fc1a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 0x7f71fc1a4770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71f400d980 tx=0x7f71f400dd40 comp rx=0 tx=0).stop 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 shutdown_connections 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f71e80a1550 0x7f71e80a3a10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc1090a0 0x7f71fc1a4770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71fc107510 0x7f71fc19d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 --2- 172.21.15.17:0/3718230486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71fc108700 0x7f71fc19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.613+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 >> 172.21.15.17:0/3718230486 conn(0x7f71fc076490 msgr2=0x7f71fc078810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.614+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 shutdown_connections 2023-10-05T15:41:34.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:41:34.615+0000 7f72043ff700 1 -- 172.21.15.17:0/3718230486 wait complete. 2023-10-05T15:41:34.647 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:41:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:35 smithi167 ceph-mon[133366]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 739 op/s 2023-10-05T15:41:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:35 smithi079 ceph-mon[132936]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 739 op/s 2023-10-05T15:41:36.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:35 smithi017 ceph-mon[129107]: pgmap v519: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 739 op/s 2023-10-05T15:41:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:37 smithi167 ceph-mon[133366]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 638 op/s 2023-10-05T15:41:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:37 smithi079 ceph-mon[132936]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 638 op/s 2023-10-05T15:41:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 180.0 s, 546.2 tps, lat 182.967 ms stddev 239.545 2023-10-05T15:41:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:37 smithi017 ceph-mon[129107]: pgmap v520: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 11 MiB/s wr, 638 op/s 2023-10-05T15:41:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:39 smithi167 ceph-mon[133366]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 700 op/s 2023-10-05T15:41:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:39 smithi079 ceph-mon[132936]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 700 op/s 2023-10-05T15:41:40.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:39 smithi017 ceph-mon[129107]: pgmap v521: 129 pgs: 129 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 700 op/s 2023-10-05T15:41:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:41 smithi167 ceph-mon[133366]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 718 op/s 2023-10-05T15:41:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:41 smithi079 ceph-mon[132936]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 718 op/s 2023-10-05T15:41:42.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:41 smithi017 ceph-mon[129107]: pgmap v522: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 12 MiB/s wr, 718 op/s 2023-10-05T15:41:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 185.0 s, 300.5 tps, lat 157.869 ms stddev 46.543 2023-10-05T15:41:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:43 smithi167 ceph-mon[133366]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 664 op/s 2023-10-05T15:41:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:43 smithi079 ceph-mon[132936]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 664 op/s 2023-10-05T15:41:44.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:43 smithi017 ceph-mon[129107]: pgmap v523: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 664 op/s 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2582240923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 msgr2=0x7f4a48100340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2582240923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a48100340 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009990 tx=0x7f4a38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2582240923 shutdown_connections 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2582240923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a48100880 0x7f4a48105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2582240923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a480fed90 0x7f4a480ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2582240923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a48100340 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.991+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2582240923 >> 172.21.15.17:0/2582240923 conn(0x7f4a480fa690 msgr2=0x7f4a480fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.992+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2582240923 shutdown_connections 2023-10-05T15:41:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.992+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2582240923 wait complete. 2023-10-05T15:41:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.995+0000 7f4a4f7ff700 1 Processor -- start 2023-10-05T15:41:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.995+0000 7f4a4f7ff700 1 -- start start 2023-10-05T15:41:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.996+0000 7f4a4f7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a480fed90 0x7f4a4819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.996+0000 7f4a4f7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a4819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.996+0000 7f4a4f7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a48100880 0x7f4a4819e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.996+0000 7f4a4f7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4819ec90 con 0x7f4a48100880 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.996+0000 7f4a4f7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4819ee00 con 0x7f4a480ffec0 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.996+0000 7f4a4f7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4819efc0 con 0x7f4a480fed90 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.997+0000 7f4a4cd9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a4819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.997+0000 7f4a4cd9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a4819d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40600/0 (socket says 172.21.15.17:40600) 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.997+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2212209840 learned_addr learned my addr 172.21.15.17:0/2212209840 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.997+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a48100880 0x7f4a4819e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.997+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a480fed90 0x7f4a4819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.998+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2212209840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a480fed90 msgr2=0x7f4a4819d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.998+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a480fed90 0x7f4a4819d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.998+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a48100880 msgr2=0x7f4a4819e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.998+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a48100880 0x7f4a4819e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.998+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2212209840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380095f0 con 0x7f4a480ffec0 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.998+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a4819d7b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a380039f0 tx=0x7f4a38003a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.999+0000 7f4a3e7fc700 1 -- 172.21.15.17:0/2212209840 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3801d070 con 0x7f4a480ffec0 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.999+0000 7f4a3e7fc700 1 -- 172.21.15.17:0/2212209840 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a3800beb0 con 0x7f4a480ffec0 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.999+0000 7f4a3e7fc700 1 -- 172.21.15.17:0/2212209840 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38005310 con 0x7f4a480ffec0 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.999+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4819f240 con 0x7f4a480ffec0 2023-10-05T15:41:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:45.999+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a481a5880 con 0x7f4a480ffec0 2023-10-05T15:41:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.005+0000 7f4a3e7fc700 1 -- 172.21.15.17:0/2212209840 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4a38005470 con 0x7f4a480ffec0 2023-10-05T15:41:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.006+0000 7f4a63090b80 1 Processor -- start 2023-10-05T15:41:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 -- start start 2023-10-05T15:41:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b8fec0 0x560b36b902e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b91450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b98220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36af8400 con 0x560b36b8fec0 2023-10-05T15:41:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36ae9bc0 con 0x560b36b90fd0 2023-10-05T15:41:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.007+0000 7f4a63090b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36ae74e0 con 0x560b36b91990 2023-10-05T15:41:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.008+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b91450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.008+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b91450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40602/0 (socket says 172.21.15.17:40602) 2023-10-05T15:41:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.008+0000 7f4a4d59b700 1 -- 172.21.15.17:0/2490366919 learned_addr learned my addr 172.21.15.17:0/2490366919 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.008+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b8fec0 0x560b36b902e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.008+0000 7f4a4d59b700 1 -- 172.21.15.17:0/2490366919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 msgr2=0x560b36b98220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.008+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b98220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.009+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b98220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.009+0000 7f4a4d59b700 1 -- 172.21.15.17:0/2490366919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b8fec0 msgr2=0x560b36b902e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.009+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b8fec0 0x560b36b902e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.009+0000 7f4a4d59b700 1 -- 172.21.15.17:0/2490366919 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b3690dd80 con 0x560b36b90fd0 2023-10-05T15:41:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.010+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b8fec0 0x560b36b902e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:41:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.010+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b98220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:41:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.010+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b91450 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400a9a0 tx=0x7f4a4400acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92535992f2f1442 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.010+0000 7f4a337fe700 1 -- 172.21.15.17:0/2490366919 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400ca90 con 0x560b36b90fd0 2023-10-05T15:41:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.010+0000 7f4a337fe700 1 -- 172.21.15.17:0/2490366919 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a4400cbf0 con 0x560b36b90fd0 2023-10-05T15:41:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.010+0000 7f4a337fe700 1 -- 172.21.15.17:0/2490366919 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44018360 con 0x560b36b90fd0 2023-10-05T15:41:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.011+0000 7f4a3e7fc700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4a340a1650 0x7f4a340a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.011+0000 7f4a3e7fc700 1 -- 172.21.15.17:0/2212209840 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4a380ce330 con 0x7f4a480ffec0 2023-10-05T15:41:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.011+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4a340a1650 0x7f4a340a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 -- 172.21.15.17:0/2490366919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 msgr2=0x560b36b91450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b91450 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400a9a0 tx=0x7f4a4400acb0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 -- 172.21.15.17:0/2490366919 shutdown_connections 2023-10-05T15:41:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b98220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b8fec0 0x560b36b902e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2490366919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b91450 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.012+0000 7f4a63090b80 1 -- 172.21.15.17:0/2490366919 >> 172.21.15.17:0/2490366919 conn(0x560b36b04200 msgr2=0x560b36b8abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.013+0000 7f4a63090b80 1 -- 172.21.15.17:0/2490366919 shutdown_connections 2023-10-05T15:41:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.013+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4a340a1650 0x7f4a340a3b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560b36b8fc60 tx=0x7f4a4000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.013+0000 7f4a63090b80 1 -- 172.21.15.17:0/2490366919 wait complete. 2023-10-05T15:41:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.014+0000 7f4a63090b80 1 -- start start 2023-10-05T15:41:46.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.014+0000 7f4a63090b80 1 Processor -- start 2023-10-05T15:41:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b99c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b9a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36ba1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36ae2dd0 con 0x560b36b91990 2023-10-05T15:41:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36a7f6b0 con 0x560b36b90fd0 2023-10-05T15:41:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36a7f350 con 0x560b36b8fec0 2023-10-05T15:41:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.015+0000 7f4a63090b80 10 client.0 _ll_register_callbacks cb 0x560b368dc7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.016+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b99c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.016+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b99c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53370/0 (socket says 172.21.15.17:53370) 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.016+0000 7f4a4d59b700 1 -- 172.21.15.17:0/4183365265 learned_addr learned my addr 172.21.15.17:0/4183365265 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.016+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b9a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.016+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36ba1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4d59b700 1 -- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 msgr2=0x560b36b9a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b9a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4d59b700 1 -- 172.21.15.17:0/4183365265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 msgr2=0x560b36ba1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36ba1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4d59b700 1 -- 172.21.15.17:0/4183365265 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4400a5d0 con 0x560b36b8fec0 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36ba1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:41:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b9a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:41:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b99c00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400a580 tx=0x7f4a4400ce10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2250380477db254c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.017+0000 7f4a30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:41:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.018+0000 7f4a30ff9700 1 -- 172.21.15.17:0/4183365265 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4401f070 con 0x560b36b8fec0 2023-10-05T15:41:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.018+0000 7f4a30ff9700 1 -- 172.21.15.17:0/4183365265 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4a44011470 con 0x560b36b8fec0 2023-10-05T15:41:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.018+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b36b82d50 con 0x560b36b8fec0 2023-10-05T15:41:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.018+0000 7f4a30ff9700 1 -- 172.21.15.17:0/4183365265 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a44011630 con 0x560b36b8fec0 2023-10-05T15:41:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.018+0000 7f4a63090b80 10 client.26248 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.018+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560b368f6c00 con 0x560b36b8fec0 2023-10-05T15:41:46.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.019+0000 7f4a30ff9700 1 -- 172.21.15.17:0/4183365265 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b36b82d50 con 0x560b36b8fec0 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a30ff9700 1 -- 172.21.15.17:0/4183365265 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4a4401a450 con 0x560b36b8fec0 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a63090b80 10 client.26248 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a63090b80 10 client.26248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a63090b80 20 client.26248 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a63090b80 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36bb6860 0x560b36bb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a63090b80 4 client.26248 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:46.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.020+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b36adbdb0 con 0x560b36bb6860 2023-10-05T15:41:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.021+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36bb6860 0x560b36bb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.021+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36bb6860 0x560b36bb8c80 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52641d358be42d13 server_cookie=d3355ced5bfdce4a in_seq=0 out_seq=0 2023-10-05T15:41:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.022+0000 7f4a30ff9700 10 client.26248 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.022+0000 7f4a30ff9700 1 -- 172.21.15.17:0/4183365265 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560b36adbdb0 con 0x560b36bb6860 2023-10-05T15:41:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.022+0000 7f4a30ff9700 10 client.26248 handle_command_reply: tid=0 2023-10-05T15:41:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.022+0000 7f4a63090b80 1 client.26248 shutdown 2023-10-05T15:41:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 msgr2=0x560b36b99c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b99c00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400a580 tx=0x7f4a4400ce10 comp rx=0 tx=0).stop 2023-10-05T15:41:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 shutdown_connections 2023-10-05T15:41:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36bb6860 0x560b36bb8c80 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36ba1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b99c00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 --2- 172.21.15.17:0/4183365265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36b9a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.023+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 >> 172.21.15.17:0/4183365265 conn(0x560b36b04200 msgr2=0x560b36b8a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.024+0000 7f4a30ff9700 0 client.26248 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.024+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 shutdown_connections 2023-10-05T15:41:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.024+0000 7f4a63090b80 1 -- 172.21.15.17:0/4183365265 wait complete. 2023-10-05T15:41:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.024+0000 7f4a63090b80 20 client.26248 trim_cache size 0 max 16384 2023-10-05T15:41:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 Processor -- start 2023-10-05T15:41:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 -- start start 2023-10-05T15:41:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36ba1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36b97e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b369638c0 con 0x560b36b91990 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36bb63d0 con 0x560b36b90fd0 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.054+0000 7f4a63090b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36b87890 con 0x560b36b8fec0 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4cd9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36ba1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4cd9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36ba1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40624/0 (socket says 172.21.15.17:40624) 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/705595797 learned_addr learned my addr 172.21.15.17:0/705595797 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36b97e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4d59b700 1 -- 172.21.15.17:0/705595797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 msgr2=0x560b36ba1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36ba1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4d59b700 1 -- 172.21.15.17:0/705595797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 msgr2=0x560b36b97e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36b97e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.055+0000 7f4a4d59b700 1 -- 172.21.15.17:0/705595797 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b369341f0 con 0x560b36b8fec0 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.056+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b992b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400a8c0 tx=0x7f4a44001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1004d5f59ae2cb8c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.056+0000 7f4a33fff700 1 -- 172.21.15.17:0/705595797 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4401f070 con 0x560b36b8fec0 2023-10-05T15:41:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.056+0000 7f4a33fff700 1 -- 172.21.15.17:0/705595797 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a4401a450 con 0x560b36b8fec0 2023-10-05T15:41:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.056+0000 7f4a33fff700 1 -- 172.21.15.17:0/705595797 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4401a950 con 0x560b36b8fec0 2023-10-05T15:41:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 -- 172.21.15.17:0/705595797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 msgr2=0x560b36b992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b992b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400a8c0 tx=0x7f4a44001e70 comp rx=0 tx=0).stop 2023-10-05T15:41:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 -- 172.21.15.17:0/705595797 shutdown_connections 2023-10-05T15:41:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b91990 0x560b36b97e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b8fec0 0x560b36b992b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 --2- 172.21.15.17:0/705595797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b90fd0 0x560b36ba1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.057+0000 7f4a63090b80 1 -- 172.21.15.17:0/705595797 >> 172.21.15.17:0/705595797 conn(0x560b36b04200 msgr2=0x560b36bb8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.058+0000 7f4a63090b80 1 -- 172.21.15.17:0/705595797 shutdown_connections 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.058+0000 7f4a63090b80 1 -- 172.21.15.17:0/705595797 wait complete. 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.058+0000 7f4a63090b80 1 -- start start 2023-10-05T15:41:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.059+0000 7f4a63090b80 1 Processor -- start 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.059+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 0x560b36b9e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.059+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b90fd0 0x560b36b9e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a63090b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b9f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a63090b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36b9fcf0 con 0x560b36b90fd0 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a63090b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36b9fe60 con 0x560b36b8fec0 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a63090b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b36ba0020 con 0x560b36b91990 2023-10-05T15:41:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a63090b80 10 client.0 _ll_register_callbacks cb 0x7f4a4400a7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 0x560b36b9e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a4d59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 0x560b36b9e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40626/0 (socket says 172.21.15.17:40626) 2023-10-05T15:41:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a4d59b700 1 -- 172.21.15.17:0/2143219459 learned_addr learned my addr 172.21.15.17:0/2143219459 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b90fd0 0x560b36b9e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.060+0000 7f4a4dd9c700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b9f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2143219459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 msgr2=0x560b36b9f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b9f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 msgr2=0x560b36b9e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 0x560b36b9e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4cd9a700 1 -- 172.21.15.17:0/2143219459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b368f6c00 con 0x560b36b90fd0 2023-10-05T15:41:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 0x560b36b9e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:41:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a4cd9a700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b90fd0 0x560b36b9e7a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a30b0 tx=0x7f4a3801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3722232a68133f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.061+0000 7f4a30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:41:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.062+0000 7f4a30ff9700 1 -- 172.21.15.17:0/2143219459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a380ce120 con 0x560b36b90fd0 2023-10-05T15:41:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.062+0000 7f4a30ff9700 1 -- 172.21.15.17:0/2143219459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4a38004830 con 0x560b36b90fd0 2023-10-05T15:41:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.062+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a4400cbf0 con 0x560b36b90fd0 2023-10-05T15:41:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.062+0000 7f4a30ff9700 1 -- 172.21.15.17:0/2143219459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a3809b2e0 con 0x560b36b90fd0 2023-10-05T15:41:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.062+0000 7f4a63090b80 10 client.16419 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.062+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560b3690c250 con 0x560b36b90fd0 2023-10-05T15:41:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a30ff9700 1 -- 172.21.15.17:0/2143219459 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a4400cbf0 con 0x560b36b90fd0 2023-10-05T15:41:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a30ff9700 1 -- 172.21.15.17:0/2143219459 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4a380a3150 con 0x560b36b90fd0 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a63090b80 10 client.16419 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a63090b80 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a63090b80 20 client.16419 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36c0a6d0 0x560b36c0cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a63090b80 4 client.16419 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.063+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560b36adbad0 con 0x560b36c0a6d0 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.064+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36c0a6d0 0x560b36c0cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.064+0000 7f4a4d59b700 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36c0a6d0 0x560b36c0cac0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1408e9285a194fa server_cookie=a39f50c15262cfd0 in_seq=0 out_seq=0 2023-10-05T15:41:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.064+0000 7f4a30ff9700 10 client.16419 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:45 smithi167 ceph-mon[133366]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 755 op/s 2023-10-05T15:41:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.084+0000 7f4a30ff9700 1 -- 172.21.15.17:0/2143219459 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560b36adbad0 con 0x560b36c0a6d0 2023-10-05T15:41:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.084+0000 7f4a30ff9700 10 client.16419 handle_command_reply: tid=0 2023-10-05T15:41:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.084+0000 7f4a63090b80 1 client.16419 shutdown 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b90fd0 msgr2=0x560b36b9e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b90fd0 0x560b36b9e7a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a30b0 tx=0x7f4a3801a040 comp rx=0 tx=0).stop 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 shutdown_connections 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560b36c0a6d0 0x560b36c0cac0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560b36b91990 0x560b36b9f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b36b8fec0 0x560b36b9e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 --2- 172.21.15.17:0/2143219459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560b36b90fd0 0x560b36b9e7a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 >> 172.21.15.17:0/2143219459 conn(0x560b36b04200 msgr2=0x560b36bb8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a30ff9700 0 client.16419 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 shutdown_connections 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.085+0000 7f4a63090b80 1 -- 172.21.15.17:0/2143219459 wait complete. 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.086+0000 7f4a63090b80 20 client.16419 trim_cache size 0 max 16384 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:41:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:41:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:41:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:41:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4a340a1650 msgr2=0x7f4a340a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4a340a1650 0x7f4a340a3b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x560b36b8fc60 tx=0x7f4a4000b040 comp rx=0 tx=0).stop 2023-10-05T15:41:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 msgr2=0x7f4a4819d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a4819d7b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a380039f0 tx=0x7f4a38003a20 comp rx=0 tx=0).stop 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 shutdown_connections 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4a340a1650 0x7f4a340a3b10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.087+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a48100880 0x7f4a4819e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.088+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a480fed90 0x7f4a4819d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.088+0000 7f4a4f7ff700 1 --2- 172.21.15.17:0/2212209840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a480ffec0 0x7f4a4819d7b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.088+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 >> 172.21.15.17:0/2212209840 conn(0x7f4a480fa690 msgr2=0x7f4a480fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.088+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 shutdown_connections 2023-10-05T15:41:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:46.088+0000 7f4a4f7ff700 1 -- 172.21.15.17:0/2212209840 wait complete. 2023-10-05T15:41:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:45 smithi079 ceph-mon[132936]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 755 op/s 2023-10-05T15:41:46.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:45 smithi017 ceph-mon[129107]: pgmap v524: 129 pgs: 129 active+clean; 1.5 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 755 op/s 2023-10-05T15:41:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:47 smithi167 ceph-mon[133366]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.6 MiB/s wr, 553 op/s 2023-10-05T15:41:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:47 smithi079 ceph-mon[132936]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.6 MiB/s wr, 553 op/s 2023-10-05T15:41:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 190.0 s, 489.2 tps, lat 310.736 ms stddev 979.881 2023-10-05T15:41:48.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:47 smithi017 ceph-mon[129107]: pgmap v525: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.6 MiB/s wr, 553 op/s 2023-10-05T15:41:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:49 smithi167 ceph-mon[133366]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.3 MiB/s wr, 522 op/s 2023-10-05T15:41:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:49 smithi079 ceph-mon[132936]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.3 MiB/s wr, 522 op/s 2023-10-05T15:41:50.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:49 smithi017 ceph-mon[129107]: pgmap v526: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 7.3 MiB/s wr, 522 op/s 2023-10-05T15:41:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:51 smithi167 ceph-mon[133366]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 490 op/s 2023-10-05T15:41:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:51 smithi079 ceph-mon[132936]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 490 op/s 2023-10-05T15:41:52.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:51 smithi017 ceph-mon[129107]: pgmap v527: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 490 op/s 2023-10-05T15:41:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 195.0 s, 609.8 tps, lat 165.164 ms stddev 48.101 2023-10-05T15:41:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:53 smithi167 ceph-mon[133366]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.7 MiB/s wr, 401 op/s 2023-10-05T15:41:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:53 smithi079 ceph-mon[132936]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.7 MiB/s wr, 401 op/s 2023-10-05T15:41:54.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:53 smithi017 ceph-mon[129107]: pgmap v528: 129 pgs: 129 active+clean; 1.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 5.7 MiB/s wr, 401 op/s 2023-10-05T15:41:56.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:55 smithi167 ceph-mon[133366]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.4 MiB/s wr, 578 op/s 2023-10-05T15:41:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:55 smithi079 ceph-mon[132936]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.4 MiB/s wr, 578 op/s 2023-10-05T15:41:56.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:55 smithi017 ceph-mon[129107]: pgmap v529: 129 pgs: 129 active+clean; 1.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.4 MiB/s wr, 578 op/s 2023-10-05T15:41:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:57 smithi167 ceph-mon[133366]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.3 MiB/s wr, 489 op/s 2023-10-05T15:41:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:57 smithi079 ceph-mon[132936]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.3 MiB/s wr, 489 op/s 2023-10-05T15:41:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 200.0 s, 696.4 tps, lat 137.782 ms stddev 41.105 2023-10-05T15:41:58.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:57 smithi017 ceph-mon[129107]: pgmap v530: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.3 MiB/s wr, 489 op/s 2023-10-05T15:41:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.347+0000 7f5e34fff700 1 -- 172.21.15.17:0/3095961115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 msgr2=0x7f5e30109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.347+0000 7f5e34fff700 1 --2- 172.21.15.17:0/3095961115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e30109040 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800b0a0 tx=0x7f5e2800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.348+0000 7f5e34fff700 1 -- 172.21.15.17:0/3095961115 shutdown_connections 2023-10-05T15:41:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.348+0000 7f5e34fff700 1 --2- 172.21.15.17:0/3095961115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e30109040 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.348+0000 7f5e34fff700 1 --2- 172.21.15.17:0/3095961115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101970 0x7f5e30103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.348+0000 7f5e34fff700 1 --2- 172.21.15.17:0/3095961115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e301042a0 0x7f5e30106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.348+0000 7f5e34fff700 1 -- 172.21.15.17:0/3095961115 >> 172.21.15.17:0/3095961115 conn(0x7f5e300fb340 msgr2=0x7f5e300fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.348+0000 7f5e34fff700 1 -- 172.21.15.17:0/3095961115 shutdown_connections 2023-10-05T15:41:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.349+0000 7f5e34fff700 1 -- 172.21.15.17:0/3095961115 wait complete. 2023-10-05T15:41:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 Processor -- start 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 -- start start 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101970 0x7f5e30111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e301042a0 0x7f5e301116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e3010fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30112010 con 0x7f5e301042a0 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30110010 con 0x7f5e30106bd0 2023-10-05T15:41:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.350+0000 7f5e34fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301101d0 con 0x7f5e30101970 2023-10-05T15:41:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e3010fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e301042a0 0x7f5e301116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e3010fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55316/0 (socket says 172.21.15.17:55316) 2023-10-05T15:41:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/2669279623 learned_addr learned my addr 172.21.15.17:0/2669279623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/2669279623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101970 msgr2=0x7f5e30111190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:41:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101970 0x7f5e30111190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e301042a0 msgr2=0x7f5e301116d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e301042a0 0x7f5e301116d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.351+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/2669279623 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28009d00 con 0x7f5e30106bd0 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.352+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e3010fad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800d010 tx=0x7f5e2800bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.352+0000 7f5e1f7fe700 1 -- 172.21.15.17:0/2669279623 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800e040 con 0x7f5e30106bd0 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.352+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e30110450 con 0x7f5e30106bd0 2023-10-05T15:41:59.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.352+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e30110950 con 0x7f5e30106bd0 2023-10-05T15:41:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.353+0000 7f5e1f7fe700 1 -- 172.21.15.17:0/2669279623 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e28003e10 con 0x7f5e30106bd0 2023-10-05T15:41:59.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.353+0000 7f5e1f7fe700 1 -- 172.21.15.17:0/2669279623 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280052a0 con 0x7f5e30106bd0 2023-10-05T15:41:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.358+0000 7f5e1f7fe700 1 -- 172.21.15.17:0/2669279623 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5e2801d480 con 0x7f5e30106bd0 2023-10-05T15:41:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.360+0000 7f5e4885fb80 1 Processor -- start 2023-10-05T15:41:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.362+0000 7f5e1f7fe700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5e180a1560 0x7f5e180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.362+0000 7f5e1f7fe700 1 -- 172.21.15.17:0/2669279623 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5e280ce0d0 con 0x7f5e30106bd0 2023-10-05T15:41:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.362+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5e180a1560 0x7f5e180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.362+0000 7f5e4885fb80 1 -- start start 2023-10-05T15:41:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.363+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 0x55a18b2b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.363+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.363+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2be220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.363+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b21e400 con 0x55a18b2b7990 2023-10-05T15:41:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.363+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b20fbc0 con 0x55a18b2b5ec0 2023-10-05T15:41:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.363+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b20d4e0 con 0x55a18b2b6fd0 2023-10-05T15:41:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 0x55a18b2b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 0x55a18b2b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55322/0 (socket says 172.21.15.17:55322) 2023-10-05T15:41:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 -- 172.21.15.17:0/2611636922 learned_addr learned my addr 172.21.15.17:0/2611636922 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 -- 172.21.15.17:0/2611636922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 msgr2=0x55a18b2b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 -- 172.21.15.17:0/2611636922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 msgr2=0x55a18b2be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2be220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.364+0000 7f5e2e59c700 1 -- 172.21.15.17:0/2611636922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a18b033d80 con 0x55a18b2b5ec0 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.365+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5e180a1560 0x7f5e180a3a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e30110dd0 tx=0x7f5e24009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.365+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 0x55a18b2b62e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009bd0 tx=0x7f5e20009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faa699b234d29857 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.365+0000 7f5e1cff9700 1 -- 172.21.15.17:0/2611636922 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009750 con 0x55a18b2b5ec0 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.365+0000 7f5e1cff9700 1 -- 172.21.15.17:0/2611636922 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e20004830 con 0x55a18b2b5ec0 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.365+0000 7f5e1cff9700 1 -- 172.21.15.17:0/2611636922 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20005620 con 0x55a18b2b5ec0 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.366+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2611636922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 msgr2=0x55a18b2b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.366+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 0x55a18b2b62e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009bd0 tx=0x7f5e20009ee0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2611636922 shutdown_connections 2023-10-05T15:41:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2be220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b5ec0 0x55a18b2b62e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2611636922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2611636922 >> 172.21.15.17:0/2611636922 conn(0x55a18b22a200 msgr2=0x55a18b2b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2611636922 shutdown_connections 2023-10-05T15:41:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2611636922 wait complete. 2023-10-05T15:41:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.367+0000 7f5e4885fb80 1 -- start start 2023-10-05T15:41:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 Processor -- start 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b7990 0x55a18b2c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b208dd0 con 0x55a18b2b5ec0 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b1a56b0 con 0x55a18b2b6fd0 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b1a5350 con 0x55a18b2b7990 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.368+0000 7f5e4885fb80 10 client.0 _ll_register_callbacks cb 0x55a18b0027a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.369+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.369+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43894/0 (socket says 172.21.15.17:43894) 2023-10-05T15:41:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.369+0000 7f5e2e59c700 1 -- 172.21.15.17:0/844056034 learned_addr learned my addr 172.21.15.17:0/844056034 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.369+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b7990 0x55a18b2c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.369+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.370+0000 7f5e2e59c700 1 -- 172.21.15.17:0/844056034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b7990 msgr2=0x55a18b2c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.370+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b7990 0x55a18b2c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.370+0000 7f5e2e59c700 1 -- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 msgr2=0x55a18b2c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.370+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.370+0000 7f5e2e59c700 1 -- 172.21.15.17:0/844056034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e200098b0 con 0x55a18b2b5ec0 2023-10-05T15:41:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.371+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2bfb80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5e20004e30 tx=0x7f5e20005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e240a593fb6e52ff server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.371+0000 7f5e15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:41:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.371+0000 7f5e15ffb700 1 -- 172.21.15.17:0/844056034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009750 con 0x55a18b2b5ec0 2023-10-05T15:41:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.371+0000 7f5e15ffb700 1 -- 172.21.15.17:0/844056034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5e20014070 con 0x55a18b2b5ec0 2023-10-05T15:41:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.371+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a18b2a8d50 con 0x55a18b2b5ec0 2023-10-05T15:41:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.372+0000 7f5e15ffb700 1 -- 172.21.15.17:0/844056034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e2000eb60 con 0x55a18b2b5ec0 2023-10-05T15:41:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.372+0000 7f5e4885fb80 10 client.16431 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.372+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a18b01cc00 con 0x55a18b2b5ec0 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.372+0000 7f5e15ffb700 1 -- 172.21.15.17:0/844056034 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a18b2a8d50 con 0x55a18b2b5ec0 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.372+0000 7f5e15ffb700 1 -- 172.21.15.17:0/844056034 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5e20018a60 con 0x55a18b2b5ec0 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.373+0000 7f5e4885fb80 10 client.16431 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.373+0000 7f5e4885fb80 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.373+0000 7f5e4885fb80 20 client.16431 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.373+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b2cb8e0 0x55a18b2cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.373+0000 7f5e4885fb80 4 client.16431 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:41:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.373+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a18b201db0 con 0x55a18b2cb8e0 2023-10-05T15:41:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.374+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b2cb8e0 0x55a18b2cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.374+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b2cb8e0 0x55a18b2cdd00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7715c50892cab5 server_cookie=14c51a49dd6dce59 in_seq=0 out_seq=0 2023-10-05T15:41:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.374+0000 7f5e15ffb700 10 client.16431 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.375+0000 7f5e15ffb700 1 -- 172.21.15.17:0/844056034 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a18b201db0 con 0x55a18b2cb8e0 2023-10-05T15:41:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.375+0000 7f5e15ffb700 10 client.16431 handle_command_reply: tid=0 2023-10-05T15:41:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.375+0000 7f5e4885fb80 1 client.16431 shutdown 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 msgr2=0x55a18b2bfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2bfb80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5e20004e30 tx=0x7f5e20005590 comp rx=0 tx=0).stop 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 shutdown_connections 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b2cb8e0 0x55a18b2cdd00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b7990 0x55a18b2c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2bfb80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/844056034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.376+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 >> 172.21.15.17:0/844056034 conn(0x55a18b22a200 msgr2=0x55a18b2b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.377+0000 7f5e15ffb700 0 client.16431 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.377+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 shutdown_connections 2023-10-05T15:41:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.377+0000 7f5e4885fb80 1 -- 172.21.15.17:0/844056034 wait complete. 2023-10-05T15:41:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.377+0000 7f5e4885fb80 20 client.16431 trim_cache size 0 max 16384 2023-10-05T15:41:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 Processor -- start 2023-10-05T15:41:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 -- start start 2023-10-05T15:41:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 0x55a18b2ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2bade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b0898c0 con 0x55a18b2b7990 2023-10-05T15:41:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b2bf030 con 0x55a18b2b6fd0 2023-10-05T15:41:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.407+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b2b7d70 con 0x55a18b2b5ec0 2023-10-05T15:41:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 0x55a18b2ba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 0x55a18b2ba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:56274/0 (socket says 172.21.15.17:56274) 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2e59c700 1 -- 172.21.15.17:0/2120854833 learned_addr learned my addr 172.21.15.17:0/2120854833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2bade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2dd9b700 1 -- 172.21.15.17:0/2120854833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 msgr2=0x55a18b2ba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 0x55a18b2ba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.408+0000 7f5e2dd9b700 1 -- 172.21.15.17:0/2120854833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 msgr2=0x55a18b2c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.409+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.409+0000 7f5e2dd9b700 1 -- 172.21.15.17:0/2120854833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a18b05a1f0 con 0x55a18b2b6fd0 2023-10-05T15:41:59.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.409+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 0x55a18b2ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:41:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.409+0000 7f5e2dd9b700 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2bade0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e240117d0 tx=0x7f5e24018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12238b636ed5016 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.409+0000 7f5e1d7fa700 1 -- 172.21.15.17:0/2120854833 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24023040 con 0x55a18b2b6fd0 2023-10-05T15:41:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.410+0000 7f5e1d7fa700 1 -- 172.21.15.17:0/2120854833 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e24029030 con 0x55a18b2b6fd0 2023-10-05T15:41:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.410+0000 7f5e1d7fa700 1 -- 172.21.15.17:0/2120854833 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24003a70 con 0x55a18b2b6fd0 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2120854833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 msgr2=0x55a18b2bade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2bade0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e240117d0 tx=0x7f5e24018000 comp rx=0 tx=0).stop 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2120854833 shutdown_connections 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b7990 0x55a18b2c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b5ec0 0x55a18b2ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/2120854833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b6fd0 0x55a18b2bade0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2120854833 >> 172.21.15.17:0/2120854833 conn(0x55a18b22a200 msgr2=0x55a18b2bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.411+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2120854833 shutdown_connections 2023-10-05T15:41:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.412+0000 7f5e4885fb80 1 -- 172.21.15.17:0/2120854833 wait complete. 2023-10-05T15:41:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.412+0000 7f5e4885fb80 1 -- start start 2023-10-05T15:41:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.412+0000 7f5e4885fb80 1 Processor -- start 2023-10-05T15:41:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.413+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.413+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.413+0000 7f5e4885fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 0x55a18b2c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b2c5f70 con 0x55a18b2b5ec0 2023-10-05T15:41:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b2c60e0 con 0x55a18b2b7990 2023-10-05T15:41:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e4885fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18b2c62a0 con 0x55a18b2b6fd0 2023-10-05T15:41:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e4885fb80 10 client.0 _ll_register_callbacks cb 0x7f5e20009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:41:59.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 0x55a18b2c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e2ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 0x55a18b2c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:55350/0 (socket says 172.21.15.17:55350) 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.414+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/1007637762 learned_addr learned my addr 172.21.15.17:0/1007637762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/1007637762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 msgr2=0x55a18b2c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/1007637762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 msgr2=0x55a18b2c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e2ed9d700 1 -- 172.21.15.17:0/1007637762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e24017070 con 0x55a18b2b7990 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e2ed9d700 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 0x55a18b2c5a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e2809ad80 tx=0x7f5e2809ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7f8bd83570b49e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:41:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:41:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.415+0000 7f5e15ffb700 1 -- 172.21.15.17:0/1007637762 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280a12b0 con 0x55a18b2b7990 2023-10-05T15:41:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.416+0000 7f5e15ffb700 1 -- 172.21.15.17:0/1007637762 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5e2809b080 con 0x55a18b2b7990 2023-10-05T15:41:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.416+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e20004830 con 0x55a18b2b7990 2023-10-05T15:41:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.417+0000 7f5e15ffb700 1 -- 172.21.15.17:0/1007637762 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e2809f1d0 con 0x55a18b2b7990 2023-10-05T15:41:59.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.419+0000 7f5e4885fb80 10 client.26306 fetch_fsmap learned FSMap version 39 2023-10-05T15:41:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.419+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a18b032250 con 0x55a18b2b7990 2023-10-05T15:41:59.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.420+0000 7f5e15ffb700 1 -- 172.21.15.17:0/1007637762 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e20004830 con 0x55a18b2b7990 2023-10-05T15:41:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.420+0000 7f5e15ffb700 1 -- 172.21.15.17:0/1007637762 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5e2809a570 con 0x55a18b2b7990 2023-10-05T15:41:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.420+0000 7f5e4885fb80 10 client.26306 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:41:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.421+0000 7f5e4885fb80 10 client.26306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:41:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.421+0000 7f5e4885fb80 20 client.26306 populate_metadata read hostname 'smithi017' 2023-10-05T15:41:59.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.421+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b331ce0 0x55a18b334100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:41:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.421+0000 7f5e4885fb80 4 client.26306 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:41:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.421+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a18b201ad0 con 0x55a18b331ce0 2023-10-05T15:41:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.421+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b331ce0 0x55a18b334100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:41:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.422+0000 7f5e2e59c700 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b331ce0 0x55a18b334100 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13bf27448659bd35 server_cookie=93b078b17ec81ad8 in_seq=0 out_seq=0 2023-10-05T15:41:59.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.422+0000 7f5e15ffb700 10 client.26306 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.441+0000 7f5e15ffb700 1 -- 172.21.15.17:0/1007637762 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a18b201ad0 con 0x55a18b331ce0 2023-10-05T15:41:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.441+0000 7f5e15ffb700 10 client.26306 handle_command_reply: tid=0 2023-10-05T15:41:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.441+0000 7f5e4885fb80 1 client.26306 shutdown 2023-10-05T15:41:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 msgr2=0x55a18b2c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 0x55a18b2c5a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e2809ad80 tx=0x7f5e2809ac70 comp rx=0 tx=0).stop 2023-10-05T15:41:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 shutdown_connections 2023-10-05T15:41:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a18b331ce0 0x55a18b334100 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a18b2b7990 0x55a18b2c5a30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a18b2b5ec0 0x55a18b2c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 --2- 172.21.15.17:0/1007637762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a18b2b6fd0 0x55a18b2c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.442+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 >> 172.21.15.17:0/1007637762 conn(0x55a18b22a200 msgr2=0x55a18b2bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.443+0000 7f5e15ffb700 0 client.26306 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:41:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.443+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 shutdown_connections 2023-10-05T15:41:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.443+0000 7f5e4885fb80 1 -- 172.21.15.17:0/1007637762 wait complete. 2023-10-05T15:41:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.443+0000 7f5e4885fb80 20 client.26306 trim_cache size 0 max 16384 2023-10-05T15:41:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:41:59.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:41:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:41:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:41:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.445+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5e180a1560 msgr2=0x7f5e180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.445+0000 7f5e34fff700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5e180a1560 0x7f5e180a3a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e30110dd0 tx=0x7f5e24009260 comp rx=0 tx=0).stop 2023-10-05T15:41:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.445+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 msgr2=0x7f5e3010fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:41:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.445+0000 7f5e34fff700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e3010fad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800d010 tx=0x7f5e2800bcc0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.448+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 shutdown_connections 2023-10-05T15:41:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.448+0000 7f5e34fff700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5e180a1560 0x7f5e180a3a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.448+0000 7f5e34fff700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e30106bd0 0x7f5e3010fad0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.448+0000 7f5e34fff700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101970 0x7f5e30111190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.448+0000 7f5e34fff700 1 --2- 172.21.15.17:0/2669279623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e301042a0 0x7f5e301116d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:41:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.448+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 >> 172.21.15.17:0/2669279623 conn(0x7f5e300fb340 msgr2=0x7f5e301025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:41:59.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.450+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 shutdown_connections 2023-10-05T15:41:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:41:59.450+0000 7f5e34fff700 1 -- 172.21.15.17:0/2669279623 wait complete. 2023-10-05T15:42:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:41:59 smithi167 ceph-mon[133366]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 571 op/s 2023-10-05T15:42:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:41:59 smithi079 ceph-mon[132936]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 571 op/s 2023-10-05T15:42:00.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:41:59 smithi017 ceph-mon[129107]: pgmap v531: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.1 MiB/s wr, 571 op/s 2023-10-05T15:42:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:01 smithi167 ceph-mon[133366]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.4 MiB/s wr, 727 op/s 2023-10-05T15:42:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:01 smithi079 ceph-mon[132936]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.4 MiB/s wr, 727 op/s 2023-10-05T15:42:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:01 smithi017 ceph-mon[129107]: pgmap v532: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.4 MiB/s wr, 727 op/s 2023-10-05T15:42:03.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:02 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:42:03.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:02 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:42:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 205.0 s, 505.8 tps, lat 204.376 ms stddev 173.966 2023-10-05T15:42:03.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:02 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:42:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:03 smithi167 ceph-mon[133366]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 707 op/s 2023-10-05T15:42:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:03 smithi079 ceph-mon[132936]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 707 op/s 2023-10-05T15:42:04.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:03 smithi017 ceph-mon[129107]: pgmap v533: 129 pgs: 129 active+clean; 1.5 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 707 op/s 2023-10-05T15:42:04.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:42:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 -- 172.21.15.17:0/1303231540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102a30 msgr2=0x7f0b38109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/1303231540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102a30 0x7f0b38109350 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000b0a0 tx=0x7f0b3000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 -- 172.21.15.17:0/1303231540 shutdown_connections 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/1303231540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102a30 0x7f0b38109350 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/1303231540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38100e90 0x7f0b381012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/1303231540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b38102070 0x7f0b381024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 -- 172.21.15.17:0/1303231540 >> 172.21.15.17:0/1303231540 conn(0x7f0b380fc430 msgr2=0x7f0b380fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.976+0000 7f0b3cbff700 1 -- 172.21.15.17:0/1303231540 shutdown_connections 2023-10-05T15:42:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.977+0000 7f0b3cbff700 1 -- 172.21.15.17:0/1303231540 wait complete. 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.978+0000 7f0b3cbff700 1 Processor -- start 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.978+0000 7f0b3cbff700 1 -- start start 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.978+0000 7f0b3cbff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b38100e90 0x7f0b38196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.978+0000 7f0b3cbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 0x7f0b38197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b3cbff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38102a30 0x7f0b3819e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b3cbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3819e770 con 0x7f0b38102070 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b3cbff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3819e8b0 con 0x7f0b38102a30 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b3cbff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3819ea40 con 0x7f0b38100e90 2023-10-05T15:42:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 0x7f0b38197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 0x7f0b38197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42182/0 (socket says 172.21.15.17:42182) 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 -- 172.21.15.17:0/783339310 learned_addr learned my addr 172.21.15.17:0/783339310 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b3659c700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b38100e90 0x7f0b38196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38102a30 0x7f0b3819e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 -- 172.21.15.17:0/783339310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b38100e90 msgr2=0x7f0b38196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b38100e90 0x7f0b38196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 -- 172.21.15.17:0/783339310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38102a30 msgr2=0x7f0b3819e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38102a30 0x7f0b3819e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 -- 172.21.15.17:0/783339310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30009d00 con 0x7f0b38102070 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38102a30 0x7f0b3819e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:42:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.979+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 0x7f0b38197130 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00e950 tx=0x7f0b2c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.980+0000 7f0b277fe700 1 -- 172.21.15.17:0/783339310 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c009770 con 0x7f0b38102070 2023-10-05T15:42:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.980+0000 7f0b277fe700 1 -- 172.21.15.17:0/783339310 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b2c00eea0 con 0x7f0b38102070 2023-10-05T15:42:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.980+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3819ed20 con 0x7f0b38102070 2023-10-05T15:42:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.980+0000 7f0b277fe700 1 -- 172.21.15.17:0/783339310 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c003cc0 con 0x7f0b38102070 2023-10-05T15:42:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.980+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3819f1d0 con 0x7f0b38102070 2023-10-05T15:42:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.983+0000 7f0b277fe700 1 -- 172.21.15.17:0/783339310 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0b2c003e20 con 0x7f0b38102070 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.986+0000 7f0b5051cb80 1 Processor -- start 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.986+0000 7f0b277fe700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0b200a1500 0x7f0b200a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.987+0000 7f0b277fe700 1 -- 172.21.15.17:0/783339310 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0b2c014070 con 0x7f0b38102070 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 -- start start 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c073879570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c07387a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c07387add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0737e1460 con 0x55c073879ab0 2023-10-05T15:42:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0737d2c20 con 0x55c07387a950 2023-10-05T15:42:04.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.988+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0737d0540 con 0x55c073879150 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.989+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0b200a1500 0x7f0b200a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.989+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c073879570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.989+0000 7f0b36d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c07387add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.989+0000 7f0b36d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c07387add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35014/0 (socket says 172.21.15.17:35014) 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.989+0000 7f0b36d9d700 1 -- 172.21.15.17:0/147946375 learned_addr learned my addr 172.21.15.17:0/147946375 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.989+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c07387a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.990+0000 7f0b36d9d700 1 -- 172.21.15.17:0/147946375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 msgr2=0x55c073879570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.990+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c073879570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.990+0000 7f0b36d9d700 1 -- 172.21.15.17:0/147946375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 msgr2=0x55c07387a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.990+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c07387a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.990+0000 7f0b36d9d700 1 -- 172.21.15.17:0/147946375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0735f6de0 con 0x55c07387a950 2023-10-05T15:42:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.990+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c07387add0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009610 tx=0x7f0b30007cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b71880d87706d115 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.991+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0b200a1500 0x7f0b200a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0b300062a0 tx=0x7f0b30019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.991+0000 7f0b24ff9700 1 -- 172.21.15.17:0/147946375 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000e040 con 0x55c07387a950 2023-10-05T15:42:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.991+0000 7f0b24ff9700 1 -- 172.21.15.17:0/147946375 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b300092e0 con 0x55c07387a950 2023-10-05T15:42:04.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.991+0000 7f0b24ff9700 1 -- 172.21.15.17:0/147946375 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3001d480 con 0x55c07387a950 2023-10-05T15:42:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 -- 172.21.15.17:0/147946375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 msgr2=0x55c07387add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:04.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c07387add0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009610 tx=0x7f0b30007cb0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 -- 172.21.15.17:0/147946375 shutdown_connections 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c07387add0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c073879570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/147946375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c07387a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 -- 172.21.15.17:0/147946375 >> 172.21.15.17:0/147946375 conn(0x55c0737ed260 msgr2=0x55c073874140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 -- 172.21.15.17:0/147946375 shutdown_connections 2023-10-05T15:42:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.993+0000 7f0b5051cb80 1 -- 172.21.15.17:0/147946375 wait complete. 2023-10-05T15:42:04.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.994+0000 7f0b5051cb80 1 -- start start 2023-10-05T15:42:04.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 Processor -- start 2023-10-05T15:42:04.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 0x55c0738830a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879ab0 0x55c0738835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c07387a950 0x55c073888610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:04.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0737cbe30 con 0x55c07387a950 2023-10-05T15:42:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c073768710 con 0x55c073879150 2023-10-05T15:42:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0737683b0 con 0x55c073879ab0 2023-10-05T15:42:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.995+0000 7f0b5051cb80 10 client.0 _ll_register_callbacks cb 0x55c0735c5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.996+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 0x55c0738830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.996+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 0x55c0738830a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35026/0 (socket says 172.21.15.17:35026) 2023-10-05T15:42:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.996+0000 7f0b3659c700 1 -- 172.21.15.17:0/3851316476 learned_addr learned my addr 172.21.15.17:0/3851316476 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:05.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.997+0000 7f0b3659c700 1 -- 172.21.15.17:0/3851316476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879ab0 msgr2=0x55c0738835e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:05.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.997+0000 7f0b3659c700 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879ab0 0x55c0738835e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.997+0000 7f0b3659c700 1 -- 172.21.15.17:0/3851316476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c07387a950 msgr2=0x55c073888610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:05.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.997+0000 7f0b3659c700 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c07387a950 0x55c073888610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.997+0000 7f0b3659c700 1 -- 172.21.15.17:0/3851316476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38109c80 con 0x55c073879150 2023-10-05T15:42:05.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.998+0000 7f0b3659c700 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 0x55c0738830a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0b28011780 tx=0x7f0b28011b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403f5aaafdb888e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:05.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.998+0000 7f0b1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:42:05.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.998+0000 7f0b1dffb700 1 -- 172.21.15.17:0/3851316476 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28016070 con 0x55c073879150 2023-10-05T15:42:05.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.998+0000 7f0b1dffb700 1 -- 172.21.15.17:0/3851316476 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0b28004300 con 0x55c073879150 2023-10-05T15:42:05.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.998+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c07386bf10 con 0x55c073879150 2023-10-05T15:42:05.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.999+0000 7f0b1dffb700 1 -- 172.21.15.17:0/3851316476 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b280044c0 con 0x55c073879150 2023-10-05T15:42:05.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.999+0000 7f0b5051cb80 10 client.26318 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:05.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:04.999+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55c0735dfc60 con 0x55c073879150 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.000+0000 7f0b1dffb700 1 -- 172.21.15.17:0/3851316476 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c07386bf10 con 0x55c073879150 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.000+0000 7f0b1dffb700 1 -- 172.21.15.17:0/3851316476 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0b2800f9a0 con 0x55c073879150 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.000+0000 7f0b5051cb80 10 client.26318 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.000+0000 7f0b5051cb80 10 client.26318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.001+0000 7f0b5051cb80 20 client.26318 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.001+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c07389ffb0 0x55c0738a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.001+0000 7f0b5051cb80 4 client.26318 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:42:05.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.001+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0737c4e10 con 0x55c07389ffb0 2023-10-05T15:42:05.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.001+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c07389ffb0 0x55c0738a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.002+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c07389ffb0 0x55c0738a23d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e49d36b588746d9a server_cookie=5aab35aed1f77530 in_seq=0 out_seq=0 2023-10-05T15:42:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.003+0000 7f0b1dffb700 10 client.26318 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.003+0000 7f0b1dffb700 1 -- 172.21.15.17:0/3851316476 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c0737c4e10 con 0x55c07389ffb0 2023-10-05T15:42:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.003+0000 7f0b1dffb700 10 client.26318 handle_command_reply: tid=0 2023-10-05T15:42:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.003+0000 7f0b5051cb80 1 client.26318 shutdown 2023-10-05T15:42:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 msgr2=0x55c0738830a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 0x55c0738830a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0b28011780 tx=0x7f0b28011b40 comp rx=0 tx=0).stop 2023-10-05T15:42:05.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 shutdown_connections 2023-10-05T15:42:05.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c07389ffb0 0x55c0738a23d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c07387a950 0x55c073888610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879150 0x55c0738830a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3851316476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879ab0 0x55c0738835e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 >> 172.21.15.17:0/3851316476 conn(0x55c0737ed260 msgr2=0x55c073873f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.004+0000 7f0b1dffb700 0 client.26318 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.005+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 shutdown_connections 2023-10-05T15:42:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.005+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3851316476 wait complete. 2023-10-05T15:42:05.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.005+0000 7f0b5051cb80 20 client.26318 trim_cache size 0 max 16384 2023-10-05T15:42:05.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 Processor -- start 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 -- start start 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 0x55c0738afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879ab0 0x55c073882e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c07387a950 0x55c073883390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07364c920 con 0x55c073879150 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c073879e90 con 0x55c073879ab0 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.035+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c07387a070 con 0x55c07387a950 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 0x55c0738afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 0x55c0738afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42200/0 (socket says 172.21.15.17:42200) 2023-10-05T15:42:05.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 -- 172.21.15.17:0/3652007837 learned_addr learned my addr 172.21.15.17:0/3652007837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b35d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879ab0 0x55c073882e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c07387a950 0x55c073883390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 -- 172.21.15.17:0/3652007837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c07387a950 msgr2=0x55c073883390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c07387a950 0x55c073883390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 -- 172.21.15.17:0/3652007837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879ab0 msgr2=0x55c073882e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879ab0 0x55c073882e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 -- 172.21.15.17:0/3652007837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c07361d250 con 0x55c073879150 2023-10-05T15:42:05.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b3659c700 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 0x55c0738afbb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b28011f40 tx=0x7f0b2801a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96419b1a0157892f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:05.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.036+0000 7f0b257fa700 1 -- 172.21.15.17:0/3652007837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28016040 con 0x55c073879150 2023-10-05T15:42:05.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b257fa700 1 -- 172.21.15.17:0/3652007837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b2800f5c0 con 0x55c073879150 2023-10-05T15:42:05.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b257fa700 1 -- 172.21.15.17:0/3652007837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2801a990 con 0x55c073879150 2023-10-05T15:42:05.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3652007837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 msgr2=0x55c0738afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:05.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 0x55c0738afbb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0b28011f40 tx=0x7f0b2801a4b0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3652007837 shutdown_connections 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c07387a950 0x55c073883390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879150 0x55c0738afbb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/3652007837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c073879ab0 0x55c073882e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3652007837 >> 172.21.15.17:0/3652007837 conn(0x55c0737ed260 msgr2=0x55c0738a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3652007837 shutdown_connections 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.037+0000 7f0b5051cb80 1 -- 172.21.15.17:0/3652007837 wait complete. 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 -- start start 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 Processor -- start 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c0738ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c0738f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c0738f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0738f35a0 con 0x55c073879ab0 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0738f3710 con 0x55c07387a950 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0738f38d0 con 0x55c073879150 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.038+0000 7f0b5051cb80 10 client.0 _ll_register_callbacks cb 0x7f0b28009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c0738f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b36d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c0738f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c0738f0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42202/0 (socket says 172.21.15.17:42202) 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c0738ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 -- 172.21.15.17:0/2149827754 learned_addr learned my addr 172.21.15.17:0/2149827754 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 -- 172.21.15.17:0/2149827754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 msgr2=0x55c0738ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c0738ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 -- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 msgr2=0x55c0738f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c0738f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 -- 172.21.15.17:0/2149827754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0735dfc60 con 0x55c073879ab0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b3659c700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c0738ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b36d9d700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c0738f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b35d9b700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c0738f0a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c096730 tx=0x7f0b2c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c96118aae5ba291 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.039+0000 7f0b1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b1dffb700 1 -- 172.21.15.17:0/2149827754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c09e380 con 0x55c073879ab0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b300092e0 con 0x55c073879ab0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b1dffb700 1 -- 172.21.15.17:0/2149827754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0b2c094e40 con 0x55c073879ab0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b1dffb700 1 -- 172.21.15.17:0/2149827754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b2c0a25c0 con 0x55c073879ab0 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 10 client.16446 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55c0735f52b0 con 0x55c073879ab0 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b1dffb700 1 -- 172.21.15.17:0/2149827754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b300092e0 con 0x55c073879ab0 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b1dffb700 1 -- 172.21.15.17:0/2149827754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0b2c09a490 con 0x55c073879ab0 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 10 client.16446 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 20 client.16446 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c0738f5400 0x55c0738f7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 4 client.16446 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.040+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c0737c4b30 con 0x55c0738f5400 2023-10-05T15:42:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.041+0000 7f0b3659c700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c0738f5400 0x55c0738f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.041+0000 7f0b3659c700 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c0738f5400 0x55c0738f7820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eefb3deda55df51 server_cookie=a93cf27f9bb81224 in_seq=0 out_seq=0 2023-10-05T15:42:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.041+0000 7f0b1dffb700 10 client.16446 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b1dffb700 1 -- 172.21.15.17:0/2149827754 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c0737c4b30 con 0x55c0738f5400 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b1dffb700 10 client.16446 handle_command_reply: tid=0 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 client.16446 shutdown 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 msgr2=0x55c0738f0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c0738f0a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c096730 tx=0x7f0b2c005b00 comp rx=0 tx=0).stop 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 shutdown_connections 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c0738f5400 0x55c0738f7820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c07387a950 0x55c0738f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c073879150 0x55c0738ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b1dffb700 0 client.16446 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 --2- 172.21.15.17:0/2149827754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c073879ab0 0x55c0738f0a30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 >> 172.21.15.17:0/2149827754 conn(0x55c0737ed260 msgr2=0x55c073882e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:05.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 shutdown_connections 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 1 -- 172.21.15.17:0/2149827754 wait complete. 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.042+0000 7f0b5051cb80 20 client.16446 trim_cache size 0 max 16384 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:42:05.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:42:05.051 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:42:05.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:42:05.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:42:05.051 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:42:05.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0b200a1500 msgr2=0x7f0b200a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:05.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0b200a1500 0x7f0b200a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0b300062a0 tx=0x7f0b30019000 comp rx=0 tx=0).stop 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 msgr2=0x7f0b38197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 0x7f0b38197130 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00e950 tx=0x7f0b2c00ec60 comp rx=0 tx=0).stop 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 shutdown_connections 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0b200a1500 0x7f0b200a39c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b38102a30 0x7f0b3819e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b38100e90 0x7f0b38196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 --2- 172.21.15.17:0/783339310 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b38102070 0x7f0b38197130 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 >> 172.21.15.17:0/783339310 conn(0x7f0b380fc430 msgr2=0x7f0b380fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 shutdown_connections 2023-10-05T15:42:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:05.043+0000 7f0b3cbff700 1 -- 172.21.15.17:0/783339310 wait complete. 2023-10-05T15:42:05.062 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:42:05.062 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:42:05.062 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:42:05.064 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:42:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:42:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:42:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:42:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:42:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:42:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:42:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:05 smithi167 ceph-mon[133366]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.9 MiB/s wr, 861 op/s 2023-10-05T15:42:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:05 smithi079 ceph-mon[132936]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.9 MiB/s wr, 861 op/s 2023-10-05T15:42:06.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:05 smithi017 ceph-mon[129107]: pgmap v534: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.9 MiB/s wr, 861 op/s 2023-10-05T15:42:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:07 smithi167 ceph-mon[133366]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.6 MiB/s wr, 662 op/s 2023-10-05T15:42:08.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:07 smithi079 ceph-mon[132936]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.6 MiB/s wr, 662 op/s 2023-10-05T15:42:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 210.0 s, 582.2 tps, lat 172.143 ms stddev 96.416 2023-10-05T15:42:08.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:07 smithi017 ceph-mon[129107]: pgmap v535: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.6 MiB/s wr, 662 op/s 2023-10-05T15:42:09.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:08 smithi017 ceph-mon[129107]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.4 MiB/s wr, 708 op/s 2023-10-05T15:42:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:08 smithi167 ceph-mon[133366]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.4 MiB/s wr, 708 op/s 2023-10-05T15:42:09.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:08 smithi079 ceph-mon[132936]: pgmap v536: 129 pgs: 129 active+clean; 1.5 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.4 MiB/s wr, 708 op/s 2023-10-05T15:42:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:11 smithi167 ceph-mon[133366]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.6 MiB/s wr, 753 op/s 2023-10-05T15:42:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:11 smithi079 ceph-mon[132936]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.6 MiB/s wr, 753 op/s 2023-10-05T15:42:12.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:11 smithi017 ceph-mon[129107]: pgmap v537: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.6 MiB/s wr, 753 op/s 2023-10-05T15:42:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 -- 172.21.15.17:0/563202421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0102080 msgr2=0x7f7cb0102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/563202421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0102080 0x7f7cb0102500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009990 tx=0x7f7c9c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 -- 172.21.15.17:0/563202421 shutdown_connections 2023-10-05T15:42:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/563202421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb0102a40 0x7f7cb0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/563202421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0100ea0 0x7f7cb01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/563202421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0102080 0x7f7cb0102500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.704+0000 7f7cb6fff700 1 -- 172.21.15.17:0/563202421 >> 172.21.15.17:0/563202421 conn(0x7f7cb00fc460 msgr2=0x7f7cb00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.705+0000 7f7cb6fff700 1 -- 172.21.15.17:0/563202421 shutdown_connections 2023-10-05T15:42:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.705+0000 7f7cb6fff700 1 -- 172.21.15.17:0/563202421 wait complete. 2023-10-05T15:42:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.707+0000 7f7cb6fff700 1 Processor -- start 2023-10-05T15:42:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 -- start start 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 0x7f7cb0111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb0102080 0x7f7cb0111660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0102a40 0x7f7cb010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0111eb0 con 0x7f7cb0102080 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb010ffa0 con 0x7f7cb0102a40 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb6fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0110160 con 0x7f7cb0100ea0 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0102a40 0x7f7cb010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.708+0000 7f7cb4d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 0x7f7cb0111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0102a40 0x7f7cb010fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35058/0 (socket says 172.21.15.17:35058) 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb4d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 0x7f7cb0111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44396/0 (socket says 172.21.15.17:44396) 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb559c700 1 -- 172.21.15.17:0/3462480461 learned_addr learned my addr 172.21.15.17:0/3462480461 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7caffff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb0102080 0x7f7cb0111660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb4d9b700 1 -- 172.21.15.17:0/3462480461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0102a40 msgr2=0x7f7cb010fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb4d9b700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0102a40 0x7f7cb010fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb4d9b700 1 -- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb0102080 msgr2=0x7f7cb0111660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb4d9b700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb0102080 0x7f7cb0111660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.709+0000 7f7cb4d9b700 1 -- 172.21.15.17:0/3462480461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0095f0 con 0x7f7cb0100ea0 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.710+0000 7f7cb4d9b700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 0x7f7cb0111120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400d740 tx=0x7f7ca400da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.710+0000 7f7cadffb700 1 -- 172.21.15.17:0/3462480461 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4004220 con 0x7f7cb0100ea0 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.710+0000 7f7cadffb700 1 -- 172.21.15.17:0/3462480461 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ca4004380 con 0x7f7cb0100ea0 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.710+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb0110440 con 0x7f7cb0100ea0 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.710+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb0070900 con 0x7f7cb0100ea0 2023-10-05T15:42:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.711+0000 7f7cadffb700 1 -- 172.21.15.17:0/3462480461 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4003b00 con 0x7f7cb0100ea0 2023-10-05T15:42:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.717+0000 7f7cadffb700 1 -- 172.21.15.17:0/3462480461 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7ca4003c60 con 0x7f7cb0100ea0 2023-10-05T15:42:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.718+0000 7f7cca9aab80 1 Processor -- start 2023-10-05T15:42:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.718+0000 7f7cca9aab80 1 -- start start 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.719+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd4772e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.719+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd478450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.719+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd47f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.719+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd3df400 con 0x55aacd477fd0 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.719+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd3d0bc0 con 0x55aacd478990 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.719+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd3ce4e0 con 0x55aacd476ec0 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd4772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd4772e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44408/0 (socket says 172.21.15.17:44408) 2023-10-05T15:42:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 -- 172.21.15.17:0/1376923143 learned_addr learned my addr 172.21.15.17:0/1376923143 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb4d9b700 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd478450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 -- 172.21.15.17:0/1376923143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 msgr2=0x55aacd47f220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd47f220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 -- 172.21.15.17:0/1376923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 msgr2=0x55aacd478450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd478450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.720+0000 7f7cb559c700 1 -- 172.21.15.17:0/1376923143 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aacd1f4d80 con 0x55aacd476ec0 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7cadffb700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7ca00a1530 0x7f7ca00a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7cb559c700 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd4772e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800f5a0 tx=0x7f7ca800f8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a61ee543d6c3e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7cadffb700 1 -- 172.21.15.17:0/3462480461 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7ca40cc980 con 0x7f7cb0100ea0 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7cb4d9b700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7ca00a1530 0x7f7ca00a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7c9affd700 1 -- 172.21.15.17:0/1376923143 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8004bb0 con 0x55aacd476ec0 2023-10-05T15:42:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7c9affd700 1 -- 172.21.15.17:0/1376923143 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ca8004d10 con 0x55aacd476ec0 2023-10-05T15:42:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.721+0000 7f7c9affd700 1 -- 172.21.15.17:0/1376923143 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8005110 con 0x55aacd476ec0 2023-10-05T15:42:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.723+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1376923143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 msgr2=0x55aacd4772e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.723+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd4772e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800f5a0 tx=0x7f7ca800f8b0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.723+0000 7f7cb4d9b700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7ca00a1530 0x7f7ca00a39f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40ccbe0 tx=0x7f7ca4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1376923143 shutdown_connections 2023-10-05T15:42:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd47f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd4772e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1376923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd478450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1376923143 >> 172.21.15.17:0/1376923143 conn(0x55aacd3eb200 msgr2=0x55aacd471bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1376923143 shutdown_connections 2023-10-05T15:42:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.724+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1376923143 wait complete. 2023-10-05T15:42:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.725+0000 7f7cca9aab80 1 -- start start 2023-10-05T15:42:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.725+0000 7f7cca9aab80 1 Processor -- start 2023-10-05T15:42:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd480bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd481100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd488140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd3c9dd0 con 0x55aacd477fd0 2023-10-05T15:42:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd3666b0 con 0x55aacd478990 2023-10-05T15:42:12.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd366350 con 0x55aacd476ec0 2023-10-05T15:42:12.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.726+0000 7f7cca9aab80 10 client.0 _ll_register_callbacks cb 0x55aacd1c37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.728+0000 7f7caffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd481100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.728+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd488140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.728+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd480bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.728+0000 7f7caffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd481100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42230/0 (socket says 172.21.15.17:42230) 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.728+0000 7f7caffff700 1 -- 172.21.15.17:0/3801546377 learned_addr learned my addr 172.21.15.17:0/3801546377 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.729+0000 7f7cb559c700 1 -- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 msgr2=0x55aacd488140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.729+0000 7f7cb559c700 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd488140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.729+0000 7f7cb559c700 1 -- 172.21.15.17:0/3801546377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 msgr2=0x55aacd481100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.729+0000 7f7cb559c700 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd481100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.729+0000 7f7cb559c700 1 -- 172.21.15.17:0/3801546377 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca800f1d0 con 0x55aacd476ec0 2023-10-05T15:42:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.729+0000 7f7cb559c700 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd480bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800f570 tx=0x7f7ca8000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3766b5209260b905 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.730+0000 7f7c8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:42:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.731+0000 7f7c8ffff700 1 -- 172.21.15.17:0/3801546377 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8003c10 con 0x55aacd476ec0 2023-10-05T15:42:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.731+0000 7f7c8ffff700 1 -- 172.21.15.17:0/3801546377 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7ca8003d70 con 0x55aacd476ec0 2023-10-05T15:42:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.731+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aacd469d50 con 0x55aacd476ec0 2023-10-05T15:42:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.733+0000 7f7c8ffff700 1 -- 172.21.15.17:0/3801546377 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca8005310 con 0x55aacd476ec0 2023-10-05T15:42:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.733+0000 7f7cca9aab80 10 client.26290 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.733+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55aacd1ddc00 con 0x55aacd476ec0 2023-10-05T15:42:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.733+0000 7f7c8ffff700 1 -- 172.21.15.17:0/3801546377 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aacd469d50 con 0x55aacd476ec0 2023-10-05T15:42:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.733+0000 7f7c8ffff700 1 -- 172.21.15.17:0/3801546377 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7ca8012070 con 0x55aacd476ec0 2023-10-05T15:42:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.733+0000 7f7cca9aab80 10 client.26290 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.734+0000 7f7cca9aab80 10 client.26290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.734+0000 7f7cca9aab80 20 client.26290 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.734+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd48c910 0x55aacd48ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.734+0000 7f7cca9aab80 4 client.26290 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:42:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.734+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aacd3c2db0 con 0x55aacd48c910 2023-10-05T15:42:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.734+0000 7f7caffff700 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd48c910 0x55aacd48ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.735+0000 7f7caffff700 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd48c910 0x55aacd48ed30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e8e8ff86906a2e server_cookie=d37afb001000f76a in_seq=0 out_seq=0 2023-10-05T15:42:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.735+0000 7f7c8ffff700 10 client.26290 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.736+0000 7f7c8ffff700 1 -- 172.21.15.17:0/3801546377 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aacd3c2db0 con 0x55aacd48c910 2023-10-05T15:42:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.736+0000 7f7c8ffff700 10 client.26290 handle_command_reply: tid=0 2023-10-05T15:42:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.736+0000 7f7cca9aab80 1 client.26290 shutdown 2023-10-05T15:42:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 msgr2=0x55aacd480bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd480bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800f570 tx=0x7f7ca8000f40 comp rx=0 tx=0).stop 2023-10-05T15:42:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 shutdown_connections 2023-10-05T15:42:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd48c910 0x55aacd48ed30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd478990 0x55aacd488140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd476ec0 0x55aacd480bc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/3801546377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd477fd0 0x55aacd481100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 >> 172.21.15.17:0/3801546377 conn(0x55aacd3eb200 msgr2=0x55aacd471250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.737+0000 7f7c8ffff700 0 client.26290 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.738+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 shutdown_connections 2023-10-05T15:42:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.738+0000 7f7cca9aab80 1 -- 172.21.15.17:0/3801546377 wait complete. 2023-10-05T15:42:12.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.739+0000 7f7cca9aab80 20 client.26290 trim_cache size 0 max 16384 2023-10-05T15:42:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.769+0000 7f7cca9aab80 1 Processor -- start 2023-10-05T15:42:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 -- start start 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd471250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd488970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd24a8c0 con 0x55aacd476ec0 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd46e860 con 0x55aacd477fd0 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.770+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd473680 con 0x55aacd478990 2023-10-05T15:42:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.771+0000 7f7caffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.771+0000 7f7caffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4880d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35074/0 (socket says 172.21.15.17:35074) 2023-10-05T15:42:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.771+0000 7f7caffff700 1 -- 172.21.15.17:0/1596029174 learned_addr learned my addr 172.21.15.17:0/1596029174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.771+0000 7f7cb559c700 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd488970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.771+0000 7f7cb559c700 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd471250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.772+0000 7f7caffff700 1 -- 172.21.15.17:0/1596029174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 msgr2=0x55aacd488970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.772+0000 7f7caffff700 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd488970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.772+0000 7f7caffff700 1 -- 172.21.15.17:0/1596029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 msgr2=0x55aacd471250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.772+0000 7f7caffff700 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd471250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.772+0000 7f7caffff700 1 -- 172.21.15.17:0/1596029174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aacd21b1f0 con 0x55aacd477fd0 2023-10-05T15:42:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.772+0000 7f7caffff700 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4880d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009990 tx=0x7f7c9c005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=831e8df8897d855f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.773+0000 7f7c9b7fe700 1 -- 172.21.15.17:0/1596029174 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c01d040 con 0x55aacd477fd0 2023-10-05T15:42:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.773+0000 7f7c9b7fe700 1 -- 172.21.15.17:0/1596029174 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c9c01e040 con 0x55aacd477fd0 2023-10-05T15:42:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.773+0000 7f7c9b7fe700 1 -- 172.21.15.17:0/1596029174 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0052a0 con 0x55aacd477fd0 2023-10-05T15:42:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.774+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1596029174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 msgr2=0x55aacd4880d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.774+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4880d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009990 tx=0x7f7c9c005ad0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.775+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1596029174 shutdown_connections 2023-10-05T15:42:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.775+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd488970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.775+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd471250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.775+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/1596029174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4880d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.775+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1596029174 >> 172.21.15.17:0/1596029174 conn(0x55aacd3eb200 msgr2=0x55aacd471b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:12.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.775+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1596029174 shutdown_connections 2023-10-05T15:42:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.776+0000 7f7cca9aab80 1 -- 172.21.15.17:0/1596029174 wait complete. 2023-10-05T15:42:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.776+0000 7f7cca9aab80 1 -- start start 2023-10-05T15:42:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.777+0000 7f7cca9aab80 1 Processor -- start 2023-10-05T15:42:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd485d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd4872d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd487810 con 0x55aacd476ec0 2023-10-05T15:42:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd487980 con 0x55aacd477fd0 2023-10-05T15:42:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacd487b40 con 0x55aacd478990 2023-10-05T15:42:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.778+0000 7f7cca9aab80 10 client.0 _ll_register_callbacks cb 0x7f7ca8014990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.779+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd4872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.779+0000 7f7cb559c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd4872d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44444/0 (socket says 172.21.15.17:44444) 2023-10-05T15:42:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.779+0000 7f7cb559c700 1 -- 172.21.15.17:0/4217025446 learned_addr learned my addr 172.21.15.17:0/4217025446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.779+0000 7f7caffff700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.780+0000 7f7cb559c700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd485d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.780+0000 7f7cb559c700 1 -- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 msgr2=0x55aacd4862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.780+0000 7f7cb559c700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.780+0000 7f7cb559c700 1 -- 172.21.15.17:0/4217025446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 msgr2=0x55aacd485d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.780+0000 7f7cb559c700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd485d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.780+0000 7f7cb559c700 1 -- 172.21.15.17:0/4217025446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb0109c90 con 0x55aacd478990 2023-10-05T15:42:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.781+0000 7f7cb559c700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd4872d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ca802d040 tx=0x7f7ca8004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d98882d9bc80c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.781+0000 7f7c8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:42:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.781+0000 7f7c8ffff700 1 -- 172.21.15.17:0/4217025446 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8004b70 con 0x55aacd478990 2023-10-05T15:42:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.781+0000 7f7c8ffff700 1 -- 172.21.15.17:0/4217025446 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7ca8003c10 con 0x55aacd478990 2023-10-05T15:42:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.782+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ca8004d10 con 0x55aacd478990 2023-10-05T15:42:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.782+0000 7f7c8ffff700 1 -- 172.21.15.17:0/4217025446 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca8003dd0 con 0x55aacd478990 2023-10-05T15:42:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.782+0000 7f7cca9aab80 10 client.26296 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.782+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55aacd1f3250 con 0x55aacd478990 2023-10-05T15:42:12.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.783+0000 7f7c8ffff700 1 -- 172.21.15.17:0/4217025446 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ca8004d10 con 0x55aacd478990 2023-10-05T15:42:12.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.783+0000 7f7c8ffff700 1 -- 172.21.15.17:0/4217025446 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7ca803e070 con 0x55aacd478990 2023-10-05T15:42:12.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.784+0000 7f7cca9aab80 10 client.26296 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:12.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.784+0000 7f7cca9aab80 10 client.26296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.784+0000 7f7cca9aab80 20 client.26296 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.784+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd4e1030 0x55aacd4e3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.785+0000 7f7cca9aab80 4 client.26296 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:42:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.785+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aacd3c2ad0 con 0x55aacd4e1030 2023-10-05T15:42:12.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.787+0000 7f7caffff700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd4e1030 0x55aacd4e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.793+0000 7f7caffff700 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd4e1030 0x55aacd4e3420 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=756539773bac83b5 server_cookie=760c84c807927b25 in_seq=0 out_seq=0 2023-10-05T15:42:12.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.793+0000 7f7c8ffff700 10 client.26296 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.813+0000 7f7c8ffff700 1 -- 172.21.15.17:0/4217025446 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aacd3c2ad0 con 0x55aacd4e1030 2023-10-05T15:42:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.813+0000 7f7c8ffff700 10 client.26296 handle_command_reply: tid=0 2023-10-05T15:42:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.813+0000 7f7cca9aab80 1 client.26296 shutdown 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.813+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 msgr2=0x55aacd4872d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.813+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd4872d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ca802d040 tx=0x7f7ca8004f60 comp rx=0 tx=0).stop 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 shutdown_connections 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55aacd4e1030 0x55aacd4e3420 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55aacd478990 0x55aacd4872d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aacd476ec0 0x55aacd485d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 --2- 172.21.15.17:0/4217025446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aacd477fd0 0x55aacd4862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 >> 172.21.15.17:0/4217025446 conn(0x55aacd3eb200 msgr2=0x55aacd47ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7c8ffff700 0 client.26296 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 shutdown_connections 2023-10-05T15:42:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.814+0000 7f7cca9aab80 1 -- 172.21.15.17:0/4217025446 wait complete. 2023-10-05T15:42:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.815+0000 7f7cca9aab80 20 client.26296 trim_cache size 0 max 16384 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.815+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7ca00a1530 msgr2=0x7f7ca00a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.815+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7ca00a1530 0x7f7ca00a39f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40ccbe0 tx=0x7f7ca4000bc0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.816+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 msgr2=0x7f7cb0111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.816+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 0x7f7cb0111120 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400d740 tx=0x7f7ca400da50 comp rx=0 tx=0).stop 2023-10-05T15:42:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.817+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 shutdown_connections 2023-10-05T15:42:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.817+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7ca00a1530 0x7f7ca00a39f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.817+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb0102a40 0x7f7cb010fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.817+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb0100ea0 0x7f7cb0111120 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.817+0000 7f7cb6fff700 1 --2- 172.21.15.17:0/3462480461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb0102080 0x7f7cb0111660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.817+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 >> 172.21.15.17:0/3462480461 conn(0x7f7cb00fc460 msgr2=0x7f7cb0105650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.818+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 shutdown_connections 2023-10-05T15:42:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:12.819+0000 7f7cb6fff700 1 -- 172.21.15.17:0/3462480461 wait complete. 2023-10-05T15:42:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 215.0 s, 586.6 tps, lat 170.648 ms stddev 46.022 2023-10-05T15:42:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:13 smithi167 ceph-mon[133366]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.8 MiB/s wr, 578 op/s 2023-10-05T15:42:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:13 smithi079 ceph-mon[132936]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.8 MiB/s wr, 578 op/s 2023-10-05T15:42:14.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:13 smithi017 ceph-mon[129107]: pgmap v538: 129 pgs: 129 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.8 MiB/s wr, 578 op/s 2023-10-05T15:42:16.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:15 smithi167 ceph-mon[133366]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 792 op/s 2023-10-05T15:42:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:15 smithi079 ceph-mon[132936]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 792 op/s 2023-10-05T15:42:16.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:15 smithi017 ceph-mon[129107]: pgmap v539: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.3 MiB/s wr, 792 op/s 2023-10-05T15:42:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:17 smithi167 ceph-mon[133366]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 608 op/s 2023-10-05T15:42:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:17 smithi079 ceph-mon[132936]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 608 op/s 2023-10-05T15:42:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 220.0 s, 622.4 tps, lat 160.416 ms stddev 45.849 2023-10-05T15:42:18.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:17 smithi017 ceph-mon[129107]: pgmap v540: 129 pgs: 129 active+clean; 1.5 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 608 op/s 2023-10-05T15:42:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:19 smithi167 ceph-mon[133366]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 688 op/s 2023-10-05T15:42:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:19 smithi079 ceph-mon[132936]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 688 op/s 2023-10-05T15:42:20.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:19 smithi017 ceph-mon[129107]: pgmap v541: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 688 op/s 2023-10-05T15:42:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:21 smithi167 ceph-mon[133366]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.9 MiB/s wr, 730 op/s 2023-10-05T15:42:22.114 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:21 smithi079 ceph-mon[132936]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.9 MiB/s wr, 730 op/s 2023-10-05T15:42:22.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:21 smithi017 ceph-mon[129107]: pgmap v542: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.9 MiB/s wr, 730 op/s 2023-10-05T15:42:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 225.0 s, 645.0 tps, lat 155.389 ms stddev 44.447 2023-10-05T15:42:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:23 smithi167 ceph-mon[133366]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 607 op/s 2023-10-05T15:42:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:23 smithi079 ceph-mon[132936]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 607 op/s 2023-10-05T15:42:24.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:23 smithi017 ceph-mon[129107]: pgmap v543: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 607 op/s 2023-10-05T15:42:25.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:24 smithi017 ceph-mon[129107]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.9 MiB/s wr, 845 op/s 2023-10-05T15:42:25.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:24 smithi167 ceph-mon[133366]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.9 MiB/s wr, 845 op/s 2023-10-05T15:42:25.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:24 smithi079 ceph-mon[132936]: pgmap v544: 129 pgs: 129 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.9 MiB/s wr, 845 op/s 2023-10-05T15:42:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 -- 172.21.15.17:0/2574102371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102090 msgr2=0x7fa968102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/2574102371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102090 0x7fa968102510 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa95000b0a0 tx=0x7fa95000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 -- 172.21.15.17:0/2574102371 shutdown_connections 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/2574102371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102a50 0x7fa968109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/2574102371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa968100eb0 0x7fa9681012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/2574102371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102090 0x7fa968102510 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.088+0000 7fa96e1ff700 1 -- 172.21.15.17:0/2574102371 >> 172.21.15.17:0/2574102371 conn(0x7fa9680fc430 msgr2=0x7fa9680fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.089+0000 7fa96e1ff700 1 -- 172.21.15.17:0/2574102371 shutdown_connections 2023-10-05T15:42:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.089+0000 7fa96e1ff700 1 -- 172.21.15.17:0/2574102371 wait complete. 2023-10-05T15:42:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.090+0000 7fa96e1ff700 1 Processor -- start 2023-10-05T15:42:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 -- start start 2023-10-05T15:42:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa968100eb0 0x7fa96806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 0x7fa96806ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102a50 0x7fa968070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968071460 con 0x7fa968100eb0 2023-10-05T15:42:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680715d0 con 0x7fa968102a50 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.091+0000 7fa96e1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968071790 con 0x7fa968102090 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 0x7fa96806ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 0x7fa96806ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:40606/0 (socket says 172.21.15.17:40606) 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 -- 172.21.15.17:0/4013264737 learned_addr learned my addr 172.21.15.17:0/4013264737 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa9677fe700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa968100eb0 0x7fa96806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa967fff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102a50 0x7fa968070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 -- 172.21.15.17:0/4013264737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102a50 msgr2=0x7fa968070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102a50 0x7fa968070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 -- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa968100eb0 msgr2=0x7fa96806f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa968100eb0 0x7fa96806f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.092+0000 7fa95effd700 1 -- 172.21.15.17:0/4013264737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa950009d00 con 0x7fa968102090 2023-10-05T15:42:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.093+0000 7fa95effd700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 0x7fa96806ff30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa95000b070 tx=0x7fa95000bb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.094+0000 7fa9657fa700 1 -- 172.21.15.17:0/4013264737 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000e040 con 0x7fa968102090 2023-10-05T15:42:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.094+0000 7fa9657fa700 1 -- 172.21.15.17:0/4013264737 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa950003e90 con 0x7fa968102090 2023-10-05T15:42:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.094+0000 7fa9657fa700 1 -- 172.21.15.17:0/4013264737 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500058b0 con 0x7fa968102090 2023-10-05T15:42:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.094+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968071a10 con 0x7fa968102090 2023-10-05T15:42:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.095+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa968072220 con 0x7fa968102090 2023-10-05T15:42:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.101+0000 7fa981b1eb80 1 Processor -- start 2023-10-05T15:42:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.102+0000 7fa9657fa700 1 -- 172.21.15.17:0/4013264737 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa950005040 con 0x7fa968102090 2023-10-05T15:42:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.102+0000 7fa981b1eb80 1 -- start start 2023-10-05T15:42:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f154e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f154f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154f990 0x5654f1556220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f14b6400 con 0x5654f154efd0 2023-10-05T15:42:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f14a7bc0 con 0x5654f154f990 2023-10-05T15:42:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f14a54e0 con 0x5654f154dec0 2023-10-05T15:42:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.103+0000 7fa967fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f154e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f154e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:40620/0 (socket says 172.21.15.17:40620) 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 -- 172.21.15.17:0/3115126056 learned_addr learned my addr 172.21.15.17:0/3115126056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 -- 172.21.15.17:0/3115126056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154f990 msgr2=0x5654f1556220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154f990 0x5654f1556220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 -- 172.21.15.17:0/3115126056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 msgr2=0x5654f154f450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f154f450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.104+0000 7fa967fff700 1 -- 172.21.15.17:0/3115126056 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f12cbd80 con 0x5654f154dec0 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.105+0000 7fa967fff700 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f154e2e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa960009d30 tx=0x7fa960011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8b61bb934f9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.105+0000 7fa9657fa700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9480a1650 0x7fa9480a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.105+0000 7fa9657fa700 1 -- 172.21.15.17:0/4013264737 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa9500d5d40 con 0x7fa968102090 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.105+0000 7fa95dffb700 1 -- 172.21.15.17:0/3115126056 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960019630 con 0x5654f154dec0 2023-10-05T15:42:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.105+0000 7fa95dffb700 1 -- 172.21.15.17:0/3115126056 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa960009e80 con 0x5654f154dec0 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.106+0000 7fa95dffb700 1 -- 172.21.15.17:0/3115126056 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ead0 con 0x5654f154dec0 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.106+0000 7fa9677fe700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9480a1650 0x7fa9480a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3115126056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 msgr2=0x5654f154e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f154e2e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa960009d30 tx=0x7fa960011720 comp rx=0 tx=0).stop 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3115126056 shutdown_connections 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154f990 0x5654f1556220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f154e2e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3115126056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f154f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3115126056 >> 172.21.15.17:0/3115126056 conn(0x5654f14c2200 msgr2=0x5654f1548bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3115126056 shutdown_connections 2023-10-05T15:42:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.107+0000 7fa9677fe700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9480a1650 0x7fa9480a3b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa958005950 tx=0x7fa9580058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.108+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3115126056 wait complete. 2023-10-05T15:42:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.108+0000 7fa981b1eb80 1 -- start start 2023-10-05T15:42:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 Processor -- start 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1557c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f1558170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154f990 0x5654f155f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f14a0dd0 con 0x5654f154efd0 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f143d6b0 con 0x5654f154dec0 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f143d350 con 0x5654f154f990 2023-10-05T15:42:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.109+0000 7fa981b1eb80 10 client.0 _ll_register_callbacks cb 0x5654f129a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.110+0000 7fa9677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1557c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.110+0000 7fa9677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1557c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37190/0 (socket says 172.21.15.17:37190) 2023-10-05T15:42:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.110+0000 7fa9677fe700 1 -- 172.21.15.17:0/3108449600 learned_addr learned my addr 172.21.15.17:0/3108449600 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.110+0000 7fa967fff700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154f990 0x5654f155f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.110+0000 7fa95effd700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f1558170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa967fff700 1 -- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 msgr2=0x5654f1557c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa967fff700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1557c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa967fff700 1 -- 172.21.15.17:0/3108449600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 msgr2=0x5654f1558170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa967fff700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f1558170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa967fff700 1 -- 172.21.15.17:0/3108449600 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9600099e0 con 0x5654f154f990 2023-10-05T15:42:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa967fff700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154f990 0x5654f155f1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa960009d00 tx=0x7fa9600046a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ee1e240644df5e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.111+0000 7fa956ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.112+0000 7fa956ffd700 1 -- 172.21.15.17:0/3108449600 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960027070 con 0x5654f154f990 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.112+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654f1499db0 con 0x5654f154f990 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.112+0000 7fa956ffd700 1 -- 172.21.15.17:0/3108449600 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa960009e80 con 0x5654f154f990 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.112+0000 7fa956ffd700 1 -- 172.21.15.17:0/3108449600 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa960005240 con 0x5654f154f990 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.112+0000 7fa981b1eb80 10 client.26308 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.112+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5654f12b4c00 con 0x5654f154f990 2023-10-05T15:42:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa956ffd700 1 -- 172.21.15.17:0/3108449600 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5654f1499db0 con 0x5654f154f990 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa956ffd700 1 -- 172.21.15.17:0/3108449600 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa96002a020 con 0x5654f154f990 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa981b1eb80 10 client.26308 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa981b1eb80 10 client.26308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa981b1eb80 20 client.26308 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15638a0 0x5654f1565cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa981b1eb80 4 client.26308 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.113+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654f1499ad0 con 0x5654f15638a0 2023-10-05T15:42:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.114+0000 7fa9677fe700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15638a0 0x5654f1565cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.115+0000 7fa9677fe700 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15638a0 0x5654f1565cc0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01d38fd1c9f5618 server_cookie=efc8e6869e0d3e79 in_seq=0 out_seq=0 2023-10-05T15:42:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.116+0000 7fa956ffd700 10 client.26308 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.116+0000 7fa956ffd700 1 -- 172.21.15.17:0/3108449600 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5654f1499ad0 con 0x5654f15638a0 2023-10-05T15:42:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa956ffd700 10 client.26308 handle_command_reply: tid=0 2023-10-05T15:42:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 client.26308 shutdown 2023-10-05T15:42:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154f990 msgr2=0x5654f155f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154f990 0x5654f155f1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa960009d00 tx=0x7fa9600046a0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 shutdown_connections 2023-10-05T15:42:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15638a0 0x5654f1565cc0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154f990 0x5654f155f1b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1557c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/3108449600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154efd0 0x5654f1558170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa956ffd700 0 client.26308 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.117+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 >> 172.21.15.17:0/3108449600 conn(0x5654f14c2200 msgr2=0x5654f1548250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.118+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 shutdown_connections 2023-10-05T15:42:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.118+0000 7fa981b1eb80 1 -- 172.21.15.17:0/3108449600 wait complete. 2023-10-05T15:42:26.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.119+0000 7fa981b1eb80 20 client.26308 trim_cache size 0 max 16384 2023-10-05T15:42:26.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.149+0000 7fa981b1eb80 1 Processor -- start 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 -- start start 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1555e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154efd0 0x5654f155f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f1552980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f13218c0 con 0x5654f154f990 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f1549a00 con 0x5654f154dec0 2023-10-05T15:42:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.150+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f15570e0 con 0x5654f154efd0 2023-10-05T15:42:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1555e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1555e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37194/0 (socket says 172.21.15.17:37194) 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 -- 172.21.15.17:0/4249803428 learned_addr learned my addr 172.21.15.17:0/4249803428 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa967fff700 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f1552980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa95effd700 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154efd0 0x5654f155f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 -- 172.21.15.17:0/4249803428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154efd0 msgr2=0x5654f155f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154efd0 0x5654f155f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 -- 172.21.15.17:0/4249803428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 msgr2=0x5654f1552980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f1552980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.152+0000 7fa9677fe700 1 -- 172.21.15.17:0/4249803428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654f12f21f0 con 0x5654f154dec0 2023-10-05T15:42:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.153+0000 7fa9677fe700 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1555e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x5654f15665d0 tx=0x7fa958015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fdc716ae401f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.153+0000 7fa95e7fc700 1 -- 172.21.15.17:0/4249803428 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958027520 con 0x5654f154dec0 2023-10-05T15:42:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.154+0000 7fa95e7fc700 1 -- 172.21.15.17:0/4249803428 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa958027880 con 0x5654f154dec0 2023-10-05T15:42:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.154+0000 7fa95e7fc700 1 -- 172.21.15.17:0/4249803428 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95801f690 con 0x5654f154dec0 2023-10-05T15:42:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 -- 172.21.15.17:0/4249803428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 msgr2=0x5654f1555e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1555e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x5654f15665d0 tx=0x7fa958015000 comp rx=0 tx=0).stop 2023-10-05T15:42:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 -- 172.21.15.17:0/4249803428 shutdown_connections 2023-10-05T15:42:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f1552980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154dec0 0x5654f1555e70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/4249803428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154efd0 0x5654f155f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 -- 172.21.15.17:0/4249803428 >> 172.21.15.17:0/4249803428 conn(0x5654f14c2200 msgr2=0x5654f15568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.155+0000 7fa981b1eb80 1 -- 172.21.15.17:0/4249803428 shutdown_connections 2023-10-05T15:42:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.156+0000 7fa981b1eb80 1 -- 172.21.15.17:0/4249803428 wait complete. 2023-10-05T15:42:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.156+0000 7fa981b1eb80 1 -- start start 2023-10-05T15:42:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 Processor -- start 2023-10-05T15:42:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f155cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 0x5654f155d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f155e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f155e7c0 con 0x5654f154f990 2023-10-05T15:42:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f155e930 con 0x5654f154efd0 2023-10-05T15:42:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654f155eaf0 con 0x5654f154dec0 2023-10-05T15:42:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.157+0000 7fa981b1eb80 10 client.0 _ll_register_callbacks cb 0x7fa960009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.158+0000 7fa95effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 0x5654f155d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.158+0000 7fa95effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 0x5654f155d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37196/0 (socket says 172.21.15.17:37196) 2023-10-05T15:42:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.158+0000 7fa95effd700 1 -- 172.21.15.17:0/2079378467 learned_addr learned my addr 172.21.15.17:0/2079378467 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa967fff700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f155e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa95effd700 1 -- 172.21.15.17:0/2079378467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 msgr2=0x5654f155cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa9677fe700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f155cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa95effd700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f155cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa95effd700 1 -- 172.21.15.17:0/2079378467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 msgr2=0x5654f155e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa95effd700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f155e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa95effd700 1 -- 172.21.15.17:0/2079378467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95800fe90 con 0x5654f154efd0 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa967fff700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f155e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.159+0000 7fa9677fe700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f155cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.160+0000 7fa95effd700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 0x5654f155d270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa9500d3440 tx=0x7fa950006230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c0826e7c64662a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.160+0000 7fa956ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.160+0000 7fa956ffd700 1 -- 172.21.15.17:0/2079378467 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500a2650 con 0x5654f154efd0 2023-10-05T15:42:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.160+0000 7fa956ffd700 1 -- 172.21.15.17:0/2079378467 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa9500a33f0 con 0x5654f154efd0 2023-10-05T15:42:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.160+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654f1540d50 con 0x5654f154efd0 2023-10-05T15:42:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.161+0000 7fa956ffd700 1 -- 172.21.15.17:0/2079378467 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9500a2cf0 con 0x5654f154efd0 2023-10-05T15:42:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.161+0000 7fa981b1eb80 10 client.26354 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.161+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5654f12ca250 con 0x5654f154efd0 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa956ffd700 1 -- 172.21.15.17:0/2079378467 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa950020020 con 0x5654f154efd0 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa956ffd700 1 -- 172.21.15.17:0/2079378467 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa950019020 con 0x5654f154efd0 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa981b1eb80 10 client.26354 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa981b1eb80 10 client.26354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa981b1eb80 20 client.26354 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15b7fc0 0x5654f15ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa981b1eb80 4 client.26354 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:42:26.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.162+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5654f12ecf10 con 0x5654f15b7fc0 2023-10-05T15:42:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.163+0000 7fa9677fe700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15b7fc0 0x5654f15ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:26.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.164+0000 7fa9677fe700 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15b7fc0 0x5654f15ba3e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ef62273871264 server_cookie=7f743e98d3a42e35 in_seq=0 out_seq=0 2023-10-05T15:42:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.164+0000 7fa956ffd700 10 client.26354 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:26.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.182+0000 7fa956ffd700 1 -- 172.21.15.17:0/2079378467 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5654f12ecf10 con 0x5654f15b7fc0 2023-10-05T15:42:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.182+0000 7fa956ffd700 10 client.26354 handle_command_reply: tid=0 2023-10-05T15:42:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.182+0000 7fa981b1eb80 1 client.26354 shutdown 2023-10-05T15:42:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.183+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 msgr2=0x5654f155d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.183+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 0x5654f155d270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa9500d3440 tx=0x7fa950006230 comp rx=0 tx=0).stop 2023-10-05T15:42:26.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 shutdown_connections 2023-10-05T15:42:26.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5654f15b7fc0 0x5654f15ba3e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5654f154f990 0x5654f155e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5654f154dec0 0x5654f155cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 --2- 172.21.15.17:0/2079378467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5654f154efd0 0x5654f155d270 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa956ffd700 0 client.26354 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:26.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 >> 172.21.15.17:0/2079378467 conn(0x5654f14c2200 msgr2=0x5654f1555e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:26.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 shutdown_connections 2023-10-05T15:42:26.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.184+0000 7fa981b1eb80 1 -- 172.21.15.17:0/2079378467 wait complete. 2023-10-05T15:42:26.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.185+0000 7fa981b1eb80 20 client.26354 trim_cache size 0 max 16384 2023-10-05T15:42:26.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:42:26.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:42:26.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:42:26.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9480a1650 msgr2=0x7fa9480a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9480a1650 0x7fa9480a3b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa958005950 tx=0x7fa9580058e0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 msgr2=0x7fa96806ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 0x7fa96806ff30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa95000b070 tx=0x7fa95000bb30 comp rx=0 tx=0).stop 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 shutdown_connections 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa9480a1650 0x7fa9480a3b10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa968102a50 0x7fa968070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa968100eb0 0x7fa96806f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 --2- 172.21.15.17:0/4013264737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa968102090 0x7fa96806ff30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.186+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 >> 172.21.15.17:0/4013264737 conn(0x7fa9680fc430 msgr2=0x7fa9680fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:26.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.187+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 shutdown_connections 2023-10-05T15:42:26.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:26.188+0000 7fa96e1ff700 1 -- 172.21.15.17:0/4013264737 wait complete. 2023-10-05T15:42:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:27 smithi167 ceph-mon[133366]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.2 MiB/s wr, 617 op/s 2023-10-05T15:42:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:27 smithi079 ceph-mon[132936]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.2 MiB/s wr, 617 op/s 2023-10-05T15:42:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 230.0 s, 531.8 tps, lat 187.849 ms stddev 53.458 2023-10-05T15:42:28.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:27 smithi017 ceph-mon[129107]: pgmap v545: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.2 MiB/s wr, 617 op/s 2023-10-05T15:42:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:29 smithi167 ceph-mon[133366]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.4 MiB/s wr, 721 op/s 2023-10-05T15:42:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:29 smithi079 ceph-mon[132936]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.4 MiB/s wr, 721 op/s 2023-10-05T15:42:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:29 smithi017 ceph-mon[129107]: pgmap v546: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.4 MiB/s wr, 721 op/s 2023-10-05T15:42:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:31 smithi167 ceph-mon[133366]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.7 MiB/s wr, 725 op/s 2023-10-05T15:42:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:31 smithi079 ceph-mon[132936]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.7 MiB/s wr, 725 op/s 2023-10-05T15:42:32.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:31 smithi017 ceph-mon[129107]: pgmap v547: 129 pgs: 129 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.7 MiB/s wr, 725 op/s 2023-10-05T15:42:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 235.0 s, 571.0 tps, lat 174.432 ms stddev 98.883 2023-10-05T15:42:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:33 smithi167 ceph-mon[133366]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.7 MiB/s wr, 633 op/s 2023-10-05T15:42:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:33 smithi079 ceph-mon[132936]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.7 MiB/s wr, 633 op/s 2023-10-05T15:42:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:33 smithi017 ceph-mon[129107]: pgmap v548: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.7 MiB/s wr, 633 op/s 2023-10-05T15:42:35.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:42:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.428+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3762752272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c78107eb0 msgr2=0x7f6c7810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.428+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3762752272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c78107eb0 0x7f6c7810a2e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c6801a9a0 tx=0x7f6c6801acb0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3762752272 shutdown_connections 2023-10-05T15:42:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3762752272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c7810d1f0 0x7f6c7810d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3762752272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c78107eb0 0x7f6c7810a2e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3762752272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c7810a820 0x7f6c7810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3762752272 >> 172.21.15.17:0/3762752272 conn(0x7f6c7806dc90 msgr2=0x7f6c780700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3762752272 shutdown_connections 2023-10-05T15:42:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.430+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3762752272 wait complete. 2023-10-05T15:42:35.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.432+0000 7f6c7ddff700 1 Processor -- start 2023-10-05T15:42:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.432+0000 7f6c7ddff700 1 -- start start 2023-10-05T15:42:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.433+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 0x7f6c7819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.433+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c7810a820 0x7f6c7819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.433+0000 7f6c7ddff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c7810d1f0 0x7f6c781a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.433+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781a4d30 con 0x7f6c7810d1f0 2023-10-05T15:42:35.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.433+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781a4e70 con 0x7f6c78107eb0 2023-10-05T15:42:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.433+0000 7f6c7ddff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781a5000 con 0x7f6c7810a820 2023-10-05T15:42:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 0x7f6c7819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 0x7f6c7819d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50280/0 (socket says 172.21.15.17:50280) 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c777fe700 1 -- 172.21.15.17:0/3345430216 learned_addr learned my addr 172.21.15.17:0/3345430216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c7810a820 0x7f6c7819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c77fff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c7810d1f0 0x7f6c781a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c76ffd700 1 -- 172.21.15.17:0/3345430216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 msgr2=0x7f6c7819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 0x7f6c7819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c76ffd700 1 -- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c7810d1f0 msgr2=0x7f6c781a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c7810d1f0 0x7f6c781a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.434+0000 7f6c76ffd700 1 -- 172.21.15.17:0/3345430216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6801a600 con 0x7f6c7810a820 2023-10-05T15:42:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.435+0000 7f6c777fe700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 0x7f6c7819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:42:35.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.435+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c7810a820 0x7f6c7819d6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00d740 tx=0x7f6c6c00da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:35.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.435+0000 7f6c74ff9700 1 -- 172.21.15.17:0/3345430216 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c004220 con 0x7f6c7810a820 2023-10-05T15:42:35.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.435+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c781a52e0 con 0x7f6c7810a820 2023-10-05T15:42:35.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.436+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c781a5840 con 0x7f6c7810a820 2023-10-05T15:42:35.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.436+0000 7f6c74ff9700 1 -- 172.21.15.17:0/3345430216 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c004380 con 0x7f6c7810a820 2023-10-05T15:42:35.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.436+0000 7f6c74ff9700 1 -- 172.21.15.17:0/3345430216 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c003bc0 con 0x7f6c7810a820 2023-10-05T15:42:35.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.442+0000 7f6c9172cb80 1 Processor -- start 2023-10-05T15:42:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.443+0000 7f6c9172cb80 1 -- start start 2023-10-05T15:42:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.443+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a90680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a91480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012a91ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610129f8460 con 0x561012a90bc0 2023-10-05T15:42:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610129e9c20 con 0x561012a91a60 2023-10-05T15:42:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610129e7540 con 0x561012a90260 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c74ff9700 1 -- 172.21.15.17:0/3345430216 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6c6c003d20 con 0x7f6c7810a820 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a90680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a90680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:37062/0 (socket says 172.21.15.17:37062) 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.444+0000 7f6c77fff700 1 -- 172.21.15.17:0/2130910651 learned_addr learned my addr 172.21.15.17:0/2130910651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.445+0000 7f6c77fff700 1 -- 172.21.15.17:0/2130910651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 msgr2=0x561012a91ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.445+0000 7f6c77fff700 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012a91ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.445+0000 7f6c77fff700 1 -- 172.21.15.17:0/2130910651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 msgr2=0x561012a91480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.445+0000 7f6c77fff700 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a91480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.445+0000 7f6c77fff700 1 -- 172.21.15.17:0/2130910651 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56101280dde0 con 0x561012a90260 2023-10-05T15:42:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.445+0000 7f6c77fff700 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a90680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c70003f90 tx=0x7f6c70009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8288018ed41eb020 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.446+0000 7f6c5dffb700 1 -- 172.21.15.17:0/2130910651 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70009e60 con 0x561012a90260 2023-10-05T15:42:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.446+0000 7f6c5dffb700 1 -- 172.21.15.17:0/2130910651 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c7000f040 con 0x561012a90260 2023-10-05T15:42:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.446+0000 7f6c5dffb700 1 -- 172.21.15.17:0/2130910651 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70015770 con 0x561012a90260 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.448+0000 7f6c9172cb80 1 -- 172.21.15.17:0/2130910651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 msgr2=0x561012a90680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.448+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a90680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c70003f90 tx=0x7f6c70009c20 comp rx=0 tx=0).stop 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 -- 172.21.15.17:0/2130910651 shutdown_connections 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012a91ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a90680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/2130910651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a91480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 -- 172.21.15.17:0/2130910651 >> 172.21.15.17:0/2130910651 conn(0x561012a04260 msgr2=0x561012a8b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 -- 172.21.15.17:0/2130910651 shutdown_connections 2023-10-05T15:42:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.449+0000 7f6c9172cb80 1 -- 172.21.15.17:0/2130910651 wait complete. 2023-10-05T15:42:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.450+0000 7f6c74ff9700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6c600a1490 0x7f6c600a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.450+0000 7f6c9172cb80 1 -- start start 2023-10-05T15:42:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.450+0000 7f6c74ff9700 1 -- 172.21.15.17:0/3345430216 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6c6c0ccc70 con 0x7f6c7810a820 2023-10-05T15:42:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.451+0000 7f6c9172cb80 1 Processor -- start 2023-10-05T15:42:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.451+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a9a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.451+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a9a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.451+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.452+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610129e2e30 con 0x561012a90bc0 2023-10-05T15:42:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.452+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101297f710 con 0x561012a91a60 2023-10-05T15:42:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.452+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56101297f3b0 con 0x561012a90260 2023-10-05T15:42:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.452+0000 7f6c9172cb80 10 client.0 _ll_register_callbacks cb 0x5610127dc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.452+0000 7f6c77fff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6c600a1490 0x7f6c600a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.453+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.453+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50292/0 (socket says 172.21.15.17:50292) 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.453+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a9a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.453+0000 7f6c77fff700 1 -- 172.21.15.17:0/1516175982 learned_addr learned my addr 172.21.15.17:0/1516175982 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.453+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a9a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c777fe700 1 -- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 msgr2=0x561012aa1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c777fe700 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c777fe700 1 -- 172.21.15.17:0/1516175982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 msgr2=0x561012a9a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c777fe700 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a9a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c777fe700 1 -- 172.21.15.17:0/1516175982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c70003bf0 con 0x561012a90260 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c77fff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6c600a1490 0x7f6c600a3950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009690 tx=0x7f6c70007500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.454+0000 7f6c777fe700 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a9a0e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c6801a8f0 tx=0x7f6c6801cfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d2ed259c52ef6bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.455+0000 7f6c56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.455+0000 7f6c56ffd700 1 -- 172.21.15.17:0/1516175982 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6802d050 con 0x561012a90260 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.455+0000 7f6c56ffd700 1 -- 172.21.15.17:0/1516175982 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6c68005570 con 0x561012a90260 2023-10-05T15:42:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.455+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561012a82f10 con 0x561012a90260 2023-10-05T15:42:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.456+0000 7f6c56ffd700 1 -- 172.21.15.17:0/1516175982 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c680037f0 con 0x561012a90260 2023-10-05T15:42:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.456+0000 7f6c9172cb80 10 client.26323 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.456+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5610127f6c60 con 0x561012a90260 2023-10-05T15:42:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.456+0000 7f6c56ffd700 1 -- 172.21.15.17:0/1516175982 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561012a82f10 con 0x561012a90260 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c56ffd700 1 -- 172.21.15.17:0/1516175982 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6c68032770 con 0x561012a90260 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c9172cb80 10 client.26323 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c9172cb80 10 client.26323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c9172cb80 20 client.26323 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012aa5e20 0x561012aa8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c9172cb80 4 client.26323 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610129dbe10 con 0x561012aa5e20 2023-10-05T15:42:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.457+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012aa5e20 0x561012aa8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.458+0000 7f6c76ffd700 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012aa5e20 0x561012aa8240 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ab6628e0d288ab1 server_cookie=d5101f0bd68f8882 in_seq=0 out_seq=0 2023-10-05T15:42:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.458+0000 7f6c56ffd700 10 client.26323 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.459+0000 7f6c56ffd700 1 -- 172.21.15.17:0/1516175982 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5610129dbe10 con 0x561012aa5e20 2023-10-05T15:42:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.459+0000 7f6c56ffd700 10 client.26323 handle_command_reply: tid=0 2023-10-05T15:42:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.459+0000 7f6c9172cb80 1 client.26323 shutdown 2023-10-05T15:42:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.459+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 msgr2=0x561012a9a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.459+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a9a0e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c6801a8f0 tx=0x7f6c6801cfd0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 shutdown_connections 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012aa5e20 0x561012aa8240 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90260 0x561012a9a0e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/1516175982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012a9a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 >> 172.21.15.17:0/1516175982 conn(0x561012a04260 msgr2=0x561012a8af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.460+0000 7f6c56ffd700 0 client.26323 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.461+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 shutdown_connections 2023-10-05T15:42:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.461+0000 7f6c9172cb80 1 -- 172.21.15.17:0/1516175982 wait complete. 2023-10-05T15:42:35.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.462+0000 7f6c9172cb80 20 client.26323 trim_cache size 0 max 16384 2023-10-05T15:42:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.498+0000 7f6c9172cb80 1 Processor -- start 2023-10-05T15:42:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.498+0000 7f6c9172cb80 1 -- start start 2023-10-05T15:42:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 0x561012aa1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012aa1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a91a60 0x561012a98d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561012863920 con 0x561012a90bc0 2023-10-05T15:42:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561012a9b130 con 0x561012a90260 2023-10-05T15:42:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561012a8fe90 con 0x561012a91a60 2023-10-05T15:42:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 0x561012aa1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 0x561012aa1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50308/0 (socket says 172.21.15.17:50308) 2023-10-05T15:42:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.499+0000 7f6c777fe700 1 -- 172.21.15.17:0/4020669757 learned_addr learned my addr 172.21.15.17:0/4020669757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.500+0000 7f6c777fe700 1 -- 172.21.15.17:0/4020669757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a91a60 msgr2=0x561012a98d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.500+0000 7f6c777fe700 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a91a60 0x561012a98d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.500+0000 7f6c777fe700 1 -- 172.21.15.17:0/4020669757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 msgr2=0x561012aa1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.500+0000 7f6c777fe700 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012aa1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.501+0000 7f6c777fe700 1 -- 172.21.15.17:0/4020669757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561012834250 con 0x561012a90260 2023-10-05T15:42:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.501+0000 7f6c777fe700 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 0x561012aa1f50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c680052e0 tx=0x7f6c68032cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4cf5827be0f6ec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.503+0000 7f6c5e7fc700 1 -- 172.21.15.17:0/4020669757 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6802d040 con 0x561012a90260 2023-10-05T15:42:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.503+0000 7f6c5e7fc700 1 -- 172.21.15.17:0/4020669757 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6802e040 con 0x561012a90260 2023-10-05T15:42:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.503+0000 7f6c5e7fc700 1 -- 172.21.15.17:0/4020669757 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68003d40 con 0x561012a90260 2023-10-05T15:42:35.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.504+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4020669757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 msgr2=0x561012aa1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.504+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 0x561012aa1f50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c680052e0 tx=0x7f6c68032cc0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4020669757 shutdown_connections 2023-10-05T15:42:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a91a60 0x561012a98d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a90260 0x561012aa1f50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4020669757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90bc0 0x561012aa1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4020669757 >> 172.21.15.17:0/4020669757 conn(0x561012a04260 msgr2=0x561012aacba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4020669757 shutdown_connections 2023-10-05T15:42:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.505+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4020669757 wait complete. 2023-10-05T15:42:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.506+0000 7f6c9172cb80 1 -- start start 2023-10-05T15:42:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.506+0000 7f6c9172cb80 1 Processor -- start 2023-10-05T15:42:35.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90260 0x561012a9efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90bc0 0x561012a9f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561012aa0a40 con 0x561012a90260 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561012aa0bb0 con 0x561012a91a60 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561012aa0d70 con 0x561012a90bc0 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.507+0000 7f6c9172cb80 10 client.0 _ll_register_callbacks cb 0x7f6c68005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c76ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90bc0 0x561012a9f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50312/0 (socket says 172.21.15.17:50312) 2023-10-05T15:42:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 -- 172.21.15.17:0/4103830488 learned_addr learned my addr 172.21.15.17:0/4103830488 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 -- 172.21.15.17:0/4103830488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90bc0 msgr2=0x561012a9f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90bc0 0x561012a9f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 -- 172.21.15.17:0/4103830488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90260 msgr2=0x561012a9efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90260 0x561012a9efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.508+0000 7f6c77fff700 1 -- 172.21.15.17:0/4103830488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610127f6c60 con 0x561012a91a60 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.509+0000 7f6c77fff700 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa0500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c70003f90 tx=0x7f6c70009130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4feaadb830e6c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.509+0000 7f6c56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.509+0000 7f6c56ffd700 1 -- 172.21.15.17:0/4103830488 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007cf0 con 0x561012a91a60 2023-10-05T15:42:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.509+0000 7f6c56ffd700 1 -- 172.21.15.17:0/4103830488 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6c7002c460 con 0x561012a91a60 2023-10-05T15:42:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.509+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c7000f040 con 0x561012a91a60 2023-10-05T15:42:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.510+0000 7f6c56ffd700 1 -- 172.21.15.17:0/4103830488 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c7002c620 con 0x561012a91a60 2023-10-05T15:42:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.510+0000 7f6c9172cb80 10 client.26369 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.510+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56101280c2b0 con 0x561012a91a60 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.510+0000 7f6c56ffd700 1 -- 172.21.15.17:0/4103830488 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c7000f040 con 0x561012a91a60 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.510+0000 7f6c56ffd700 1 -- 172.21.15.17:0/4103830488 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6c70037810 con 0x561012a91a60 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c9172cb80 10 client.26369 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c9172cb80 10 client.26369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c9172cb80 20 client.26369 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012afa5a0 0x561012afca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c9172cb80 4 client.26369 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5610129dbb30 con 0x561012afa5a0 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.511+0000 7f6c777fe700 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012afa5a0 0x561012afca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.512+0000 7f6c777fe700 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012afa5a0 0x561012afca40 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=180ed1b209970dc8 server_cookie=a5ae95753af4c9f5 in_seq=0 out_seq=0 2023-10-05T15:42:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.512+0000 7f6c56ffd700 10 client.26369 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.512+0000 7f6c56ffd700 1 -- 172.21.15.17:0/4103830488 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5610129dbb30 con 0x561012afa5a0 2023-10-05T15:42:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.512+0000 7f6c56ffd700 10 client.26369 handle_command_reply: tid=0 2023-10-05T15:42:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.512+0000 7f6c9172cb80 1 client.26369 shutdown 2023-10-05T15:42:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.513+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 msgr2=0x561012aa0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.513+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa0500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c70003f90 tx=0x7f6c70009130 comp rx=0 tx=0).stop 2023-10-05T15:42:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 shutdown_connections 2023-10-05T15:42:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561012afa5a0 0x561012afca40 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561012a91a60 0x561012aa0500 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561012a90260 0x561012a9efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 --2- 172.21.15.17:0/4103830488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561012a90bc0 0x561012a9f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c56ffd700 0 client.26369 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 >> 172.21.15.17:0/4103830488 conn(0x561012a04260 msgr2=0x561012aa1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.514+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 shutdown_connections 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.515+0000 7f6c9172cb80 1 -- 172.21.15.17:0/4103830488 wait complete. 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.515+0000 7f6c9172cb80 20 client.26369 trim_cache size 0 max 16384 2023-10-05T15:42:35.517 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:42:35.518 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6c600a1490 msgr2=0x7f6c600a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6c600a1490 0x7f6c600a3950 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009690 tx=0x7f6c70007500 comp rx=0 tx=0).stop 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c7810a820 msgr2=0x7f6c7819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c7810a820 0x7f6c7819d6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00d740 tx=0x7f6c6c00da50 comp rx=0 tx=0).stop 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 shutdown_connections 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f6c600a1490 0x7f6c600a3950 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c7810d1f0 0x7f6c781a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c78107eb0 0x7f6c7819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 --2- 172.21.15.17:0/3345430216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c7810a820 0x7f6c7819d6f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 >> 172.21.15.17:0/3345430216 conn(0x7f6c7806dc90 msgr2=0x7f6c78070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 shutdown_connections 2023-10-05T15:42:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:42:35.516+0000 7f6c7ddff700 1 -- 172.21.15.17:0/3345430216 wait complete. 2023-10-05T15:42:35.547 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:42:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:35 smithi167 ceph-mon[133366]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.1 MiB/s wr, 829 op/s 2023-10-05T15:42:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:35 smithi079 ceph-mon[132936]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.1 MiB/s wr, 829 op/s 2023-10-05T15:42:36.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:35 smithi017 ceph-mon[129107]: pgmap v549: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.1 MiB/s wr, 829 op/s 2023-10-05T15:42:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:37 smithi167 ceph-mon[133366]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.4 MiB/s wr, 605 op/s 2023-10-05T15:42:38.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:37 smithi079 ceph-mon[132936]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.4 MiB/s wr, 605 op/s 2023-10-05T15:42:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 240.0 s, 641.2 tps, lat 156.902 ms stddev 47.680 2023-10-05T15:42:38.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:37 smithi017 ceph-mon[129107]: pgmap v550: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.4 MiB/s wr, 605 op/s 2023-10-05T15:42:39.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:38 smithi079 ceph-mon[132936]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.0 MiB/s wr, 672 op/s 2023-10-05T15:42:39.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:38 smithi017 ceph-mon[129107]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.0 MiB/s wr, 672 op/s 2023-10-05T15:42:39.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:38 smithi167 ceph-mon[133366]: pgmap v551: 129 pgs: 129 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.0 MiB/s wr, 672 op/s 2023-10-05T15:42:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 -- 172.21.15.17:0/2796201420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80fed90 msgr2=0x7f0ea80ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/2796201420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80fed90 0x7f0ea80ff1b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009990 tx=0x7f0e90009ca0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 -- 172.21.15.17:0/2796201420 shutdown_connections 2023-10-05T15:42:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/2796201420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea8100880 0x7f0ea8105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/2796201420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80fed90 0x7f0ea80ff1b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/2796201420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80ffec0 0x7f0ea8100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 -- 172.21.15.17:0/2796201420 >> 172.21.15.17:0/2796201420 conn(0x7f0ea80fa690 msgr2=0x7f0ea80fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 -- 172.21.15.17:0/2796201420 shutdown_connections 2023-10-05T15:42:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.444+0000 7f0eae7ff700 1 -- 172.21.15.17:0/2796201420 wait complete. 2023-10-05T15:42:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.446+0000 7f0eae7ff700 1 Processor -- start 2023-10-05T15:42:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.446+0000 7f0eae7ff700 1 -- start start 2023-10-05T15:42:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.446+0000 7f0eae7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 0x7f0ea806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0eae7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80ffec0 0x7f0ea806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0eae7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea8100880 0x7f0ea8070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0eae7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8071310 con 0x7f0ea8100880 2023-10-05T15:42:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0eae7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8071480 con 0x7f0ea80ffec0 2023-10-05T15:42:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0eae7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8071640 con 0x7f0ea80fed90 2023-10-05T15:42:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 0x7f0ea806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80ffec0 0x7f0ea806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80ffec0 0x7f0ea806fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50340/0 (socket says 172.21.15.17:50340) 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 0x7f0ea806f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:37128/0 (socket says 172.21.15.17:37128) 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0e9ffff700 1 -- 172.21.15.17:0/650333039 learned_addr learned my addr 172.21.15.17:0/650333039 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 -- 172.21.15.17:0/650333039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80ffec0 msgr2=0x7f0ea806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80ffec0 0x7f0ea806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 -- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea8100880 msgr2=0x7f0ea8070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea8100880 0x7f0ea8070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.447+0000 7f0ea7fff700 1 -- 172.21.15.17:0/650333039 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009520 con 0x7f0ea80fed90 2023-10-05T15:42:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.448+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 0x7f0ea806f8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0e900098e0 tx=0x7f0e90005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.448+0000 7f0ea5ffb700 1 -- 172.21.15.17:0/650333039 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9001d070 con 0x7f0ea80fed90 2023-10-05T15:42:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.449+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e900095f0 con 0x7f0ea80fed90 2023-10-05T15:42:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.449+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea8071ef0 con 0x7f0ea80fed90 2023-10-05T15:42:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.450+0000 7f0ea5ffb700 1 -- 172.21.15.17:0/650333039 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e9000be30 con 0x7f0ea80fed90 2023-10-05T15:42:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.450+0000 7f0ea5ffb700 1 -- 172.21.15.17:0/650333039 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90022da0 con 0x7f0ea80fed90 2023-10-05T15:42:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.455+0000 7f0ea5ffb700 1 -- 172.21.15.17:0/650333039 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0e9000b9a0 con 0x7f0ea80fed90 2023-10-05T15:42:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.457+0000 7f0ec21c5b80 1 Processor -- start 2023-10-05T15:42:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.457+0000 7f0ec21c5b80 1 -- start start 2023-10-05T15:42:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8891c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e88923220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e88883400 con 0x563e8891aec0 2023-10-05T15:42:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e88874bc0 con 0x563e8891bfd0 2023-10-05T15:42:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e888724e0 con 0x563e8891c990 2023-10-05T15:42:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8891c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8891c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50352/0 (socket says 172.21.15.17:50352) 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0ea7fff700 1 -- 172.21.15.17:0/4029947976 learned_addr learned my addr 172.21.15.17:0/4029947976 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.458+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e88923220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0ea7fff700 1 -- 172.21.15.17:0/4029947976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 msgr2=0x563e88923220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e88923220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0ea7fff700 1 -- 172.21.15.17:0/4029947976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 msgr2=0x563e8891b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0ea7fff700 1 -- 172.21.15.17:0/4029947976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e88698d80 con 0x563e8891bfd0 2023-10-05T15:42:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e88923220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:42:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.459+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8891c450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e900d63d0 tx=0x7f0e900d66e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a86950d896b6a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.460+0000 7f0ea5ffb700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e940a1500 0x7f0e940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.460+0000 7f0e9e7fc700 1 -- 172.21.15.17:0/4029947976 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900d0310 con 0x563e8891bfd0 2023-10-05T15:42:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.460+0000 7f0e9e7fc700 1 -- 172.21.15.17:0/4029947976 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e900976f0 con 0x563e8891bfd0 2023-10-05T15:42:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.460+0000 7f0e9e7fc700 1 -- 172.21.15.17:0/4029947976 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9009b3b0 con 0x563e8891bfd0 2023-10-05T15:42:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.460+0000 7f0ea5ffb700 1 -- 172.21.15.17:0/650333039 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0e900ce3a0 con 0x7f0ea80fed90 2023-10-05T15:42:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/4029947976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 msgr2=0x563e8891c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8891c450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e900d63d0 tx=0x7f0e900d66e0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/4029947976 shutdown_connections 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e88923220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/4029947976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8891c450 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/4029947976 >> 172.21.15.17:0/4029947976 conn(0x563e8888f200 msgr2=0x563e88915bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.461+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/4029947976 shutdown_connections 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.462+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e940a1500 0x7f0e940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.462+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/4029947976 wait complete. 2023-10-05T15:42:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.463+0000 7f0ec21c5b80 1 -- start start 2023-10-05T15:42:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.463+0000 7f0ec21c5b80 1 Processor -- start 2023-10-05T15:42:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.463+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e940a1500 0x7f0e940a39c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x563e8891ac60 tx=0x7f0ea0009750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891aec0 0x563e88924840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e88924d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891c990 0x563e8892bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e8886ddd0 con 0x563e8891bfd0 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e8880a6b0 con 0x563e8891c990 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e8880a350 con 0x563e8891aec0 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ec21c5b80 10 client.0 _ll_register_callbacks cb 0x563e886677a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e88924d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891aec0 0x563e88924840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e88924d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46238/0 (socket says 172.21.15.17:46238) 2023-10-05T15:42:39.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0e9ffff700 1 -- 172.21.15.17:0/598393774 learned_addr learned my addr 172.21.15.17:0/598393774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.464+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891c990 0x563e8892bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.465+0000 7f0ea7fff700 1 -- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891c990 msgr2=0x563e8892bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.465+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891c990 0x563e8892bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.465+0000 7f0ea7fff700 1 -- 172.21.15.17:0/598393774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 msgr2=0x563e88924d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.465+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e88924d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.465+0000 7f0ea7fff700 1 -- 172.21.15.17:0/598393774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea8071ef0 con 0x563e8891aec0 2023-10-05T15:42:39.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.466+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891aec0 0x563e88924840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005910 tx=0x7f0e90009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f72a3a7c0f874a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.466+0000 7f0e877fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:42:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.466+0000 7f0e877fe700 1 -- 172.21.15.17:0/598393774 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900d1950 con 0x563e8891aec0 2023-10-05T15:42:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.466+0000 7f0e877fe700 1 -- 172.21.15.17:0/598393774 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0e9000bc50 con 0x563e8891aec0 2023-10-05T15:42:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.466+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e8890dd50 con 0x563e8891aec0 2023-10-05T15:42:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.467+0000 7f0e877fe700 1 -- 172.21.15.17:0/598393774 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e9009b180 con 0x563e8891aec0 2023-10-05T15:42:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.467+0000 7f0ec21c5b80 10 client.26335 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.467+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x563e88681c00 con 0x563e8891aec0 2023-10-05T15:42:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.467+0000 7f0e877fe700 1 -- 172.21.15.17:0/598393774 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563e8890dd50 con 0x563e8891aec0 2023-10-05T15:42:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0e877fe700 1 -- 172.21.15.17:0/598393774 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0e90022570 con 0x563e8891aec0 2023-10-05T15:42:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0ec21c5b80 10 client.26335 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0ec21c5b80 10 client.26335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0ec21c5b80 20 client.26335 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889301b0 0x563e889325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0ec21c5b80 4 client.26335 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:42:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.468+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e88866db0 con 0x563e889301b0 2023-10-05T15:42:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.469+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889301b0 0x563e889325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.469+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889301b0 0x563e889325d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e849fbed016a3d2 server_cookie=b419aefc33fa906b in_seq=0 out_seq=0 2023-10-05T15:42:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.469+0000 7f0e877fe700 10 client.26335 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:39.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.470+0000 7f0e877fe700 1 -- 172.21.15.17:0/598393774 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563e88866db0 con 0x563e889301b0 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.470+0000 7f0e877fe700 10 client.26335 handle_command_reply: tid=0 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.470+0000 7f0ec21c5b80 1 client.26335 shutdown 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891aec0 msgr2=0x563e88924840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891aec0 0x563e88924840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0e90005910 tx=0x7f0e90009ca0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 shutdown_connections 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889301b0 0x563e889325d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891c990 0x563e8892bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891aec0 0x563e88924840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0e877fe700 0 client.26335 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/598393774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e88924d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 >> 172.21.15.17:0/598393774 conn(0x563e8888f200 msgr2=0x563e88915250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:39.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.471+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 shutdown_connections 2023-10-05T15:42:39.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.472+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/598393774 wait complete. 2023-10-05T15:42:39.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.472+0000 7f0ec21c5b80 20 client.26335 trim_cache size 0 max 16384 2023-10-05T15:42:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 Processor -- start 2023-10-05T15:42:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 -- start start 2023-10-05T15:42:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8892bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8891f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e886ee8c0 con 0x563e8891aec0 2023-10-05T15:42:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e88866db0 con 0x563e8891bfd0 2023-10-05T15:42:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.499+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e889243b0 con 0x563e8891c990 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8891f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8891f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:37152/0 (socket says 172.21.15.17:37152) 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 -- 172.21.15.17:0/3932875650 learned_addr learned my addr 172.21.15.17:0/3932875650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 -- 172.21.15.17:0/3932875650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 msgr2=0x563e8892bd80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8892bd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 -- 172.21.15.17:0/3932875650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 msgr2=0x563e8891c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.502+0000 7f0eacd9c700 1 -- 172.21.15.17:0/3932875650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e886bf1f0 con 0x563e8891c990 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.503+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8891f750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009f90 tx=0x7f0ea0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb94b730b2be894d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.503+0000 7f0e9effd700 1 -- 172.21.15.17:0/3932875650 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0022070 con 0x563e8891c990 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.503+0000 7f0e9effd700 1 -- 172.21.15.17:0/3932875650 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ea0026410 con 0x563e8891c990 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.503+0000 7f0e9effd700 1 -- 172.21.15.17:0/3932875650 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea001c660 con 0x563e8891c990 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/3932875650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 msgr2=0x563e8891f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8891f750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009f90 tx=0x7f0ea0014000 comp rx=0 tx=0).stop 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/3932875650 shutdown_connections 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8891f750 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891aec0 0x563e8891c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/3932875650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891bfd0 0x563e8892bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.504+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/3932875650 >> 172.21.15.17:0/3932875650 conn(0x563e8888f200 msgr2=0x563e8892c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.505+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/3932875650 shutdown_connections 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.505+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/3932875650 wait complete. 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.506+0000 7f0ec21c5b80 1 -- start start 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.506+0000 7f0ec21c5b80 1 Processor -- start 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891aec0 0x563e88927b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e889280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8892b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e8892b620 con 0x563e8891bfd0 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e8892b790 con 0x563e8891aec0 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e8892b950 con 0x563e8891c990 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.507+0000 7f0ec21c5b80 10 client.0 _ll_register_callbacks cb 0x7f0e900d6250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.508+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e889280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.508+0000 7f0e9ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e889280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46256/0 (socket says 172.21.15.17:46256) 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.508+0000 7f0e9ffff700 1 -- 172.21.15.17:0/873421715 learned_addr learned my addr 172.21.15.17:0/873421715 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891aec0 0x563e88927b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0eacd9c700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8892b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0e9ffff700 1 -- 172.21.15.17:0/873421715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 msgr2=0x563e8892b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8892b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0e9ffff700 1 -- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891aec0 msgr2=0x563e88927b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891aec0 0x563e88927b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.509+0000 7f0e9ffff700 1 -- 172.21.15.17:0/873421715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea0017070 con 0x563e8891bfd0 2023-10-05T15:42:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.510+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891aec0 0x563e88927b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:42:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.510+0000 7f0e9ffff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e889280c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009550 tx=0x7f0e98008740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88638438596f37a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.510+0000 7f0e877fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:42:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.511+0000 7f0e877fe700 1 -- 172.21.15.17:0/873421715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800e040 con 0x563e8891bfd0 2023-10-05T15:42:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.511+0000 7f0e877fe700 1 -- 172.21.15.17:0/873421715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0e98004db0 con 0x563e8891bfd0 2023-10-05T15:42:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.511+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e900976f0 con 0x563e8891bfd0 2023-10-05T15:42:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.512+0000 7f0e877fe700 1 -- 172.21.15.17:0/873421715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e98025450 con 0x563e8891bfd0 2023-10-05T15:42:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.512+0000 7f0ec21c5b80 10 client.16500 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.512+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x563e88697250 con 0x563e8891bfd0 2023-10-05T15:42:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0e877fe700 1 -- 172.21.15.17:0/873421715 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e900976f0 con 0x563e8891bfd0 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0e877fe700 1 -- 172.21.15.17:0/873421715 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0e98017680 con 0x563e8891bfd0 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ec21c5b80 10 client.16500 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ec21c5b80 10 client.16500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ec21c5b80 20 client.16500 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889960c0 0x563e889984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ec21c5b80 4 client.16500 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563e88866ad0 con 0x563e889960c0 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.513+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889960c0 0x563e889984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.515+0000 7f0ea7fff700 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889960c0 0x563e889984e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9941ef850fbd5 server_cookie=3ccae0986393b73d in_seq=0 out_seq=0 2023-10-05T15:42:39.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.515+0000 7f0e877fe700 10 client.16500 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.536+0000 7f0e877fe700 1 -- 172.21.15.17:0/873421715 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563e88866ad0 con 0x563e889960c0 2023-10-05T15:42:39.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.536+0000 7f0e877fe700 10 client.16500 handle_command_reply: tid=0 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.538+0000 7f0ec21c5b80 1 client.16500 shutdown 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.538+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 msgr2=0x563e889280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.538+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e889280c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009550 tx=0x7f0e98008740 comp rx=0 tx=0).stop 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.538+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 shutdown_connections 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563e889960c0 0x563e889984e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563e8891c990 0x563e8892b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563e8891aec0 0x563e88927b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 --2- 172.21.15.17:0/873421715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563e8891bfd0 0x563e889280c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 >> 172.21.15.17:0/873421715 conn(0x563e8888f200 msgr2=0x563e8891f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0e877fe700 0 client.16500 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 shutdown_connections 2023-10-05T15:42:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 1 -- 172.21.15.17:0/873421715 wait complete. 2023-10-05T15:42:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.539+0000 7f0ec21c5b80 20 client.16500 trim_cache size 0 max 16384 2023-10-05T15:42:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:42:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:42:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:42:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:42:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.543+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e940a1500 msgr2=0x7f0e940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.543+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e940a1500 0x7f0e940a39c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x563e8891ac60 tx=0x7f0ea0009750 comp rx=0 tx=0).stop 2023-10-05T15:42:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.543+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 msgr2=0x7f0ea806f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:39.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.543+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 0x7f0ea806f8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0e900098e0 tx=0x7f0e90005740 comp rx=0 tx=0).stop 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 shutdown_connections 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0e940a1500 0x7f0e940a39c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ea8100880 0x7f0ea8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ea80fed90 0x7f0ea806f8a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 --2- 172.21.15.17:0/650333039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ea80ffec0 0x7f0ea806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 >> 172.21.15.17:0/650333039 conn(0x7f0ea80fa690 msgr2=0x7f0ea80fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 shutdown_connections 2023-10-05T15:42:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:39.544+0000 7f0eae7ff700 1 -- 172.21.15.17:0/650333039 wait complete. 2023-10-05T15:42:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:41 smithi167 ceph-mon[133366]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.7 MiB/s wr, 727 op/s 2023-10-05T15:42:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:41 smithi079 ceph-mon[132936]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.7 MiB/s wr, 727 op/s 2023-10-05T15:42:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:41 smithi017 ceph-mon[129107]: pgmap v552: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.7 MiB/s wr, 727 op/s 2023-10-05T15:42:43.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 245.0 s, 522.2 tps, lat 191.011 ms stddev 95.594 2023-10-05T15:42:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:43 smithi167 ceph-mon[133366]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 631 op/s 2023-10-05T15:42:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:43 smithi079 ceph-mon[132936]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 631 op/s 2023-10-05T15:42:44.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:43 smithi017 ceph-mon[129107]: pgmap v553: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.0 MiB/s wr, 631 op/s 2023-10-05T15:42:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:45 smithi167 ceph-mon[133366]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.1 MiB/s wr, 756 op/s 2023-10-05T15:42:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:45 smithi079 ceph-mon[132936]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.1 MiB/s wr, 756 op/s 2023-10-05T15:42:46.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:45 smithi017 ceph-mon[129107]: pgmap v554: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.1 MiB/s wr, 756 op/s 2023-10-05T15:42:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:47 smithi167 ceph-mon[133366]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 591 op/s 2023-10-05T15:42:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:47 smithi079 ceph-mon[132936]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 591 op/s 2023-10-05T15:42:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 250.0 s, 672.0 tps, lat 148.866 ms stddev 46.006 2023-10-05T15:42:48.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:47 smithi017 ceph-mon[129107]: pgmap v555: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 591 op/s 2023-10-05T15:42:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:49 smithi167 ceph-mon[133366]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 650 op/s 2023-10-05T15:42:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:49 smithi079 ceph-mon[132936]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 650 op/s 2023-10-05T15:42:50.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:49 smithi017 ceph-mon[129107]: pgmap v556: 129 pgs: 129 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 650 op/s 2023-10-05T15:42:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:51 smithi167 ceph-mon[133366]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.2 MiB/s wr, 755 op/s 2023-10-05T15:42:52.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:51 smithi079 ceph-mon[132936]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.2 MiB/s wr, 755 op/s 2023-10-05T15:42:52.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:51 smithi017 ceph-mon[129107]: pgmap v557: 129 pgs: 129 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.2 MiB/s wr, 755 op/s 2023-10-05T15:42:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.781+0000 7f1f199ff700 1 -- 172.21.15.17:0/1888524451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 msgr2=0x7f1f14076f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.781+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1888524451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f14076f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009990 tx=0x7f1efc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.782+0000 7f1f199ff700 1 -- 172.21.15.17:0/1888524451 shutdown_connections 2023-10-05T15:42:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.782+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1888524451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14077470 0x7f1f14077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.782+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1888524451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14075870 0x7f1f14075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.782+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1888524451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f14076f30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.782+0000 7f1f199ff700 1 -- 172.21.15.17:0/1888524451 >> 172.21.15.17:0/1888524451 conn(0x7f1f140fe6a0 msgr2=0x7f1f14100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.783+0000 7f1f199ff700 1 -- 172.21.15.17:0/1888524451 shutdown_connections 2023-10-05T15:42:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.783+0000 7f1f199ff700 1 -- 172.21.15.17:0/1888524451 wait complete. 2023-10-05T15:42:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.785+0000 7f1f199ff700 1 Processor -- start 2023-10-05T15:42:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.785+0000 7f1f199ff700 1 -- start start 2023-10-05T15:42:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f199ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14075870 0x7f1f1410db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f199ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f1410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f199ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14077470 0x7f1f1410ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f199ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1410f570 con 0x7f1f14077470 2023-10-05T15:42:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f199ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1410f6e0 con 0x7f1f14075870 2023-10-05T15:42:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f199ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1410f8a0 con 0x7f1f14076ab0 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f0bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f1410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f0bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f1410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:46364/0 (socket says 172.21.15.17:46364) 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14075870 0x7f1f1410db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.786+0000 7f1f0bfff700 1 -- 172.21.15.17:0/1535450848 learned_addr learned my addr 172.21.15.17:0/1535450848 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.787+0000 7f1f0bfff700 1 -- 172.21.15.17:0/1535450848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14075870 msgr2=0x7f1f1410db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.787+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14075870 0x7f1f1410db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.787+0000 7f1f0bfff700 1 -- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14077470 msgr2=0x7f1f1410ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.787+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14077470 0x7f1f1410ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.787+0000 7f1f0bfff700 1 -- 172.21.15.17:0/1535450848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0095f0 con 0x7f1f14076ab0 2023-10-05T15:42:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.788+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f1410e040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0098e0 tx=0x7f1efc005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.788+0000 7f1f189fd700 1 -- 172.21.15.17:0/1535450848 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc01d070 con 0x7f1f14076ab0 2023-10-05T15:42:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.788+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1410fb20 con 0x7f1f14076ab0 2023-10-05T15:42:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.788+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f14110330 con 0x7f1f14076ab0 2023-10-05T15:42:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.789+0000 7f1f189fd700 1 -- 172.21.15.17:0/1535450848 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1efc00f460 con 0x7f1f14076ab0 2023-10-05T15:42:52.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.789+0000 7f1f189fd700 1 -- 172.21.15.17:0/1535450848 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc021670 con 0x7f1f14076ab0 2023-10-05T15:42:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.796+0000 7f1f189fd700 1 -- 172.21.15.17:0/1535450848 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f1efc00f5d0 con 0x7f1f14076ab0 2023-10-05T15:42:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.798+0000 7f1f2d2d8b80 1 Processor -- start 2023-10-05T15:42:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.798+0000 7f1f2d2d8b80 1 -- start start 2023-10-05T15:42:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cf32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cfb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805c5b400 con 0x560805cf3fd0 2023-10-05T15:42:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805c4cbc0 con 0x560805cf2ec0 2023-10-05T15:42:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805c4a4e0 con 0x560805cf4990 2023-10-05T15:42:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cf32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cf32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37544/0 (socket says 172.21.15.17:37544) 2023-10-05T15:42:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.799+0000 7f1f137fe700 1 -- 172.21.15.17:0/1637857167 learned_addr learned my addr 172.21.15.17:0/1637857167 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f189fd700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1f000a1580 0x7f1f000a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cfb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f189fd700 1 -- 172.21.15.17:0/1535450848 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1efc0ce1e0 con 0x7f1f14076ab0 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f137fe700 1 -- 172.21.15.17:0/1637857167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 msgr2=0x560805cfb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f137fe700 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cfb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f137fe700 1 -- 172.21.15.17:0/1637857167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 msgr2=0x560805cf4450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f137fe700 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf4450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.800+0000 7f1f137fe700 1 -- 172.21.15.17:0/1637857167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560805a70d80 con 0x560805cf2ec0 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.801+0000 7f1f137fe700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1f000a1580 0x7f1f000a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.801+0000 7f1f137fe700 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cf32e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009de0 tx=0x7f1f0c0077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b524ac0ca0a6e81c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.801+0000 7f1f09ffb700 1 -- 172.21.15.17:0/1637857167 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c016800 con 0x560805cf2ec0 2023-10-05T15:42:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.801+0000 7f1f09ffb700 1 -- 172.21.15.17:0/1637857167 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f0c016e70 con 0x560805cf2ec0 2023-10-05T15:42:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.801+0000 7f1f09ffb700 1 -- 172.21.15.17:0/1637857167 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c015d90 con 0x560805cf2ec0 2023-10-05T15:42:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.802+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1637857167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 msgr2=0x560805cf32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.802+0000 7f1f137fe700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1f000a1580 0x7f1f000a3a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c015fd0 tx=0x7f1f0c014730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.802+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cf32e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009de0 tx=0x7f1f0c0077e0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.803+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1637857167 shutdown_connections 2023-10-05T15:42:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.803+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cfb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.803+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cf32e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.803+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1637857167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.803+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1637857167 >> 172.21.15.17:0/1637857167 conn(0x560805c67200 msgr2=0x560805cedbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.804+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1637857167 shutdown_connections 2023-10-05T15:42:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.804+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1637857167 wait complete. 2023-10-05T15:42:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.805+0000 7f1f2d2d8b80 1 -- start start 2023-10-05T15:42:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.805+0000 7f1f2d2d8b80 1 Processor -- start 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cfcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf3fd0 0x560805cfd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf4990 0x560805d04050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805c45dd0 con 0x560805cf4990 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805be26b0 con 0x560805cf2ec0 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805be2350 con 0x560805cf3fd0 2023-10-05T15:42:52.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.806+0000 7f1f2d2d8b80 10 client.0 _ll_register_callbacks cb 0x560805a3f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.807+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cfcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.807+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cfcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37556/0 (socket says 172.21.15.17:37556) 2023-10-05T15:42:52.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.807+0000 7f1f12ffd700 1 -- 172.21.15.17:0/3441241045 learned_addr learned my addr 172.21.15.17:0/3441241045 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.808+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf3fd0 0x560805cfd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.808+0000 7f1f12ffd700 1 -- 172.21.15.17:0/3441241045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf3fd0 msgr2=0x560805cfd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.808+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf3fd0 0x560805cfd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.808+0000 7f1f12ffd700 1 -- 172.21.15.17:0/3441241045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf4990 msgr2=0x560805d04050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.808+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf4990 0x560805d04050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.808+0000 7f1f12ffd700 1 -- 172.21.15.17:0/3441241045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c009910 con 0x560805cf2ec0 2023-10-05T15:42:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.809+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cfcad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1f04011690 tx=0x7f1f04011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cffd10f91ed9b8cf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.809+0000 7f1ef2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:42:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.809+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/3441241045 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04012920 con 0x560805cf2ec0 2023-10-05T15:42:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.809+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/3441241045 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1f04012a80 con 0x560805cf2ec0 2023-10-05T15:42:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.809+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560805ce5d50 con 0x560805cf2ec0 2023-10-05T15:42:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.810+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/3441241045 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f04012c40 con 0x560805cf2ec0 2023-10-05T15:42:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.810+0000 7f1f2d2d8b80 10 client.26393 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.810+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560805a59c00 con 0x560805cf2ec0 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/3441241045 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560805ce5d50 con 0x560805cf2ec0 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/3441241045 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1f0401a3f0 con 0x560805cf2ec0 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f2d2d8b80 10 client.26393 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f2d2d8b80 10 client.26393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f2d2d8b80 20 client.26393 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d08a00 0x560805d0ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f2d2d8b80 4 client.26393 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:42:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560805c3edb0 con 0x560805d08a00 2023-10-05T15:42:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.811+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d08a00 0x560805d0ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.813+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d08a00 0x560805d0ae20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a850e9be0f1c29a server_cookie=628968b2cc4d486a in_seq=0 out_seq=0 2023-10-05T15:42:52.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.813+0000 7f1ef2ffd700 10 client.26393 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.814+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/3441241045 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560805c3edb0 con 0x560805d08a00 2023-10-05T15:42:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.814+0000 7f1ef2ffd700 10 client.26393 handle_command_reply: tid=0 2023-10-05T15:42:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.814+0000 7f1f2d2d8b80 1 client.26393 shutdown 2023-10-05T15:42:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 msgr2=0x560805cfcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cfcad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1f04011690 tx=0x7f1f04011a50 comp rx=0 tx=0).stop 2023-10-05T15:42:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 shutdown_connections 2023-10-05T15:42:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d08a00 0x560805d0ae20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf4990 0x560805d04050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf2ec0 0x560805cfcad0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1f04011690 tx=0x7f1f04011a50 comp rx=0 tx=0).stop 2023-10-05T15:42:52.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/3441241045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf3fd0 0x560805cfd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 >> 172.21.15.17:0/3441241045 conn(0x560805c67200 msgr2=0x560805ced250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.817+0000 7f1ef2ffd700 0 client.26393 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.818+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 shutdown_connections 2023-10-05T15:42:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.819+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/3441241045 wait complete. 2023-10-05T15:42:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.819+0000 7f1f2d2d8b80 20 client.26393 trim_cache size 0 max 16384 2023-10-05T15:42:52.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 Processor -- start 2023-10-05T15:42:52.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 -- start start 2023-10-05T15:42:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cf7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cfb860 0x560805d04010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805ac68c0 con 0x560805cf3fd0 2023-10-05T15:42:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805cfdcf0 con 0x560805cfb860 2023-10-05T15:42:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.846+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805cfdb00 con 0x560805cf4990 2023-10-05T15:42:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41458/0 (socket says 172.21.15.17:41458) 2023-10-05T15:42:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 -- 172.21.15.17:0/1101992537 learned_addr learned my addr 172.21.15.17:0/1101992537 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 -- 172.21.15.17:0/1101992537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 msgr2=0x560805cf7de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cf7de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 -- 172.21.15.17:0/1101992537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cfb860 msgr2=0x560805d04010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:42:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cfb860 0x560805d04010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.847+0000 7f1f12ffd700 1 -- 172.21.15.17:0/1101992537 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560805a971f0 con 0x560805cf3fd0 2023-10-05T15:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.848+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf78a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1f0401a750 tx=0x7f1f04005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ac117df8b3f830 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.848+0000 7f1f0a7fc700 1 -- 172.21.15.17:0/1101992537 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400fdf0 con 0x560805cf3fd0 2023-10-05T15:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.848+0000 7f1f0a7fc700 1 -- 172.21.15.17:0/1101992537 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f0401a3f0 con 0x560805cf3fd0 2023-10-05T15:42:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.848+0000 7f1f0a7fc700 1 -- 172.21.15.17:0/1101992537 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04012980 con 0x560805cf3fd0 2023-10-05T15:42:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.849+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1101992537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 msgr2=0x560805cf78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.849+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf78a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1f0401a750 tx=0x7f1f04005ce0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.850+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1101992537 shutdown_connections 2023-10-05T15:42:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.850+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cfb860 0x560805d04010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.850+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cf3fd0 0x560805cf78a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.850+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/1101992537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805cf7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.850+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1101992537 >> 172.21.15.17:0/1101992537 conn(0x560805c67200 msgr2=0x560805cfad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.850+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1101992537 shutdown_connections 2023-10-05T15:42:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.851+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/1101992537 wait complete. 2023-10-05T15:42:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.851+0000 7f1f2d2d8b80 1 -- start start 2023-10-05T15:42:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.851+0000 7f1f2d2d8b80 1 Processor -- start 2023-10-05T15:42:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 0x560805d039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805d03f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cfb860 0x560805d01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805d02610 con 0x560805cfb860 2023-10-05T15:42:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805d02780 con 0x560805cf3fd0 2023-10-05T15:42:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560805d02940 con 0x560805cf4990 2023-10-05T15:42:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f2d2d8b80 10 client.0 _ll_register_callbacks cb 0x7f1f04009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:42:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.853+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 0x560805d039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 0x560805d039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:37574/0 (socket says 172.21.15.17:37574) 2023-10-05T15:42:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 -- 172.21.15.17:0/902703027 learned_addr learned my addr 172.21.15.17:0/902703027 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:42:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 -- 172.21.15.17:0/902703027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 msgr2=0x560805d03f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805d03f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 -- 172.21.15.17:0/902703027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cfb860 msgr2=0x560805d01ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cfb860 0x560805d01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.854+0000 7f1f12ffd700 1 -- 172.21.15.17:0/902703027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560805a59c00 con 0x560805cf3fd0 2023-10-05T15:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.855+0000 7f1f12ffd700 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 0x560805d039e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005a80 tx=0x7f1f04012a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=821288469519c8d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.855+0000 7f1ef2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:42:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.856+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/902703027 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0401a560 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.856+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/902703027 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1f04000e40 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.856+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f0c016e70 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.856+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/902703027 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f04012e30 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.856+0000 7f1f2d2d8b80 10 client.26396 fetch_fsmap learned FSMap version 39 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.856+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560805a6f250 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.857+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/902703027 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f0c016e70 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.857+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/902703027 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1f0401ad20 con 0x560805cf3fd0 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.858+0000 7f1f2d2d8b80 10 client.26396 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:42:52.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.858+0000 7f1f2d2d8b80 10 client.26396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:42:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.858+0000 7f1f2d2d8b80 20 client.26396 populate_metadata read hostname 'smithi017' 2023-10-05T15:42:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.858+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d5d7e0 0x560805d5fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:42:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.858+0000 7f1f2d2d8b80 4 client.26396 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:42:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.858+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560805c3ead0 con 0x560805d5d7e0 2023-10-05T15:42:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.859+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d5d7e0 0x560805d5fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:42:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.861+0000 7f1f0bfff700 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d5d7e0 0x560805d5fc00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a466075f3b467448 server_cookie=1caad177b29153bf in_seq=0 out_seq=0 2023-10-05T15:42:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.861+0000 7f1ef2ffd700 10 client.26396 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.880+0000 7f1ef2ffd700 1 -- 172.21.15.17:0/902703027 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560805c3ead0 con 0x560805d5d7e0 2023-10-05T15:42:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.880+0000 7f1ef2ffd700 10 client.26396 handle_command_reply: tid=0 2023-10-05T15:42:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.880+0000 7f1f2d2d8b80 1 client.26396 shutdown 2023-10-05T15:42:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.882+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 msgr2=0x560805d039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.882+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 0x560805d039e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005a80 tx=0x7f1f04012a00 comp rx=0 tx=0).stop 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 shutdown_connections 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560805d5d7e0 0x560805d5fc00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560805cfb860 0x560805d01ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560805cf3fd0 0x560805d039e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 --2- 172.21.15.17:0/902703027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560805cf4990 0x560805d03f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 >> 172.21.15.17:0/902703027 conn(0x560805c67200 msgr2=0x560805cf78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1ef2ffd700 0 client.26396 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:42:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.884+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 shutdown_connections 2023-10-05T15:42:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.885+0000 7f1f2d2d8b80 1 -- 172.21.15.17:0/902703027 wait complete. 2023-10-05T15:42:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.886+0000 7f1f2d2d8b80 20 client.26396 trim_cache size 0 max 16384 2023-10-05T15:42:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:42:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:42:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:42:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1f000a1580 msgr2=0x7f1f000a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1f000a1580 0x7f1f000a3a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c015fd0 tx=0x7f1f0c014730 comp rx=0 tx=0).stop 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 msgr2=0x7f1f1410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f1410e040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0098e0 tx=0x7f1efc005ef0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 shutdown_connections 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f1f000a1580 0x7f1f000a3a40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f14077470 0x7f1f1410ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14075870 0x7f1f1410db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 --2- 172.21.15.17:0/1535450848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f14076ab0 0x7f1f1410e040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:42:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 >> 172.21.15.17:0/1535450848 conn(0x7f1f140fe6a0 msgr2=0x7f1f141003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:42:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 shutdown_connections 2023-10-05T15:42:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:42:52.887+0000 7f1f199ff700 1 -- 172.21.15.17:0/1535450848 wait complete. 2023-10-05T15:42:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 255.0 s, 619.0 tps, lat 161.649 ms stddev 43.794 2023-10-05T15:42:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:53 smithi167 ceph-mon[133366]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 620 op/s 2023-10-05T15:42:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:53 smithi079 ceph-mon[132936]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 620 op/s 2023-10-05T15:42:54.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:53 smithi017 ceph-mon[129107]: pgmap v558: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 620 op/s 2023-10-05T15:42:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:55 smithi079 ceph-mon[132936]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 778 op/s 2023-10-05T15:42:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:55 smithi017 ceph-mon[129107]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 778 op/s 2023-10-05T15:42:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:55 smithi167 ceph-mon[133366]: pgmap v559: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 778 op/s 2023-10-05T15:42:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:57 smithi167 ceph-mon[133366]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 682 op/s 2023-10-05T15:42:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:57 smithi079 ceph-mon[132936]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 682 op/s 2023-10-05T15:42:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 260.0 s, 614.4 tps, lat 162.258 ms stddev 48.071 2023-10-05T15:42:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:57 smithi017 ceph-mon[129107]: pgmap v560: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 682 op/s 2023-10-05T15:43:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:42:59 smithi167 ceph-mon[133366]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 766 op/s 2023-10-05T15:43:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:42:59 smithi079 ceph-mon[132936]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 766 op/s 2023-10-05T15:43:00.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:42:59 smithi017 ceph-mon[129107]: pgmap v561: 129 pgs: 129 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 766 op/s 2023-10-05T15:43:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:01 smithi167 ceph-mon[133366]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.1 MiB/s wr, 778 op/s 2023-10-05T15:43:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:01 smithi079 ceph-mon[132936]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.1 MiB/s wr, 778 op/s 2023-10-05T15:43:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:01 smithi017 ceph-mon[129107]: pgmap v562: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.1 MiB/s wr, 778 op/s 2023-10-05T15:43:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 265.0 s, 624.6 tps, lat 160.767 ms stddev 50.864 2023-10-05T15:43:04.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:03 smithi167 ceph-mon[133366]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2023-10-05T15:43:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:03 smithi079 ceph-mon[132936]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2023-10-05T15:43:04.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:03 smithi017 ceph-mon[129107]: pgmap v563: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2023-10-05T15:43:05.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:04 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:43:05.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:04 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:43:05.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:04 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:43:05.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:43:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.929+0000 7f588dfff700 1 -- 172.21.15.17:0/2955111689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888101940 msgr2=0x7f5888103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.929+0000 7f588dfff700 1 --2- 172.21.15.17:0/2955111689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888101940 0x7f5888103d30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f587800b0a0 tx=0x7f587800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.930+0000 7f588dfff700 1 -- 172.21.15.17:0/2955111689 shutdown_connections 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.930+0000 7f588dfff700 1 --2- 172.21.15.17:0/2955111689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5888106ba0 0x7f5888109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.930+0000 7f588dfff700 1 --2- 172.21.15.17:0/2955111689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888101940 0x7f5888103d30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.930+0000 7f588dfff700 1 --2- 172.21.15.17:0/2955111689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888104270 0x7f5888106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.930+0000 7f588dfff700 1 -- 172.21.15.17:0/2955111689 >> 172.21.15.17:0/2955111689 conn(0x7f58880fb330 msgr2=0x7f58880fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.931+0000 7f588dfff700 1 -- 172.21.15.17:0/2955111689 shutdown_connections 2023-10-05T15:43:05.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.931+0000 7f588dfff700 1 -- 172.21.15.17:0/2955111689 wait complete. 2023-10-05T15:43:05.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.933+0000 7f588dfff700 1 Processor -- start 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.933+0000 7f588dfff700 1 -- start start 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.934+0000 7f588dfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5888101940 0x7f5888194a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.934+0000 7f588dfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888104270 0x7f5888194f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.934+0000 7f588dfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888106ba0 0x7f588819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.934+0000 7f588dfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588819c570 con 0x7f5888101940 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.934+0000 7f588dfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588819c6b0 con 0x7f5888104270 2023-10-05T15:43:05.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.934+0000 7f588dfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588819c840 con 0x7f5888106ba0 2023-10-05T15:43:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f5887fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888106ba0 0x7f588819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f587effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888104270 0x7f5888194f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f5887fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888106ba0 0x7f588819bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44870/0 (socket says 172.21.15.17:44870) 2023-10-05T15:43:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f5887fff700 1 -- 172.21.15.17:0/1721059580 learned_addr learned my addr 172.21.15.17:0/1721059580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f587effd700 1 -- 172.21.15.17:0/1721059580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888106ba0 msgr2=0x7f588819bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:05.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f587effd700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888106ba0 0x7f588819bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f587effd700 1 -- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5888101940 msgr2=0x7f5888194a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f587effd700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5888101940 0x7f5888194a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.935+0000 7f587effd700 1 -- 172.21.15.17:0/1721059580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009d00 con 0x7f5888104270 2023-10-05T15:43:05.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.940+0000 7f587effd700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888104270 0x7f5888194f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f587000b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.940+0000 7f58857fa700 1 -- 172.21.15.17:0/1721059580 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870011830 con 0x7f5888104270 2023-10-05T15:43:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.940+0000 7f58857fa700 1 -- 172.21.15.17:0/1721059580 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5870011e20 con 0x7f5888104270 2023-10-05T15:43:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.940+0000 7f58857fa700 1 -- 172.21.15.17:0/1721059580 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870010d00 con 0x7f5888104270 2023-10-05T15:43:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.941+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588819cb20 con 0x7f5888104270 2023-10-05T15:43:05.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.941+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588819d060 con 0x7f5888104270 2023-10-05T15:43:05.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:05 smithi017 ceph-mon[129107]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 789 op/s 2023-10-05T15:43:05.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.948+0000 7f58a1a03b80 1 Processor -- start 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 -- start start 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5ad260 0x55850e5ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5ae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 0x55850e5aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e515460 con 0x55850e5aea60 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e506c20 con 0x55850e5adbc0 2023-10-05T15:43:05.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.951+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e504540 con 0x55850e5ad260 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.953+0000 7f58877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.953+0000 7f58877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5ae480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40706/0 (socket says 172.21.15.17:40706) 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.953+0000 7f58877fe700 1 -- 172.21.15.17:0/2713227917 learned_addr learned my addr 172.21.15.17:0/2713227917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.953+0000 7f5887fff700 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5ad260 0x55850e5ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58877fe700 1 -- 172.21.15.17:0/2713227917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5ad260 msgr2=0x55850e5ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58877fe700 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5ad260 0x55850e5ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58877fe700 1 -- 172.21.15.17:0/2713227917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 msgr2=0x55850e5aeee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:05.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58877fe700 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 0x55850e5aeee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58877fe700 1 -- 172.21.15.17:0/2713227917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55850e32ade0 con 0x55850e5adbc0 2023-10-05T15:43:05.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58857fa700 1 -- 172.21.15.17:0/1721059580 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5870011990 con 0x7f5888104270 2023-10-05T15:43:05.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.954+0000 7f58877fe700 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5ae480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f587800b070 tx=0x7f5878008d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=205508e75c236c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:05.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.955+0000 7f587dffb700 1 -- 172.21.15.17:0/2713227917 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800e040 con 0x55850e5adbc0 2023-10-05T15:43:05.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.955+0000 7f587dffb700 1 -- 172.21.15.17:0/2713227917 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58780092d0 con 0x55850e5adbc0 2023-10-05T15:43:05.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.955+0000 7f587dffb700 1 -- 172.21.15.17:0/2713227917 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780052d0 con 0x55850e5adbc0 2023-10-05T15:43:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.956+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2713227917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 msgr2=0x55850e5ae480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.956+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5ae480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f587800b070 tx=0x7f5878008d80 comp rx=0 tx=0).stop 2023-10-05T15:43:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2713227917 shutdown_connections 2023-10-05T15:43:05.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 0x55850e5aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5ad260 0x55850e5ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2713227917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5ae480 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2713227917 >> 172.21.15.17:0/2713227917 conn(0x55850e521260 msgr2=0x55850e5a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2713227917 shutdown_connections 2023-10-05T15:43:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.957+0000 7f58857fa700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58740a1510 0x7f58740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.958+0000 7f58857fa700 1 -- 172.21.15.17:0/1721059580 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f58700cc790 con 0x7f5888104270 2023-10-05T15:43:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.958+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2713227917 wait complete. 2023-10-05T15:43:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.959+0000 7f58a1a03b80 1 -- start start 2023-10-05T15:43:05.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.959+0000 7f58877fe700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58740a1510 0x7f58740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.959+0000 7f58a1a03b80 1 Processor -- start 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5adbc0 0x55850e5b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5be590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e4ffe30 con 0x55850e5adbc0 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e49c710 con 0x55850e5ad260 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e49c3b0 con 0x55850e5aea60 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.960+0000 7f58a1a03b80 10 client.0 _ll_register_callbacks cb 0x55850e2f9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.961+0000 7f5887fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.961+0000 7f5887fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5be590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44898/0 (socket says 172.21.15.17:44898) 2023-10-05T15:43:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.961+0000 7f5887fff700 1 -- 172.21.15.17:0/218367586 learned_addr learned my addr 172.21.15.17:0/218367586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f5887fff700 1 -- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 msgr2=0x55850e5b7010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f587effd700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5adbc0 0x55850e5b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f5887fff700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b7010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f5887fff700 1 -- 172.21.15.17:0/218367586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5adbc0 msgr2=0x55850e5b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f5887fff700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5adbc0 0x55850e5b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f5887fff700 1 -- 172.21.15.17:0/218367586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5888109c00 con 0x55850e5aea60 2023-10-05T15:43:05.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.962+0000 7f587effd700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5adbc0 0x55850e5b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:43:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.964+0000 7f5887fff700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5be590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58800114c0 tx=0x7f5880011880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10dee9fef25ef1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.964+0000 7f5866ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:43:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.964+0000 7f5866ffd700 1 -- 172.21.15.17:0/218367586 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880016070 con 0x55850e5aea60 2023-10-05T15:43:05.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.964+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55850e59ff10 con 0x55850e5aea60 2023-10-05T15:43:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.965+0000 7f5866ffd700 1 -- 172.21.15.17:0/218367586 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5880004830 con 0x55850e5aea60 2023-10-05T15:43:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.965+0000 7f5866ffd700 1 -- 172.21.15.17:0/218367586 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5880004a30 con 0x55850e5aea60 2023-10-05T15:43:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.965+0000 7f58a1a03b80 10 client.26362 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.965+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55850e313c60 con 0x55850e5aea60 2023-10-05T15:43:05.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58877fe700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58740a1510 0x7f58740a39d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5878009820 tx=0x7f58780099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:05.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f5866ffd700 1 -- 172.21.15.17:0/218367586 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55850e59ff10 con 0x55850e5aea60 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f5866ffd700 1 -- 172.21.15.17:0/218367586 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5880010720 con 0x55850e5aea60 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58a1a03b80 10 client.26362 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58a1a03b80 10 client.26362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58a1a03b80 20 client.26362 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e5c2d90 0x55850e5c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58a1a03b80 4 client.26362 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.966+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55850e4f8e10 con 0x55850e5c2d90 2023-10-05T15:43:05.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.968+0000 7f58877fe700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e5c2d90 0x55850e5c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:05.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.969+0000 7f5866ffd700 10 client.26362 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:05.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.969+0000 7f58877fe700 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e5c2d90 0x55850e5c51b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c056988be91ad09a server_cookie=5455452a030bd93e in_seq=0 out_seq=0 2023-10-05T15:43:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.970+0000 7f5866ffd700 1 -- 172.21.15.17:0/218367586 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55850e4f8e10 con 0x55850e5c2d90 2023-10-05T15:43:05.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.970+0000 7f5866ffd700 10 client.26362 handle_command_reply: tid=0 2023-10-05T15:43:05.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.970+0000 7f58a1a03b80 1 client.26362 shutdown 2023-10-05T15:43:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.972+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 msgr2=0x55850e5be590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.972+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5be590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58800114c0 tx=0x7f5880011880 comp rx=0 tx=0).stop 2023-10-05T15:43:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 shutdown_connections 2023-10-05T15:43:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e5c2d90 0x55850e5c51b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5be590 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/218367586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5adbc0 0x55850e5b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f5866ffd700 0 client.26362 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 >> 172.21.15.17:0/218367586 conn(0x55850e521260 msgr2=0x55850e5a7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.973+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 shutdown_connections 2023-10-05T15:43:05.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.974+0000 7f58a1a03b80 1 -- 172.21.15.17:0/218367586 wait complete. 2023-10-05T15:43:05.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:05.974+0000 7f58a1a03b80 20 client.26362 trim_cache size 0 max 16384 2023-10-05T15:43:06.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.009+0000 7f58a1a03b80 1 Processor -- start 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 -- start start 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5adbc0 0x55850e5be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 0x55850e5b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e380920 con 0x55850e5aea60 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e5c02b0 con 0x55850e5ad260 2023-10-05T15:43:06.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.010+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e5b5ac0 con 0x55850e5adbc0 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f58877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f58877fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40716/0 (socket says 172.21.15.17:40716) 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f58877fe700 1 -- 172.21.15.17:0/2589676113 learned_addr learned my addr 172.21.15.17:0/2589676113 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f587effd700 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5adbc0 0x55850e5be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f587effd700 1 -- 172.21.15.17:0/2589676113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 msgr2=0x55850e5b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f587effd700 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f587effd700 1 -- 172.21.15.17:0/2589676113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 msgr2=0x55850e5b7300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f587effd700 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 0x55850e5b7300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.011+0000 7f587effd700 1 -- 172.21.15.17:0/2589676113 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55850e351250 con 0x55850e5adbc0 2023-10-05T15:43:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.012+0000 7f587effd700 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5adbc0 0x55850e5be550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55850e5ae240 tx=0x7f58700c9dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b0d4ec02161e5f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.012+0000 7f587e7fc700 1 -- 172.21.15.17:0/2589676113 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870099250 con 0x55850e5adbc0 2023-10-05T15:43:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.012+0000 7f587e7fc700 1 -- 172.21.15.17:0/2589676113 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5870099070 con 0x55850e5adbc0 2023-10-05T15:43:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.012+0000 7f587e7fc700 1 -- 172.21.15.17:0/2589676113 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587009d860 con 0x55850e5adbc0 2023-10-05T15:43:06.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.013+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2589676113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5adbc0 msgr2=0x55850e5be550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.013+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5adbc0 0x55850e5be550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55850e5ae240 tx=0x7f58700c9dc0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.014+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2589676113 shutdown_connections 2023-10-05T15:43:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.014+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5aea60 0x55850e5b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.014+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5ad260 0x55850e5b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.014+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/2589676113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5adbc0 0x55850e5be550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.014+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2589676113 >> 172.21.15.17:0/2589676113 conn(0x55850e521260 msgr2=0x55850e5bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.014+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2589676113 shutdown_connections 2023-10-05T15:43:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.015+0000 7f58a1a03b80 1 -- 172.21.15.17:0/2589676113 wait complete. 2023-10-05T15:43:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.015+0000 7f58a1a03b80 1 -- start start 2023-10-05T15:43:06.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.015+0000 7f58a1a03b80 1 Processor -- start 2023-10-05T15:43:06.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5ad260 0x55850e5be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e5bd330 con 0x55850e5ad260 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e5bd4a0 con 0x55850e5adbc0 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55850e5bd660 con 0x55850e5aea60 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.016+0000 7f58a1a03b80 10 client.0 _ll_register_callbacks cb 0x7f588000bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40720/0 (socket says 172.21.15.17:40720) 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 -- 172.21.15.17:0/1405444555 learned_addr learned my addr 172.21.15.17:0/1405444555 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f5887fff700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f58877fe700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5ad260 0x55850e5be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 -- 172.21.15.17:0/1405444555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 msgr2=0x55850e5bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5bcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 -- 172.21.15.17:0/1405444555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5ad260 msgr2=0x55850e5be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5ad260 0x55850e5be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.017+0000 7f587effd700 1 -- 172.21.15.17:0/1405444555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588819d060 con 0x55850e5adbc0 2023-10-05T15:43:06.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.018+0000 7f587effd700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5bc8b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58700996a0 tx=0x7f5870099e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f0da78ed6cc1c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.018+0000 7f5866ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.019+0000 7f5866ffd700 1 -- 172.21.15.17:0/1405444555 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870010380 con 0x55850e5adbc0 2023-10-05T15:43:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.019+0000 7f5866ffd700 1 -- 172.21.15.17:0/1405444555 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5870011c40 con 0x55850e5adbc0 2023-10-05T15:43:06.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.019+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58780092d0 con 0x55850e5adbc0 2023-10-05T15:43:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f5866ffd700 1 -- 172.21.15.17:0/1405444555 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58700a1aa0 con 0x55850e5adbc0 2023-10-05T15:43:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 10 client.26411 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55850e3292b0 con 0x55850e5adbc0 2023-10-05T15:43:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f5866ffd700 1 -- 172.21.15.17:0/1405444555 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58780092d0 con 0x55850e5adbc0 2023-10-05T15:43:06.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f5866ffd700 1 -- 172.21.15.17:0/1405444555 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5870098c00 con 0x55850e5adbc0 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 10 client.26411 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 10 client.26411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 20 client.26411 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e618000 0x55850e61a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 4 client.26411 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.020+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55850e4f8b30 con 0x55850e618000 2023-10-05T15:43:06.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.021+0000 7f58877fe700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e618000 0x55850e61a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.022+0000 7f58877fe700 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e618000 0x55850e61a420 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db7d8f36b297fc88 server_cookie=78ee29f454520277 in_seq=0 out_seq=0 2023-10-05T15:43:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.022+0000 7f5866ffd700 10 client.26411 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.022+0000 7f5866ffd700 1 -- 172.21.15.17:0/1405444555 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55850e4f8b30 con 0x55850e618000 2023-10-05T15:43:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.022+0000 7f5866ffd700 10 client.26411 handle_command_reply: tid=0 2023-10-05T15:43:06.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.022+0000 7f58a1a03b80 1 client.26411 shutdown 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 msgr2=0x55850e5bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5bc8b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58700996a0 tx=0x7f5870099e10 comp rx=0 tx=0).stop 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 shutdown_connections 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55850e618000 0x55850e61a420 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55850e5aea60 0x55850e5bcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55850e5ad260 0x55850e5be2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 --2- 172.21.15.17:0/1405444555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55850e5adbc0 0x55850e5bc8b0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58700996a0 tx=0x7f5870099e10 comp rx=0 tx=0).stop 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f5866ffd700 0 client.26411 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:06.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.023+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 >> 172.21.15.17:0/1405444555 conn(0x55850e521260 msgr2=0x55850e5b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.024+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 shutdown_connections 2023-10-05T15:43:06.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.024+0000 7f58a1a03b80 1 -- 172.21.15.17:0/1405444555 wait complete. 2023-10-05T15:43:06.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.024+0000 7f58a1a03b80 20 client.26411 trim_cache size 0 max 16384 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:43:06.028 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:43:06.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:43:06.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:43:06.029 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:43:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58740a1510 msgr2=0x7f58740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58740a1510 0x7f58740a39d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5878009820 tx=0x7f58780099e0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888104270 msgr2=0x7f5888194f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888104270 0x7f5888194f80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f587000b730 comp rx=0 tx=0).stop 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 shutdown_connections 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58740a1510 0x7f58740a39d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5888106ba0 0x7f588819bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5888101940 0x7f5888194a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 --2- 172.21.15.17:0/1721059580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5888104270 0x7f5888194f80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.027+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 >> 172.21.15.17:0/1721059580 conn(0x7f58880fb330 msgr2=0x7f58881008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.028+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 shutdown_connections 2023-10-05T15:43:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:06.028+0000 7f588dfff700 1 -- 172.21.15.17:0/1721059580 wait complete. 2023-10-05T15:43:06.068 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:43:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:05 smithi167 ceph-mon[133366]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 789 op/s 2023-10-05T15:43:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:05 smithi079 ceph-mon[132936]: pgmap v564: 129 pgs: 129 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 789 op/s 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 -- 172.21.15.17:0/453151744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c1090c0 msgr2=0x7fd92c10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 --2- 172.21.15.17:0/453151744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c1090c0 0x7fd92c10f970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd92400b0d0 tx=0x7fd92400b3e0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 -- 172.21.15.17:0/453151744 shutdown_connections 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 --2- 172.21.15.17:0/453151744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c1090c0 0x7fd92c10f970 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 --2- 172.21.15.17:0/453151744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c107530 0x7fd92c107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 --2- 172.21.15.17:0/453151744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c108720 0x7fd92c108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.156+0000 7fd932dff700 1 -- 172.21.15.17:0/453151744 >> 172.21.15.17:0/453151744 conn(0x7fd92c0764b0 msgr2=0x7fd92c078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.157+0000 7fd932dff700 1 -- 172.21.15.17:0/453151744 shutdown_connections 2023-10-05T15:43:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.158+0000 7fd932dff700 1 -- 172.21.15.17:0/453151744 wait complete. 2023-10-05T15:43:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.159+0000 7fd932dff700 1 Processor -- start 2023-10-05T15:43:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.159+0000 7fd932dff700 1 -- start start 2023-10-05T15:43:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd932dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 0x7fd92c071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd932dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c108720 0x7fd92c072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd932dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c1090c0 0x7fd92c070550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd932dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c072ab0 con 0x7fd92c1090c0 2023-10-05T15:43:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd932dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c070a90 con 0x7fd92c107530 2023-10-05T15:43:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd930b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 0x7fd92c071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd932dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92c070c50 con 0x7fd92c108720 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd930b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 0x7fd92c071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40728/0 (socket says 172.21.15.17:40728) 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.160+0000 7fd930b9b700 1 -- 172.21.15.17:0/4235499166 learned_addr learned my addr 172.21.15.17:0/4235499166 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd92bfff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c108720 0x7fd92c072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd93139c700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c1090c0 0x7fd92c070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd930b9b700 1 -- 172.21.15.17:0/4235499166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c108720 msgr2=0x7fd92c072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd930b9b700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c108720 0x7fd92c072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd930b9b700 1 -- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c1090c0 msgr2=0x7fd92c070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd930b9b700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c1090c0 0x7fd92c070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd930b9b700 1 -- 172.21.15.17:0/4235499166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd924009d00 con 0x7fd92c107530 2023-10-05T15:43:06.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.161+0000 7fd93139c700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c1090c0 0x7fd92c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:43:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.162+0000 7fd930b9b700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 0x7fd92c071c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd92000c990 tx=0x7fd92000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.162+0000 7fd929ffb700 1 -- 172.21.15.17:0/4235499166 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920007b00 con 0x7fd92c107530 2023-10-05T15:43:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.162+0000 7fd929ffb700 1 -- 172.21.15.17:0/4235499166 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd920007c60 con 0x7fd92c107530 2023-10-05T15:43:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.162+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92c070f30 con 0x7fd92c107530 2023-10-05T15:43:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.162+0000 7fd929ffb700 1 -- 172.21.15.17:0/4235499166 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920018660 con 0x7fd92c107530 2023-10-05T15:43:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.163+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92c1ae3e0 con 0x7fd92c107530 2023-10-05T15:43:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.170+0000 7fd946647b80 1 Processor -- start 2023-10-05T15:43:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 -- start start 2023-10-05T15:43:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 0x5631baa272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa27fd0 0x5631baa28450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa2f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba98f400 con 0x5631baa28990 2023-10-05T15:43:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba980bc0 con 0x5631baa27fd0 2023-10-05T15:43:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.171+0000 7fd946647b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba97e4e0 con 0x5631baa26ec0 2023-10-05T15:43:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.172+0000 7fd93139c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 0x5631baa272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.172+0000 7fd93139c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 0x5631baa272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44920/0 (socket says 172.21.15.17:44920) 2023-10-05T15:43:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.172+0000 7fd93139c700 1 -- 172.21.15.17:0/3103989364 learned_addr learned my addr 172.21.15.17:0/3103989364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.172+0000 7fd92bfff700 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa2f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.173+0000 7fd93139c700 1 -- 172.21.15.17:0/3103989364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa27fd0 msgr2=0x5631baa28450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.173+0000 7fd93139c700 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa27fd0 0x5631baa28450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.173+0000 7fd93139c700 1 -- 172.21.15.17:0/3103989364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 msgr2=0x5631baa2f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.173+0000 7fd93139c700 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa2f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.173+0000 7fd93139c700 1 -- 172.21.15.17:0/3103989364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631ba7a4d80 con 0x5631baa26ec0 2023-10-05T15:43:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.174+0000 7fd93139c700 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 0x5631baa272e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd92400ce10 tx=0x7fd92400ce40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa77dfff1e48f8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.174+0000 7fd929ffb700 1 -- 172.21.15.17:0/4235499166 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd92000f450 con 0x7fd92c107530 2023-10-05T15:43:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.174+0000 7fd916ffd700 1 -- 172.21.15.17:0/3103989364 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92400e050 con 0x5631baa26ec0 2023-10-05T15:43:06.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.174+0000 7fd916ffd700 1 -- 172.21.15.17:0/3103989364 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd924007760 con 0x5631baa26ec0 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.174+0000 7fd916ffd700 1 -- 172.21.15.17:0/3103989364 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924005370 con 0x5631baa26ec0 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.175+0000 7fd946647b80 1 -- 172.21.15.17:0/3103989364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 msgr2=0x5631baa272e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.175+0000 7fd946647b80 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 0x5631baa272e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd92400ce10 tx=0x7fd92400ce40 comp rx=0 tx=0).stop 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.175+0000 7fd946647b80 1 -- 172.21.15.17:0/3103989364 shutdown_connections 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.175+0000 7fd946647b80 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa2f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.176+0000 7fd946647b80 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa26ec0 0x5631baa272e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.176+0000 7fd946647b80 1 --2- 172.21.15.17:0/3103989364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa27fd0 0x5631baa28450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.176+0000 7fd946647b80 1 -- 172.21.15.17:0/3103989364 >> 172.21.15.17:0/3103989364 conn(0x5631ba99b200 msgr2=0x5631baa21bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.176+0000 7fd946647b80 1 -- 172.21.15.17:0/3103989364 shutdown_connections 2023-10-05T15:43:06.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.177+0000 7fd929ffb700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd91c0a1560 0x7fd91c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.177+0000 7fd929ffb700 1 -- 172.21.15.17:0/4235499166 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9200ccfd0 con 0x7fd92c107530 2023-10-05T15:43:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.177+0000 7fd946647b80 1 -- 172.21.15.17:0/3103989364 wait complete. 2023-10-05T15:43:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.178+0000 7fd92bfff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd91c0a1560 0x7fd91c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.178+0000 7fd946647b80 1 -- start start 2023-10-05T15:43:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.178+0000 7fd946647b80 1 Processor -- start 2023-10-05T15:43:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd92bfff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd91c0a1560 0x7fd91c0a3a20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd92c071850 tx=0x7fd91800d500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa30c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa311c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa38200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba979dd0 con 0x5631baa28990 2023-10-05T15:43:06.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba9166b0 con 0x5631baa26ec0 2023-10-05T15:43:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba916350 con 0x5631baa27fd0 2023-10-05T15:43:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.179+0000 7fd946647b80 10 client.0 _ll_register_callbacks cb 0x5631ba7737a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa311c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44928/0 (socket says 172.21.15.17:44928) 2023-10-05T15:43:06.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 -- 172.21.15.17:0/827835877 learned_addr learned my addr 172.21.15.17:0/827835877 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 -- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 msgr2=0x5631baa30c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa30c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 -- 172.21.15.17:0/827835877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 msgr2=0x5631baa38200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa38200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 -- 172.21.15.17:0/827835877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92c1102c0 con 0x5631baa27fd0 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.180+0000 7fd92bfff700 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa311c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd918003bf0 tx=0x7fd918004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6ea00cc7e241cf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.181+0000 7fd90bfff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:43:06.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.181+0000 7fd90bfff700 1 -- 172.21.15.17:0/827835877 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918012e60 con 0x5631baa27fd0 2023-10-05T15:43:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.181+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631baa19d50 con 0x5631baa27fd0 2023-10-05T15:43:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.181+0000 7fd90bfff700 1 -- 172.21.15.17:0/827835877 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd91801b460 con 0x5631baa27fd0 2023-10-05T15:43:06.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.181+0000 7fd90bfff700 1 -- 172.21.15.17:0/827835877 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd91801b620 con 0x5631baa27fd0 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 10 client.26380 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5631ba78dc00 con 0x5631baa27fd0 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd90bfff700 1 -- 172.21.15.17:0/827835877 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5631baa19d50 con 0x5631baa27fd0 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd90bfff700 1 -- 172.21.15.17:0/827835877 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd918026810 con 0x5631baa27fd0 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 10 client.26380 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 10 client.26380 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 20 client.26380 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa3cb80 0x5631baa3efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 4 client.26380 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.182+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631ba972db0 con 0x5631baa3cb80 2023-10-05T15:43:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.183+0000 7fd930b9b700 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa3cb80 0x5631baa3efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.183+0000 7fd930b9b700 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa3cb80 0x5631baa3efc0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4423fdf81d5e9e2e server_cookie=8104ada1b0362511 in_seq=0 out_seq=0 2023-10-05T15:43:06.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.184+0000 7fd90bfff700 10 client.26380 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.184+0000 7fd90bfff700 1 -- 172.21.15.17:0/827835877 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5631ba972db0 con 0x5631baa3cb80 2023-10-05T15:43:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.184+0000 7fd90bfff700 10 client.26380 handle_command_reply: tid=0 2023-10-05T15:43:06.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.185+0000 7fd946647b80 1 client.26380 shutdown 2023-10-05T15:43:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 msgr2=0x5631baa311c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa311c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd918003bf0 tx=0x7fd918004750 comp rx=0 tx=0).stop 2023-10-05T15:43:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 shutdown_connections 2023-10-05T15:43:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa3cb80 0x5631baa3efc0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa28990 0x5631baa38200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa30c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 --2- 172.21.15.17:0/827835877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa311c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 >> 172.21.15.17:0/827835877 conn(0x5631ba99b200 msgr2=0x5631baa21250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.186+0000 7fd90bfff700 0 client.26380 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.187+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 shutdown_connections 2023-10-05T15:43:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.187+0000 7fd946647b80 1 -- 172.21.15.17:0/827835877 wait complete. 2023-10-05T15:43:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.187+0000 7fd946647b80 20 client.26380 trim_cache size 0 max 16384 2023-10-05T15:43:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.216+0000 7fd946647b80 1 Processor -- start 2023-10-05T15:43:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 -- start start 2023-10-05T15:43:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa26ec0 0x5631baa2f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa28990 0x5631baa2ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ba7fa8c0 con 0x5631baa26ec0 2023-10-05T15:43:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631baa30150 con 0x5631baa28990 2023-10-05T15:43:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd946647b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631baa232f0 con 0x5631baa27fd0 2023-10-05T15:43:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd92bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd92bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44938/0 (socket says 172.21.15.17:44938) 2023-10-05T15:43:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd92bfff700 1 -- 172.21.15.17:0/4063678904 learned_addr learned my addr 172.21.15.17:0/4063678904 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.217+0000 7fd93139c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa28990 0x5631baa2ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.218+0000 7fd930b9b700 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa26ec0 0x5631baa2f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.218+0000 7fd92bfff700 1 -- 172.21.15.17:0/4063678904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa28990 msgr2=0x5631baa2ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.218+0000 7fd92bfff700 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa28990 0x5631baa2ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.218+0000 7fd92bfff700 1 -- 172.21.15.17:0/4063678904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa26ec0 msgr2=0x5631baa2f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.219+0000 7fd92bfff700 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa26ec0 0x5631baa2f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.219+0000 7fd92bfff700 1 -- 172.21.15.17:0/4063678904 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631ba7cb1f0 con 0x5631baa27fd0 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.219+0000 7fd930b9b700 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa26ec0 0x5631baa2f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.219+0000 7fd92bfff700 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa381c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd918026c40 tx=0x7fd91801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f04037f24f350c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.220+0000 7fd9177fe700 1 -- 172.21.15.17:0/4063678904 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918026640 con 0x5631baa27fd0 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.220+0000 7fd9177fe700 1 -- 172.21.15.17:0/4063678904 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9180127e0 con 0x5631baa27fd0 2023-10-05T15:43:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.220+0000 7fd9177fe700 1 -- 172.21.15.17:0/4063678904 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918004a20 con 0x5631baa27fd0 2023-10-05T15:43:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 -- 172.21.15.17:0/4063678904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 msgr2=0x5631baa381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa381c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd918026c40 tx=0x7fd91801c3f0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 -- 172.21.15.17:0/4063678904 shutdown_connections 2023-10-05T15:43:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa28990 0x5631baa2ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa26ec0 0x5631baa2f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 --2- 172.21.15.17:0/4063678904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa27fd0 0x5631baa381c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 -- 172.21.15.17:0/4063678904 >> 172.21.15.17:0/4063678904 conn(0x5631ba99b200 msgr2=0x5631baa228b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 -- 172.21.15.17:0/4063678904 shutdown_connections 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.221+0000 7fd946647b80 1 -- 172.21.15.17:0/4063678904 wait complete. 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.222+0000 7fd946647b80 1 -- start start 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.222+0000 7fd946647b80 1 Processor -- start 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa35c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa27fd0 0x5631baa361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa28990 0x5631baa371c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631baa37700 con 0x5631baa27fd0 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631baa37870 con 0x5631baa26ec0 2023-10-05T15:43:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631baa37a30 con 0x5631baa28990 2023-10-05T15:43:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd946647b80 10 client.0 _ll_register_callbacks cb 0x7fd9180037c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.223+0000 7fd93139c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa28990 0x5631baa371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd93139c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa28990 0x5631baa371c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44950/0 (socket says 172.21.15.17:44950) 2023-10-05T15:43:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd93139c700 1 -- 172.21.15.17:0/997279264 learned_addr learned my addr 172.21.15.17:0/997279264 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd930b9b700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa35c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd92bfff700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa27fd0 0x5631baa361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd930b9b700 1 -- 172.21.15.17:0/997279264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa28990 msgr2=0x5631baa371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd930b9b700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa28990 0x5631baa371c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd930b9b700 1 -- 172.21.15.17:0/997279264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa27fd0 msgr2=0x5631baa361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd930b9b700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa27fd0 0x5631baa361b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.224+0000 7fd930b9b700 1 -- 172.21.15.17:0/997279264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92c1ae3e0 con 0x5631baa26ec0 2023-10-05T15:43:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.225+0000 7fd930b9b700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa35c70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd920099e80 tx=0x7fd92000fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbfbd30ad3cd03e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.225+0000 7fd90bfff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.226+0000 7fd90bfff700 1 -- 172.21.15.17:0/997279264 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92009e040 con 0x5631baa26ec0 2023-10-05T15:43:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.226+0000 7fd90bfff700 1 -- 172.21.15.17:0/997279264 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9200a2280 con 0x5631baa26ec0 2023-10-05T15:43:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.229+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd924007760 con 0x5631baa26ec0 2023-10-05T15:43:06.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.229+0000 7fd90bfff700 1 -- 172.21.15.17:0/997279264 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9200b80c0 con 0x5631baa26ec0 2023-10-05T15:43:06.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.229+0000 7fd946647b80 10 client.26423 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:06.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.229+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5631ba78dc00 con 0x5631baa26ec0 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.230+0000 7fd90bfff700 1 -- 172.21.15.17:0/997279264 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9200a7070 con 0x5631baa26ec0 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.230+0000 7fd90bfff700 1 -- 172.21.15.17:0/997279264 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd92009a150 con 0x5631baa26ec0 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.230+0000 7fd946647b80 10 client.26423 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.230+0000 7fd946647b80 10 client.26423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.230+0000 7fd946647b80 20 client.26423 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.230+0000 7fd946647b80 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa916a0 0x5631baa93b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:06.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.231+0000 7fd946647b80 4 client.26423 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:43:06.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.231+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5631ba972ad0 con 0x5631baa916a0 2023-10-05T15:43:06.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.231+0000 7fd92bfff700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa916a0 0x5631baa93b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.233+0000 7fd92bfff700 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa916a0 0x5631baa93b60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a04b5066e05f04 server_cookie=6411b1ff7b34e13f in_seq=0 out_seq=0 2023-10-05T15:43:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.234+0000 7fd90bfff700 10 client.26423 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.246+0000 7fd90bfff700 1 -- 172.21.15.17:0/997279264 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5631ba972ad0 con 0x5631baa916a0 2023-10-05T15:43:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.246+0000 7fd90bfff700 10 client.26423 handle_command_reply: tid=0 2023-10-05T15:43:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.246+0000 7fd946647b80 1 client.26423 shutdown 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 msgr2=0x5631baa35c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa35c70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd920099e80 tx=0x7fd92000fb40 comp rx=0 tx=0).stop 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 shutdown_connections 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5631baa916a0 0x5631baa93b60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631baa28990 0x5631baa371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631baa26ec0 0x5631baa35c70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 --2- 172.21.15.17:0/997279264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631baa27fd0 0x5631baa361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 >> 172.21.15.17:0/997279264 conn(0x5631ba99b200 msgr2=0x5631baa2f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd90bfff700 0 client.26423 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 shutdown_connections 2023-10-05T15:43:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.247+0000 7fd946647b80 1 -- 172.21.15.17:0/997279264 wait complete. 2023-10-05T15:43:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.249+0000 7fd946647b80 20 client.26423 trim_cache size 0 max 16384 2023-10-05T15:43:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:43:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:43:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:43:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:43:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.251+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd91c0a1560 msgr2=0x7fd91c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.251+0000 7fd932dff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd91c0a1560 0x7fd91c0a3a20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd92c071850 tx=0x7fd91800d500 comp rx=0 tx=0).stop 2023-10-05T15:43:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.251+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 msgr2=0x7fd92c071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.251+0000 7fd932dff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 0x7fd92c071c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd92000c990 tx=0x7fd92000cd50 comp rx=0 tx=0).stop 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 shutdown_connections 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd91c0a1560 0x7fd91c0a3a20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd92c1090c0 0x7fd92c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd92c107530 0x7fd92c071c10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 --2- 172.21.15.17:0/4235499166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd92c108720 0x7fd92c072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 >> 172.21.15.17:0/4235499166 conn(0x7fd92c0764b0 msgr2=0x7fd92c10bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 shutdown_connections 2023-10-05T15:43:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:06.252+0000 7fd932dff700 1 -- 172.21.15.17:0/4235499166 wait complete. 2023-10-05T15:43:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:43:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:43:07.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:43:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:43:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:43:07.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:43:07.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:43:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:43:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:43:07.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:43:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:07 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-10-05T15:43:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:07 smithi167 ceph-mon[133366]: Unable to set osd_memory_target on smithi017 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-05T15:43:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:07 smithi167 ceph-mon[133366]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.9 MiB/s wr, 664 op/s 2023-10-05T15:43:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:07 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-10-05T15:43:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:07 smithi079 ceph-mon[132936]: Unable to set osd_memory_target on smithi017 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-05T15:43:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:07 smithi079 ceph-mon[132936]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.9 MiB/s wr, 664 op/s 2023-10-05T15:43:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 270.0 s, 582.2 tps, lat 172.296 ms stddev 61.765 2023-10-05T15:43:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:07 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-10-05T15:43:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:07 smithi017 ceph-mon[129107]: Unable to set osd_memory_target on smithi017 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-05T15:43:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:07 smithi017 ceph-mon[129107]: pgmap v565: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.9 MiB/s wr, 664 op/s 2023-10-05T15:43:10.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:09 smithi167 ceph-mon[133366]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 686 op/s 2023-10-05T15:43:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:09 smithi079 ceph-mon[132936]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 686 op/s 2023-10-05T15:43:10.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:09 smithi017 ceph-mon[129107]: pgmap v566: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 686 op/s 2023-10-05T15:43:12.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:11 smithi167 ceph-mon[133366]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.1 MiB/s wr, 718 op/s 2023-10-05T15:43:12.122 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:11 smithi079 ceph-mon[132936]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.1 MiB/s wr, 718 op/s 2023-10-05T15:43:12.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:11 smithi017 ceph-mon[129107]: pgmap v567: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.1 MiB/s wr, 718 op/s 2023-10-05T15:43:13.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 275.0 s, 567.9 tps, lat 175.453 ms stddev 65.882 2023-10-05T15:43:14.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:13 smithi167 ceph-mon[133366]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2023-10-05T15:43:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:13 smithi079 ceph-mon[132936]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2023-10-05T15:43:14.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:13 smithi017 ceph-mon[129107]: pgmap v568: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2023-10-05T15:43:16.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:15 smithi079 ceph-mon[132936]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 781 op/s 2023-10-05T15:43:16.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:15 smithi017 ceph-mon[129107]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 781 op/s 2023-10-05T15:43:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:15 smithi167 ceph-mon[133366]: pgmap v569: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 781 op/s 2023-10-05T15:43:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:17 smithi079 ceph-mon[132936]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 622 op/s 2023-10-05T15:43:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 280.0 s, 573.5 tps, lat 174.305 ms stddev 86.002 2023-10-05T15:43:18.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:17 smithi017 ceph-mon[129107]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 622 op/s 2023-10-05T15:43:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:17 smithi167 ceph-mon[133366]: pgmap v570: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 622 op/s 2023-10-05T15:43:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.496+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/740744248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f8100880 msgr2=0x7ff2f8101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.496+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/740744248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f8100880 0x7ff2f8101100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80098f0 tx=0x7ff2e8009c00 comp rx=0 tx=0).stop 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/740744248 shutdown_connections 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/740744248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f8100880 0x7ff2f8101100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/740744248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f80fee50 0x7ff2f80ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/740744248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f8100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/740744248 >> 172.21.15.17:0/740744248 conn(0x7ff2f80fa690 msgr2=0x7ff2f80fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/740744248 shutdown_connections 2023-10-05T15:43:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.497+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/740744248 wait complete. 2023-10-05T15:43:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 Processor -- start 2023-10-05T15:43:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 -- start start 2023-10-05T15:43:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f80fee50 0x7ff2f806f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f8100880 0x7ff2f8070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80712e0 con 0x7ff2f80ffec0 2023-10-05T15:43:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8071450 con 0x7ff2f8100880 2023-10-05T15:43:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.499+0000 7ff2ff3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8071610 con 0x7ff2f80fee50 2023-10-05T15:43:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.500+0000 7ff2fd19b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f80fee50 0x7ff2f806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.500+0000 7ff2fc99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.500+0000 7ff2fc99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f806fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43106/0 (socket says 172.21.15.17:43106) 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.500+0000 7ff2fc99a700 1 -- 172.21.15.17:0/1423667746 learned_addr learned my addr 172.21.15.17:0/1423667746 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.500+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f8100880 0x7ff2f8070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fd19b700 1 -- 172.21.15.17:0/1423667746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f8100880 msgr2=0x7ff2f8070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f8100880 0x7ff2f8070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fd19b700 1 -- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 msgr2=0x7ff2f806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fd19b700 1 -- 172.21.15.17:0/1423667746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8009520 con 0x7ff2f80fee50 2023-10-05T15:43:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.501+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f80fee50 0x7ff2f806f870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ef10 tx=0x7ff2f000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.502+0000 7ff2ee7fc700 1 -- 172.21.15.17:0/1423667746 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000c9c0 con 0x7ff2f80fee50 2023-10-05T15:43:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.502+0000 7ff2ee7fc700 1 -- 172.21.15.17:0/1423667746 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2f000f040 con 0x7ff2f80fee50 2023-10-05T15:43:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.502+0000 7ff2ee7fc700 1 -- 172.21.15.17:0/1423667746 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0014480 con 0x7ff2f80fee50 2023-10-05T15:43:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.502+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f8071890 con 0x7ff2f80fee50 2023-10-05T15:43:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.503+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f80720a0 con 0x7ff2f80fee50 2023-10-05T15:43:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.509+0000 7ff312c8db80 1 Processor -- start 2023-10-05T15:43:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.509+0000 7ff312c8db80 1 -- start start 2023-10-05T15:43:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e11af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e127e0 0x555d89e12c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e131a0 0x555d89e19a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff312c8db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89d71400 con 0x555d89e131a0 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff312c8db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89d62bc0 con 0x555d89e127e0 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff312c8db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89d604e0 con 0x555d89e116d0 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff2fd99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e11af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff2fd99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e11af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57852/0 (socket says 172.21.15.17:57852) 2023-10-05T15:43:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.510+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1917131780 learned_addr learned my addr 172.21.15.17:0/1917131780 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e131a0 0x555d89e19a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1917131780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e127e0 msgr2=0x555d89e12c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e127e0 0x555d89e12c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1917131780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e131a0 msgr2=0x555d89e19a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e131a0 0x555d89e19a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1917131780 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d89b86d80 con 0x555d89e116d0 2023-10-05T15:43:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e11af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009230 tx=0x7ff2e8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb21ed94546fafb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.511+0000 7ff2ee7fc700 1 -- 172.21.15.17:0/1423667746 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff2f000cb20 con 0x7ff2f80fee50 2023-10-05T15:43:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.512+0000 7ff2df7fe700 1 -- 172.21.15.17:0/1917131780 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800fe60 con 0x555d89e116d0 2023-10-05T15:43:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.512+0000 7ff2df7fe700 1 -- 172.21.15.17:0/1917131780 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2e801d040 con 0x555d89e116d0 2023-10-05T15:43:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.512+0000 7ff2df7fe700 1 -- 172.21.15.17:0/1917131780 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80052a0 con 0x555d89e116d0 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 -- 172.21.15.17:0/1917131780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 msgr2=0x555d89e11af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e11af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009230 tx=0x7ff2e8005dc0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 -- 172.21.15.17:0/1917131780 shutdown_connections 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e131a0 0x555d89e19a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e11af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1917131780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e127e0 0x555d89e12c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 -- 172.21.15.17:0/1917131780 >> 172.21.15.17:0/1917131780 conn(0x555d89d7d200 msgr2=0x555d89e03bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 -- 172.21.15.17:0/1917131780 shutdown_connections 2023-10-05T15:43:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.513+0000 7ff312c8db80 1 -- 172.21.15.17:0/1917131780 wait complete. 2023-10-05T15:43:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.514+0000 7ff312c8db80 1 -- start start 2023-10-05T15:43:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.514+0000 7ff312c8db80 1 Processor -- start 2023-10-05T15:43:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff2ee7fc700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2e00a1560 0x7ff2e00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff2ee7fc700 1 -- 172.21.15.17:0/1423667746 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff2f00ccc70 con 0x7ff2f80fee50 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e1b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e127e0 0x555d89e1b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e22930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89d5bdd0 con 0x555d89e127e0 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89cf86b0 con 0x555d89e131a0 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89cf8350 con 0x555d89e116d0 2023-10-05T15:43:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff312c8db80 10 client.0 _ll_register_callbacks cb 0x555d89b557a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.515+0000 7ff2fc99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e127e0 0x555d89e1b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fc99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e127e0 0x555d89e1b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43120/0 (socket says 172.21.15.17:43120) 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fc99a700 1 -- 172.21.15.17:0/1682780279 learned_addr learned my addr 172.21.15.17:0/1682780279 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e1b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2e00a1560 0x7ff2e00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1682780279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 msgr2=0x555d89e1b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e1b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1682780279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e127e0 msgr2=0x555d89e1b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e127e0 0x555d89e1b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.516+0000 7ff2fd99c700 1 -- 172.21.15.17:0/1682780279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f8101b30 con 0x555d89e131a0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.517+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2e00a1560 0x7ff2e00a3a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009fd0 tx=0x7ff2e8018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.517+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e22930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8005a80 tx=0x7ff2e80052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d4a78f633a5724 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.517+0000 7ff2dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.518+0000 7ff2dcff9700 1 -- 172.21.15.17:0/1682780279 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8034070 con 0x555d89e131a0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.518+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d89dfbd50 con 0x555d89e131a0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.518+0000 7ff2dcff9700 1 -- 172.21.15.17:0/1682780279 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff2e8003680 con 0x555d89e131a0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.518+0000 7ff2dcff9700 1 -- 172.21.15.17:0/1682780279 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e8003840 con 0x555d89e131a0 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.518+0000 7ff312c8db80 10 client.26432 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.518+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555d89b6fc00 con 0x555d89e131a0 2023-10-05T15:43:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff2dcff9700 1 -- 172.21.15.17:0/1682780279 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555d89dfbd50 con 0x555d89e131a0 2023-10-05T15:43:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff2dcff9700 1 -- 172.21.15.17:0/1682780279 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff2e8028030 con 0x555d89e131a0 2023-10-05T15:43:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff312c8db80 10 client.26432 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff312c8db80 10 client.26432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff312c8db80 20 client.26432 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e26e50 0x555d89e29270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff312c8db80 4 client.26432 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d89d54db0 con 0x555d89e26e50 2023-10-05T15:43:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.519+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e26e50 0x555d89e29270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.520+0000 7ff2dcff9700 10 client.26432 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.520+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e26e50 0x555d89e29270 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123c9e4eca888432 server_cookie=c1a4199bf28d5090 in_seq=0 out_seq=0 2023-10-05T15:43:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff2dcff9700 1 -- 172.21.15.17:0/1682780279 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d89d54db0 con 0x555d89e26e50 2023-10-05T15:43:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff2dcff9700 10 client.26432 handle_command_reply: tid=0 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 client.26432 shutdown 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 msgr2=0x555d89e22930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e22930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8005a80 tx=0x7ff2e80052f0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 shutdown_connections 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e26e50 0x555d89e29270 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e22930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff2dcff9700 0 client.26432 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e116d0 0x555d89e1b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 --2- 172.21.15.17:0/1682780279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e127e0 0x555d89e1b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.521+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 >> 172.21.15.17:0/1682780279 conn(0x555d89d7d200 msgr2=0x555d89e03250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.522+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 shutdown_connections 2023-10-05T15:43:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.522+0000 7ff312c8db80 1 -- 172.21.15.17:0/1682780279 wait complete. 2023-10-05T15:43:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.522+0000 7ff312c8db80 20 client.26432 trim_cache size 0 max 16384 2023-10-05T15:43:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 Processor -- start 2023-10-05T15:43:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 -- start start 2023-10-05T15:43:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e1a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e228f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e03250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89bdc8c0 con 0x555d89e116d0 2023-10-05T15:43:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89e1af20 con 0x555d89e131a0 2023-10-05T15:43:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.549+0000 7ff312c8db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89e00860 con 0x555d89e127e0 2023-10-05T15:43:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57864/0 (socket says 172.21.15.17:57864) 2023-10-05T15:43:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 -- 172.21.15.17:0/3924057758 learned_addr learned my addr 172.21.15.17:0/3924057758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e1a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fd99c700 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e03250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 -- 172.21.15.17:0/3924057758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 msgr2=0x555d89e03250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e03250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 -- 172.21.15.17:0/3924057758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 msgr2=0x555d89e1a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e1a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.550+0000 7ff2fc99a700 1 -- 172.21.15.17:0/3924057758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d89bad1f0 con 0x555d89e127e0 2023-10-05T15:43:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.551+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e228f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40127a0 tx=0x7ff2f4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d87bfbd485b7f779 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.551+0000 7ff2dffff700 1 -- 172.21.15.17:0/3924057758 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4017070 con 0x555d89e127e0 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.551+0000 7ff2dffff700 1 -- 172.21.15.17:0/3924057758 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2f4018040 con 0x555d89e127e0 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.551+0000 7ff2dffff700 1 -- 172.21.15.17:0/3924057758 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4003d70 con 0x555d89e127e0 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 -- 172.21.15.17:0/3924057758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 msgr2=0x555d89e228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e228f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40127a0 tx=0x7ff2f4009260 comp rx=0 tx=0).stop 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 -- 172.21.15.17:0/3924057758 shutdown_connections 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e03250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e1a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 --2- 172.21.15.17:0/3924057758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e228f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 -- 172.21.15.17:0/3924057758 >> 172.21.15.17:0/3924057758 conn(0x555d89d7d200 msgr2=0x555d89e03b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.552+0000 7ff312c8db80 1 -- 172.21.15.17:0/3924057758 shutdown_connections 2023-10-05T15:43:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.553+0000 7ff312c8db80 1 -- 172.21.15.17:0/3924057758 wait complete. 2023-10-05T15:43:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.553+0000 7ff312c8db80 1 -- start start 2023-10-05T15:43:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.553+0000 7ff312c8db80 1 Processor -- start 2023-10-05T15:43:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e20650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e20b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e21ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89e220e0 con 0x555d89e116d0 2023-10-05T15:43:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89e22250 con 0x555d89e131a0 2023-10-05T15:43:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89e22410 con 0x555d89e127e0 2023-10-05T15:43:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.554+0000 7ff312c8db80 10 client.0 _ll_register_callbacks cb 0x7ff2e8009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.555+0000 7ff2fd99c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e21ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.555+0000 7ff2fd99c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e21ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:47184/0 (socket says 172.21.15.17:47184) 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.555+0000 7ff2fd99c700 1 -- 172.21.15.17:0/2649675235 learned_addr learned my addr 172.21.15.17:0/2649675235 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.555+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e20650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2fd19b700 1 -- 172.21.15.17:0/2649675235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 msgr2=0x555d89e20b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e20b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2fd19b700 1 -- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 msgr2=0x555d89e21ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e21ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2fd19b700 1 -- 172.21.15.17:0/2649675235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f4012450 con 0x555d89e116d0 2023-10-05T15:43:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2fd19b700 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e20650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0099920 tx=0x7ff2f000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7b43c02f5037bc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.556+0000 7ff2dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:43:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.557+0000 7ff2dcff9700 1 -- 172.21.15.17:0/2649675235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f009a320 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.557+0000 7ff2dcff9700 1 -- 172.21.15.17:0/2649675235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff2f0099c20 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.557+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2e801d040 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.557+0000 7ff2dcff9700 1 -- 172.21.15.17:0/2649675235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2f009dd70 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.557+0000 7ff312c8db80 10 client.16542 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.557+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555d89b85250 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff2dcff9700 1 -- 172.21.15.17:0/2649675235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2e801d040 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff2dcff9700 1 -- 172.21.15.17:0/2649675235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff2f0099110 con 0x555d89e116d0 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff312c8db80 10 client.16542 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff312c8db80 10 client.16542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff312c8db80 20 client.16542 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff312c8db80 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e7bb70 0x555d89e7df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff312c8db80 4 client.16542 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:43:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.558+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555d89d54ad0 con 0x555d89e7bb70 2023-10-05T15:43:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.559+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e7bb70 0x555d89e7df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.560+0000 7ff2fc99a700 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e7bb70 0x555d89e7df90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a5cbfd4f4fbcc0a server_cookie=395e005daf5cf351 in_seq=0 out_seq=0 2023-10-05T15:43:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.560+0000 7ff2dcff9700 10 client.16542 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.580+0000 7ff2dcff9700 1 -- 172.21.15.17:0/2649675235 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555d89d54ad0 con 0x555d89e7bb70 2023-10-05T15:43:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.580+0000 7ff2dcff9700 10 client.16542 handle_command_reply: tid=0 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 client.16542 shutdown 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 msgr2=0x555d89e20650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e20650 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0099920 tx=0x7ff2f000c040 comp rx=0 tx=0).stop 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 shutdown_connections 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555d89e7bb70 0x555d89e7df90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555d89e131a0 0x555d89e21ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff2dcff9700 0 client.16542 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555d89e116d0 0x555d89e20650 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0099920 tx=0x7ff2f000c040 comp rx=0 tx=0).stop 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 --2- 172.21.15.17:0/2649675235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555d89e127e0 0x555d89e20b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.581+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 >> 172.21.15.17:0/2649675235 conn(0x555d89d7d200 msgr2=0x555d89e16130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.582+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 shutdown_connections 2023-10-05T15:43:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.583+0000 7ff312c8db80 1 -- 172.21.15.17:0/2649675235 wait complete. 2023-10-05T15:43:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.583+0000 7ff312c8db80 20 client.16542 trim_cache size 0 max 16384 2023-10-05T15:43:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:43:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:43:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:43:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2e00a1560 msgr2=0x7ff2e00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2e00a1560 0x7ff2e00a3a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009fd0 tx=0x7ff2e8018000 comp rx=0 tx=0).stop 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f80fee50 msgr2=0x7ff2f806f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f80fee50 0x7ff2f806f870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000ef10 tx=0x7ff2f000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 shutdown_connections 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff2e00a1560 0x7ff2e00a3a20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f8100880 0x7ff2f8070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2f80fee50 0x7ff2f806f870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 --2- 172.21.15.17:0/1423667746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2f80ffec0 0x7ff2f806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.584+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 >> 172.21.15.17:0/1423667746 conn(0x7ff2f80fa690 msgr2=0x7ff2f80fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.585+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 shutdown_connections 2023-10-05T15:43:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:19.585+0000 7ff2ff3ff700 1 -- 172.21.15.17:0/1423667746 wait complete. 2023-10-05T15:43:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:19 smithi079 ceph-mon[132936]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 688 op/s 2023-10-05T15:43:20.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:19 smithi017 ceph-mon[129107]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 688 op/s 2023-10-05T15:43:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:19 smithi167 ceph-mon[133366]: pgmap v571: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 688 op/s 2023-10-05T15:43:21.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:20 smithi017 ceph-mon[129107]: pgmap v572: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 762 op/s 2023-10-05T15:43:21.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:20 smithi167 ceph-mon[133366]: pgmap v572: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 762 op/s 2023-10-05T15:43:21.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:20 smithi079 ceph-mon[132936]: pgmap v572: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.6 MiB/s wr, 762 op/s 2023-10-05T15:43:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 285.0 s, 678.6 tps, lat 146.438 ms stddev 42.303 2023-10-05T15:43:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:23 smithi167 ceph-mon[133366]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 633 op/s 2023-10-05T15:43:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:23 smithi079 ceph-mon[132936]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 633 op/s 2023-10-05T15:43:24.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:23 smithi017 ceph-mon[129107]: pgmap v573: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.6 MiB/s wr, 633 op/s 2023-10-05T15:43:26.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:25 smithi167 ceph-mon[133366]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 863 op/s 2023-10-05T15:43:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:25 smithi079 ceph-mon[132936]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 863 op/s 2023-10-05T15:43:26.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:25 smithi017 ceph-mon[129107]: pgmap v574: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 863 op/s 2023-10-05T15:43:28.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:27 smithi079 ceph-mon[132936]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 683 op/s 2023-10-05T15:43:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 290.0 s, 582.8 tps, lat 172.373 ms stddev 51.070 2023-10-05T15:43:28.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:27 smithi017 ceph-mon[129107]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 683 op/s 2023-10-05T15:43:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:27 smithi167 ceph-mon[133366]: pgmap v575: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 683 op/s 2023-10-05T15:43:30.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:29 smithi017 ceph-mon[129107]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 751 op/s 2023-10-05T15:43:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:29 smithi167 ceph-mon[133366]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 751 op/s 2023-10-05T15:43:30.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:29 smithi079 ceph-mon[132936]: pgmap v576: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 11 MiB/s wr, 751 op/s 2023-10-05T15:43:31.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:30 smithi017 ceph-mon[129107]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-10-05T15:43:31.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:30 smithi167 ceph-mon[133366]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-10-05T15:43:31.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:30 smithi079 ceph-mon[132936]: pgmap v577: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-10-05T15:43:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 -- 172.21.15.17:0/2820448345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534101a10 msgr2=0x7f8534103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 --2- 172.21.15.17:0/2820448345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534101a10 0x7f8534103e00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f853000b0a0 tx=0x7f853000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 -- 172.21.15.17:0/2820448345 shutdown_connections 2023-10-05T15:43:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 --2- 172.21.15.17:0/2820448345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534106c70 0x7f8534109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 --2- 172.21.15.17:0/2820448345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534101a10 0x7f8534103e00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 --2- 172.21.15.17:0/2820448345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 0x7f8534106730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.837+0000 7f853b9ff700 1 -- 172.21.15.17:0/2820448345 >> 172.21.15.17:0/2820448345 conn(0x7f85340fb340 msgr2=0x7f85340fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.838+0000 7f853b9ff700 1 -- 172.21.15.17:0/2820448345 shutdown_connections 2023-10-05T15:43:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.838+0000 7f853b9ff700 1 -- 172.21.15.17:0/2820448345 wait complete. 2023-10-05T15:43:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.839+0000 7f853b9ff700 1 Processor -- start 2023-10-05T15:43:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 -- start start 2023-10-05T15:43:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 0x7f8534194b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 0x7f8534195070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534106c70 0x7f8534195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85341965a0 con 0x7f8534104340 2023-10-05T15:43:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534196710 con 0x7f8534106c70 2023-10-05T15:43:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853b9ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85341968d0 con 0x7f8534101a10 2023-10-05T15:43:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853979b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 0x7f8534194b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.840+0000 7f853979b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 0x7f8534194b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38972/0 (socket says 172.21.15.17:38972) 2023-10-05T15:43:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f853979b700 1 -- 172.21.15.17:0/4036622275 learned_addr learned my addr 172.21.15.17:0/4036622275 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f8538f9a700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 0x7f8534195070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f853979b700 1 -- 172.21.15.17:0/4036622275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534106c70 msgr2=0x7f8534195f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f853979b700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534106c70 0x7f8534195f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f853979b700 1 -- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 msgr2=0x7f8534195070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f853979b700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 0x7f8534195070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f853979b700 1 -- 172.21.15.17:0/4036622275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530009d00 con 0x7f8534101a10 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.841+0000 7f8538f9a700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 0x7f8534195070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.842+0000 7f853979b700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 0x7f8534194b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f853000b070 tx=0x7f853000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.842+0000 7f852a7fc700 1 -- 172.21.15.17:0/4036622275 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000e040 con 0x7f8534101a10 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.842+0000 7f852a7fc700 1 -- 172.21.15.17:0/4036622275 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853001d910 con 0x7f8534101a10 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.842+0000 7f852a7fc700 1 -- 172.21.15.17:0/4036622275 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530005390 con 0x7f8534101a10 2023-10-05T15:43:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.842+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8534196b50 con 0x7f8534101a10 2023-10-05T15:43:32.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.842+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85341973e0 con 0x7f8534101a10 2023-10-05T15:43:32.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.847+0000 7f852a7fc700 1 -- 172.21.15.17:0/4036622275 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f853001d480 con 0x7f8534101a10 2023-10-05T15:43:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.849+0000 7f852a7fc700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85200a15b0 0x7f85200a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.849+0000 7f852a7fc700 1 -- 172.21.15.17:0/4036622275 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f85300ce3b0 con 0x7f8534101a10 2023-10-05T15:43:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.850+0000 7f8538f9a700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85200a15b0 0x7f85200a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.851+0000 7f854f3aab80 1 Processor -- start 2023-10-05T15:43:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.851+0000 7f854f3aab80 1 -- start start 2023-10-05T15:43:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 0x55684c9692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c969fd0 0x55684c96a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c971220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f854f3aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c8d1400 con 0x55684c969fd0 2023-10-05T15:43:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f854f3aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c8c2bc0 con 0x55684c968ec0 2023-10-05T15:43:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f854f3aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c8c04e0 con 0x55684c96a990 2023-10-05T15:43:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.852+0000 7f853979b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 0x55684c9692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 0x55684c9692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45030/0 (socket says 172.21.15.17:45030) 2023-10-05T15:43:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 -- 172.21.15.17:0/1713828207 learned_addr learned my addr 172.21.15.17:0/1713828207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f8539f9c700 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c971220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f8538f9a700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85200a15b0 0x7f85200a3a70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8534195b80 tx=0x7f8524008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f8538f9a700 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c969fd0 0x55684c96a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 -- 172.21.15.17:0/1713828207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 msgr2=0x55684c971220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c971220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 -- 172.21.15.17:0/1713828207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c969fd0 msgr2=0x55684c96a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c969fd0 0x55684c96a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 -- 172.21.15.17:0/1713828207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55684c6e6d80 con 0x55684c968ec0 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.853+0000 7f853979b700 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 0x55684c9692e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f85300a3130 tx=0x7f85300095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9947f9aa23d05f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.854+0000 7f851f7fe700 1 -- 172.21.15.17:0/1713828207 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853001d730 con 0x55684c968ec0 2023-10-05T15:43:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.854+0000 7f851f7fe700 1 -- 172.21.15.17:0/1713828207 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853009ba60 con 0x55684c968ec0 2023-10-05T15:43:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.854+0000 7f851f7fe700 1 -- 172.21.15.17:0/1713828207 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a3660 con 0x55684c968ec0 2023-10-05T15:43:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.855+0000 7f854f3aab80 1 -- 172.21.15.17:0/1713828207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 msgr2=0x55684c9692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.855+0000 7f854f3aab80 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 0x55684c9692e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f85300a3130 tx=0x7f85300095a0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 -- 172.21.15.17:0/1713828207 shutdown_connections 2023-10-05T15:43:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c971220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c968ec0 0x55684c9692e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 --2- 172.21.15.17:0/1713828207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c969fd0 0x55684c96a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 -- 172.21.15.17:0/1713828207 >> 172.21.15.17:0/1713828207 conn(0x55684c8dd200 msgr2=0x55684c963bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 -- 172.21.15.17:0/1713828207 shutdown_connections 2023-10-05T15:43:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.856+0000 7f854f3aab80 1 -- 172.21.15.17:0/1713828207 wait complete. 2023-10-05T15:43:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.857+0000 7f854f3aab80 1 -- start start 2023-10-05T15:43:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.857+0000 7f854f3aab80 1 Processor -- start 2023-10-05T15:43:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 0x55684c9728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c972df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c96a990 0x55684c979e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c8bbdd0 con 0x55684c96a990 2023-10-05T15:43:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c8586b0 con 0x55684c969fd0 2023-10-05T15:43:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c858350 con 0x55684c968ec0 2023-10-05T15:43:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.858+0000 7f854f3aab80 10 client.0 _ll_register_callbacks cb 0x55684c6b57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.859+0000 7f853979b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 0x55684c9728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.859+0000 7f853979b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 0x55684c9728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38996/0 (socket says 172.21.15.17:38996) 2023-10-05T15:43:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.859+0000 7f853979b700 1 -- 172.21.15.17:0/2583618825 learned_addr learned my addr 172.21.15.17:0/2583618825 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:32.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.859+0000 7f8538f9a700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c972df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f8539f9c700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c96a990 0x55684c979e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f853979b700 1 -- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 msgr2=0x55684c972df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f853979b700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c972df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f853979b700 1 -- 172.21.15.17:0/2583618825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c96a990 msgr2=0x55684c979e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f853979b700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c96a990 0x55684c979e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f853979b700 1 -- 172.21.15.17:0/2583618825 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85341973e0 con 0x55684c968ec0 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f853979b700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 0x55684c9728b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f853009b060 tx=0x7f853000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d422a73b0e160a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.860+0000 7f851cff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.861+0000 7f851cff9700 1 -- 172.21.15.17:0/2583618825 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530024510 con 0x55684c968ec0 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.861+0000 7f851cff9700 1 -- 172.21.15.17:0/2583618825 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f853009b360 con 0x55684c968ec0 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.861+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55684c95bd50 con 0x55684c968ec0 2023-10-05T15:43:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.861+0000 7f851cff9700 1 -- 172.21.15.17:0/2583618825 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85300ce170 con 0x55684c968ec0 2023-10-05T15:43:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.861+0000 7f854f3aab80 10 client.26413 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.861+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55684c6cfc00 con 0x55684c968ec0 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f851cff9700 1 -- 172.21.15.17:0/2583618825 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55684c95bd50 con 0x55684c968ec0 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f851cff9700 1 -- 172.21.15.17:0/2583618825 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f85300a31d0 con 0x55684c968ec0 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f854f3aab80 10 client.26413 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f854f3aab80 10 client.26413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f854f3aab80 20 client.26413 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f854f3aab80 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c97e320 0x55684c980740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f854f3aab80 4 client.26413 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.864+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55684c8b4db0 con 0x55684c97e320 2023-10-05T15:43:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.865+0000 7f8538f9a700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c97e320 0x55684c980740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.866+0000 7f8538f9a700 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c97e320 0x55684c980740 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea56c5722459d13 server_cookie=582ff6a80916a59e in_seq=0 out_seq=0 2023-10-05T15:43:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.866+0000 7f851cff9700 10 client.26413 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.867+0000 7f851cff9700 1 -- 172.21.15.17:0/2583618825 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55684c8b4db0 con 0x55684c97e320 2023-10-05T15:43:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.867+0000 7f851cff9700 10 client.26413 handle_command_reply: tid=0 2023-10-05T15:43:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.867+0000 7f854f3aab80 1 client.26413 shutdown 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 msgr2=0x55684c9728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 0x55684c9728b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f853009b060 tx=0x7f853000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 shutdown_connections 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c97e320 0x55684c980740 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c96a990 0x55684c979e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c968ec0 0x55684c9728b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 --2- 172.21.15.17:0/2583618825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c972df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 >> 172.21.15.17:0/2583618825 conn(0x55684c8dd200 msgr2=0x55684c963250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f851cff9700 0 client.26413 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 shutdown_connections 2023-10-05T15:43:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.868+0000 7f854f3aab80 1 -- 172.21.15.17:0/2583618825 wait complete. 2023-10-05T15:43:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.869+0000 7f854f3aab80 20 client.26413 trim_cache size 0 max 16384 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 Processor -- start 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 -- start start 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c980330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c979df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c96d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c73c8c0 con 0x55684c968ec0 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c969c10 con 0x55684c969fd0 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.896+0000 7f854f3aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c972450 con 0x55684c96a990 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c979df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c979df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45052/0 (socket says 172.21.15.17:45052) 2023-10-05T15:43:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 -- 172.21.15.17:0/693686560 learned_addr learned my addr 172.21.15.17:0/693686560 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8539f9c700 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c96d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f853979b700 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c980330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 -- 172.21.15.17:0/693686560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 msgr2=0x55684c96d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c96d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 -- 172.21.15.17:0/693686560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 msgr2=0x55684c980330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.897+0000 7f8538f9a700 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c980330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.898+0000 7f8538f9a700 1 -- 172.21.15.17:0/693686560 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55684c70d1f0 con 0x55684c969fd0 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.898+0000 7f8538f9a700 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c979df0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8524007210 tx=0x7f8524011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb16fa3d76f06be server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.898+0000 7f851ffff700 1 -- 172.21.15.17:0/693686560 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852402f470 con 0x55684c969fd0 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.899+0000 7f851ffff700 1 -- 172.21.15.17:0/693686560 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f852402fa60 con 0x55684c969fd0 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.899+0000 7f851ffff700 1 -- 172.21.15.17:0/693686560 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240139f0 con 0x55684c969fd0 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.899+0000 7f854f3aab80 1 -- 172.21.15.17:0/693686560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 msgr2=0x55684c979df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.899+0000 7f854f3aab80 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c979df0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8524007210 tx=0x7f8524011000 comp rx=0 tx=0).stop 2023-10-05T15:43:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 -- 172.21.15.17:0/693686560 shutdown_connections 2023-10-05T15:43:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c96d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c980330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 --2- 172.21.15.17:0/693686560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c979df0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 -- 172.21.15.17:0/693686560 >> 172.21.15.17:0/693686560 conn(0x55684c8dd200 msgr2=0x55684c963250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 -- 172.21.15.17:0/693686560 shutdown_connections 2023-10-05T15:43:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.902+0000 7f854f3aab80 1 -- 172.21.15.17:0/693686560 wait complete. 2023-10-05T15:43:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.903+0000 7f854f3aab80 1 -- start start 2023-10-05T15:43:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.903+0000 7f854f3aab80 1 Processor -- start 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c977a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c977f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c978fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c9794e0 con 0x55684c968ec0 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c979650 con 0x55684c969fd0 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55684c9797c0 con 0x55684c96a990 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.904+0000 7f854f3aab80 10 client.0 _ll_register_callbacks cb 0x7f852c009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c977f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c977f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45068/0 (socket says 172.21.15.17:45068) 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 -- 172.21.15.17:0/199049709 learned_addr learned my addr 172.21.15.17:0/199049709 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8539f9c700 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c978fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 -- 172.21.15.17:0/199049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 msgr2=0x55684c978fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c978fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 -- 172.21.15.17:0/199049709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 msgr2=0x55684c977a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c977a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.905+0000 7f8538f9a700 1 -- 172.21.15.17:0/199049709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852401b040 con 0x55684c969fd0 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.906+0000 7f8538f9a700 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c977f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8524013480 tx=0x7f852402fe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6302ec109da65c13 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f851cff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f851cff9700 1 -- 172.21.15.17:0/199049709 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524027040 con 0x55684c969fd0 2023-10-05T15:43:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f851cff9700 1 -- 172.21.15.17:0/199049709 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8524025070 con 0x55684c969fd0 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f853009ba60 con 0x55684c969fd0 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f851cff9700 1 -- 172.21.15.17:0/199049709 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f852402f900 con 0x55684c969fd0 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f854f3aab80 10 client.26453 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55684c6e5250 con 0x55684c969fd0 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.907+0000 7f851cff9700 1 -- 172.21.15.17:0/199049709 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853009ba60 con 0x55684c969fd0 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f851cff9700 1 -- 172.21.15.17:0/199049709 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8524021720 con 0x55684c969fd0 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f854f3aab80 10 client.26453 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f854f3aab80 10 client.26453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f854f3aab80 20 client.26453 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f854f3aab80 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c9e3e30 0x55684c9e6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f854f3aab80 4 client.26453 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.908+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55684c8b4ad0 con 0x55684c9e3e30 2023-10-05T15:43:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.909+0000 7f853979b700 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c9e3e30 0x55684c9e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.909+0000 7f853979b700 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c9e3e30 0x55684c9e6250 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409ddf3476db69e8 server_cookie=108ad2c1d1fa84b3 in_seq=0 out_seq=0 2023-10-05T15:43:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.909+0000 7f851cff9700 10 client.26453 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.925+0000 7f851cff9700 1 -- 172.21.15.17:0/199049709 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55684c8b4ad0 con 0x55684c9e3e30 2023-10-05T15:43:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.925+0000 7f851cff9700 10 client.26453 handle_command_reply: tid=0 2023-10-05T15:43:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.926+0000 7f854f3aab80 1 client.26453 shutdown 2023-10-05T15:43:32.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 msgr2=0x55684c977f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c977f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8524013480 tx=0x7f852402fe80 comp rx=0 tx=0).stop 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 shutdown_connections 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55684c9e3e30 0x55684c9e6250 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55684c96a990 0x55684c978fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55684c968ec0 0x55684c977a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 --2- 172.21.15.17:0/199049709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55684c969fd0 0x55684c977f90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.927+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 >> 172.21.15.17:0/199049709 conn(0x55684c8dd200 msgr2=0x55684c980330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.928+0000 7f851cff9700 0 client.26453 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.928+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 shutdown_connections 2023-10-05T15:43:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.928+0000 7f854f3aab80 1 -- 172.21.15.17:0/199049709 wait complete. 2023-10-05T15:43:32.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.928+0000 7f854f3aab80 20 client.26453 trim_cache size 0 max 16384 2023-10-05T15:43:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:43:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:43:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:43:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85200a15b0 msgr2=0x7f85200a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85200a15b0 0x7f85200a3a70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8534195b80 tx=0x7f8524008040 comp rx=0 tx=0).stop 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 msgr2=0x7f8534194b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 0x7f8534194b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f853000b070 tx=0x7f853000bd70 comp rx=0 tx=0).stop 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 shutdown_connections 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f85200a15b0 0x7f85200a3a70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8534106c70 0x7f8534195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8534101a10 0x7f8534194b30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 --2- 172.21.15.17:0/4036622275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8534104340 0x7f8534195070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.930+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 >> 172.21.15.17:0/4036622275 conn(0x7f85340fb340 msgr2=0x7f8534102680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.932+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 shutdown_connections 2023-10-05T15:43:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:32.932+0000 7f853b9ff700 1 -- 172.21.15.17:0/4036622275 wait complete. 2023-10-05T15:43:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 295.0 s, 585.8 tps, lat 171.165 ms stddev 63.754 2023-10-05T15:43:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:33 smithi167 ceph-mon[133366]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 9.7 MiB/s wr, 646 op/s 2023-10-05T15:43:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:33 smithi079 ceph-mon[132936]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 9.7 MiB/s wr, 646 op/s 2023-10-05T15:43:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:33 smithi017 ceph-mon[129107]: pgmap v578: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 9.7 MiB/s wr, 646 op/s 2023-10-05T15:43:36.069 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:43:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:35 smithi167 ceph-mon[133366]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 832 op/s 2023-10-05T15:43:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:35 smithi079 ceph-mon[132936]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 832 op/s 2023-10-05T15:43:36.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:35 smithi017 ceph-mon[129107]: pgmap v579: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 832 op/s 2023-10-05T15:43:36.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 -- 172.21.15.17:0/3012753331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c102090 msgr2=0x7f685c102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 --2- 172.21.15.17:0/3012753331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c102090 0x7f685c102510 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6850009990 tx=0x7f6850009ca0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 -- 172.21.15.17:0/3012753331 shutdown_connections 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 --2- 172.21.15.17:0/3012753331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685c102a50 0x7f685c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 --2- 172.21.15.17:0/3012753331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c100f40 0x7f685c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 --2- 172.21.15.17:0/3012753331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c102090 0x7f685c102510 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 -- 172.21.15.17:0/3012753331 >> 172.21.15.17:0/3012753331 conn(0x7f685c0fc4d0 msgr2=0x7f685c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 -- 172.21.15.17:0/3012753331 shutdown_connections 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.290+0000 7f68623ff700 1 -- 172.21.15.17:0/3012753331 wait complete. 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 Processor -- start 2023-10-05T15:43:36.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 -- start start 2023-10-05T15:43:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 0x7f685c196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c102090 0x7f685c197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685c102a50 0x7f685c19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c19e6a0 con 0x7f685c100f40 2023-10-05T15:43:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c19e7e0 con 0x7f685c102090 2023-10-05T15:43:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.291+0000 7f68623ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c19e970 con 0x7f685c102a50 2023-10-05T15:43:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 0x7f685c196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 0x7f685c196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38274/0 (socket says 172.21.15.17:38274) 2023-10-05T15:43:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 -- 172.21.15.17:0/1687793466 learned_addr learned my addr 172.21.15.17:0/1687793466 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685b7fe700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c102090 0x7f685c197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f686099c700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685c102a50 0x7f685c19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 -- 172.21.15.17:0/1687793466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685c102a50 msgr2=0x7f685c19e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685c102a50 0x7f685c19e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 -- 172.21.15.17:0/1687793466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c102090 msgr2=0x7f685c197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c102090 0x7f685c197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 -- 172.21.15.17:0/1687793466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68500095f0 con 0x7f685c100f40 2023-10-05T15:43:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.292+0000 7f685bfff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 0x7f685c196b20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f684c00e9a0 tx=0x7f684c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.293+0000 7f68597fa700 1 -- 172.21.15.17:0/1687793466 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c009790 con 0x7f685c100f40 2023-10-05T15:43:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.293+0000 7f68597fa700 1 -- 172.21.15.17:0/1687793466 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f684c010430 con 0x7f685c100f40 2023-10-05T15:43:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.293+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c19ec50 con 0x7f685c100f40 2023-10-05T15:43:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.293+0000 7f68597fa700 1 -- 172.21.15.17:0/1687793466 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c00cea0 con 0x7f685c100f40 2023-10-05T15:43:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.293+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c19f1b0 con 0x7f685c100f40 2023-10-05T15:43:36.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.296+0000 7f68597fa700 1 -- 172.21.15.17:0/1687793466 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f684c0105a0 con 0x7f685c100f40 2023-10-05T15:43:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.297+0000 7f6875daab80 1 Processor -- start 2023-10-05T15:43:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f68597fa700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68440a1500 0x7f68440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 -- start start 2023-10-05T15:43:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f68597fa700 1 -- 172.21.15.17:0/1687793466 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f684c014070 con 0x7f685c100f40 2023-10-05T15:43:36.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f686099c700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68440a1500 0x7f68440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05bf7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05bf8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05bf92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05b5b460 con 0x564e05bf8e70 2023-10-05T15:43:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05b4cc20 con 0x564e05bf7fd0 2023-10-05T15:43:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f6875daab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05b4a540 con 0x564e05bf7670 2023-10-05T15:43:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f686099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05bf92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.298+0000 7f685bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05bf7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05bf8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05bf7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58302/0 (socket says 172.21.15.17:58302) 2023-10-05T15:43:36.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 -- 172.21.15.17:0/3928394852 learned_addr learned my addr 172.21.15.17:0/3928394852 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f686099c700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68440a1500 0x7f68440a39c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f685400f590 tx=0x7f6854009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 -- 172.21.15.17:0/3928394852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 msgr2=0x564e05bf8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05bf8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 -- 172.21.15.17:0/3928394852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 msgr2=0x564e05bf92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:36.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05bf92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 -- 172.21.15.17:0/3928394852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e05970de0 con 0x564e05bf7670 2023-10-05T15:43:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685b7fe700 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05bf8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f685bfff700 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05bf7a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f684c0a1fd0 tx=0x7f684c099ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0938dc86c3705b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f68427fc700 1 -- 172.21.15.17:0/3928394852 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c09a170 con 0x564e05bf7670 2023-10-05T15:43:36.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f68427fc700 1 -- 172.21.15.17:0/3928394852 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f684c09e2c0 con 0x564e05bf7670 2023-10-05T15:43:36.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.299+0000 7f68427fc700 1 -- 172.21.15.17:0/3928394852 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0998c0 con 0x564e05bf7670 2023-10-05T15:43:36.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 -- 172.21.15.17:0/3928394852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 msgr2=0x564e05bf7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05bf7a90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f684c0a1fd0 tx=0x7f684c099ba0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 -- 172.21.15.17:0/3928394852 shutdown_connections 2023-10-05T15:43:36.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05bf92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05bf7a90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 --2- 172.21.15.17:0/3928394852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05bf8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 -- 172.21.15.17:0/3928394852 >> 172.21.15.17:0/3928394852 conn(0x564e05b67260 msgr2=0x564e05bee140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:36.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 -- 172.21.15.17:0/3928394852 shutdown_connections 2023-10-05T15:43:36.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.300+0000 7f6875daab80 1 -- 172.21.15.17:0/3928394852 wait complete. 2023-10-05T15:43:36.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.301+0000 7f6875daab80 1 -- start start 2023-10-05T15:43:36.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.301+0000 7f6875daab80 1 Processor -- start 2023-10-05T15:43:36.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7fd0 0x564e05bf6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 0x564e05bf3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05b45e30 con 0x564e05bf7670 2023-10-05T15:43:36.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05ae2710 con 0x564e05bf8e70 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05ae23b0 con 0x564e05bf7fd0 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f6875daab80 10 client.0 _ll_register_callbacks cb 0x564e0593f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f685bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 0x564e05bf3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7fd0 0x564e05bf6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 0x564e05bf3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45054/0 (socket says 172.21.15.17:45054) 2023-10-05T15:43:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7fd0 0x564e05bf6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58306/0 (socket says 172.21.15.17:58306) 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 -- 172.21.15.17:0/3934938616 learned_addr learned my addr 172.21.15.17:0/3934938616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 -- 172.21.15.17:0/3934938616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7fd0 msgr2=0x564e05bf6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7fd0 0x564e05bf6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 -- 172.21.15.17:0/3934938616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 msgr2=0x564e05bf6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.302+0000 7f686099c700 1 -- 172.21.15.17:0/3934938616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c109ca0 con 0x564e05bf8e70 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f686099c700 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 0x564e05bf3300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6854019ef0 tx=0x7f6854004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e9d285ba538312 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:36.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f683b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f683b7fe700 1 -- 172.21.15.17:0/3934938616 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400e040 con 0x564e05bf8e70 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e05be5f10 con 0x564e05bf8e70 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f683b7fe700 1 -- 172.21.15.17:0/3934938616 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6854003a00 con 0x564e05bf8e70 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f683b7fe700 1 -- 172.21.15.17:0/3934938616 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6854003bc0 con 0x564e05bf8e70 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f6875daab80 10 client.26465 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.303+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f685c19f1b0 con 0x564e05bf8e70 2023-10-05T15:43:36.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f683b7fe700 1 -- 172.21.15.17:0/3934938616 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564e05be5f10 con 0x564e05bf8e70 2023-10-05T15:43:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f683b7fe700 1 -- 172.21.15.17:0/3934938616 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f68540223f0 con 0x564e05bf8e70 2023-10-05T15:43:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f6875daab80 10 client.26465 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f6875daab80 10 client.26465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f6875daab80 20 client.26465 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f6875daab80 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c116f0 0x564e05c13b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f6875daab80 4 client.26465 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e05b3ee10 con 0x564e05c116f0 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.304+0000 7f685bfff700 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c116f0 0x564e05c13b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.305+0000 7f685bfff700 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c116f0 0x564e05c13b10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cee1542c1b383d6a server_cookie=b0d0afbae6423f9d in_seq=0 out_seq=0 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.305+0000 7f683b7fe700 10 client.26465 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.305+0000 7f683b7fe700 1 -- 172.21.15.17:0/3934938616 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564e05b3ee10 con 0x564e05c116f0 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.305+0000 7f683b7fe700 10 client.26465 handle_command_reply: tid=0 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.305+0000 7f6875daab80 1 client.26465 shutdown 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 msgr2=0x564e05bf3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 0x564e05bf3300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6854019ef0 tx=0x7f6854004b40 comp rx=0 tx=0).stop 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 shutdown_connections 2023-10-05T15:43:36.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c116f0 0x564e05c13b10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf8e70 0x564e05bf3300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 --2- 172.21.15.17:0/3934938616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7fd0 0x564e05bf6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 >> 172.21.15.17:0/3934938616 conn(0x564e05b67260 msgr2=0x564e05bedf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f683b7fe700 0 client.26465 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 shutdown_connections 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 1 -- 172.21.15.17:0/3934938616 wait complete. 2023-10-05T15:43:36.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.306+0000 7f6875daab80 20 client.26465 trim_cache size 0 max 16384 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.330+0000 7f6875daab80 1 Processor -- start 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 -- start start 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05be9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 0x564e05c212f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e059c6920 con 0x564e05bf7670 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05c0ead0 con 0x564e05bf7fd0 2023-10-05T15:43:36.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.331+0000 7f6875daab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05c21830 con 0x564e05bf8e70 2023-10-05T15:43:36.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 0x564e05c212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 0x564e05c212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58308/0 (socket says 172.21.15.17:58308) 2023-10-05T15:43:36.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 -- 172.21.15.17:0/1059873738 learned_addr learned my addr 172.21.15.17:0/1059873738 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f685bfff700 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 -- 172.21.15.17:0/1059873738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 msgr2=0x564e05be9e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05be9e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 -- 172.21.15.17:0/1059873738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 msgr2=0x564e05bf31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.332+0000 7f686099c700 1 -- 172.21.15.17:0/1059873738 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e05959c60 con 0x564e05bf8e70 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.333+0000 7f686099c700 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 0x564e05c212f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f685400fe70 tx=0x7f685400fea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e4cb635c37c3f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:36.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.333+0000 7f6842ffd700 1 -- 172.21.15.17:0/1059873738 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400e040 con 0x564e05bf8e70 2023-10-05T15:43:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.333+0000 7f6842ffd700 1 -- 172.21.15.17:0/1059873738 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f685400f040 con 0x564e05bf8e70 2023-10-05T15:43:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.333+0000 7f6842ffd700 1 -- 172.21.15.17:0/1059873738 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685402ad70 con 0x564e05bf8e70 2023-10-05T15:43:36.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.334+0000 7f6875daab80 1 -- 172.21.15.17:0/1059873738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 msgr2=0x564e05c212f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.334+0000 7f6875daab80 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 0x564e05c212f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f685400fe70 tx=0x7f685400fea0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 -- 172.21.15.17:0/1059873738 shutdown_connections 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf8e70 0x564e05c212f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf7670 0x564e05bf31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 --2- 172.21.15.17:0/1059873738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05be9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 -- 172.21.15.17:0/1059873738 >> 172.21.15.17:0/1059873738 conn(0x564e05b67260 msgr2=0x564e05c18470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 -- 172.21.15.17:0/1059873738 shutdown_connections 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.335+0000 7f6875daab80 1 -- 172.21.15.17:0/1059873738 wait complete. 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.336+0000 7f6875daab80 1 -- start start 2023-10-05T15:43:36.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.336+0000 7f6875daab80 1 Processor -- start 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05c1f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05c1f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05c20550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05c20a90 con 0x564e05bf8e70 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05c20c00 con 0x564e05bf7fd0 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e05c20dc0 con 0x564e05bf7670 2023-10-05T15:43:36.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f6875daab80 10 client.0 _ll_register_callbacks cb 0x7f68540198c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f685bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05c1f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f685bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05c1f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58320/0 (socket says 172.21.15.17:58320) 2023-10-05T15:43:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f685bfff700 1 -- 172.21.15.17:0/4195032862 learned_addr learned my addr 172.21.15.17:0/4195032862 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.337+0000 7f686099c700 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05c20550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.338+0000 7f685bfff700 1 -- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 msgr2=0x564e05c1f540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.338+0000 7f685bfff700 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05c1f540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.338+0000 7f685bfff700 1 -- 172.21.15.17:0/4195032862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 msgr2=0x564e05c20550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.338+0000 7f685bfff700 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05c20550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.338+0000 7f685bfff700 1 -- 172.21.15.17:0/4195032862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c19f1b0 con 0x564e05bf7670 2023-10-05T15:43:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.339+0000 7f685bfff700 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05c1f000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c2d0 tx=0x7f684c010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42dded7ae4e0a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:36.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.345+0000 7f683b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:43:36.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.345+0000 7f683b7fe700 1 -- 172.21.15.17:0/4195032862 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c09a170 con 0x564e05bf7670 2023-10-05T15:43:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.345+0000 7f683b7fe700 1 -- 172.21.15.17:0/4195032862 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f684c0b8200 con 0x564e05bf7670 2023-10-05T15:43:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.345+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f684c09e2c0 con 0x564e05bf7670 2023-10-05T15:43:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.346+0000 7f683b7fe700 1 -- 172.21.15.17:0/4195032862 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f684c0b83c0 con 0x564e05bf7670 2023-10-05T15:43:36.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.346+0000 7f6875daab80 10 client.26437 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:36.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.346+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x564e05997250 con 0x564e05bf7670 2023-10-05T15:43:36.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.347+0000 7f683b7fe700 1 -- 172.21.15.17:0/4195032862 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f684c09e2c0 con 0x564e05bf7670 2023-10-05T15:43:36.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.347+0000 7f683b7fe700 1 -- 172.21.15.17:0/4195032862 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f684c0a2070 con 0x564e05bf7670 2023-10-05T15:43:36.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.348+0000 7f6875daab80 10 client.26437 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.348+0000 7f6875daab80 10 client.26437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.348+0000 7f6875daab80 20 client.26437 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.348+0000 7f6875daab80 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c07b40 0x564e05c07f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.348+0000 7f6875daab80 4 client.26437 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:43:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.348+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564e05b3eb30 con 0x564e05c07b40 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.349+0000 7f685b7fe700 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c07b40 0x564e05c07f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.350+0000 7f685b7fe700 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c07b40 0x564e05c07f50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd812ce1e1516ee7 server_cookie=de1c89cfcec8ba72 in_seq=0 out_seq=0 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.351+0000 7f683b7fe700 10 client.26437 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.351+0000 7f683b7fe700 1 -- 172.21.15.17:0/4195032862 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564e05b3eb30 con 0x564e05c07b40 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.351+0000 7f683b7fe700 10 client.26437 handle_command_reply: tid=0 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.351+0000 7f6875daab80 1 client.26437 shutdown 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.351+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 msgr2=0x564e05c1f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.351+0000 7f6875daab80 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05c1f000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c2d0 tx=0x7f684c010a70 comp rx=0 tx=0).stop 2023-10-05T15:43:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.352+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 shutdown_connections 2023-10-05T15:43:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.352+0000 7f6875daab80 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564e05c07b40 0x564e05c07f50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.352+0000 7f6875daab80 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e05bf8e70 0x564e05c20550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.352+0000 7f6875daab80 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e05bf7670 0x564e05c1f000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.352+0000 7f6875daab80 1 --2- 172.21.15.17:0/4195032862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e05bf7fd0 0x564e05c1f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.352+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 >> 172.21.15.17:0/4195032862 conn(0x564e05b67260 msgr2=0x564e05bedf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.353+0000 7f683b7fe700 0 client.26437 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.353+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 shutdown_connections 2023-10-05T15:43:36.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.353+0000 7f6875daab80 1 -- 172.21.15.17:0/4195032862 wait complete. 2023-10-05T15:43:36.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.356+0000 7f6875daab80 20 client.26437 trim_cache size 0 max 16384 2023-10-05T15:43:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:43:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:43:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:43:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:43:36.361 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:43:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:43:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:43:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:43:36.362 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:43:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:43:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.361+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68440a1500 msgr2=0x7f68440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.361+0000 7f68623ff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68440a1500 0x7f68440a39c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f685400f590 tx=0x7f6854009920 comp rx=0 tx=0).stop 2023-10-05T15:43:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.361+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 msgr2=0x7f685c196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:36.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.361+0000 7f68623ff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 0x7f685c196b20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f684c00e9a0 tx=0x7f684c00ecb0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.362+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 shutdown_connections 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.362+0000 7f68623ff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f68440a1500 0x7f68440a39c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.362+0000 7f68623ff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f685c102a50 0x7f685c19e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.362+0000 7f68623ff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f685c100f40 0x7f685c196b20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.362+0000 7f68623ff700 1 --2- 172.21.15.17:0/1687793466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f685c102090 0x7f685c197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.362+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 >> 172.21.15.17:0/1687793466 conn(0x7f685c0fc4d0 msgr2=0x7f685c0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:36.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.363+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 shutdown_connections 2023-10-05T15:43:36.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:43:36.363+0000 7f68623ff700 1 -- 172.21.15.17:0/1687793466 wait complete. 2023-10-05T15:43:36.395 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:43:38.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:37 smithi167 ceph-mon[133366]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.3 MiB/s wr, 606 op/s 2023-10-05T15:43:38.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:37 smithi079 ceph-mon[132936]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.3 MiB/s wr, 606 op/s 2023-10-05T15:43:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 300.0 s, 590.8 tps, lat 169.927 ms stddev 98.580 2023-10-05T15:43:38.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:37 smithi017 ceph-mon[129107]: pgmap v580: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.3 MiB/s wr, 606 op/s 2023-10-05T15:43:40.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:39 smithi167 ceph-mon[133366]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.3 MiB/s wr, 676 op/s 2023-10-05T15:43:40.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:39 smithi079 ceph-mon[132936]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.3 MiB/s wr, 676 op/s 2023-10-05T15:43:40.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:39 smithi017 ceph-mon[129107]: pgmap v581: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.3 MiB/s wr, 676 op/s 2023-10-05T15:43:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:41 smithi167 ceph-mon[133366]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-10-05T15:43:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:41 smithi079 ceph-mon[132936]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-10-05T15:43:42.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:41 smithi017 ceph-mon[129107]: pgmap v582: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-10-05T15:43:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 305.0 s, 673.9 tps, lat 148.209 ms stddev 44.595 2023-10-05T15:43:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:43 smithi167 ceph-mon[133366]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.8 MiB/s wr, 612 op/s 2023-10-05T15:43:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:43 smithi079 ceph-mon[132936]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.8 MiB/s wr, 612 op/s 2023-10-05T15:43:44.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:43 smithi017 ceph-mon[129107]: pgmap v583: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.8 MiB/s wr, 612 op/s 2023-10-05T15:43:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:45 smithi167 ceph-mon[133366]: pgmap v584: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 805 op/s 2023-10-05T15:43:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:45 smithi079 ceph-mon[132936]: pgmap v584: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 805 op/s 2023-10-05T15:43:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 -- 172.21.15.17:0/4225736436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4102a50 msgr2=0x7f3be4109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/4225736436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4102a50 0x7f3be4109370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b0a0 tx=0x7f3bdc00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 -- 172.21.15.17:0/4225736436 shutdown_connections 2023-10-05T15:43:46.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/4225736436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4102a50 0x7f3be4109370 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/4225736436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4100eb0 0x7f3be41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/4225736436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3be4102090 0x7f3be4102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 -- 172.21.15.17:0/4225736436 >> 172.21.15.17:0/4225736436 conn(0x7f3be40fc430 msgr2=0x7f3be40fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 -- 172.21.15.17:0/4225736436 shutdown_connections 2023-10-05T15:43:46.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.148+0000 7f3bea5ff700 1 -- 172.21.15.17:0/4225736436 wait complete. 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.149+0000 7f3bea5ff700 1 Processor -- start 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 -- start start 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 0x7f3be4198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4102090 0x7f3be4199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3be4102a50 0x7f3be419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be419a900 con 0x7f3be4100eb0 2023-10-05T15:43:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be419aa70 con 0x7f3be4102090 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bea5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be419ac30 con 0x7f3be4102a50 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 0x7f3be4198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4102090 0x7f3be4199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 0x7f3be4198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43680/0 (socket says 172.21.15.17:43680) 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.150+0000 7f3bdbfff700 1 -- 172.21.15.17:0/2555996953 learned_addr learned my addr 172.21.15.17:0/2555996953 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3be4102a50 0x7f3be419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be3fff700 1 -- 172.21.15.17:0/2555996953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3be4102a50 msgr2=0x7f3be419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be3fff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3be4102a50 0x7f3be419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be3fff700 1 -- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 msgr2=0x7f3be4198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be3fff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 0x7f3be4198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be3fff700 1 -- 172.21.15.17:0/2555996953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4009520 con 0x7f3be4102090 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 0x7f3be4198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be3fff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4102090 0x7f3be4199420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00e9c0 tx=0x7f3bcc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be1ffb700 1 -- 172.21.15.17:0/2555996953 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc004220 con 0x7f3be4102090 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be1ffb700 1 -- 172.21.15.17:0/2555996953 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bcc004380 con 0x7f3be4102090 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3be1ffb700 1 -- 172.21.15.17:0/2555996953 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc003b40 con 0x7f3be4102090 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.151+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc009d00 con 0x7f3be4102090 2023-10-05T15:43:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.152+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be41a14f0 con 0x7f3be4102090 2023-10-05T15:43:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.155+0000 7f3be1ffb700 1 -- 172.21.15.17:0/2555996953 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3bcc003ca0 con 0x7f3be4102090 2023-10-05T15:43:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.156+0000 7f3bfdf49b80 1 Processor -- start 2023-10-05T15:43:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 -- start start 2023-10-05T15:43:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 0x560e140a9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a9990 0x560e140b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e14010400 con 0x560e140a8fd0 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e14001bc0 con 0x560e140a7ec0 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13fff4e0 con 0x560e140a9990 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.157+0000 7f3be1ffb700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3bd00a1500 0x7f3bd00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 0x560e140a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a9990 0x560e140b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 0x560e140a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43688/0 (socket says 172.21.15.17:43688) 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46288/0 (socket says 172.21.15.17:46288) 2023-10-05T15:43:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 -- 172.21.15.17:0/715530100 learned_addr learned my addr 172.21.15.17:0/715530100 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be1ffb700 1 -- 172.21.15.17:0/2555996953 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3bcc014070 con 0x7f3be4102090 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3bd00a1500 0x7f3bd00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 -- 172.21.15.17:0/715530100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a9990 msgr2=0x560e140b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a9990 0x560e140b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 -- 172.21.15.17:0/715530100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 msgr2=0x560e140a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 -- 172.21.15.17:0/715530100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e13e25d80 con 0x560e140a8fd0 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be3fff700 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a9990 0x560e140b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 0x560e140a9450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4011810 tx=0x7f3bd4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10d4472f7e06ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.158+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3bd00a1500 0x7f3bd00a39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b780 tx=0x7f3bdc006210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.159+0000 7f3bda7fc700 1 -- 172.21.15.17:0/715530100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4004830 con 0x560e140a8fd0 2023-10-05T15:43:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.159+0000 7f3bda7fc700 1 -- 172.21.15.17:0/715530100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bd4004e20 con 0x560e140a8fd0 2023-10-05T15:43:46.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.159+0000 7f3bda7fc700 1 -- 172.21.15.17:0/715530100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400f820 con 0x560e140a8fd0 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.159+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/715530100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 msgr2=0x560e140a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.159+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 0x560e140a9450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4011810 tx=0x7f3bd4011b20 comp rx=0 tx=0).stop 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/715530100 shutdown_connections 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a9990 0x560e140b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/715530100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a8fd0 0x560e140a9450 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/715530100 >> 172.21.15.17:0/715530100 conn(0x560e1401c200 msgr2=0x560e140a2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/715530100 shutdown_connections 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/715530100 wait complete. 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 -- start start 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.160+0000 7f3bfdf49b80 1 Processor -- start 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13ffadd0 con 0x560e140a9990 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13f976b0 con 0x560e140a7ec0 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13f97350 con 0x560e140a8fd0 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bfdf49b80 10 client.0 _ll_register_callbacks cb 0x560e13df47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43702/0 (socket says 172.21.15.17:43702) 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 -- 172.21.15.17:0/718506826 learned_addr learned my addr 172.21.15.17:0/718506826 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 -- 172.21.15.17:0/718506826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 msgr2=0x560e140b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 -- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 msgr2=0x560e140b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.161+0000 7f3be8b9c700 1 -- 172.21.15.17:0/718506826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be41a14f0 con 0x560e140a9990 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b9030 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b0a0 tx=0x7f3bdc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4fa74c7ba65795 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:43:46.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bc37fe700 1 -- 172.21.15.17:0/718506826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00e070 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e1409ad50 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bc37fe700 1 -- 172.21.15.17:0/718506826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3bdc01f640 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bc37fe700 1 -- 172.21.15.17:0/718506826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bdc007780 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bfdf49b80 10 client.16581 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f3bd4011440 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.162+0000 7f3bc37fe700 1 -- 172.21.15.17:0/718506826 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e1409ad50 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bc37fe700 1 -- 172.21.15.17:0/718506826 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3bdc029070 con 0x560e140a9990 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bfdf49b80 10 client.16581 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bfdf49b80 10 client.16581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bfdf49b80 20 client.16581 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e140bd8b0 0x560e140bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bfdf49b80 4 client.16581 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e13ff3db0 con 0x560e140bd8b0 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.163+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e140bd8b0 0x560e140bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.164+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e140bd8b0 0x560e140bfcd0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c46eac076a0bbcd server_cookie=9d1fafba2217a820 in_seq=0 out_seq=0 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.164+0000 7f3bc37fe700 10 client.16581 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.164+0000 7f3bc37fe700 1 -- 172.21.15.17:0/718506826 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e13ff3db0 con 0x560e140bd8b0 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.164+0000 7f3bc37fe700 10 client.16581 handle_command_reply: tid=0 2023-10-05T15:43:46.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.164+0000 7f3bfdf49b80 1 client.16581 shutdown 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 msgr2=0x560e140b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b9030 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b0a0 tx=0x7f3bdc0099e0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 shutdown_connections 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e140bd8b0 0x560e140bfcd0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b9030 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bc37fe700 0 client.16581 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/718506826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 >> 172.21.15.17:0/718506826 conn(0x560e1401c200 msgr2=0x560e140a2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 shutdown_connections 2023-10-05T15:43:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/718506826 wait complete. 2023-10-05T15:43:46.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.165+0000 7f3bfdf49b80 20 client.16581 trim_cache size 0 max 16384 2023-10-05T15:43:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.180+0000 7f3bfdf49b80 1 Processor -- start 2023-10-05T15:43:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.180+0000 7f3bfdf49b80 1 -- start start 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.180+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13e7b8c0 con 0x560e140a9990 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e140a9e10 con 0x560e140a7ec0 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e140afba0 con 0x560e140a8fd0 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:40206/0 (socket says 172.21.15.17:40206) 2023-10-05T15:43:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be3fff700 1 -- 172.21.15.17:0/2050634344 learned_addr learned my addr 172.21.15.17:0/2050634344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be8b9c700 1 -- 172.21.15.17:0/2050634344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 msgr2=0x560e140b8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be8b9c700 1 -- 172.21.15.17:0/2050634344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 msgr2=0x560e140a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.181+0000 7f3be8b9c700 1 -- 172.21.15.17:0/2050634344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e13e0ec00 con 0x560e140a9990 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b07f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc005600 tx=0x7f3bdc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6198956f4aca440 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bdaffd700 1 -- 172.21.15.17:0/2050634344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00e070 con 0x560e140a9990 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bdaffd700 1 -- 172.21.15.17:0/2050634344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bdc026040 con 0x560e140a9990 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bdaffd700 1 -- 172.21.15.17:0/2050634344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc01fa10 con 0x560e140a9990 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/2050634344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 msgr2=0x560e140b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b07f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc005600 tx=0x7f3bdc003ce0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/2050634344 shutdown_connections 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a9990 0x560e140b07f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a7ec0 0x560e140a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/2050634344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/2050634344 >> 172.21.15.17:0/2050634344 conn(0x560e1401c200 msgr2=0x560e140c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/2050634344 shutdown_connections 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.182+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/2050634344 wait complete. 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 -- start start 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 Processor -- start 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 0x560e140b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 0x560e140b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e140b83c0 con 0x560e140a7ec0 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.183+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e140b8530 con 0x560e140a9990 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3bfdf49b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e140b86f0 con 0x560e140a8fd0 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3bfdf49b80 10 client.0 _ll_register_callbacks cb 0x7f3bdc00bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:46.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 0x560e140b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 0x560e140b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:40218/0 (socket says 172.21.15.17:40218) 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 0x560e140b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43732/0 (socket says 172.21.15.17:43732) 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be3fff700 1 -- 172.21.15.17:0/1912682207 learned_addr learned my addr 172.21.15.17:0/1912682207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 0x560e140b7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:46312/0 (socket says 172.21.15.17:46312) 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 -- 172.21.15.17:0/1912682207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 msgr2=0x560e140b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 -- 172.21.15.17:0/1912682207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 msgr2=0x560e140b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 0x560e140b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 -- 172.21.15.17:0/1912682207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd4011440 con 0x560e140a9990 2023-10-05T15:43:46.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 0x560e140b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be3fff700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3be8b9c700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 0x560e140b7e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0079c0 tx=0x7f3bdc0078b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f4b509796403c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.184+0000 7f3bc37fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bc37fe700 1 -- 172.21.15.17:0/1912682207 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00e040 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bd4004e20 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bc37fe700 1 -- 172.21.15.17:0/1912682207 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3bdc005270 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bc37fe700 1 -- 172.21.15.17:0/1912682207 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bdc01fa10 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bfdf49b80 10 client.26483 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560e13e4c1f0 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bc37fe700 1 -- 172.21.15.17:0/1912682207 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bd4004e20 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.185+0000 7f3bc37fe700 1 -- 172.21.15.17:0/1912682207 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3bdc034070 con 0x560e140a9990 2023-10-05T15:43:46.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bfdf49b80 10 client.26483 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bfdf49b80 10 client.26483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bfdf49b80 20 client.26483 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e14111db0 0x560e141141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bfdf49b80 4 client.26483 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e13ff3ad0 con 0x560e14111db0 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e14111db0 0x560e141141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:46.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bdbfff700 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e14111db0 0x560e141141a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dec1e5959c9e8e6 server_cookie=5fcbed3a8b592ceb in_seq=0 out_seq=0 2023-10-05T15:43:46.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.186+0000 7f3bc37fe700 10 client.26483 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:46.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:45 smithi017 ceph-mon[129107]: pgmap v584: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 805 op/s 2023-10-05T15:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.350+0000 7f3bc37fe700 1 -- 172.21.15.17:0/1912682207 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e13ff3ad0 con 0x560e14111db0 2023-10-05T15:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.350+0000 7f3bc37fe700 10 client.26483 handle_command_reply: tid=0 2023-10-05T15:43:46.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.350+0000 7f3bfdf49b80 1 client.26483 shutdown 2023-10-05T15:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.351+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 msgr2=0x560e140b7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.351+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 0x560e140b7e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0079c0 tx=0x7f3bdc0078b0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 shutdown_connections 2023-10-05T15:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560e14111db0 0x560e141141a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560e140a9990 0x560e140b7e80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e140a7ec0 0x560e140b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bfdf49b80 1 --2- 172.21.15.17:0/1912682207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560e140a8fd0 0x560e140b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 >> 172.21.15.17:0/1912682207 conn(0x560e1401c200 msgr2=0x560e140b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.352+0000 7f3bc37fe700 0 client.26483 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.353+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 shutdown_connections 2023-10-05T15:43:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.354+0000 7f3bfdf49b80 1 -- 172.21.15.17:0/1912682207 wait complete. 2023-10-05T15:43:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.356+0000 7f3bfdf49b80 20 client.26483 trim_cache size 0 max 16384 2023-10-05T15:43:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:43:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:43:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:43:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:43:46.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.357+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3bd00a1500 msgr2=0x7f3bd00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.357+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3bd00a1500 0x7f3bd00a39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b780 tx=0x7f3bdc006210 comp rx=0 tx=0).stop 2023-10-05T15:43:46.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.357+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4102090 msgr2=0x7f3be4199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:46.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.357+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4102090 0x7f3be4199420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00e9c0 tx=0x7f3bcc00ecd0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 shutdown_connections 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3bd00a1500 0x7f3bd00a39c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3be4102a50 0x7f3be419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3be4100eb0 0x7f3be4198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 --2- 172.21.15.17:0/2555996953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3be4102090 0x7f3be4199420 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 >> 172.21.15.17:0/2555996953 conn(0x7f3be40fc430 msgr2=0x7f3be4107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 shutdown_connections 2023-10-05T15:43:46.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:46.358+0000 7f3bea5ff700 1 -- 172.21.15.17:0/2555996953 wait complete. 2023-10-05T15:43:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:47 smithi167 ceph-mon[133366]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.3 MiB/s wr, 593 op/s 2023-10-05T15:43:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:47 smithi079 ceph-mon[132936]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.3 MiB/s wr, 593 op/s 2023-10-05T15:43:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 310.0 s, 519.9 tps, lat 192.936 ms stddev 98.792 2023-10-05T15:43:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:47 smithi017 ceph-mon[129107]: pgmap v585: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.3 MiB/s wr, 593 op/s 2023-10-05T15:43:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:49 smithi079 ceph-mon[132936]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.3 MiB/s wr, 635 op/s 2023-10-05T15:43:50.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:49 smithi017 ceph-mon[129107]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.3 MiB/s wr, 635 op/s 2023-10-05T15:43:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:49 smithi167 ceph-mon[133366]: pgmap v586: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.3 MiB/s wr, 635 op/s 2023-10-05T15:43:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:51 smithi079 ceph-mon[132936]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 669 op/s 2023-10-05T15:43:52.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:51 smithi017 ceph-mon[129107]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 669 op/s 2023-10-05T15:43:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:51 smithi167 ceph-mon[133366]: pgmap v587: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.1 MiB/s wr, 669 op/s 2023-10-05T15:43:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 315.0 s, 489.9 tps, lat 172.715 ms stddev 53.446 2023-10-05T15:43:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:53 smithi079 ceph-mon[132936]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.9 MiB/s wr, 574 op/s 2023-10-05T15:43:54.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:53 smithi017 ceph-mon[129107]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.9 MiB/s wr, 574 op/s 2023-10-05T15:43:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:53 smithi167 ceph-mon[133366]: pgmap v588: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.9 MiB/s wr, 574 op/s 2023-10-05T15:43:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:55 smithi017 ceph-mon[129107]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.2 MiB/s wr, 755 op/s 2023-10-05T15:43:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:55 smithi167 ceph-mon[133366]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.2 MiB/s wr, 755 op/s 2023-10-05T15:43:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:55 smithi079 ceph-mon[132936]: pgmap v589: 129 pgs: 129 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.2 MiB/s wr, 755 op/s 2023-10-05T15:43:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:57 smithi167 ceph-mon[133366]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.9 MiB/s wr, 562 op/s 2023-10-05T15:43:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:57 smithi079 ceph-mon[132936]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.9 MiB/s wr, 562 op/s 2023-10-05T15:43:58.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 320.0 s, 627.5 tps, lat 183.031 ms stddev 136.639 2023-10-05T15:43:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:57 smithi017 ceph-mon[129107]: pgmap v590: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.9 MiB/s wr, 562 op/s 2023-10-05T15:43:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.615+0000 7f2dc3fff700 1 -- 172.21.15.17:0/4294629584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc0ff1b0 msgr2=0x7f2dbc0ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.615+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/4294629584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc0ff5d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009990 tx=0x7f2db8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.616+0000 7f2dc3fff700 1 -- 172.21.15.17:0/4294629584 shutdown_connections 2023-10-05T15:43:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.616+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/4294629584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc1008d0 0x7f2dbc105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.616+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/4294629584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc0ff5d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.616+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/4294629584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc0fff10 0x7f2dbc100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.616+0000 7f2dc3fff700 1 -- 172.21.15.17:0/4294629584 >> 172.21.15.17:0/4294629584 conn(0x7f2dbc0faac0 msgr2=0x7f2dbc0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.618+0000 7f2dc3fff700 1 -- 172.21.15.17:0/4294629584 shutdown_connections 2023-10-05T15:43:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.618+0000 7f2dc3fff700 1 -- 172.21.15.17:0/4294629584 wait complete. 2023-10-05T15:43:59.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.620+0000 7f2dc3fff700 1 Processor -- start 2023-10-05T15:43:59.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.620+0000 7f2dc3fff700 1 -- start start 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc06f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc0fff10 0x7f2dbc06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc1008d0 0x7f2dbc070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc3fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc071300 con 0x7f2dbc0fff10 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc3fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc071470 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc3fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc071630 con 0x7f2dbc1008d0 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc06f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc06f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52334/0 (socket says 172.21.15.17:52334) 2023-10-05T15:43:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.621+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/3230288353 learned_addr learned my addr 172.21.15.17:0/3230288353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc159a700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc0fff10 0x7f2dbc06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc259c700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc1008d0 0x7f2dbc070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/3230288353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc1008d0 msgr2=0x7f2dbc070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc1008d0 0x7f2dbc070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc0fff10 msgr2=0x7f2dbc06fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc0fff10 0x7f2dbc06fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.622+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/3230288353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80095f0 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.623+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc06f890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2db8000c00 tx=0x7f2db8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.623+0000 7f2db2ffd700 1 -- 172.21.15.17:0/3230288353 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db801d070 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.623+0000 7f2db2ffd700 1 -- 172.21.15.17:0/3230288353 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2db800be30 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.623+0000 7f2db2ffd700 1 -- 172.21.15.17:0/3230288353 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8021410 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.623+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc0718b0 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.624+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc0720c0 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.631+0000 7f2dd78a4b80 1 Processor -- start 2023-10-05T15:43:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.631+0000 7f2dd78a4b80 1 -- start start 2023-10-05T15:43:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b66122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6612fe0 0x5614b6613460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b661a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b6569400 con 0x5614b6611ed0 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b655abc0 con 0x5614b66139a0 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b65584e0 con 0x5614b6612fe0 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dc1d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6612fe0 0x5614b6613460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dc259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b66122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dc1d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6612fe0 0x5614b6613460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:47906/0 (socket says 172.21.15.17:47906) 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dc259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b66122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43076/0 (socket says 172.21.15.17:43076) 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.632+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/1215254115 learned_addr learned my addr 172.21.15.17:0/1215254115 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.633+0000 7f2dc259c700 1 -- 172.21.15.17:0/1215254115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6612fe0 msgr2=0x5614b6613460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.633+0000 7f2dc259c700 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6612fe0 0x5614b6613460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.633+0000 7f2dc259c700 1 -- 172.21.15.17:0/1215254115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 msgr2=0x5614b661a230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.633+0000 7f2dc259c700 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b661a230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.633+0000 7f2dc259c700 1 -- 172.21.15.17:0/1215254115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614b637ed80 con 0x5614b6611ed0 2023-10-05T15:43:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.634+0000 7f2dc259c700 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b66122f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2db4011580 tx=0x7f2db4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a109b8de868fa36 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.634+0000 7f2db2ffd700 1 -- 172.21.15.17:0/3230288353 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2db800f660 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.634+0000 7f2da7fff700 1 -- 172.21.15.17:0/1215254115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400e040 con 0x5614b6611ed0 2023-10-05T15:43:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.634+0000 7f2da7fff700 1 -- 172.21.15.17:0/1215254115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2db400f040 con 0x5614b6611ed0 2023-10-05T15:43:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.634+0000 7f2da7fff700 1 -- 172.21.15.17:0/1215254115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4004390 con 0x5614b6611ed0 2023-10-05T15:43:59.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.635+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1215254115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 msgr2=0x5614b66122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.635+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b66122f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2db4011580 tx=0x7f2db4009920 comp rx=0 tx=0).stop 2023-10-05T15:43:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.636+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1215254115 shutdown_connections 2023-10-05T15:43:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.636+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b661a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.636+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b66122f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.636+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1215254115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6612fe0 0x5614b6613460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.636+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1215254115 >> 172.21.15.17:0/1215254115 conn(0x5614b6575200 msgr2=0x5614b65fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.636+0000 7f2db2ffd700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2da80a15d0 0x7f2da80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.637+0000 7f2db2ffd700 1 -- 172.21.15.17:0/3230288353 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2db80ce470 con 0x7f2dbc0ff1b0 2023-10-05T15:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.637+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1215254115 shutdown_connections 2023-10-05T15:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.638+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1215254115 wait complete. 2023-10-05T15:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.638+0000 7f2dc159a700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2da80a15d0 0x7f2da80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.638+0000 7f2dd78a4b80 1 -- start start 2023-10-05T15:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 Processor -- start 2023-10-05T15:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b6608580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 0x5614b6608ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b66139a0 0x5614b660fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b6553dd0 con 0x5614b6611ed0 2023-10-05T15:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b64f06b0 con 0x5614b6612fe0 2023-10-05T15:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b64f0350 con 0x5614b66139a0 2023-10-05T15:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.639+0000 7f2dd78a4b80 10 client.0 _ll_register_callbacks cb 0x5614b634d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.640+0000 7f2dc159a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 0x5614b6608ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.640+0000 7f2dc159a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 0x5614b6608ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52344/0 (socket says 172.21.15.17:52344) 2023-10-05T15:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.640+0000 7f2dc159a700 1 -- 172.21.15.17:0/3392558227 learned_addr learned my addr 172.21.15.17:0/3392558227 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.640+0000 7f2dc259c700 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b66139a0 0x5614b660fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.640+0000 7f2dc159a700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2da80a15d0 0x7f2da80a3a90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0708e0 tx=0x7f2dac014750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2dc159a700 1 -- 172.21.15.17:0/3392558227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b66139a0 msgr2=0x5614b660fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2dc159a700 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b66139a0 0x5614b660fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2dc159a700 1 -- 172.21.15.17:0/3392558227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 msgr2=0x5614b6608580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2dc159a700 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b6608580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2dc159a700 1 -- 172.21.15.17:0/3392558227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db4011230 con 0x5614b6612fe0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2dc159a700 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 0x5614b6608ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2dac010650 tx=0x7f2dac017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b543d1b819ee8e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2da57fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.641+0000 7f2da57fa700 1 -- 172.21.15.17:0/3392558227 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac004a30 con 0x5614b6612fe0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.642+0000 7f2da57fa700 1 -- 172.21.15.17:0/3392558227 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2dac022030 con 0x5614b6612fe0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.642+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614b65f3d50 con 0x5614b6612fe0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.642+0000 7f2da57fa700 1 -- 172.21.15.17:0/3392558227 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dac010ed0 con 0x5614b6612fe0 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.643+0000 7f2dd78a4b80 10 client.26492 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.643+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5614b6367c00 con 0x5614b6612fe0 2023-10-05T15:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.643+0000 7f2da57fa700 1 -- 172.21.15.17:0/3392558227 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5614b65f3d50 con 0x5614b6612fe0 2023-10-05T15:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.643+0000 7f2da57fa700 1 -- 172.21.15.17:0/3392558227 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2dac011440 con 0x5614b6612fe0 2023-10-05T15:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dd78a4b80 10 client.26492 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dd78a4b80 10 client.26492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dd78a4b80 20 client.26492 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b6616b50 0x5614b6618f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dd78a4b80 4 client.26492 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:43:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614b654cdb0 con 0x5614b6616b50 2023-10-05T15:43:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.644+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b6616b50 0x5614b6618f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.645+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b6616b50 0x5614b6618f70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24897484e65c2493 server_cookie=763e7d89284f67c8 in_seq=0 out_seq=0 2023-10-05T15:43:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.645+0000 7f2da57fa700 10 client.26492 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.646+0000 7f2da57fa700 1 -- 172.21.15.17:0/3392558227 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5614b654cdb0 con 0x5614b6616b50 2023-10-05T15:43:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.646+0000 7f2da57fa700 10 client.26492 handle_command_reply: tid=0 2023-10-05T15:43:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.646+0000 7f2dd78a4b80 1 client.26492 shutdown 2023-10-05T15:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.646+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 msgr2=0x5614b6608ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.646+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 0x5614b6608ac0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2dac010650 tx=0x7f2dac017000 comp rx=0 tx=0).stop 2023-10-05T15:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 shutdown_connections 2023-10-05T15:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b6616b50 0x5614b6618f70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b66139a0 0x5614b660fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6611ed0 0x5614b6608580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/3392558227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b6612fe0 0x5614b6608ac0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 >> 172.21.15.17:0/3392558227 conn(0x5614b6575200 msgr2=0x5614b65fb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2da57fa700 0 client.26492 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 shutdown_connections 2023-10-05T15:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/3392558227 wait complete. 2023-10-05T15:43:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.647+0000 7f2dd78a4b80 20 client.26492 trim_cache size 0 max 16384 2023-10-05T15:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 Processor -- start 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 -- start start 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b65fc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b65fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b6608150 con 0x5614b6612fe0 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b63d48c0 con 0x5614b66139a0 2023-10-05T15:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.674+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b6616850 con 0x5614b6611ed0 2023-10-05T15:43:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b65fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b65fb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52360/0 (socket says 172.21.15.17:52360) 2023-10-05T15:43:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 -- 172.21.15.17:0/1908057313 learned_addr learned my addr 172.21.15.17:0/1908057313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc159a700 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 -- 172.21.15.17:0/1908057313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 msgr2=0x5614b65fc8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b65fc8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 -- 172.21.15.17:0/1908057313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 msgr2=0x5614b660fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.675+0000 7f2dc259c700 1 -- 172.21.15.17:0/1908057313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614b63a51f0 con 0x5614b66139a0 2023-10-05T15:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.676+0000 7f2dc259c700 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b65fb9a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2db4019000 tx=0x7f2db4011f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1777701eea9dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.676+0000 7f2db0ff9700 1 -- 172.21.15.17:0/1908057313 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db400e040 con 0x5614b66139a0 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.676+0000 7f2db0ff9700 1 -- 172.21.15.17:0/1908057313 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2db40093e0 con 0x5614b66139a0 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.676+0000 7f2db0ff9700 1 -- 172.21.15.17:0/1908057313 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40050c0 con 0x5614b66139a0 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1908057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 msgr2=0x5614b65fb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b65fb9a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2db4019000 tx=0x7f2db4011f40 comp rx=0 tx=0).stop 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1908057313 shutdown_connections 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b65fb9a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b65fc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/1908057313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.677+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1908057313 >> 172.21.15.17:0/1908057313 conn(0x5614b6575200 msgr2=0x5614b65fb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.678+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1908057313 shutdown_connections 2023-10-05T15:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.678+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/1908057313 wait complete. 2023-10-05T15:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.678+0000 7f2dd78a4b80 1 -- start start 2023-10-05T15:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 Processor -- start 2023-10-05T15:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b660cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b660e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b660e9c0 con 0x5614b6612fe0 2023-10-05T15:43:59.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b660eb30 con 0x5614b66139a0 2023-10-05T15:43:59.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614b660ecf0 con 0x5614b6611ed0 2023-10-05T15:43:59.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.679+0000 7f2dd78a4b80 10 client.0 _ll_register_callbacks cb 0x7f2dac014cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:43:59.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.680+0000 7f2dc159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.680+0000 7f2dc159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43104/0 (socket says 172.21.15.17:43104) 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.680+0000 7f2dc159a700 1 -- 172.21.15.17:0/905968656 learned_addr learned my addr 172.21.15.17:0/905968656 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.680+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b660cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.680+0000 7f2dc259c700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b660e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 msgr2=0x5614b660e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b660e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/905968656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 msgr2=0x5614b660d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2dc1d9b700 1 -- 172.21.15.17:0/905968656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614b637ed80 con 0x5614b6611ed0 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2dc1d9b700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b660cf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2db809b3b0 tx=0x7f2db8005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5bdbda6a0e8d3d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:43:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.681+0000 7f2da57fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.682+0000 7f2da57fa700 1 -- 172.21.15.17:0/905968656 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db809af60 con 0x5614b6611ed0 2023-10-05T15:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.682+0000 7f2da57fa700 1 -- 172.21.15.17:0/905968656 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f2db800f460 con 0x5614b6611ed0 2023-10-05T15:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.685+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2db400f040 con 0x5614b6611ed0 2023-10-05T15:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.685+0000 7f2da57fa700 1 -- 172.21.15.17:0/905968656 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2db809ad80 con 0x5614b6611ed0 2023-10-05T15:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.686+0000 7f2dd78a4b80 10 client.26470 fetch_fsmap learned FSMap version 39 2023-10-05T15:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.686+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5614b637d250 con 0x5614b6611ed0 2023-10-05T15:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.686+0000 7f2da57fa700 1 -- 172.21.15.17:0/905968656 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2db400f040 con 0x5614b6611ed0 2023-10-05T15:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2da57fa700 1 -- 172.21.15.17:0/905968656 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2db80ce130 con 0x5614b6611ed0 2023-10-05T15:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dd78a4b80 10 client.26470 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dd78a4b80 10 client.26470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dd78a4b80 20 client.26470 populate_metadata read hostname 'smithi017' 2023-10-05T15:43:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b666ac70 0x5614b666d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:43:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dd78a4b80 4 client.26470 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:43:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5614b654cad0 con 0x5614b666ac70 2023-10-05T15:43:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.687+0000 7f2dc159a700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b666ac70 0x5614b666d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:43:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.688+0000 7f2dc159a700 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b666ac70 0x5614b666d060 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c1e20ae0b6fe17 server_cookie=2e45f53b2cb6c6d1 in_seq=0 out_seq=0 2023-10-05T15:43:59.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.688+0000 7f2da57fa700 10 client.26470 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:59.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.705+0000 7f2da57fa700 1 -- 172.21.15.17:0/905968656 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5614b654cad0 con 0x5614b666ac70 2023-10-05T15:43:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.705+0000 7f2da57fa700 10 client.26470 handle_command_reply: tid=0 2023-10-05T15:43:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.705+0000 7f2dd78a4b80 1 client.26470 shutdown 2023-10-05T15:43:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.705+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 msgr2=0x5614b660cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.705+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b660cf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2db809b3b0 tx=0x7f2db8005c60 comp rx=0 tx=0).stop 2023-10-05T15:43:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 shutdown_connections 2023-10-05T15:43:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5614b666ac70 0x5614b666d060 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5614b66139a0 0x5614b660e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614b6611ed0 0x5614b660cf30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2dd78a4b80 1 --2- 172.21.15.17:0/905968656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5614b6612fe0 0x5614b660d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 >> 172.21.15.17:0/905968656 conn(0x5614b6575200 msgr2=0x5614b6618b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.706+0000 7f2da57fa700 0 client.26470 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:43:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.707+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 shutdown_connections 2023-10-05T15:43:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.707+0000 7f2dd78a4b80 1 -- 172.21.15.17:0/905968656 wait complete. 2023-10-05T15:43:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.709+0000 7f2dd78a4b80 20 client.26470 trim_cache size 0 max 16384 2023-10-05T15:43:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:43:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:43:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:43:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:43:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.710+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2da80a15d0 msgr2=0x7f2da80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.710+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2da80a15d0 0x7f2da80a3a90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0708e0 tx=0x7f2dac014750 comp rx=0 tx=0).stop 2023-10-05T15:43:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.710+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 msgr2=0x7f2dbc06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:43:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.710+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc06f890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2db8000c00 tx=0x7f2db8005740 comp rx=0 tx=0).stop 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 shutdown_connections 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f2da80a15d0 0x7f2da80a3a90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dbc1008d0 0x7f2dbc070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2dbc0ff1b0 0x7f2dbc06f890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 --2- 172.21.15.17:0/3230288353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dbc0fff10 0x7f2dbc06fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 >> 172.21.15.17:0/3230288353 conn(0x7f2dbc0faac0 msgr2=0x7f2dbc0fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 shutdown_connections 2023-10-05T15:43:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:43:59.711+0000 7f2dc3fff700 1 -- 172.21.15.17:0/3230288353 wait complete. 2023-10-05T15:44:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:43:59 smithi167 ceph-mon[133366]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.2 MiB/s wr, 654 op/s 2023-10-05T15:44:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:43:59 smithi079 ceph-mon[132936]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.2 MiB/s wr, 654 op/s 2023-10-05T15:44:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:43:59 smithi017 ceph-mon[129107]: pgmap v591: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.2 MiB/s wr, 654 op/s 2023-10-05T15:44:02.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:01 smithi167 ceph-mon[133366]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 749 op/s 2023-10-05T15:44:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:01 smithi079 ceph-mon[132936]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 749 op/s 2023-10-05T15:44:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:01 smithi017 ceph-mon[129107]: pgmap v592: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 749 op/s 2023-10-05T15:44:03.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 325.0 s, 608.3 tps, lat 163.667 ms stddev 52.408 2023-10-05T15:44:04.086 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:03 smithi167 ceph-mon[133366]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.4 MiB/s wr, 643 op/s 2023-10-05T15:44:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:03 smithi079 ceph-mon[132936]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.4 MiB/s wr, 643 op/s 2023-10-05T15:44:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:03 smithi017 ceph-mon[129107]: pgmap v593: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.4 MiB/s wr, 643 op/s 2023-10-05T15:44:06.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:05 smithi167 ceph-mon[133366]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 872 op/s 2023-10-05T15:44:06.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:05 smithi079 ceph-mon[132936]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 872 op/s 2023-10-05T15:44:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:05 smithi017 ceph-mon[129107]: pgmap v594: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 872 op/s 2023-10-05T15:44:06.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:44:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.770+0000 7f3717fff700 1 -- 172.21.15.17:0/893045335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37100ff730 msgr2=0x7f3710101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.770+0000 7f3717fff700 1 --2- 172.21.15.17:0/893045335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37100ff730 0x7f3710101b60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f370c009990 tx=0x7f370c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.771+0000 7f3717fff700 1 -- 172.21.15.17:0/893045335 shutdown_connections 2023-10-05T15:44:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.771+0000 7f3717fff700 1 --2- 172.21.15.17:0/893045335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3710104a70 0x7f3710104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.771+0000 7f3717fff700 1 --2- 172.21.15.17:0/893045335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37100ff730 0x7f3710101b60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.771+0000 7f3717fff700 1 --2- 172.21.15.17:0/893045335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f3710104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.772+0000 7f3717fff700 1 -- 172.21.15.17:0/893045335 >> 172.21.15.17:0/893045335 conn(0x7f37100fb330 msgr2=0x7f37100fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:06.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.772+0000 7f3717fff700 1 -- 172.21.15.17:0/893045335 shutdown_connections 2023-10-05T15:44:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.772+0000 7f3717fff700 1 -- 172.21.15.17:0/893045335 wait complete. 2023-10-05T15:44:06.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.774+0000 7f3717fff700 1 Processor -- start 2023-10-05T15:44:06.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.775+0000 7f3717fff700 1 -- start start 2023-10-05T15:44:06.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.775+0000 7f3717fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37100ff730 0x7f371006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.775+0000 7f3717fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f371006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f371559a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f371006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f371559a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f371006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50504/0 (socket says 172.21.15.17:50504) 2023-10-05T15:44:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f3715d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37100ff730 0x7f371006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f3715d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37100ff730 0x7f371006f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48860/0 (socket says 172.21.15.17:48860) 2023-10-05T15:44:06.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f3717fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3710104a70 0x7f37101ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f3717fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710072de0 con 0x7f37100ff730 2023-10-05T15:44:06.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f3717fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710072f50 con 0x7f37101020a0 2023-10-05T15:44:06.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.776+0000 7f3717fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37101ad850 con 0x7f3710104a70 2023-10-05T15:44:06.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.777+0000 7f371559a700 1 -- 172.21.15.17:0/1093008788 learned_addr learned my addr 172.21.15.17:0/1093008788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:06.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.778+0000 7f371559a700 1 -- 172.21.15.17:0/1093008788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3710104a70 msgr2=0x7f37101ad310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:44:06.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.778+0000 7f371559a700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3710104a70 0x7f37101ad310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.778+0000 7f371559a700 1 -- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37100ff730 msgr2=0x7f371006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.778+0000 7f371559a700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37100ff730 0x7f371006f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.778+0000 7f371559a700 1 -- 172.21.15.17:0/1093008788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0095f0 con 0x7f37101020a0 2023-10-05T15:44:06.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.779+0000 7f371559a700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f371006fd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f370000b550 tx=0x7f370000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:06.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.779+0000 7f3706ffd700 1 -- 172.21.15.17:0/1093008788 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700011830 con 0x7f37101020a0 2023-10-05T15:44:06.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.779+0000 7f3706ffd700 1 -- 172.21.15.17:0/1093008788 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3700011e20 con 0x7f37101020a0 2023-10-05T15:44:06.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.779+0000 7f3706ffd700 1 -- 172.21.15.17:0/1093008788 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700010da0 con 0x7f37101020a0 2023-10-05T15:44:06.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.780+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37101adb00 con 0x7f37101020a0 2023-10-05T15:44:06.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.780+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37101ae040 con 0x7f37101020a0 2023-10-05T15:44:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.788+0000 7f372b9deb80 1 Processor -- start 2023-10-05T15:44:06.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.789+0000 7f3706ffd700 1 -- 172.21.15.17:0/1093008788 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3700011990 con 0x7f37101020a0 2023-10-05T15:44:06.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.790+0000 7f372b9deb80 1 -- start start 2023-10-05T15:44:06.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.790+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3260 0x55a6171e3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.790+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.791+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 0x55a6171e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.791+0000 7f372b9deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a61714b460 con 0x55a6171e3bc0 2023-10-05T15:44:06.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.791+0000 7f372b9deb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a61713cc20 con 0x55a6171e4a60 2023-10-05T15:44:06.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.791+0000 7f372b9deb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a61713a540 con 0x55a6171e3260 2023-10-05T15:44:06.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.792+0000 7f3715d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.792+0000 7f3715d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171e4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48874/0 (socket says 172.21.15.17:48874) 2023-10-05T15:44:06.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.792+0000 7f3715d9b700 1 -- 172.21.15.17:0/4177839516 learned_addr learned my addr 172.21.15.17:0/4177839516 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:06.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.792+0000 7f371659c700 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3260 0x55a6171e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f371659c700 1 -- 172.21.15.17:0/4177839516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 msgr2=0x55a6171e4ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f371659c700 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 0x55a6171e4ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f371659c700 1 -- 172.21.15.17:0/4177839516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 msgr2=0x55a6171e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f371659c700 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f371659c700 1 -- 172.21.15.17:0/4177839516 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a616f60de0 con 0x55a6171e3260 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f3706ffd700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36fc0a1680 0x7f36fc0a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f371659c700 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3260 0x55a6171e3680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f370800e490 tx=0x7f3708009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652c299ad80fc62e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:06.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.793+0000 7f3706ffd700 1 -- 172.21.15.17:0/1093008788 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f37000cc8d0 con 0x7f37101020a0 2023-10-05T15:44:06.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.794+0000 7f36fbfff700 1 -- 172.21.15.17:0/4177839516 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708004db0 con 0x55a6171e3260 2023-10-05T15:44:06.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.794+0000 7f36fbfff700 1 -- 172.21.15.17:0/4177839516 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f370800f040 con 0x55a6171e3260 2023-10-05T15:44:06.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.794+0000 7f36fbfff700 1 -- 172.21.15.17:0/4177839516 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708004450 con 0x55a6171e3260 2023-10-05T15:44:06.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.794+0000 7f3715d9b700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36fc0a1680 0x7f36fc0a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.795+0000 7f372b9deb80 1 -- 172.21.15.17:0/4177839516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3260 msgr2=0x55a6171e3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.795+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3260 0x55a6171e3680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f370800e490 tx=0x7f3708009920 comp rx=0 tx=0).stop 2023-10-05T15:44:06.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.796+0000 7f3715d9b700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36fc0a1680 0x7f36fc0a3b40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f370c00b2e0 tx=0x7f370c004080 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:06.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.796+0000 7f372b9deb80 1 -- 172.21.15.17:0/4177839516 shutdown_connections 2023-10-05T15:44:06.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.796+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 0x55a6171e4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.796+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3260 0x55a6171e3680 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.796+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4177839516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.796+0000 7f372b9deb80 1 -- 172.21.15.17:0/4177839516 >> 172.21.15.17:0/4177839516 conn(0x55a617157260 msgr2=0x55a6171de140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:06.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.798+0000 7f372b9deb80 1 -- 172.21.15.17:0/4177839516 shutdown_connections 2023-10-05T15:44:06.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.798+0000 7f372b9deb80 1 -- 172.21.15.17:0/4177839516 wait complete. 2023-10-05T15:44:06.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.799+0000 7f372b9deb80 1 -- start start 2023-10-05T15:44:06.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 Processor -- start 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3260 0x55a6171ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171ed620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a617135e30 con 0x55a6171e3bc0 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6170d2710 con 0x55a6171e3260 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6170d23b0 con 0x55a6171e4a60 2023-10-05T15:44:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.800+0000 7f372b9deb80 10 client.0 _ll_register_callbacks cb 0x55a616f2f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.801+0000 7f371559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.801+0000 7f371559a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171ed620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48888/0 (socket says 172.21.15.17:48888) 2023-10-05T15:44:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.801+0000 7f371559a700 1 -- 172.21.15.17:0/2694368571 learned_addr learned my addr 172.21.15.17:0/2694368571 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.801+0000 7f3715d9b700 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3260 0x55a6171ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.802+0000 7f371559a700 1 -- 172.21.15.17:0/2694368571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 msgr2=0x55a6171f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.802+0000 7f371559a700 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.802+0000 7f371559a700 1 -- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3260 msgr2=0x55a6171ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.802+0000 7f371559a700 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3260 0x55a6171ed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.802+0000 7f371559a700 1 -- 172.21.15.17:0/2694368571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370800e140 con 0x55a6171e3bc0 2023-10-05T15:44:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.803+0000 7f371559a700 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171ed620 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f370000bf90 tx=0x7f3700099460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19af5a8c28066e1d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.803+0000 7f36f97fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:44:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.803+0000 7f36f97fa700 1 -- 172.21.15.17:0/2694368571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000997f0 con 0x55a6171e3bc0 2023-10-05T15:44:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.803+0000 7f36f97fa700 1 -- 172.21.15.17:0/2694368571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f370009d940 con 0x55a6171e3bc0 2023-10-05T15:44:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.804+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6171d5f10 con 0x55a6171e3bc0 2023-10-05T15:44:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.804+0000 7f36f97fa700 1 -- 172.21.15.17:0/2694368571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37000a1b80 con 0x55a6171e3bc0 2023-10-05T15:44:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.804+0000 7f372b9deb80 10 client.16614 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.804+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a616f49c60 con 0x55a6171e3bc0 2023-10-05T15:44:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f36f97fa700 1 -- 172.21.15.17:0/2694368571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6171d5f10 con 0x55a6171e3bc0 2023-10-05T15:44:06.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f36f97fa700 1 -- 172.21.15.17:0/2694368571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f37000b3050 con 0x55a6171e3bc0 2023-10-05T15:44:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f372b9deb80 10 client.16614 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f372b9deb80 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f372b9deb80 20 client.16614 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f372b9deb80 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a6171f8e40 0x55a6171fb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f372b9deb80 4 client.16614 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:44:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.806+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a61712ee10 con 0x55a6171f8e40 2023-10-05T15:44:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.807+0000 7f3715d9b700 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a6171f8e40 0x55a6171fb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.808+0000 7f3715d9b700 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a6171f8e40 0x55a6171fb260 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b4bf95d24a7cbe server_cookie=eaec0e43338c2b79 in_seq=0 out_seq=0 2023-10-05T15:44:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.808+0000 7f36f97fa700 10 client.16614 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:06.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.810+0000 7f36f97fa700 1 -- 172.21.15.17:0/2694368571 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a61712ee10 con 0x55a6171f8e40 2023-10-05T15:44:06.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.810+0000 7f36f97fa700 10 client.16614 handle_command_reply: tid=0 2023-10-05T15:44:06.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.810+0000 7f372b9deb80 1 client.16614 shutdown 2023-10-05T15:44:06.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.811+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 msgr2=0x55a6171ed620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.811+0000 7f372b9deb80 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171ed620 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f370000bf90 tx=0x7f3700099460 comp rx=0 tx=0).stop 2023-10-05T15:44:06.814 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:06 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:44:06.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 shutdown_connections 2023-10-05T15:44:06.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a6171f8e40 0x55a6171fb260 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3260 0x55a6171ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 --2- 172.21.15.17:0/2694368571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3bc0 0x55a6171ed620 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 >> 172.21.15.17:0/2694368571 conn(0x55a617157260 msgr2=0x55a6171ddf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:06.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f36f97fa700 0 client.16614 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:06.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.813+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 shutdown_connections 2023-10-05T15:44:06.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.814+0000 7f372b9deb80 1 -- 172.21.15.17:0/2694368571 wait complete. 2023-10-05T15:44:06.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.814+0000 7f372b9deb80 20 client.16614 trim_cache size 0 max 16384 2023-10-05T15:44:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 Processor -- start 2023-10-05T15:44:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 -- start start 2023-10-05T15:44:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3260 0x55a6171f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3bc0 0x55a6171f4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 0x55a6171ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a616fb6920 con 0x55a6171e3260 2023-10-05T15:44:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6171df020 con 0x55a6171e4a60 2023-10-05T15:44:06.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.847+0000 7f372b9deb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6171e2ee0 con 0x55a6171e3bc0 2023-10-05T15:44:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f371559a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3bc0 0x55a6171f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f3715d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3260 0x55a6171f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f371559a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3bc0 0x55a6171f4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60372/0 (socket says 172.21.15.17:60372) 2023-10-05T15:44:06.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f371559a700 1 -- 172.21.15.17:0/3487839337 learned_addr learned my addr 172.21.15.17:0/3487839337 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f3715d9b700 1 -- 172.21.15.17:0/3487839337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3bc0 msgr2=0x55a6171f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f3715d9b700 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3bc0 0x55a6171f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f3715d9b700 1 -- 172.21.15.17:0/3487839337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 msgr2=0x55a6171ed0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:44:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f3715d9b700 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 0x55a6171ed0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.849+0000 7f3715d9b700 1 -- 172.21.15.17:0/3487839337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a616f87250 con 0x55a6171e3260 2023-10-05T15:44:06.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.850+0000 7f3715d9b700 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3260 0x55a6171f4ef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55a6171fbb90 tx=0x7f370c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e798fb0d3ab3f874 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.851+0000 7f3704ff9700 1 -- 172.21.15.17:0/3487839337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c034e60 con 0x55a6171e3260 2023-10-05T15:44:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.851+0000 7f3704ff9700 1 -- 172.21.15.17:0/3487839337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f370c01e040 con 0x55a6171e3260 2023-10-05T15:44:06.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.851+0000 7f3704ff9700 1 -- 172.21.15.17:0/3487839337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c003cf0 con 0x55a6171e3260 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 -- 172.21.15.17:0/3487839337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3260 msgr2=0x55a6171f4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3260 0x55a6171f4ef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55a6171fbb90 tx=0x7f370c023000 comp rx=0 tx=0).stop 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 -- 172.21.15.17:0/3487839337 shutdown_connections 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e4a60 0x55a6171ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171e3260 0x55a6171f4ef0 secure :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55a6171fbb90 tx=0x7f370c023000 comp rx=0 tx=0).stop 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 --2- 172.21.15.17:0/3487839337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e3bc0 0x55a6171f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 -- 172.21.15.17:0/3487839337 >> 172.21.15.17:0/3487839337 conn(0x55a617157260 msgr2=0x55a6171dcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:06.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.852+0000 7f372b9deb80 1 -- 172.21.15.17:0/3487839337 shutdown_connections 2023-10-05T15:44:06.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.853+0000 7f372b9deb80 1 -- 172.21.15.17:0/3487839337 wait complete. 2023-10-05T15:44:06.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.853+0000 7f372b9deb80 1 -- start start 2023-10-05T15:44:06.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.853+0000 7f372b9deb80 1 Processor -- start 2023-10-05T15:44:06.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.854+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3bc0 0x55a6171f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.854+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.854+0000 7f372b9deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171f2750 0x55a6171f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.854+0000 7f372b9deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6171f3300 con 0x55a6171f2750 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.854+0000 7f372b9deb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6171f3470 con 0x55a6171e3bc0 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.854+0000 7f372b9deb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a61724cc80 con 0x55a6171e4a60 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.855+0000 7f371559a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.855+0000 7f371559a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60376/0 (socket says 172.21.15.17:60376) 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.855+0000 7f371559a700 1 -- 172.21.15.17:0/4098925496 learned_addr learned my addr 172.21.15.17:0/4098925496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:06.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.855+0000 7f371659c700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171f2750 0x55a6171f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.855+0000 7f371559a700 1 -- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3bc0 msgr2=0x55a6171f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:06.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.855+0000 7f371559a700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3bc0 0x55a6171f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f372b9deb80 10 client.0 _ll_register_callbacks cb 0x7f3700095b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:06.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f371559a700 1 -- 172.21.15.17:0/4098925496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171f2750 msgr2=0x55a6171f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:06.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f371559a700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171f2750 0x55a6171f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f371559a700 1 -- 172.21.15.17:0/4098925496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c02c040 con 0x55a6171e4a60 2023-10-05T15:44:06.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f371659c700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171f2750 0x55a6171f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:44:06.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f370800f040 con 0x55a6171e4a60 2023-10-05T15:44:06.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f371559a700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3700096260 tx=0x7f37000105b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd9251f14c65673 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:06.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.857+0000 7f36f97fa700 10 client.26482 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:44:06.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.858+0000 7f36f97fa700 1 -- 172.21.15.17:0/4098925496 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370009d940 con 0x55a6171e4a60 2023-10-05T15:44:06.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.858+0000 7f36f97fa700 1 -- 172.21.15.17:0/4098925496 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f37000a1b80 con 0x55a6171e4a60 2023-10-05T15:44:06.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.858+0000 7f36f97fa700 1 -- 172.21.15.17:0/4098925496 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37000997f0 con 0x55a6171e4a60 2023-10-05T15:44:06.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.858+0000 7f372b9deb80 10 client.26482 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:06.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.858+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({fsmap=39}) v3 -- 0x55a616f5f2b0 con 0x55a6171e4a60 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f36f97fa700 1 -- 172.21.15.17:0/4098925496 <== mon.1 v2:172.21.15.167:3300/0 4 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f37000b3030 con 0x55a6171e4a60 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f372b9deb80 10 client.26482 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f372b9deb80 10 client.26482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f372b9deb80 20 client.26482 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a61724df40 0x55a617250360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f372b9deb80 4 client.26482 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:44:06.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.859+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a61712eb30 con 0x55a61724df40 2023-10-05T15:44:06.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.860+0000 7f3715d9b700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a61724df40 0x55a617250360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:06.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.861+0000 7f3715d9b700 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a61724df40 0x55a617250360 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7295d26f49ffa083 server_cookie=451e3b0f72f74e7a in_seq=0 out_seq=0 2023-10-05T15:44:06.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.861+0000 7f36f97fa700 10 client.26482 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:06.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.861+0000 7f36f97fa700 1 -- 172.21.15.17:0/4098925496 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a61712eb30 con 0x55a61724df40 2023-10-05T15:44:06.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.861+0000 7f36f97fa700 10 client.26482 handle_command_reply: tid=0 2023-10-05T15:44:06.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.861+0000 7f372b9deb80 1 client.26482 shutdown 2023-10-05T15:44:06.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.862+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 msgr2=0x55a6171f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.862+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3700096260 tx=0x7f37000105b0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 shutdown_connections 2023-10-05T15:44:06.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a61724df40 0x55a617250360 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6171f2750 0x55a6171f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a6171e3bc0 0x55a6171f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 --2- 172.21.15.17:0/4098925496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a6171e4a60 0x55a6171f4680 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 >> 172.21.15.17:0/4098925496 conn(0x55a617157260 msgr2=0x55a6171f4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:06.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f36f97fa700 0 client.26482 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:06.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 shutdown_connections 2023-10-05T15:44:06.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.863+0000 7f372b9deb80 1 -- 172.21.15.17:0/4098925496 wait complete. 2023-10-05T15:44:06.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.864+0000 7f372b9deb80 20 client.26482 trim_cache size 0 max 16384 2023-10-05T15:44:06.867 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:44:06.867 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:44:06.867 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:44:06.867 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:44:06.868 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:44:06.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:44:06.868 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:44:06.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:44:06.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:44:06.868 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36fc0a1680 msgr2=0x7f36fc0a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36fc0a1680 0x7f36fc0a3b40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f370c00b2e0 tx=0x7f370c004080 comp rx=0 tx=0).stop 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 msgr2=0x7f371006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f371006fd00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f370000b550 tx=0x7f370000b910 comp rx=0 tx=0).stop 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 shutdown_connections 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f36fc0a1680 0x7f36fc0a3b40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3710104a70 0x7f37101ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37100ff730 0x7f371006f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 --2- 172.21.15.17:0/1093008788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37101020a0 0x7f371006fd00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.865+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 >> 172.21.15.17:0/1093008788 conn(0x7f37100fb330 msgr2=0x7f3710102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.866+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 shutdown_connections 2023-10-05T15:44:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:06.866+0000 7f3717fff700 1 -- 172.21.15.17:0/1093008788 wait complete. 2023-10-05T15:44:06.895 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:44:07.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:06 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:44:07.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:06 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:44:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.3 MiB/s wr, 661 op/s 2023-10-05T15:44:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:44:08.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:07 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.3 MiB/s wr, 661 op/s 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:44:08.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:44:08.106 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:07 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:44:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 330.0 s, 548.3 tps, lat 184.010 ms stddev 65.686 2023-10-05T15:44:08.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: pgmap v595: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.3 MiB/s wr, 661 op/s 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:44:08.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:44:08.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:07 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:44:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:08 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi167 to 220.9M 2023-10-05T15:44:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:08 smithi167 ceph-mon[133366]: Unable to set osd_memory_target on smithi167 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-05T15:44:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:08 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi079 to 220.9M 2023-10-05T15:44:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:08 smithi167 ceph-mon[133366]: Unable to set osd_memory_target on smithi079 to 231673344: error parsing value: Value '231673344' is below minimum 939524096 2023-10-05T15:44:09.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:08 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi167 to 220.9M 2023-10-05T15:44:09.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:08 smithi079 ceph-mon[132936]: Unable to set osd_memory_target on smithi167 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-05T15:44:09.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:08 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi079 to 220.9M 2023-10-05T15:44:09.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:08 smithi079 ceph-mon[132936]: Unable to set osd_memory_target on smithi079 to 231673344: error parsing value: Value '231673344' is below minimum 939524096 2023-10-05T15:44:09.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:08 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi167 to 220.9M 2023-10-05T15:44:09.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:08 smithi017 ceph-mon[129107]: Unable to set osd_memory_target on smithi167 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-05T15:44:09.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:08 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi079 to 220.9M 2023-10-05T15:44:09.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:08 smithi017 ceph-mon[129107]: Unable to set osd_memory_target on smithi079 to 231673344: error parsing value: Value '231673344' is below minimum 939524096 2023-10-05T15:44:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:09 smithi079 ceph-mon[132936]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 740 op/s 2023-10-05T15:44:10.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:09 smithi017 ceph-mon[129107]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 740 op/s 2023-10-05T15:44:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:09 smithi167 ceph-mon[133366]: pgmap v596: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 740 op/s 2023-10-05T15:44:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:11 smithi079 ceph-mon[132936]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.3 MiB/s wr, 723 op/s 2023-10-05T15:44:12.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:11 smithi017 ceph-mon[129107]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.3 MiB/s wr, 723 op/s 2023-10-05T15:44:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:11 smithi167 ceph-mon[133366]: pgmap v597: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.3 MiB/s wr, 723 op/s 2023-10-05T15:44:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.979+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/270128426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48100f10 msgr2=0x7f7c48101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:12.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.979+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/270128426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48100f10 0x7f7c48101330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009990 tx=0x7f7c38009ca0 comp rx=0 tx=0).stop 2023-10-05T15:44:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.982+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/270128426 shutdown_connections 2023-10-05T15:44:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.982+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/270128426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102a20 0x7f7c48109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.982+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/270128426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48100f10 0x7f7c48101330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.982+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/270128426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c48102060 0x7f7c481024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.982+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/270128426 >> 172.21.15.17:0/270128426 conn(0x7f7c480fc460 msgr2=0x7f7c480fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:12.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.984+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/270128426 shutdown_connections 2023-10-05T15:44:12.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.984+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/270128426 wait complete. 2023-10-05T15:44:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 Processor -- start 2023-10-05T15:44:12.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 -- start start 2023-10-05T15:44:12.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c48100f10 0x7f7c4819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102060 0x7f7c4819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48102a20 0x7f7c4819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4819ec90 con 0x7f7c48102060 2023-10-05T15:44:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4819ee00 con 0x7f7c48102a20 2023-10-05T15:44:12.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.986+0000 7f7c4c9ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4819efc0 con 0x7f7c48100f10 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.987+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102060 0x7f7c4819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.987+0000 7f7c46d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48102a20 0x7f7c4819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.987+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102060 0x7f7c4819dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48922/0 (socket says 172.21.15.17:48922) 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.987+0000 7f7c45d9b700 1 -- 172.21.15.17:0/3974039924 learned_addr learned my addr 172.21.15.17:0/3974039924 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.987+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c48100f10 0x7f7c4819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.988+0000 7f7c46d9d700 1 -- 172.21.15.17:0/3974039924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c48100f10 msgr2=0x7f7c4819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.988+0000 7f7c46d9d700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c48100f10 0x7f7c4819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.988+0000 7f7c46d9d700 1 -- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102060 msgr2=0x7f7c4819dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.988+0000 7f7c46d9d700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102060 0x7f7c4819dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:12.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.988+0000 7f7c46d9d700 1 -- 172.21.15.17:0/3974039924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380095f0 con 0x7f7c48102a20 2023-10-05T15:44:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.988+0000 7f7c46d9d700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48102a20 0x7f7c4819e650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c40007f10 tx=0x7f7c4000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.989+0000 7f7c377fe700 1 -- 172.21.15.17:0/3974039924 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000ddd0 con 0x7f7c48102a20 2023-10-05T15:44:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.989+0000 7f7c377fe700 1 -- 172.21.15.17:0/3974039924 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c4000f040 con 0x7f7c48102a20 2023-10-05T15:44:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.989+0000 7f7c377fe700 1 -- 172.21.15.17:0/3974039924 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400059b0 con 0x7f7c48102a20 2023-10-05T15:44:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.989+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4819f2a0 con 0x7f7c48102a20 2023-10-05T15:44:12.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.989+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c481a5a80 con 0x7f7c48102a20 2023-10-05T15:44:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.996+0000 7f7c377fe700 1 -- 172.21.15.17:0/3974039924 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7c40005020 con 0x7f7c48102a20 2023-10-05T15:44:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.996+0000 7f7c6031ab80 1 Processor -- start 2023-10-05T15:44:13.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.997+0000 7f7c6031ab80 1 -- start start 2023-10-05T15:44:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.999+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3158ed0 0x560bf31592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.999+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 0x560bf315a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.999+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.999+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf30b0400 con 0x560bf315a9a0 2023-10-05T15:44:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.999+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf30a1bc0 con 0x560bf3158ed0 2023-10-05T15:44:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:12.999+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf309f4e0 con 0x560bf3159fe0 2023-10-05T15:44:13.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.000+0000 7f7c4659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 0x560bf315a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.000+0000 7f7c4659c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 0x560bf315a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60406/0 (socket says 172.21.15.17:60406) 2023-10-05T15:44:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.000+0000 7f7c4659c700 1 -- 172.21.15.17:0/3134263535 learned_addr learned my addr 172.21.15.17:0/3134263535 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.000+0000 7f7c377fe700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7c300a15d0 0x7f7c300a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c377fe700 1 -- 172.21.15.17:0/3974039924 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7c400cc9e0 con 0x7f7c48102a20 2023-10-05T15:44:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c4659c700 1 -- 172.21.15.17:0/3134263535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3158ed0 msgr2=0x560bf31592f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:44:13.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3158ed0 0x560bf31592f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c4659c700 1 -- 172.21.15.17:0/3134263535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 msgr2=0x560bf3161230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:44:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3161230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c4659c700 1 -- 172.21.15.17:0/3134263535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bf2ec5d80 con 0x560bf3159fe0 2023-10-05T15:44:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c46d9d700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7c300a15d0 0x7f7c300a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.001+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 0x560bf315a460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7c38015000 tx=0x7f7c38005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f098a001a6a66a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.002+0000 7f7c34ff9700 1 -- 172.21.15.17:0/3134263535 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800b970 con 0x560bf3159fe0 2023-10-05T15:44:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.002+0000 7f7c34ff9700 1 -- 172.21.15.17:0/3134263535 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c3801e040 con 0x560bf3159fe0 2023-10-05T15:44:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.002+0000 7f7c34ff9700 1 -- 172.21.15.17:0/3134263535 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004760 con 0x560bf3159fe0 2023-10-05T15:44:13.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3134263535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 msgr2=0x560bf315a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c46d9d700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7c300a15d0 0x7f7c300a3a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c40095e00 tx=0x7f7c40007f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 0x560bf315a460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7c38015000 tx=0x7f7c38005da0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3134263535 shutdown_connections 2023-10-05T15:44:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3158ed0 0x560bf31592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3134263535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3159fe0 0x560bf315a460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.003+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3134263535 >> 172.21.15.17:0/3134263535 conn(0x560bf30bc200 msgr2=0x560bf3142bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.004+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3134263535 shutdown_connections 2023-10-05T15:44:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.005+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3134263535 wait complete. 2023-10-05T15:44:13.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.005+0000 7f7c6031ab80 1 -- start start 2023-10-05T15:44:13.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.006+0000 7f7c6031ab80 1 Processor -- start 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf3163110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf316a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf309add0 con 0x560bf315a9a0 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf30376b0 con 0x560bf3159fe0 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf3037350 con 0x560bf3158ed0 2023-10-05T15:44:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.007+0000 7f7c6031ab80 10 client.0 _ll_register_callbacks cb 0x560bf2e947a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.008+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.008+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3162bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60408/0 (socket says 172.21.15.17:60408) 2023-10-05T15:44:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.008+0000 7f7c45d9b700 1 -- 172.21.15.17:0/3439501782 learned_addr learned my addr 172.21.15.17:0/3439501782 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf316a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf3163110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 -- 172.21.15.17:0/3439501782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 msgr2=0x560bf3162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 -- 172.21.15.17:0/3439501782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 msgr2=0x560bf316a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf316a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 -- 172.21.15.17:0/3439501782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c48109c70 con 0x560bf3159fe0 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c4659c700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf3163110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c38000c00 tx=0x7f7c38005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d94e5dedeac4184 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.009+0000 7f7c2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.010+0000 7f7c2dffb700 1 -- 172.21.15.17:0/3439501782 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004700 con 0x560bf3159fe0 2023-10-05T15:44:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.010+0000 7f7c2dffb700 1 -- 172.21.15.17:0/3439501782 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7c38005670 con 0x560bf3159fe0 2023-10-05T15:44:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.010+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bf313ad50 con 0x560bf3159fe0 2023-10-05T15:44:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.011+0000 7f7c2dffb700 1 -- 172.21.15.17:0/3439501782 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c38004860 con 0x560bf3159fe0 2023-10-05T15:44:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.011+0000 7f7c6031ab80 10 client.26513 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.011+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560bf2eaec00 con 0x560bf3159fe0 2023-10-05T15:44:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c2dffb700 1 -- 172.21.15.17:0/3439501782 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560bf313ad50 con 0x560bf3159fe0 2023-10-05T15:44:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c2dffb700 1 -- 172.21.15.17:0/3439501782 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c3800fac0 con 0x560bf3159fe0 2023-10-05T15:44:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c6031ab80 10 client.26513 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c6031ab80 10 client.26513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c6031ab80 20 client.26513 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:13.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf317f680 0x560bf3181aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c6031ab80 4 client.26513 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:44:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.013+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bf3093db0 con 0x560bf317f680 2023-10-05T15:44:13.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.014+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf317f680 0x560bf3181aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.015+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf317f680 0x560bf3181aa0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=965cc2276e2cbbb2 server_cookie=e40c2eaa276a3732 in_seq=0 out_seq=0 2023-10-05T15:44:13.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.016+0000 7f7c2dffb700 10 client.26513 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:13.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.016+0000 7f7c2dffb700 1 -- 172.21.15.17:0/3439501782 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560bf3093db0 con 0x560bf317f680 2023-10-05T15:44:13.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.016+0000 7f7c2dffb700 10 client.26513 handle_command_reply: tid=0 2023-10-05T15:44:13.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.016+0000 7f7c6031ab80 1 client.26513 shutdown 2023-10-05T15:44:13.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.018+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 msgr2=0x560bf3163110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:13.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.018+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf3163110 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c38000c00 tx=0x7f7c38005270 comp rx=0 tx=0).stop 2023-10-05T15:44:13.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.018+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 shutdown_connections 2023-10-05T15:44:13.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.018+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf317f680 0x560bf3181aa0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf316a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/3439501782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf3163110 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 >> 172.21.15.17:0/3439501782 conn(0x560bf30bc200 msgr2=0x560bf3142250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c2dffb700 0 client.26513 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 shutdown_connections 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 1 -- 172.21.15.17:0/3439501782 wait complete. 2023-10-05T15:44:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.019+0000 7f7c6031ab80 20 client.26513 trim_cache size 0 max 16384 2023-10-05T15:44:13.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.046+0000 7f7c6031ab80 1 Processor -- start 2023-10-05T15:44:13.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 -- start start 2023-10-05T15:44:13.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf31618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf316a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3142980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf2f1b8c0 con 0x560bf315a9a0 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf3159de0 con 0x560bf3159fe0 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.047+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf3144320 con 0x560bf3158ed0 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.048+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf31618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.048+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf31618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60416/0 (socket says 172.21.15.17:60416) 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.048+0000 7f7c45d9b700 1 -- 172.21.15.17:0/1909679224 learned_addr learned my addr 172.21.15.17:0/1909679224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:13.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.048+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.049+0000 7f7c45d9b700 1 -- 172.21.15.17:0/1909679224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 msgr2=0x560bf316a110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:44:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.049+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf316a110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.049+0000 7f7c45d9b700 1 -- 172.21.15.17:0/1909679224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 msgr2=0x560bf3142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.049+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.049+0000 7f7c45d9b700 1 -- 172.21.15.17:0/1909679224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bf2eec1f0 con 0x560bf3158ed0 2023-10-05T15:44:13.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.049+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf31618e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00b620 tx=0x7f7c3c00b500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57bea768ecc87ff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.051+0000 7f7c357fa700 1 -- 172.21.15.17:0/1909679224 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c01f520 con 0x560bf3158ed0 2023-10-05T15:44:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.051+0000 7f7c357fa700 1 -- 172.21.15.17:0/1909679224 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c3c003ea0 con 0x560bf3158ed0 2023-10-05T15:44:13.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.051+0000 7f7c357fa700 1 -- 172.21.15.17:0/1909679224 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0049b0 con 0x560bf3158ed0 2023-10-05T15:44:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 -- 172.21.15.17:0/1909679224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 msgr2=0x560bf31618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:13.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf31618e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00b620 tx=0x7f7c3c00b500 comp rx=0 tx=0).stop 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 -- 172.21.15.17:0/1909679224 shutdown_connections 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf315a9a0 0x560bf3142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf31618e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/1909679224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf3159fe0 0x560bf316a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 -- 172.21.15.17:0/1909679224 >> 172.21.15.17:0/1909679224 conn(0x560bf30bc200 msgr2=0x560bf3142250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 -- 172.21.15.17:0/1909679224 shutdown_connections 2023-10-05T15:44:13.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.052+0000 7f7c6031ab80 1 -- 172.21.15.17:0/1909679224 wait complete. 2023-10-05T15:44:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.053+0000 7f7c6031ab80 1 -- start start 2023-10-05T15:44:13.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 Processor -- start 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3167700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf3159fe0 0x560bf3167c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf315a9a0 0x560bf3168c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf3169190 con 0x560bf3159fe0 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf3169300 con 0x560bf315a9a0 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.054+0000 7f7c6031ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf31694c0 con 0x560bf3158ed0 2023-10-05T15:44:13.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c6031ab80 10 client.0 _ll_register_callbacks cb 0x7f7c38009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:13.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3167700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60430/0 (socket says 172.21.15.17:60430) 2023-10-05T15:44:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 -- 172.21.15.17:0/2207661491 learned_addr learned my addr 172.21.15.17:0/2207661491 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf315a9a0 0x560bf3168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c4659c700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf3159fe0 0x560bf3167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 -- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf315a9a0 msgr2=0x560bf3168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf315a9a0 0x560bf3168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 -- 172.21.15.17:0/2207661491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf3159fe0 msgr2=0x560bf3167c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf3159fe0 0x560bf3167c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.055+0000 7f7c45d9b700 1 -- 172.21.15.17:0/2207661491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c01a040 con 0x560bf3158ed0 2023-10-05T15:44:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.056+0000 7f7c45d9b700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3167700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00b370 tx=0x7f7c3c022040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7368f82816a1e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.056+0000 7f7c2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.056+0000 7f7c2dffb700 1 -- 172.21.15.17:0/2207661491 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c01f5e0 con 0x560bf3158ed0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.056+0000 7f7c2dffb700 1 -- 172.21.15.17:0/2207661491 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7c3c01f740 con 0x560bf3158ed0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.056+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c3801e040 con 0x560bf3158ed0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.056+0000 7f7c2dffb700 1 -- 172.21.15.17:0/2207661491 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c3c01f900 con 0x560bf3158ed0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 10 client.26500 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560bf2ec4250 con 0x560bf3158ed0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c2dffb700 1 -- 172.21.15.17:0/2207661491 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c3801e040 con 0x560bf3158ed0 2023-10-05T15:44:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c2dffb700 1 -- 172.21.15.17:0/2207661491 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c3c012ac0 con 0x560bf3158ed0 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 10 client.26500 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 10 client.26500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 20 client.26500 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf31d3be0 0x560bf31d6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 4 client.26500 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.057+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560bf3093ad0 con 0x560bf31d3be0 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.058+0000 7f7c4659c700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf31d3be0 0x560bf31d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.058+0000 7f7c4659c700 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf31d3be0 0x560bf31d6000 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633a6fb3160e90c5 server_cookie=59765d236de17920 in_seq=0 out_seq=0 2023-10-05T15:44:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.058+0000 7f7c2dffb700 10 client.26500 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.081+0000 7f7c2dffb700 1 -- 172.21.15.17:0/2207661491 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560bf3093ad0 con 0x560bf31d3be0 2023-10-05T15:44:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.081+0000 7f7c2dffb700 10 client.26500 handle_command_reply: tid=0 2023-10-05T15:44:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.081+0000 7f7c6031ab80 1 client.26500 shutdown 2023-10-05T15:44:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 msgr2=0x560bf3167700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3167700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00b370 tx=0x7f7c3c022040 comp rx=0 tx=0).stop 2023-10-05T15:44:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 shutdown_connections 2023-10-05T15:44:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560bf31d3be0 0x560bf31d6000 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560bf315a9a0 0x560bf3168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560bf3158ed0 0x560bf3167700 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 --2- 172.21.15.17:0/2207661491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bf3159fe0 0x560bf3167c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 >> 172.21.15.17:0/2207661491 conn(0x560bf30bc200 msgr2=0x560bf3181690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c2dffb700 0 client.26500 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 shutdown_connections 2023-10-05T15:44:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.082+0000 7f7c6031ab80 1 -- 172.21.15.17:0/2207661491 wait complete. 2023-10-05T15:44:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.083+0000 7f7c6031ab80 20 client.26500 trim_cache size 0 max 16384 2023-10-05T15:44:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:44:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:44:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:44:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.083+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7c300a15d0 msgr2=0x7f7c300a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.083+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7c300a15d0 0x7f7c300a3a90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c40095e00 tx=0x7f7c40007f40 comp rx=0 tx=0).stop 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.083+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48102a20 msgr2=0x7f7c4819e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.083+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48102a20 0x7f7c4819e650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c40007f10 tx=0x7f7c4000d3b0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 shutdown_connections 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7c300a15d0 0x7f7c300a3a90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c48102a20 0x7f7c4819e650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c48100f10 0x7f7c4819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 --2- 172.21.15.17:0/3974039924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c48102060 0x7f7c4819dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 >> 172.21.15.17:0/3974039924 conn(0x7f7c480fc460 msgr2=0x7f7c480fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 shutdown_connections 2023-10-05T15:44:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:13.084+0000 7f7c4c9ff700 1 -- 172.21.15.17:0/3974039924 wait complete. 2023-10-05T15:44:13.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 335.0 s, 606.5 tps, lat 163.348 ms stddev 51.386 2023-10-05T15:44:14.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:13 smithi079 ceph-mon[132936]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.0 MiB/s wr, 578 op/s 2023-10-05T15:44:14.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:13 smithi017 ceph-mon[129107]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.0 MiB/s wr, 578 op/s 2023-10-05T15:44:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:13 smithi167 ceph-mon[133366]: pgmap v598: 129 pgs: 129 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.0 MiB/s wr, 578 op/s 2023-10-05T15:44:16.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:15 smithi017 ceph-mon[129107]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.5 MiB/s wr, 780 op/s 2023-10-05T15:44:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:15 smithi167 ceph-mon[133366]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.5 MiB/s wr, 780 op/s 2023-10-05T15:44:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:15 smithi079 ceph-mon[132936]: pgmap v599: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.5 MiB/s wr, 780 op/s 2023-10-05T15:44:18.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:17 smithi167 ceph-mon[133366]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.9 MiB/s wr, 531 op/s 2023-10-05T15:44:18.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:17 smithi079 ceph-mon[132936]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.9 MiB/s wr, 531 op/s 2023-10-05T15:44:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 340.0 s, 606.7 tps, lat 165.394 ms stddev 49.288 2023-10-05T15:44:18.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:17 smithi017 ceph-mon[129107]: pgmap v600: 129 pgs: 129 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.9 MiB/s wr, 531 op/s 2023-10-05T15:44:20.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:19 smithi167 ceph-mon[133366]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.0 MiB/s wr, 613 op/s 2023-10-05T15:44:20.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:19 smithi079 ceph-mon[132936]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.0 MiB/s wr, 613 op/s 2023-10-05T15:44:20.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:19 smithi017 ceph-mon[129107]: pgmap v601: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.0 MiB/s wr, 613 op/s 2023-10-05T15:44:22.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:21 smithi167 ceph-mon[133366]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.8 MiB/s wr, 606 op/s 2023-10-05T15:44:22.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:21 smithi079 ceph-mon[132936]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.8 MiB/s wr, 606 op/s 2023-10-05T15:44:22.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:21 smithi017 ceph-mon[129107]: pgmap v602: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.8 MiB/s wr, 606 op/s 2023-10-05T15:44:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 345.0 s, 496.2 tps, lat 200.097 ms stddev 87.869 2023-10-05T15:44:24.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:23 smithi167 ceph-mon[133366]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 550 op/s 2023-10-05T15:44:24.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:23 smithi079 ceph-mon[132936]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 550 op/s 2023-10-05T15:44:24.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:23 smithi017 ceph-mon[129107]: pgmap v603: 129 pgs: 129 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 550 op/s 2023-10-05T15:44:26.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:25 smithi167 ceph-mon[133366]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.7 MiB/s wr, 726 op/s 2023-10-05T15:44:26.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:25 smithi079 ceph-mon[132936]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.7 MiB/s wr, 726 op/s 2023-10-05T15:44:26.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:25 smithi017 ceph-mon[129107]: pgmap v604: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.7 MiB/s wr, 726 op/s 2023-10-05T15:44:26.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 -- 172.21.15.17:0/201425782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 msgr2=0x7f166c103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 --2- 172.21.15.17:0/201425782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c103570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f165c0099c0 tx=0x7f165c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 -- 172.21.15.17:0/201425782 shutdown_connections 2023-10-05T15:44:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 --2- 172.21.15.17:0/201425782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f166c104ce0 0x7f166c10b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 --2- 172.21.15.17:0/201425782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c103570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 --2- 172.21.15.17:0/201425782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f166c104340 0x7f166c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 -- 172.21.15.17:0/201425782 >> 172.21.15.17:0/201425782 conn(0x7f166c0fe6a0 msgr2=0x7f166c100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 -- 172.21.15.17:0/201425782 shutdown_connections 2023-10-05T15:44:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.333+0000 7f1670fff700 1 -- 172.21.15.17:0/201425782 wait complete. 2023-10-05T15:44:26.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.335+0000 7f1670fff700 1 Processor -- start 2023-10-05T15:44:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.335+0000 7f1670fff700 1 -- start start 2023-10-05T15:44:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f1670fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c19d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f1670fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f166c104340 0x7f166c19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f1670fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f166c104ce0 0x7f166c19e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f1670fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c19ec90 con 0x7f166c104ce0 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f1670fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c19ee00 con 0x7f166c103150 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f1670fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c19efc0 con 0x7f166c104340 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f166a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c19d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f166a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c19d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34292/0 (socket says 172.21.15.17:34292) 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.336+0000 7f166a59c700 1 -- 172.21.15.17:0/800720626 learned_addr learned my addr 172.21.15.17:0/800720626 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.337+0000 7f166a59c700 1 -- 172.21.15.17:0/800720626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f166c104340 msgr2=0x7f166c19d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.337+0000 7f166a59c700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f166c104340 0x7f166c19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.337+0000 7f166a59c700 1 -- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f166c104ce0 msgr2=0x7f166c19e630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.337+0000 7f166a59c700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f166c104ce0 0x7f166c19e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.337+0000 7f166a59c700 1 -- 172.21.15.17:0/800720626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0095f0 con 0x7f166c103150 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.337+0000 7f166a59c700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c19d270 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c00fab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.338+0000 7f165b7fe700 1 -- 172.21.15.17:0/800720626 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c01d070 con 0x7f166c103150 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.338+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c19f240 con 0x7f166c103150 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.338+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c10db10 con 0x7f166c103150 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.338+0000 7f165b7fe700 1 -- 172.21.15.17:0/800720626 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f165c00bcf0 con 0x7f166c103150 2023-10-05T15:44:26.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.338+0000 7f165b7fe700 1 -- 172.21.15.17:0/800720626 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0173f0 con 0x7f166c103150 2023-10-05T15:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.345+0000 7f165b7fe700 1 -- 172.21.15.17:0/800720626 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f165c022470 con 0x7f166c103150 2023-10-05T15:44:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.347+0000 7f16849f9b80 1 Processor -- start 2023-10-05T15:44:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.347+0000 7f16849f9b80 1 -- start start 2023-10-05T15:44:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535dec0 0x55614535e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 0x55614535f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145366220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f16849f9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561452c6400 con 0x55614535dec0 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f16849f9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561452b7bc0 con 0x55614535f990 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f16849f9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561452b54e0 con 0x55614535efd0 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f166a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 0x55614535f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f166a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 0x55614535f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33728/0 (socket says 172.21.15.17:33728) 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f166a59c700 1 -- 172.21.15.17:0/2806501698 learned_addr learned my addr 172.21.15.17:0/2806501698 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.348+0000 7f1669d9b700 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145366220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.349+0000 7f166a59c700 1 -- 172.21.15.17:0/2806501698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 msgr2=0x556145366220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.349+0000 7f166a59c700 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145366220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.349+0000 7f166a59c700 1 -- 172.21.15.17:0/2806501698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535dec0 msgr2=0x55614535e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.349+0000 7f166a59c700 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535dec0 0x55614535e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.349+0000 7f166a59c700 1 -- 172.21.15.17:0/2806501698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561450dbd80 con 0x55614535efd0 2023-10-05T15:44:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.350+0000 7f166a59c700 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 0x55614535f450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f165c0d60e0 tx=0x7f165c0d63f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5beee319514516c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.350+0000 7f165b7fe700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f16540a1580 0x7f16540a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.351+0000 7f165b7fe700 1 -- 172.21.15.17:0/800720626 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f165c0ce190 con 0x7f166c103150 2023-10-05T15:44:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.351+0000 7f166ad9d700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f16540a1580 0x7f16540a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.352+0000 7f166ad9d700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f16540a1580 0x7f16540a3a40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16640060b0 tx=0x7f166400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.353+0000 7f1658ff9700 1 -- 172.21.15.17:0/2806501698 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0d1c20 con 0x55614535efd0 2023-10-05T15:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.353+0000 7f1658ff9700 1 -- 172.21.15.17:0/2806501698 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f165c097480 con 0x55614535efd0 2023-10-05T15:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.353+0000 7f1658ff9700 1 -- 172.21.15.17:0/2806501698 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c09ac80 con 0x55614535efd0 2023-10-05T15:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.355+0000 7f16849f9b80 1 -- 172.21.15.17:0/2806501698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 msgr2=0x55614535f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.355+0000 7f16849f9b80 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 0x55614535f450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f165c0d60e0 tx=0x7f165c0d63f0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.356+0000 7f16849f9b80 1 -- 172.21.15.17:0/2806501698 shutdown_connections 2023-10-05T15:44:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.356+0000 7f16849f9b80 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145366220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.356+0000 7f16849f9b80 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535dec0 0x55614535e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.356+0000 7f16849f9b80 1 --2- 172.21.15.17:0/2806501698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535efd0 0x55614535f450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.356+0000 7f16849f9b80 1 -- 172.21.15.17:0/2806501698 >> 172.21.15.17:0/2806501698 conn(0x5561452d2200 msgr2=0x556145358bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.356+0000 7f16849f9b80 1 -- 172.21.15.17:0/2806501698 shutdown_connections 2023-10-05T15:44:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.357+0000 7f16849f9b80 1 -- 172.21.15.17:0/2806501698 wait complete. 2023-10-05T15:44:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.357+0000 7f16849f9b80 1 -- start start 2023-10-05T15:44:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.358+0000 7f16849f9b80 1 Processor -- start 2023-10-05T15:44:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145367860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x556145367da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x55614536ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561452b0dd0 con 0x55614535efd0 2023-10-05T15:44:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614524d6b0 con 0x55614535f990 2023-10-05T15:44:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614524d350 con 0x55614535dec0 2023-10-05T15:44:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f16849f9b80 10 client.0 _ll_register_callbacks cb 0x5561450aa7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:26.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f166a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145367860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f166a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145367860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33742/0 (socket says 172.21.15.17:33742) 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.359+0000 7f166a59c700 1 -- 172.21.15.17:0/3202718191 learned_addr learned my addr 172.21.15.17:0/3202718191 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f166ad9d700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x55614536ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f1669d9b700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x556145367da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f166ad9d700 1 -- 172.21.15.17:0/3202718191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 msgr2=0x556145367860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f166ad9d700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145367860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f166ad9d700 1 -- 172.21.15.17:0/3202718191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 msgr2=0x556145367da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f166ad9d700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x556145367da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.360+0000 7f166ad9d700 1 -- 172.21.15.17:0/3202718191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c10db10 con 0x55614535f990 2023-10-05T15:44:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.361+0000 7f166ad9d700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x55614536ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55614535dc60 tx=0x7f1664009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba23c5351c442e17 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.361+0000 7f1651ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:44:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.361+0000 7f1651ffb700 1 -- 172.21.15.17:0/3202718191 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664013850 con 0x55614535f990 2023-10-05T15:44:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.361+0000 7f1651ffb700 1 -- 172.21.15.17:0/3202718191 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f16640139b0 con 0x55614535f990 2023-10-05T15:44:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.361+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556145350d50 con 0x55614535f990 2023-10-05T15:44:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.362+0000 7f1651ffb700 1 -- 172.21.15.17:0/3202718191 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1664013b70 con 0x55614535f990 2023-10-05T15:44:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.362+0000 7f16849f9b80 10 client.26525 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.362+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5561450c4c00 con 0x55614535f990 2023-10-05T15:44:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.362+0000 7f1651ffb700 1 -- 172.21.15.17:0/3202718191 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556145350d50 con 0x55614535f990 2023-10-05T15:44:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.363+0000 7f1651ffb700 1 -- 172.21.15.17:0/3202718191 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f166401f3f0 con 0x55614535f990 2023-10-05T15:44:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.363+0000 7f16849f9b80 10 client.26525 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.364+0000 7f16849f9b80 10 client.26525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.364+0000 7f16849f9b80 20 client.26525 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.364+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453736e0 0x556145375b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.364+0000 7f16849f9b80 4 client.26525 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:44:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.364+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561452a9db0 con 0x5561453736e0 2023-10-05T15:44:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.364+0000 7f166a59c700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453736e0 0x556145375b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.365+0000 7f166a59c700 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453736e0 0x556145375b00 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8cd06783597079e server_cookie=551ccade56239c2 in_seq=0 out_seq=0 2023-10-05T15:44:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.365+0000 7f1651ffb700 10 client.26525 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.366+0000 7f1651ffb700 1 -- 172.21.15.17:0/3202718191 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561452a9db0 con 0x5561453736e0 2023-10-05T15:44:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.366+0000 7f1651ffb700 10 client.26525 handle_command_reply: tid=0 2023-10-05T15:44:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.366+0000 7f16849f9b80 1 client.26525 shutdown 2023-10-05T15:44:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.366+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 msgr2=0x55614536ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.366+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x55614536ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55614535dc60 tx=0x7f1664009920 comp rx=0 tx=0).stop 2023-10-05T15:44:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 shutdown_connections 2023-10-05T15:44:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453736e0 0x556145375b00 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x55614536ede0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145367860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3202718191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x556145367da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 >> 172.21.15.17:0/3202718191 conn(0x5561452d2200 msgr2=0x556145358250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f1651ffb700 0 client.26525 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 shutdown_connections 2023-10-05T15:44:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.367+0000 7f16849f9b80 1 -- 172.21.15.17:0/3202718191 wait complete. 2023-10-05T15:44:26.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.368+0000 7f16849f9b80 20 client.26525 trim_cache size 0 max 16384 2023-10-05T15:44:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.398+0000 7f16849f9b80 1 Processor -- start 2023-10-05T15:44:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.398+0000 7f16849f9b80 1 -- start start 2023-10-05T15:44:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.398+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145358250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.399+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x55614536eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.399+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145358790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.399+0000 7f16849f9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561451318c0 con 0x55614535efd0 2023-10-05T15:44:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.399+0000 7f16849f9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614535ec10 con 0x55614535f990 2023-10-05T15:44:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.399+0000 7f16849f9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556145366d10 con 0x55614535dec0 2023-10-05T15:44:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.400+0000 7f166a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145358250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.400+0000 7f166ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145358790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.400+0000 7f166a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145358250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33748/0 (socket says 172.21.15.17:33748) 2023-10-05T15:44:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.400+0000 7f166a59c700 1 -- 172.21.15.17:0/3362114132 learned_addr learned my addr 172.21.15.17:0/3362114132 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.400+0000 7f1669d9b700 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x55614536eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.401+0000 7f1669d9b700 1 -- 172.21.15.17:0/3362114132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 msgr2=0x556145358250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.401+0000 7f1669d9b700 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145358250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.401+0000 7f1669d9b700 1 -- 172.21.15.17:0/3362114132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 msgr2=0x556145358790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.401+0000 7f1669d9b700 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145358790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.401+0000 7f1669d9b700 1 -- 172.21.15.17:0/3362114132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561451021f0 con 0x55614535efd0 2023-10-05T15:44:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.402+0000 7f1669d9b700 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x55614536eda0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1660009b20 tx=0x7f1660009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431e681e7612ffc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.403+0000 7f16597fa700 1 -- 172.21.15.17:0/3362114132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660011a50 con 0x55614535efd0 2023-10-05T15:44:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.403+0000 7f16597fa700 1 -- 172.21.15.17:0/3362114132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1660016070 con 0x55614535efd0 2023-10-05T15:44:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.403+0000 7f16597fa700 1 -- 172.21.15.17:0/3362114132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660012450 con 0x55614535efd0 2023-10-05T15:44:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 -- 172.21.15.17:0/3362114132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 msgr2=0x55614536eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x55614536eda0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1660009b20 tx=0x7f1660009e30 comp rx=0 tx=0).stop 2023-10-05T15:44:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 -- 172.21.15.17:0/3362114132 shutdown_connections 2023-10-05T15:44:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614535f990 0x556145358790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x556145358250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 --2- 172.21.15.17:0/3362114132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535efd0 0x55614536eda0 secure :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1660009b20 tx=0x7f1660009e30 comp rx=0 tx=0).stop 2023-10-05T15:44:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.404+0000 7f16849f9b80 1 -- 172.21.15.17:0/3362114132 >> 172.21.15.17:0/3362114132 conn(0x5561452d2200 msgr2=0x556145367860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.405+0000 7f16849f9b80 1 -- 172.21.15.17:0/3362114132 shutdown_connections 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.405+0000 7f16849f9b80 1 -- 172.21.15.17:0/3362114132 wait complete. 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.406+0000 7f16849f9b80 1 -- start start 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.406+0000 7f16849f9b80 1 Processor -- start 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x55614536e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 0x55614536ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614536cca0 0x55614536d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614536d6f0 con 0x55614535f990 2023-10-05T15:44:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614536d860 con 0x55614536cca0 2023-10-05T15:44:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55614536da20 con 0x55614535dec0 2023-10-05T15:44:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.407+0000 7f16849f9b80 10 client.0 _ll_register_callbacks cb 0x7f16640153f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 0x55614536ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f166ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614536cca0 0x55614536d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 0x55614536ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34884/0 (socket says 172.21.15.17:34884) 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 -- 172.21.15.17:0/832922942 learned_addr learned my addr 172.21.15.17:0/832922942 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f166a59c700 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x55614536e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 -- 172.21.15.17:0/832922942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 msgr2=0x55614536e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x55614536e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 -- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614536cca0 msgr2=0x55614536d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614536cca0 0x55614536d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.408+0000 7f1669d9b700 1 -- 172.21.15.17:0/832922942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1660009800 con 0x55614535f990 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.409+0000 7f1669d9b700 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 0x55614536ebd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x5561452b7cb0 tx=0x7f1660004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e2454f94e05d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.409+0000 7f1651ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:44:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.409+0000 7f1651ffb700 1 -- 172.21.15.17:0/832922942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660011a60 con 0x55614535f990 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.409+0000 7f1651ffb700 1 -- 172.21.15.17:0/832922942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f1660018070 con 0x55614535f990 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.409+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f165c097480 con 0x55614535f990 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.409+0000 7f1651ffb700 1 -- 172.21.15.17:0/832922942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1660011bc0 con 0x55614535f990 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.410+0000 7f16849f9b80 10 client.16644 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.410+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5561450da250 con 0x55614535f990 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.411+0000 7f1651ffb700 1 -- 172.21.15.17:0/832922942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f165c097480 con 0x55614535f990 2023-10-05T15:44:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.411+0000 7f1651ffb700 1 -- 172.21.15.17:0/832922942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1660012450 con 0x55614535f990 2023-10-05T15:44:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f16849f9b80 10 client.16644 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f16849f9b80 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f16849f9b80 20 client.16644 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f16849f9b80 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453eaa20 0x5561453ece40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f16849f9b80 4 client.16644 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:44:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5561452a9ad0 con 0x5561453eaa20 2023-10-05T15:44:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.413+0000 7f166a59c700 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453eaa20 0x5561453ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.414+0000 7f166a59c700 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453eaa20 0x5561453ece40 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39c526bd15d0a830 server_cookie=c42632183eb1a69 in_seq=0 out_seq=0 2023-10-05T15:44:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.414+0000 7f1651ffb700 10 client.16644 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.431+0000 7f1651ffb700 1 -- 172.21.15.17:0/832922942 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5561452a9ad0 con 0x5561453eaa20 2023-10-05T15:44:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.431+0000 7f1651ffb700 10 client.16644 handle_command_reply: tid=0 2023-10-05T15:44:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.431+0000 7f16849f9b80 1 client.16644 shutdown 2023-10-05T15:44:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.431+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 msgr2=0x55614536ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.431+0000 7f16849f9b80 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 0x55614536ebd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x5561452b7cb0 tx=0x7f1660004270 comp rx=0 tx=0).stop 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 shutdown_connections 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5561453eaa20 0x5561453ece40 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55614536cca0 0x55614536d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55614535dec0 0x55614536e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 --2- 172.21.15.17:0/832922942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55614535f990 0x55614536ebd0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 >> 172.21.15.17:0/832922942 conn(0x5561452d2200 msgr2=0x55614535cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f1651ffb700 0 client.16644 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.432+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 shutdown_connections 2023-10-05T15:44:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.433+0000 7f16849f9b80 1 -- 172.21.15.17:0/832922942 wait complete. 2023-10-05T15:44:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.433+0000 7f16849f9b80 20 client.16644 trim_cache size 0 max 16384 2023-10-05T15:44:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:44:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:44:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:44:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:44:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.434+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f16540a1580 msgr2=0x7f16540a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.434+0000 7f1670fff700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f16540a1580 0x7f16540a3a40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16640060b0 tx=0x7f166400b040 comp rx=0 tx=0).stop 2023-10-05T15:44:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.434+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 msgr2=0x7f166c19d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.434+0000 7f1670fff700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c19d270 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c00fab0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 shutdown_connections 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f16540a1580 0x7f16540a3a40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f166c104ce0 0x7f166c19e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f166c103150 0x7f166c19d270 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 --2- 172.21.15.17:0/800720626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f166c104340 0x7f166c19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 >> 172.21.15.17:0/800720626 conn(0x7f166c0fe6a0 msgr2=0x7f166c078ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 shutdown_connections 2023-10-05T15:44:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:26.435+0000 7f1670fff700 1 -- 172.21.15.17:0/800720626 wait complete. 2023-10-05T15:44:28.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:27 smithi167 ceph-mon[133366]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 515 op/s 2023-10-05T15:44:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:27 smithi079 ceph-mon[132936]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 515 op/s 2023-10-05T15:44:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 350.0 s, 521.4 tps, lat 194.023 ms stddev 65.193 2023-10-05T15:44:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:27 smithi017 ceph-mon[129107]: pgmap v605: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.1 MiB/s wr, 515 op/s 2023-10-05T15:44:30.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:29 smithi167 ceph-mon[133366]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.5 MiB/s wr, 608 op/s 2023-10-05T15:44:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:29 smithi079 ceph-mon[132936]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.5 MiB/s wr, 608 op/s 2023-10-05T15:44:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:29 smithi017 ceph-mon[129107]: pgmap v606: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.5 MiB/s wr, 608 op/s 2023-10-05T15:44:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:31 smithi167 ceph-mon[133366]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 625 op/s 2023-10-05T15:44:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:31 smithi079 ceph-mon[132936]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 625 op/s 2023-10-05T15:44:32.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:31 smithi017 ceph-mon[129107]: pgmap v607: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 625 op/s 2023-10-05T15:44:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 355.0 s, 594.2 tps, lat 167.141 ms stddev 57.519 2023-10-05T15:44:34.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:33 smithi167 ceph-mon[133366]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 541 op/s 2023-10-05T15:44:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:33 smithi079 ceph-mon[132936]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 541 op/s 2023-10-05T15:44:34.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:33 smithi017 ceph-mon[129107]: pgmap v608: 129 pgs: 129 active+clean; 1.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 541 op/s 2023-10-05T15:44:36.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:35 smithi167 ceph-mon[133366]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.6 MiB/s wr, 740 op/s 2023-10-05T15:44:36.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:35 smithi079 ceph-mon[132936]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.6 MiB/s wr, 740 op/s 2023-10-05T15:44:36.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:35 smithi017 ceph-mon[129107]: pgmap v609: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.6 MiB/s wr, 740 op/s 2023-10-05T15:44:36.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:44:37.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.254+0000 7f74327ff700 1 -- 172.21.15.17:0/3743536622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c104a70 msgr2=0x7f742c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.254+0000 7f74327ff700 1 --2- 172.21.15.17:0/3743536622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c104a70 0x7f742c104ef0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f741c009990 tx=0x7f741c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 -- 172.21.15.17:0/3743536622 shutdown_connections 2023-10-05T15:44:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 --2- 172.21.15.17:0/3743536622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c104a70 0x7f742c104ef0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 --2- 172.21.15.17:0/3743536622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f742c0ff730 0x7f742c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 --2- 172.21.15.17:0/3743536622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 -- 172.21.15.17:0/3743536622 >> 172.21.15.17:0/3743536622 conn(0x7f742c0fb330 msgr2=0x7f742c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 -- 172.21.15.17:0/3743536622 shutdown_connections 2023-10-05T15:44:37.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.255+0000 7f74327ff700 1 -- 172.21.15.17:0/3743536622 wait complete. 2023-10-05T15:44:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.257+0000 7f74327ff700 1 Processor -- start 2023-10-05T15:44:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.257+0000 7f74327ff700 1 -- start start 2023-10-05T15:44:37.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f74327ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c0ff730 0x7f742c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f74327ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f74327ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f742c104a70 0x7f742c1ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f74327ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c072de0 con 0x7f742c104a70 2023-10-05T15:44:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f74327ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c072f50 con 0x7f742c1020a0 2023-10-05T15:44:37.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f74327ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c1ad810 con 0x7f742c0ff730 2023-10-05T15:44:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.258+0000 7f742b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.259+0000 7f742b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c06fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41254/0 (socket says 172.21.15.17:41254) 2023-10-05T15:44:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.259+0000 7f742b7fe700 1 -- 172.21.15.17:0/270537979 learned_addr learned my addr 172.21.15.17:0/270537979 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.259+0000 7f742bfff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c0ff730 0x7f742c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.260+0000 7f742b7fe700 1 -- 172.21.15.17:0/270537979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c0ff730 msgr2=0x7f742c06f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.260+0000 7f742b7fe700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c0ff730 0x7f742c06f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.260+0000 7f742b7fe700 1 -- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f742c104a70 msgr2=0x7f742c1ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.260+0000 7f742b7fe700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f742c104a70 0x7f742c1ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.260+0000 7f742b7fe700 1 -- 172.21.15.17:0/270537979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0095f0 con 0x7f742c1020a0 2023-10-05T15:44:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.261+0000 7f742b7fe700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c06fd00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f741400ba50 tx=0x7f741400be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.261+0000 7f74297fa700 1 -- 172.21.15.17:0/270537979 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400cab0 con 0x7f742c1020a0 2023-10-05T15:44:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.261+0000 7f74297fa700 1 -- 172.21.15.17:0/270537979 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f741400cc10 con 0x7f742c1020a0 2023-10-05T15:44:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.261+0000 7f74297fa700 1 -- 172.21.15.17:0/270537979 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140075b0 con 0x7f742c1020a0 2023-10-05T15:44:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.261+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c1adac0 con 0x7f742c1020a0 2023-10-05T15:44:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.261+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c1ae000 con 0x7f742c1020a0 2023-10-05T15:44:37.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.270+0000 7f74460beb80 1 Processor -- start 2023-10-05T15:44:37.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 -- start start 2023-10-05T15:44:37.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b635460 con 0x558e2b6cd260 2023-10-05T15:44:37.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b626c20 con 0x558e2b6cea60 2023-10-05T15:44:37.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.271+0000 7f74460beb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b624540 con 0x558e2b6cdbc0 2023-10-05T15:44:37.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.272+0000 7f742bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.272+0000 7f742bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44228/0 (socket says 172.21.15.17:44228) 2023-10-05T15:44:37.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.272+0000 7f742bfff700 1 -- 172.21.15.17:0/3477926758 learned_addr learned my addr 172.21.15.17:0/3477926758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:37.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.273+0000 7f74297fa700 1 -- 172.21.15.17:0/270537979 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7414014440 con 0x7f742c1020a0 2023-10-05T15:44:37.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.273+0000 7f742bfff700 1 -- 172.21.15.17:0/3477926758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 msgr2=0x558e2b6ceee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:44:37.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.273+0000 7f742bfff700 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6ceee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.273+0000 7f742bfff700 1 -- 172.21.15.17:0/3477926758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 msgr2=0x558e2b6cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.273+0000 7f742bfff700 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.273+0000 7f742bfff700 1 -- 172.21.15.17:0/3477926758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e2b44ade0 con 0x558e2b6cdbc0 2023-10-05T15:44:37.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.274+0000 7f742bfff700 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6ce480 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7424009d10 tx=0x7f74240116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aee66bfc77f575f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:37.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.275+0000 7f74227fc700 1 -- 172.21.15.17:0/3477926758 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424011ed0 con 0x558e2b6cdbc0 2023-10-05T15:44:37.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.275+0000 7f74227fc700 1 -- 172.21.15.17:0/3477926758 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7424009e60 con 0x558e2b6cdbc0 2023-10-05T15:44:37.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.275+0000 7f74227fc700 1 -- 172.21.15.17:0/3477926758 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400f7e0 con 0x558e2b6cdbc0 2023-10-05T15:44:37.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.275+0000 7f74297fa700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f740c0a15d0 0x7f740c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.275+0000 7f74297fa700 1 -- 172.21.15.17:0/270537979 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f74140cc870 con 0x7f742c1020a0 2023-10-05T15:44:37.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 -- 172.21.15.17:0/3477926758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 msgr2=0x558e2b6ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6ce480 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7424009d10 tx=0x7f74240116c0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 -- 172.21.15.17:0/3477926758 shutdown_connections 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 --2- 172.21.15.17:0/3477926758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6ce480 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f74460beb80 1 -- 172.21.15.17:0/3477926758 >> 172.21.15.17:0/3477926758 conn(0x558e2b641260 msgr2=0x558e2b6c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:37.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.276+0000 7f7430d9c700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f740c0a15d0 0x7f740c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.277+0000 7f74460beb80 1 -- 172.21.15.17:0/3477926758 shutdown_connections 2023-10-05T15:44:37.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.277+0000 7f74460beb80 1 -- 172.21.15.17:0/3477926758 wait complete. 2023-10-05T15:44:37.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.278+0000 7f7430d9c700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f740c0a15d0 0x7f740c0a3a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f741c006010 tx=0x7f741c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.278+0000 7f74460beb80 1 -- start start 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 Processor -- start 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6d7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 0x558e2b6de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b61fe30 con 0x558e2b6cea60 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b5bc710 con 0x558e2b6cd260 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.279+0000 7f74460beb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b5bc3b0 con 0x558e2b6cdbc0 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.280+0000 7f74460beb80 10 client.0 _ll_register_callbacks cb 0x558e2b419800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.280+0000 7f7430d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 0x558e2b6de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.280+0000 7f7430d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 0x558e2b6de5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60262/0 (socket says 172.21.15.17:60262) 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.280+0000 7f7430d9c700 1 -- 172.21.15.17:0/2609702709 learned_addr learned my addr 172.21.15.17:0/2609702709 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f742b7fe700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f742bfff700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f7430d9c700 1 -- 172.21.15.17:0/2609702709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 msgr2=0x558e2b6d75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f7430d9c700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6d75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f7430d9c700 1 -- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 msgr2=0x558e2b6d7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f7430d9c700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6d7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f7430d9c700 1 -- 172.21.15.17:0/2609702709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7424009940 con 0x558e2b6cea60 2023-10-05T15:44:37.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.281+0000 7f7430d9c700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 0x558e2b6de5e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f741c004360 tx=0x7f741c00ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995acf4fcc5845f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.282+0000 7f741b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:44:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.282+0000 7f741b7fe700 1 -- 172.21.15.17:0/2609702709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c01d070 con 0x558e2b6cea60 2023-10-05T15:44:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.282+0000 7f741b7fe700 1 -- 172.21.15.17:0/2609702709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f741c003c70 con 0x558e2b6cea60 2023-10-05T15:44:37.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.282+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e2b6bff10 con 0x558e2b6cea60 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.283+0000 7f741b7fe700 1 -- 172.21.15.17:0/2609702709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f741c00f460 con 0x558e2b6cea60 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.284+0000 7f74460beb80 10 client.16650 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.284+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558e2b433c60 con 0x558e2b6cea60 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.284+0000 7f741b7fe700 1 -- 172.21.15.17:0/2609702709 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558e2b6bff10 con 0x558e2b6cea60 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f741b7fe700 1 -- 172.21.15.17:0/2609702709 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f741c039500 con 0x558e2b6cea60 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f74460beb80 10 client.16650 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:37.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f74460beb80 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f74460beb80 20 client.16650 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f74460beb80 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b6e2e80 0x558e2b6e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f74460beb80 4 client.16650 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:44:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.285+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e2b618e10 con 0x558e2b6e2e80 2023-10-05T15:44:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.286+0000 7f742bfff700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b6e2e80 0x558e2b6e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.287+0000 7f741b7fe700 10 client.16650 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.287+0000 7f742bfff700 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b6e2e80 0x558e2b6e52a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa82bb1dcf8e43c5 server_cookie=657241a04a9d888d in_seq=0 out_seq=0 2023-10-05T15:44:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.288+0000 7f741b7fe700 1 -- 172.21.15.17:0/2609702709 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558e2b618e10 con 0x558e2b6e2e80 2023-10-05T15:44:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.288+0000 7f741b7fe700 10 client.16650 handle_command_reply: tid=0 2023-10-05T15:44:37.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.288+0000 7f74460beb80 1 client.16650 shutdown 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.288+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 msgr2=0x558e2b6de5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.288+0000 7f74460beb80 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 0x558e2b6de5e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f741c004360 tx=0x7f741c00ba90 comp rx=0 tx=0).stop 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 shutdown_connections 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b6e2e80 0x558e2b6e52a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cea60 0x558e2b6de5e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6d7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 --2- 172.21.15.17:0/2609702709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6d75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 >> 172.21.15.17:0/2609702709 conn(0x558e2b641260 msgr2=0x558e2b6c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:37.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f741b7fe700 0 client.16650 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.289+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 shutdown_connections 2023-10-05T15:44:37.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.290+0000 7f74460beb80 1 -- 172.21.15.17:0/2609702709 wait complete. 2023-10-05T15:44:37.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.292+0000 7f74460beb80 20 client.16650 trim_cache size 0 max 16384 2023-10-05T15:44:37.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.319+0000 7f74460beb80 1 Processor -- start 2023-10-05T15:44:37.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 -- start start 2023-10-05T15:44:37.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6deed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cdbc0 0x558e2b6de500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cea60 0x558e2b6d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b4a0920 con 0x558e2b6cdbc0 2023-10-05T15:44:37.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b6c2540 con 0x558e2b6cd260 2023-10-05T15:44:37.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.321+0000 7f74460beb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b6dea40 con 0x558e2b6cea60 2023-10-05T15:44:37.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6deed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6deed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41268/0 (socket says 172.21.15.17:41268) 2023-10-05T15:44:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742bfff700 1 -- 172.21.15.17:0/3598000824 learned_addr learned my addr 172.21.15.17:0/3598000824 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742b7fe700 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cdbc0 0x558e2b6de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742b7fe700 1 -- 172.21.15.17:0/3598000824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cea60 msgr2=0x558e2b6d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742b7fe700 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cea60 0x558e2b6d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742b7fe700 1 -- 172.21.15.17:0/3598000824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 msgr2=0x558e2b6deed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742b7fe700 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6deed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742b7fe700 1 -- 172.21.15.17:0/3598000824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e2b471250 con 0x558e2b6cdbc0 2023-10-05T15:44:37.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.322+0000 7f742bfff700 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6deed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:44:37.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.323+0000 7f742b7fe700 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cdbc0 0x558e2b6de500 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x558e2b6ce240 tx=0x7f74140c9e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3458d3f496241b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:37.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.324+0000 7f7422ffd700 1 -- 172.21.15.17:0/3598000824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414099e90 con 0x558e2b6cdbc0 2023-10-05T15:44:37.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.324+0000 7f7422ffd700 1 -- 172.21.15.17:0/3598000824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7414099790 con 0x558e2b6cdbc0 2023-10-05T15:44:37.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.324+0000 7f7422ffd700 1 -- 172.21.15.17:0/3598000824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140999f0 con 0x558e2b6cdbc0 2023-10-05T15:44:37.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 -- 172.21.15.17:0/3598000824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cdbc0 msgr2=0x558e2b6de500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cdbc0 0x558e2b6de500 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x558e2b6ce240 tx=0x7f74140c9e40 comp rx=0 tx=0).stop 2023-10-05T15:44:37.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 -- 172.21.15.17:0/3598000824 shutdown_connections 2023-10-05T15:44:37.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cea60 0x558e2b6d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cd260 0x558e2b6deed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 --2- 172.21.15.17:0/3598000824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cdbc0 0x558e2b6de500 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 -- 172.21.15.17:0/3598000824 >> 172.21.15.17:0/3598000824 conn(0x558e2b641260 msgr2=0x558e2b6c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:37.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 -- 172.21.15.17:0/3598000824 shutdown_connections 2023-10-05T15:44:37.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.325+0000 7f74460beb80 1 -- 172.21.15.17:0/3598000824 wait complete. 2023-10-05T15:44:37.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.326+0000 7f74460beb80 1 -- start start 2023-10-05T15:44:37.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.326+0000 7f74460beb80 1 Processor -- start 2023-10-05T15:44:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6dc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b6dde10 con 0x558e2b6cd260 2023-10-05T15:44:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b6ddf80 con 0x558e2b6cea60 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e2b6de140 con 0x558e2b6cdbc0 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.327+0000 7f74460beb80 10 client.0 _ll_register_callbacks cb 0x7f741c003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.328+0000 7f742b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.328+0000 7f742b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6dc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44252/0 (socket says 172.21.15.17:44252) 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.328+0000 7f742bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.328+0000 7f742b7fe700 1 -- 172.21.15.17:0/2787520812 learned_addr learned my addr 172.21.15.17:0/2787520812 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.328+0000 7f7430d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.329+0000 7f7430d9c700 1 -- 172.21.15.17:0/2787520812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 msgr2=0x558e2b6dc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.329+0000 7f7430d9c700 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6dc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.329+0000 7f7430d9c700 1 -- 172.21.15.17:0/2787520812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 msgr2=0x558e2b6dc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.329+0000 7f7430d9c700 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6dc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.329+0000 7f7430d9c700 1 -- 172.21.15.17:0/2787520812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e2b44ade0 con 0x558e2b6cea60 2023-10-05T15:44:37.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.330+0000 7f7430d9c700 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6dd8d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f741c01f040 tx=0x7f741c003ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43090150fc4ab05 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:37.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.330+0000 7f741b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:44:37.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.330+0000 7f741b7fe700 1 -- 172.21.15.17:0/2787520812 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c039680 con 0x558e2b6cea60 2023-10-05T15:44:37.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.330+0000 7f741b7fe700 1 -- 172.21.15.17:0/2787520812 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f741c00f460 con 0x558e2b6cea60 2023-10-05T15:44:37.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.331+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7424009e60 con 0x558e2b6cea60 2023-10-05T15:44:37.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.332+0000 7f741b7fe700 1 -- 172.21.15.17:0/2787520812 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f741c00f620 con 0x558e2b6cea60 2023-10-05T15:44:37.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.332+0000 7f74460beb80 10 client.26543 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:37.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.332+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f742c1ae000 con 0x558e2b6cea60 2023-10-05T15:44:37.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.332+0000 7f741b7fe700 1 -- 172.21.15.17:0/2787520812 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f741c047030 con 0x558e2b6cea60 2023-10-05T15:44:37.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f741b7fe700 1 -- 172.21.15.17:0/2787520812 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f741c02f890 con 0x558e2b6cea60 2023-10-05T15:44:37.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f74460beb80 10 client.26543 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:37.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f74460beb80 10 client.26543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:37.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f74460beb80 20 client.26543 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f74460beb80 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b737960 0x558e2b739d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f74460beb80 4 client.26543 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558e2b618b30 con 0x558e2b737960 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.333+0000 7f742bfff700 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b737960 0x558e2b739d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.334+0000 7f742bfff700 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b737960 0x558e2b739d80 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd5b75ce49bc2cbd server_cookie=e117180a61fdc9e9 in_seq=0 out_seq=0 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.334+0000 7f741b7fe700 10 client.26543 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:37.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f741b7fe700 1 -- 172.21.15.17:0/2787520812 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558e2b618b30 con 0x558e2b737960 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f741b7fe700 10 client.26543 handle_command_reply: tid=0 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 client.26543 shutdown 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 msgr2=0x558e2b6dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6dd8d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f741c01f040 tx=0x7f741c003ea0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 shutdown_connections 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558e2b737960 0x558e2b739d80 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e2b6cea60 0x558e2b6dd8d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e2b6cd260 0x558e2b6dc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 --2- 172.21.15.17:0/2787520812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e2b6cdbc0 0x558e2b6dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 >> 172.21.15.17:0/2787520812 conn(0x558e2b641260 msgr2=0x558e2b6e4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.335+0000 7f741b7fe700 0 client.26543 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:37.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.336+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 shutdown_connections 2023-10-05T15:44:37.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.336+0000 7f74460beb80 1 -- 172.21.15.17:0/2787520812 wait complete. 2023-10-05T15:44:37.343 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:44:37.344 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:44:37.344 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:44:37.344 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:44:37.344 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:44:37.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:44:37.344 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:44:37.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:44:37.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:44:37.345 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:44:37.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.336+0000 7f74460beb80 20 client.26543 trim_cache size 0 max 16384 2023-10-05T15:44:37.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.337+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f740c0a15d0 msgr2=0x7f740c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.337+0000 7f74327ff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f740c0a15d0 0x7f740c0a3a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f741c006010 tx=0x7f741c00b260 comp rx=0 tx=0).stop 2023-10-05T15:44:37.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.337+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 msgr2=0x7f742c06fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:37.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.337+0000 7f74327ff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c06fd00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f741400ba50 tx=0x7f741400be10 comp rx=0 tx=0).stop 2023-10-05T15:44:37.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 shutdown_connections 2023-10-05T15:44:37.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f740c0a15d0 0x7f740c0a3a90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f742c104a70 0x7f742c1ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f742c0ff730 0x7f742c06f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 --2- 172.21.15.17:0/270537979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f742c1020a0 0x7f742c06fd00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:37.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 >> 172.21.15.17:0/270537979 conn(0x7f742c0fb330 msgr2=0x7f742c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:37.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 shutdown_connections 2023-10-05T15:44:37.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:44:37.338+0000 7f74327ff700 1 -- 172.21.15.17:0/270537979 wait complete. 2023-10-05T15:44:37.371 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:44:38.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:37 smithi167 ceph-mon[133366]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 555 op/s 2023-10-05T15:44:38.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:37 smithi079 ceph-mon[132936]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 555 op/s 2023-10-05T15:44:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 360.0 s, 557.8 tps, lat 179.787 ms stddev 65.905 2023-10-05T15:44:38.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:37 smithi017 ceph-mon[129107]: pgmap v610: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.4 MiB/s wr, 555 op/s 2023-10-05T15:44:39.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.685+0000 7f53047ff700 1 -- 172.21.15.17:0/975979110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc102090 msgr2=0x7f52fc102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.685+0000 7f53047ff700 1 --2- 172.21.15.17:0/975979110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc102090 0x7f52fc102510 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009990 tx=0x7f52ec009ca0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 -- 172.21.15.17:0/975979110 shutdown_connections 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 --2- 172.21.15.17:0/975979110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102a50 0x7f52fc109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 --2- 172.21.15.17:0/975979110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc100eb0 0x7f52fc1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 --2- 172.21.15.17:0/975979110 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc102090 0x7f52fc102510 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 -- 172.21.15.17:0/975979110 >> 172.21.15.17:0/975979110 conn(0x7f52fc0fc430 msgr2=0x7f52fc0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 -- 172.21.15.17:0/975979110 shutdown_connections 2023-10-05T15:44:39.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.686+0000 7f53047ff700 1 -- 172.21.15.17:0/975979110 wait complete. 2023-10-05T15:44:39.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.688+0000 7f53047ff700 1 Processor -- start 2023-10-05T15:44:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 -- start start 2023-10-05T15:44:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc100eb0 0x7f52fc19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 0x7f52fc19dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc102a50 0x7f52fc19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc19ecd0 con 0x7f52fc102a50 2023-10-05T15:44:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc19ee40 con 0x7f52fc100eb0 2023-10-05T15:44:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.690+0000 7f53047ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc19f000 con 0x7f52fc102090 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 0x7f52fc19dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 0x7f52fc19dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44274/0 (socket says 172.21.15.17:44274) 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 -- 172.21.15.17:0/2767456305 learned_addr learned my addr 172.21.15.17:0/2767456305 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f530259b700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc100eb0 0x7f52fc19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5302d9c700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc102a50 0x7f52fc19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 -- 172.21.15.17:0/2767456305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc100eb0 msgr2=0x7f52fc19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc100eb0 0x7f52fc19d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 -- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc102a50 msgr2=0x7f52fc19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc102a50 0x7f52fc19e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.691+0000 7f5301d9a700 1 -- 172.21.15.17:0/2767456305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0095f0 con 0x7f52fc102090 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.692+0000 7f5302d9c700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc102a50 0x7f52fc19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.692+0000 7f5301d9a700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 0x7f52fc19dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52ec005740 tx=0x7f52ec005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.692+0000 7f52f37fe700 1 -- 172.21.15.17:0/2767456305 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec01d070 con 0x7f52fc102090 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.692+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc19f280 con 0x7f52fc102090 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.692+0000 7f52f37fe700 1 -- 172.21.15.17:0/2767456305 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52ec004220 con 0x7f52fc102090 2023-10-05T15:44:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.692+0000 7f52f37fe700 1 -- 172.21.15.17:0/2767456305 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec022e20 con 0x7f52fc102090 2023-10-05T15:44:39.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.693+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc194f10 con 0x7f52fc102090 2023-10-05T15:44:39.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.699+0000 7f531807bb80 1 Processor -- start 2023-10-05T15:44:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.699+0000 7f531807bb80 1 -- start start 2023-10-05T15:44:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.700+0000 7f531807bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf84ec0 0x56174bf852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.700+0000 7f531807bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf85fd0 0x56174bf86450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.700+0000 7f531807bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf8d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.700+0000 7f531807bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174beed400 con 0x56174bf85fd0 2023-10-05T15:44:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.700+0000 7f531807bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bedebc0 con 0x56174bf86990 2023-10-05T15:44:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.700+0000 7f531807bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bedc4e0 con 0x56174bf84ec0 2023-10-05T15:44:39.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.701+0000 7f530259b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf85fd0 0x56174bf86450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.701+0000 7f530259b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf85fd0 0x56174bf86450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60286/0 (socket says 172.21.15.17:60286) 2023-10-05T15:44:39.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.701+0000 7f530259b700 1 -- 172.21.15.17:0/988071027 learned_addr learned my addr 172.21.15.17:0/988071027 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:39.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.701+0000 7f5302d9c700 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf84ec0 0x56174bf852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f5302d9c700 1 -- 172.21.15.17:0/988071027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 msgr2=0x56174bf8d220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:44:39.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f5302d9c700 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf8d220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f5302d9c700 1 -- 172.21.15.17:0/988071027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf85fd0 msgr2=0x56174bf86450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f5302d9c700 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf85fd0 0x56174bf86450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f5302d9c700 1 -- 172.21.15.17:0/988071027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56174bd02d80 con 0x56174bf84ec0 2023-10-05T15:44:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f5302d9c700 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf84ec0 0x56174bf852e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f52f400d250 tx=0x7f52f400d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a20e4ae429e017 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.702+0000 7f52f37fe700 1 -- 172.21.15.17:0/2767456305 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f52ec022570 con 0x7f52fc102090 2023-10-05T15:44:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.703+0000 7f52f0ff9700 1 -- 172.21.15.17:0/988071027 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40123f0 con 0x56174bf84ec0 2023-10-05T15:44:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.703+0000 7f52f0ff9700 1 -- 172.21.15.17:0/988071027 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52f40129e0 con 0x56174bf84ec0 2023-10-05T15:44:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.703+0000 7f52f0ff9700 1 -- 172.21.15.17:0/988071027 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4011970 con 0x56174bf84ec0 2023-10-05T15:44:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 -- 172.21.15.17:0/988071027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf84ec0 msgr2=0x56174bf852e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf84ec0 0x56174bf852e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f52f400d250 tx=0x7f52f400d560 comp rx=0 tx=0).stop 2023-10-05T15:44:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 -- 172.21.15.17:0/988071027 shutdown_connections 2023-10-05T15:44:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf8d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf84ec0 0x56174bf852e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 --2- 172.21.15.17:0/988071027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf85fd0 0x56174bf86450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.704+0000 7f531807bb80 1 -- 172.21.15.17:0/988071027 >> 172.21.15.17:0/988071027 conn(0x56174bef9200 msgr2=0x56174bf7fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:39.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.705+0000 7f531807bb80 1 -- 172.21.15.17:0/988071027 shutdown_connections 2023-10-05T15:44:39.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.706+0000 7f531807bb80 1 -- 172.21.15.17:0/988071027 wait complete. 2023-10-05T15:44:39.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.706+0000 7f52f37fe700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52e80a1490 0x7f52e80a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.706+0000 7f52f37fe700 1 -- 172.21.15.17:0/2767456305 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f52ec0ce1f0 con 0x7f52fc102090 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.706+0000 7f531807bb80 1 -- start start 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 Processor -- start 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f530259b700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52e80a1490 0x7f52e80a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf8ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf8f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf96200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bed7dd0 con 0x56174bf84ec0 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174be746b0 con 0x56174bf86990 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174be74350 con 0x56174bf85fd0 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.707+0000 7f531807bb80 10 client.0 _ll_register_callbacks cb 0x56174bcd17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf96200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf96200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41314/0 (socket says 172.21.15.17:41314) 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 -- 172.21.15.17:0/3333321795 learned_addr learned my addr 172.21.15.17:0/3333321795 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5301d9a700 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf8f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 -- 172.21.15.17:0/3333321795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 msgr2=0x56174bf8f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf8f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 -- 172.21.15.17:0/3333321795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 msgr2=0x56174bf8ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf8ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.708+0000 7f5302d9c700 1 -- 172.21.15.17:0/3333321795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f4007d20 con 0x56174bf86990 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.709+0000 7f5302d9c700 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf96200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52f400d220 tx=0x7f52f400de30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da037866cbc3d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.709+0000 7f52e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:44:39.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f52e5ffb700 1 -- 172.21.15.17:0/3333321795 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40125f0 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f52e5ffb700 1 -- 172.21.15.17:0/3333321795 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f52f4012750 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56174bf77d50 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f530259b700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52e80a1490 0x7f52e80a3950 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f52f8006b00 tx=0x7f52f8007610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f52e5ffb700 1 -- 172.21.15.17:0/3333321795 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52f4011670 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f531807bb80 10 client.26552 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.710+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56174bcebc00 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f52e5ffb700 1 -- 172.21.15.17:0/3333321795 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56174bf77d50 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f52e5ffb700 1 -- 172.21.15.17:0/3333321795 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f52f401bae0 con 0x56174bf86990 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f531807bb80 10 client.26552 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f531807bb80 10 client.26552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f531807bb80 20 client.26552 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f531807bb80 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bf9aa00 0x56174bf9ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f531807bb80 4 client.26552 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:44:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.711+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56174bed0db0 con 0x56174bf9aa00 2023-10-05T15:44:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.714+0000 7f530259b700 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bf9aa00 0x56174bf9ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.715+0000 7f530259b700 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bf9aa00 0x56174bf9ce20 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86102a880672385f server_cookie=7de6a025e89f865f in_seq=0 out_seq=0 2023-10-05T15:44:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.716+0000 7f52e5ffb700 10 client.26552 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.716+0000 7f52e5ffb700 1 -- 172.21.15.17:0/3333321795 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56174bed0db0 con 0x56174bf9aa00 2023-10-05T15:44:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.716+0000 7f52e5ffb700 10 client.26552 handle_command_reply: tid=0 2023-10-05T15:44:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.716+0000 7f531807bb80 1 client.26552 shutdown 2023-10-05T15:44:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.717+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 msgr2=0x56174bf96200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.717+0000 7f531807bb80 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf96200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52f400d220 tx=0x7f52f400de30 comp rx=0 tx=0).stop 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 shutdown_connections 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bf9aa00 0x56174bf9ce20 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf96200 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf8ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 --2- 172.21.15.17:0/3333321795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf8f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 >> 172.21.15.17:0/3333321795 conn(0x56174bef9200 msgr2=0x56174bf7f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f52e5ffb700 0 client.26552 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 shutdown_connections 2023-10-05T15:44:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.718+0000 7f531807bb80 1 -- 172.21.15.17:0/3333321795 wait complete. 2023-10-05T15:44:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.719+0000 7f531807bb80 20 client.26552 trim_cache size 0 max 16384 2023-10-05T15:44:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 Processor -- start 2023-10-05T15:44:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 -- start start 2023-10-05T15:44:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf9ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bd588c0 con 0x56174bf84ec0 2023-10-05T15:44:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bf8e130 con 0x56174bf86990 2023-10-05T15:44:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.747+0000 7f531807bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bf85740 con 0x56174bf85fd0 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf89980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41330/0 (socket says 172.21.15.17:41330) 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 -- 172.21.15.17:0/506472609 learned_addr learned my addr 172.21.15.17:0/506472609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5301d9a700 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 -- 172.21.15.17:0/506472609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 msgr2=0x56174bf961c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 -- 172.21.15.17:0/506472609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 msgr2=0x56174bf9ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf9ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.748+0000 7f5302d9c700 1 -- 172.21.15.17:0/506472609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56174bd291f0 con 0x56174bf86990 2023-10-05T15:44:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.749+0000 7f5302d9c700 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf89980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f52f400d170 tx=0x7f52f40077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b5898a89dbfc88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.749+0000 7f52f17fa700 1 -- 172.21.15.17:0/506472609 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4011430 con 0x56174bf86990 2023-10-05T15:44:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.749+0000 7f52f17fa700 1 -- 172.21.15.17:0/506472609 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52f4011590 con 0x56174bf86990 2023-10-05T15:44:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.749+0000 7f52f17fa700 1 -- 172.21.15.17:0/506472609 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4011c40 con 0x56174bf86990 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 -- 172.21.15.17:0/506472609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 msgr2=0x56174bf89980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf89980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f52f400d170 tx=0x7f52f40077a0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 -- 172.21.15.17:0/506472609 shutdown_connections 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf89980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf9ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 --2- 172.21.15.17:0/506472609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf961c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 -- 172.21.15.17:0/506472609 >> 172.21.15.17:0/506472609 conn(0x56174bef9200 msgr2=0x56174bf7f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.750+0000 7f531807bb80 1 -- 172.21.15.17:0/506472609 shutdown_connections 2023-10-05T15:44:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.751+0000 7f531807bb80 1 -- 172.21.15.17:0/506472609 wait complete. 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.751+0000 7f531807bb80 1 -- start start 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.751+0000 7f531807bb80 1 Processor -- start 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf93a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf93f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf94fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bf954e0 con 0x56174bf84ec0 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bf95650 con 0x56174bf86990 2023-10-05T15:44:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56174bf95810 con 0x56174bf85fd0 2023-10-05T15:44:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.752+0000 7f531807bb80 10 client.0 _ll_register_callbacks cb 0x7f52f8007220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.753+0000 7f5301d9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf93f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.753+0000 7f5301d9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf93f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44302/0 (socket says 172.21.15.17:44302) 2023-10-05T15:44:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.753+0000 7f5301d9a700 1 -- 172.21.15.17:0/275688533 learned_addr learned my addr 172.21.15.17:0/275688533 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.753+0000 7f5302d9c700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf94fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f530259b700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf93a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f5301d9a700 1 -- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 msgr2=0x56174bf94fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f5301d9a700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf94fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f5301d9a700 1 -- 172.21.15.17:0/275688533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 msgr2=0x56174bf93a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f5301d9a700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf93a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f5301d9a700 1 -- 172.21.15.17:0/275688533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56174bcebc00 con 0x56174bf85fd0 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f5301d9a700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf93f90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0976a0 tx=0x7f52ec097610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adeb3e6726f17e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.754+0000 7f52e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.755+0000 7f52e5ffb700 1 -- 172.21.15.17:0/275688533 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0a3210 con 0x56174bf85fd0 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.755+0000 7f52e5ffb700 1 -- 172.21.15.17:0/275688533 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f52ec09b8a0 con 0x56174bf85fd0 2023-10-05T15:44:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.755+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f52f40129e0 con 0x56174bf85fd0 2023-10-05T15:44:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.757+0000 7f52e5ffb700 1 -- 172.21.15.17:0/275688533 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52ec09b1a0 con 0x56174bf85fd0 2023-10-05T15:44:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.757+0000 7f531807bb80 10 client.26542 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.757+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56174bd01250 con 0x56174bf85fd0 2023-10-05T15:44:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.758+0000 7f52e5ffb700 1 -- 172.21.15.17:0/275688533 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52f40129e0 con 0x56174bf85fd0 2023-10-05T15:44:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f52e5ffb700 1 -- 172.21.15.17:0/275688533 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f52ec0b3bd0 con 0x56174bf85fd0 2023-10-05T15:44:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f531807bb80 10 client.26542 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f531807bb80 10 client.26542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f531807bb80 20 client.26542 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f531807bb80 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bfeefc0 0x56174bff13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f531807bb80 4 client.26542 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:44:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.759+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56174bed0ad0 con 0x56174bfeefc0 2023-10-05T15:44:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.760+0000 7f530259b700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bfeefc0 0x56174bff13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.761+0000 7f530259b700 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bfeefc0 0x56174bff13b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbf7c4e4bf98d1d server_cookie=382e1a2e54ba19de in_seq=0 out_seq=0 2023-10-05T15:44:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.761+0000 7f52e5ffb700 10 client.26542 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.777+0000 7f52e5ffb700 1 -- 172.21.15.17:0/275688533 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56174bed0ad0 con 0x56174bfeefc0 2023-10-05T15:44:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.777+0000 7f52e5ffb700 10 client.26542 handle_command_reply: tid=0 2023-10-05T15:44:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.777+0000 7f531807bb80 1 client.26542 shutdown 2023-10-05T15:44:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 msgr2=0x56174bf93f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf93f90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0976a0 tx=0x7f52ec097610 comp rx=0 tx=0).stop 2023-10-05T15:44:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 shutdown_connections 2023-10-05T15:44:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56174bfeefc0 0x56174bff13b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56174bf86990 0x56174bf94fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56174bf84ec0 0x56174bf93a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 --2- 172.21.15.17:0/275688533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56174bf85fd0 0x56174bf93f90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 >> 172.21.15.17:0/275688533 conn(0x56174bef9200 msgr2=0x56174bf9ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.778+0000 7f52e5ffb700 0 client.26542 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.779+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 shutdown_connections 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.779+0000 7f531807bb80 1 -- 172.21.15.17:0/275688533 wait complete. 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.779+0000 7f531807bb80 20 client.26542 trim_cache size 0 max 16384 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:44:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:44:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.780+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52e80a1490 msgr2=0x7f52e80a3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.780+0000 7f53047ff700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52e80a1490 0x7f52e80a3950 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f52f8006b00 tx=0x7f52f8007610 comp rx=0 tx=0).stop 2023-10-05T15:44:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.780+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 msgr2=0x7f52fc19dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.780+0000 7f53047ff700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 0x7f52fc19dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52ec005740 tx=0x7f52ec005770 comp rx=0 tx=0).stop 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 shutdown_connections 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52e80a1490 0x7f52e80a3950 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52fc102a50 0x7f52fc19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52fc100eb0 0x7f52fc19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 --2- 172.21.15.17:0/2767456305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52fc102090 0x7f52fc19dcd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 >> 172.21.15.17:0/2767456305 conn(0x7f52fc0fc430 msgr2=0x7f52fc0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 shutdown_connections 2023-10-05T15:44:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:39.781+0000 7f53047ff700 1 -- 172.21.15.17:0/2767456305 wait complete. 2023-10-05T15:44:40.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:39 smithi167 ceph-mon[133366]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.6 MiB/s wr, 647 op/s 2023-10-05T15:44:40.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:39 smithi079 ceph-mon[132936]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.6 MiB/s wr, 647 op/s 2023-10-05T15:44:40.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:39 smithi017 ceph-mon[129107]: pgmap v611: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.6 MiB/s wr, 647 op/s 2023-10-05T15:44:42.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:41 smithi167 ceph-mon[133366]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.5 MiB/s wr, 674 op/s 2023-10-05T15:44:42.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:41 smithi079 ceph-mon[132936]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.5 MiB/s wr, 674 op/s 2023-10-05T15:44:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:41 smithi017 ceph-mon[129107]: pgmap v612: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.5 MiB/s wr, 674 op/s 2023-10-05T15:44:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 365.0 s, 653.2 tps, lat 153.167 ms stddev 47.513 2023-10-05T15:44:44.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:43 smithi167 ceph-mon[133366]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.8 MiB/s wr, 587 op/s 2023-10-05T15:44:44.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:43 smithi079 ceph-mon[132936]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.8 MiB/s wr, 587 op/s 2023-10-05T15:44:44.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:43 smithi017 ceph-mon[129107]: pgmap v613: 129 pgs: 129 active+clean; 1.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.8 MiB/s wr, 587 op/s 2023-10-05T15:44:46.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:45 smithi167 ceph-mon[133366]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 782 op/s 2023-10-05T15:44:46.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:45 smithi079 ceph-mon[132936]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 782 op/s 2023-10-05T15:44:46.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:45 smithi017 ceph-mon[129107]: pgmap v614: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.7 MiB/s wr, 782 op/s 2023-10-05T15:44:48.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:47 smithi167 ceph-mon[133366]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 565 op/s 2023-10-05T15:44:48.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:47 smithi079 ceph-mon[132936]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 565 op/s 2023-10-05T15:44:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 370.0 s, 601.8 tps, lat 165.134 ms stddev 50.711 2023-10-05T15:44:48.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:47 smithi017 ceph-mon[129107]: pgmap v615: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 565 op/s 2023-10-05T15:44:50.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:49 smithi167 ceph-mon[133366]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2023-10-05T15:44:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:49 smithi079 ceph-mon[132936]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2023-10-05T15:44:50.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:49 smithi017 ceph-mon[129107]: pgmap v616: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2023-10-05T15:44:52.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:51 smithi167 ceph-mon[133366]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.7 MiB/s wr, 693 op/s 2023-10-05T15:44:52.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:51 smithi079 ceph-mon[132936]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.7 MiB/s wr, 693 op/s 2023-10-05T15:44:52.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:51 smithi017 ceph-mon[129107]: pgmap v617: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.7 MiB/s wr, 693 op/s 2023-10-05T15:44:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3858021449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd40ff120 msgr2=0x7fcbd40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3858021449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd40ff120 0x7fcbd40ff540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00afc0 tx=0x7fcbcc00c650 comp rx=0 tx=0).stop 2023-10-05T15:44:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3858021449 shutdown_connections 2023-10-05T15:44:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3858021449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3858021449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd40ff120 0x7fcbd40ff540 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3858021449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd4100310 0x7fcbd4100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.046+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3858021449 >> 172.21.15.17:0/3858021449 conn(0x7fcbd40fa690 msgr2=0x7fcbd40fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.048+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3858021449 shutdown_connections 2023-10-05T15:44:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.048+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3858021449 wait complete. 2023-10-05T15:44:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.049+0000 7fcbdb5ff700 1 Processor -- start 2023-10-05T15:44:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 -- start start 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 0x7fcbd410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4100310 0x7fcbd4110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd410e800 con 0x7fcbd4100310 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd410e970 con 0x7fcbd40ff120 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbdb5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd410eb30 con 0x7fcbd4100cb0 2023-10-05T15:44:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.050+0000 7fcbd939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 0x7fcbd410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 0x7fcbd410fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54240/0 (socket says 172.21.15.17:54240) 2023-10-05T15:44:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 -- 172.21.15.17:0/3592555721 learned_addr learned my addr 172.21.15.17:0/3592555721 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4100310 0x7fcbd4110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 -- 172.21.15.17:0/3592555721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd4100cb0 msgr2=0x7fcbd4110840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4110840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 -- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4100310 msgr2=0x7fcbd4110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4100310 0x7fcbd4110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.051+0000 7fcbd939b700 1 -- 172.21.15.17:0/3592555721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc00c050 con 0x7fcbd40ff120 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.052+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4100310 0x7fcbd4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:44:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.052+0000 7fcbd939b700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 0x7fcbd410fdc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00a6a0 tx=0x7fcbcc00a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.052+0000 7fcbc67fc700 1 -- 172.21.15.17:0/3592555721 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc019830 con 0x7fcbd40ff120 2023-10-05T15:44:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.052+0000 7fcbc67fc700 1 -- 172.21.15.17:0/3592555721 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbcc019e20 con 0x7fcbd40ff120 2023-10-05T15:44:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.052+0000 7fcbc67fc700 1 -- 172.21.15.17:0/3592555721 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc022e00 con 0x7fcbd40ff120 2023-10-05T15:44:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.053+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd410edb0 con 0x7fcbd40ff120 2023-10-05T15:44:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.053+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd410f210 con 0x7fcbd40ff120 2023-10-05T15:44:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.060+0000 7fcbeef39b80 1 Processor -- start 2023-10-05T15:44:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.060+0000 7fcbc67fc700 1 -- 172.21.15.17:0/3592555721 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcbcc01f070 con 0x7fcbd40ff120 2023-10-05T15:44:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.060+0000 7fcbeef39b80 1 -- start start 2023-10-05T15:44:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.061+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5ca32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.061+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5ca4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.061+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca4990 0x555fc5cab220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.061+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5c0b400 con 0x555fc5ca2ec0 2023-10-05T15:44:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.061+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5bfcbc0 con 0x555fc5ca4990 2023-10-05T15:44:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.061+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5bfa4e0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbd939b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5ca4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbc67fc700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcbc00a15d0 0x7fcbc00a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbd939b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5ca4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:32878/0 (socket says 172.21.15.17:32878) 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbd939b700 1 -- 172.21.15.17:0/1504941722 learned_addr learned my addr 172.21.15.17:0/1504941722 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5ca32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca4990 0x555fc5cab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.062+0000 7fcbc67fc700 1 -- 172.21.15.17:0/3592555721 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcbcc015070 con 0x7fcbd40ff120 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd939b700 1 -- 172.21.15.17:0/1504941722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca4990 msgr2=0x555fc5cab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd939b700 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca4990 0x555fc5cab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd939b700 1 -- 172.21.15.17:0/1504941722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 msgr2=0x555fc5ca32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd939b700 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5ca32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd939b700 1 -- 172.21.15.17:0/1504941722 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fc5a20d80 con 0x555fc5ca3fd0 2023-10-05T15:44:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcbc00a15d0 0x7fcbc00a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbd939b700 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5ca4450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc000c00 tx=0x7fcbcc019f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7916fc1cc3a97bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.063+0000 7fcbbf7fe700 1 -- 172.21.15.17:0/1504941722 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc09a3f0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.064+0000 7fcbbf7fe700 1 -- 172.21.15.17:0/1504941722 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbcc09a160 con 0x555fc5ca3fd0 2023-10-05T15:44:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.064+0000 7fcbbf7fe700 1 -- 172.21.15.17:0/1504941722 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0850d0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.064+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1504941722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 msgr2=0x555fc5ca4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.064+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5ca4450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc000c00 tx=0x7fcbcc019f90 comp rx=0 tx=0).stop 2023-10-05T15:44:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.065+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcbc00a15d0 0x7fcbc00a3a90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x555fc5ca2c60 tx=0x7fcbd00047c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1504941722 shutdown_connections 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca4990 0x555fc5cab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5ca32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1504941722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5ca4450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1504941722 >> 172.21.15.17:0/1504941722 conn(0x555fc5c17200 msgr2=0x555fc5c9dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1504941722 shutdown_connections 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.066+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1504941722 wait complete. 2023-10-05T15:44:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.067+0000 7fcbeef39b80 1 -- start start 2023-10-05T15:44:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.067+0000 7fcbeef39b80 1 Processor -- start 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca2ec0 0x555fc5cac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cacd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5bf5dd0 con 0x555fc5ca4990 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5b926b0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5b92350 con 0x555fc5ca2ec0 2023-10-05T15:44:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.068+0000 7fcbeef39b80 10 client.0 _ll_register_callbacks cb 0x555fc59ef7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.069+0000 7fcbd9b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.069+0000 7fcbd9b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46208/0 (socket says 172.21.15.17:46208) 2023-10-05T15:44:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.069+0000 7fcbd9b9c700 1 -- 172.21.15.17:0/864315555 learned_addr learned my addr 172.21.15.17:0/864315555 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.069+0000 7fcbd939b700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca2ec0 0x555fc5cac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.069+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cacd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.070+0000 7fcbd9b9c700 1 -- 172.21.15.17:0/864315555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca2ec0 msgr2=0x555fc5cac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.070+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca2ec0 0x555fc5cac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.070+0000 7fcbd9b9c700 1 -- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 msgr2=0x555fc5cacd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.070+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cacd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.070+0000 7fcbd9b9c700 1 -- 172.21.15.17:0/864315555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd410f210 con 0x555fc5ca4990 2023-10-05T15:44:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.070+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cacd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:44:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.071+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb3d50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0003eb0 tx=0x7fcbd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba9931ec54fcf2d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.071+0000 7fcbbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:44:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.071+0000 7fcbbcff9700 1 -- 172.21.15.17:0/864315555 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0021680 con 0x555fc5ca4990 2023-10-05T15:44:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.072+0000 7fcbbcff9700 1 -- 172.21.15.17:0/864315555 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcbd00217e0 con 0x555fc5ca4990 2023-10-05T15:44:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.072+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555fc5c95d50 con 0x555fc5ca4990 2023-10-05T15:44:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.072+0000 7fcbbcff9700 1 -- 172.21.15.17:0/864315555 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbd0012e80 con 0x555fc5ca4990 2023-10-05T15:44:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.073+0000 7fcbeef39b80 10 client.16671 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.073+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555fc5a09c00 con 0x555fc5ca4990 2023-10-05T15:44:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbbcff9700 1 -- 172.21.15.17:0/864315555 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555fc5c95d50 con 0x555fc5ca4990 2023-10-05T15:44:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbbcff9700 1 -- 172.21.15.17:0/864315555 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcbd0010940 con 0x555fc5ca4990 2023-10-05T15:44:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbeef39b80 10 client.16671 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbeef39b80 10 client.16671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbeef39b80 20 client.16671 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5cb8630 0x555fc5cbaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbeef39b80 4 client.16671 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:44:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.074+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555fc5beedb0 con 0x555fc5cb8630 2023-10-05T15:44:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.075+0000 7fcbd939b700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5cb8630 0x555fc5cbaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.076+0000 7fcbd939b700 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5cb8630 0x555fc5cbaa50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c714ad4120b724a server_cookie=3b2710b796d9bd2a in_seq=0 out_seq=0 2023-10-05T15:44:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.076+0000 7fcbbcff9700 10 client.16671 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.077+0000 7fcbbcff9700 1 -- 172.21.15.17:0/864315555 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555fc5beedb0 con 0x555fc5cb8630 2023-10-05T15:44:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.077+0000 7fcbbcff9700 10 client.16671 handle_command_reply: tid=0 2023-10-05T15:44:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.077+0000 7fcbeef39b80 1 client.16671 shutdown 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 msgr2=0x555fc5cb3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb3d50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0003eb0 tx=0x7fcbd0004750 comp rx=0 tx=0).stop 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 shutdown_connections 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5cb8630 0x555fc5cbaa50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb3d50 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca2ec0 0x555fc5cac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/864315555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cacd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 >> 172.21.15.17:0/864315555 conn(0x555fc5c17200 msgr2=0x555fc5c9d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.078+0000 7fcbbcff9700 0 client.16671 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.079+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 shutdown_connections 2023-10-05T15:44:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.079+0000 7fcbeef39b80 1 -- 172.21.15.17:0/864315555 wait complete. 2023-10-05T15:44:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.080+0000 7fcbeef39b80 20 client.16671 trim_cache size 0 max 16384 2023-10-05T15:44:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.105+0000 7fcbeef39b80 1 Processor -- start 2023-10-05T15:44:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 -- start start 2023-10-05T15:44:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5cabe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca4990 0x555fc5cba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5a768c0 con 0x555fc5ca2ec0 2023-10-05T15:44:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5cabcc0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.106+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5c9a860 con 0x555fc5ca4990 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd9b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca4990 0x555fc5cba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54264/0 (socket says 172.21.15.17:54264) 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/1773562985 learned_addr learned my addr 172.21.15.17:0/1773562985 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/1773562985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca4990 msgr2=0x555fc5cba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca4990 0x555fc5cba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/1773562985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 msgr2=0x555fc5cabe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5cabe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.107+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/1773562985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555fc5a471f0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.108+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb3d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8007630 tx=0x7fcbc8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bbf5e9ed2be0b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.108+0000 7fcbbffff700 1 -- 172.21.15.17:0/1773562985 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8018070 con 0x555fc5ca3fd0 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.108+0000 7fcbbffff700 1 -- 172.21.15.17:0/1773562985 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbc8003e90 con 0x555fc5ca3fd0 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.108+0000 7fcbbffff700 1 -- 172.21.15.17:0/1773562985 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80134a0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1773562985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 msgr2=0x555fc5cb3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb3d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8007630 tx=0x7fcbc8009920 comp rx=0 tx=0).stop 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1773562985 shutdown_connections 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca4990 0x555fc5cba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca2ec0 0x555fc5cabe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/1773562985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb3d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1773562985 >> 172.21.15.17:0/1773562985 conn(0x555fc5c17200 msgr2=0x555fc5c9d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1773562985 shutdown_connections 2023-10-05T15:44:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.109+0000 7fcbeef39b80 1 -- 172.21.15.17:0/1773562985 wait complete. 2023-10-05T15:44:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.110+0000 7fcbeef39b80 1 -- start start 2023-10-05T15:44:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.110+0000 7fcbeef39b80 1 Processor -- start 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca2ec0 0x555fc5cb12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5cb2d50 con 0x555fc5ca4990 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5cb2ec0 con 0x555fc5ca2ec0 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555fc5cb3080 con 0x555fc5ca3fd0 2023-10-05T15:44:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.111+0000 7fcbeef39b80 10 client.0 _ll_register_callbacks cb 0x7fcbd0003a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:44:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:32902/0 (socket says 172.21.15.17:32902) 2023-10-05T15:44:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/291274757 learned_addr learned my addr 172.21.15.17:0/291274757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:44:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd9b9c700 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca2ec0 msgr2=0x555fc5cb12c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:44:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca2ec0 0x555fc5cb12c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/291274757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 msgr2=0x555fc5cb2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:44:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.112+0000 7fcbd8b9a700 1 -- 172.21.15.17:0/291274757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc8009300 con 0x555fc5ca3fd0 2023-10-05T15:44:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.116+0000 7fcbd8b9a700 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb1800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80060b0 tx=0x7fcbc8003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4872f2e9c38904e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:44:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.116+0000 7fcbbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:44:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.116+0000 7fcbbcff9700 1 -- 172.21.15.17:0/291274757 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8018040 con 0x555fc5ca3fd0 2023-10-05T15:44:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.116+0000 7fcbbcff9700 1 -- 172.21.15.17:0/291274757 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcbc8003ca0 con 0x555fc5ca3fd0 2023-10-05T15:44:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.116+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbcc09a160 con 0x555fc5ca3fd0 2023-10-05T15:44:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.117+0000 7fcbbcff9700 1 -- 172.21.15.17:0/291274757 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbc8005040 con 0x555fc5ca3fd0 2023-10-05T15:44:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.117+0000 7fcbeef39b80 10 client.26560 fetch_fsmap learned FSMap version 39 2023-10-05T15:44:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.117+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555fc5a1f250 con 0x555fc5ca3fd0 2023-10-05T15:44:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.117+0000 7fcbbcff9700 1 -- 172.21.15.17:0/291274757 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbcc09a160 con 0x555fc5ca3fd0 2023-10-05T15:44:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.118+0000 7fcbbcff9700 1 -- 172.21.15.17:0/291274757 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcbc8028640 con 0x555fc5ca3fd0 2023-10-05T15:44:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbeef39b80 10 client.26560 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbeef39b80 10 client.26560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbeef39b80 20 client.26560 populate_metadata read hostname 'smithi017' 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5d0cb10 0x555fc5d0ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbeef39b80 4 client.26560 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555fc5beead0 con 0x555fc5d0cb10 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.119+0000 7fcbd939b700 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5d0cb10 0x555fc5d0ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:44:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.120+0000 7fcbbcff9700 10 client.26560 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.120+0000 7fcbd939b700 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5d0cb10 0x555fc5d0ef30 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a30ce0b4b8b8061d server_cookie=a44aa711b114f545 in_seq=0 out_seq=0 2023-10-05T15:44:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.144+0000 7fcbbcff9700 1 -- 172.21.15.17:0/291274757 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555fc5beead0 con 0x555fc5d0cb10 2023-10-05T15:44:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.144+0000 7fcbbcff9700 10 client.26560 handle_command_reply: tid=0 2023-10-05T15:44:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.144+0000 7fcbeef39b80 1 client.26560 shutdown 2023-10-05T15:44:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.145+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 msgr2=0x555fc5cb1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.145+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb1800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80060b0 tx=0x7fcbc8003a00 comp rx=0 tx=0).stop 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 shutdown_connections 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555fc5d0cb10 0x555fc5d0ef30 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555fc5ca4990 0x555fc5cb2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555fc5ca2ec0 0x555fc5cb12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbeef39b80 1 --2- 172.21.15.17:0/291274757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555fc5ca3fd0 0x555fc5cb1800 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 >> 172.21.15.17:0/291274757 conn(0x555fc5c17200 msgr2=0x555fc5cba640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.146+0000 7fcbbcff9700 0 client.26560 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:44:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.147+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 shutdown_connections 2023-10-05T15:44:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.147+0000 7fcbeef39b80 1 -- 172.21.15.17:0/291274757 wait complete. 2023-10-05T15:44:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.148+0000 7fcbeef39b80 20 client.26560 trim_cache size 0 max 16384 2023-10-05T15:44:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:44:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:44:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:44:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:44:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.152+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcbc00a15d0 msgr2=0x7fcbc00a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.152+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcbc00a15d0 0x7fcbc00a3a90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x555fc5ca2c60 tx=0x7fcbd00047c0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.152+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 msgr2=0x7fcbd410fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:44:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.152+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 0x7fcbd410fdc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00a6a0 tx=0x7fcbcc00a6d0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 shutdown_connections 2023-10-05T15:44:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcbc00a15d0 0x7fcbc00a3a90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd4100cb0 0x7fcbd4110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcbd40ff120 0x7fcbd410fdc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 --2- 172.21.15.17:0/3592555721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbd4100310 0x7fcbd4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:44:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 >> 172.21.15.17:0/3592555721 conn(0x7fcbd40fa690 msgr2=0x7fcbd40fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:44:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 shutdown_connections 2023-10-05T15:44:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:44:53.153+0000 7fcbdb5ff700 1 -- 172.21.15.17:0/3592555721 wait complete. 2023-10-05T15:44:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 375.0 s, 564.0 tps, lat 177.302 ms stddev 53.729 2023-10-05T15:44:54.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:53 smithi167 ceph-mon[133366]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 606 op/s 2023-10-05T15:44:54.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:53 smithi079 ceph-mon[132936]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 606 op/s 2023-10-05T15:44:54.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:53 smithi017 ceph-mon[129107]: pgmap v618: 129 pgs: 129 active+clean; 1.5 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 606 op/s 2023-10-05T15:44:56.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:55 smithi079 ceph-mon[132936]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.0 MiB/s wr, 744 op/s 2023-10-05T15:44:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:55 smithi017 ceph-mon[129107]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.0 MiB/s wr, 744 op/s 2023-10-05T15:44:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:55 smithi167 ceph-mon[133366]: pgmap v619: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.0 MiB/s wr, 744 op/s 2023-10-05T15:44:58.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:57 smithi167 ceph-mon[133366]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 538 op/s 2023-10-05T15:44:58.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:57 smithi079 ceph-mon[132936]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 538 op/s 2023-10-05T15:44:58.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 380.0 s, 557.0 tps, lat 180.196 ms stddev 78.226 2023-10-05T15:44:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:57 smithi017 ceph-mon[129107]: pgmap v620: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 538 op/s 2023-10-05T15:45:00.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:44:59 smithi167 ceph-mon[133366]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 649 op/s 2023-10-05T15:45:00.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:44:59 smithi079 ceph-mon[132936]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 649 op/s 2023-10-05T15:45:00.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:44:59 smithi017 ceph-mon[129107]: pgmap v621: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 649 op/s 2023-10-05T15:45:02.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:01 smithi079 ceph-mon[132936]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 645 op/s 2023-10-05T15:45:02.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:01 smithi017 ceph-mon[129107]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 645 op/s 2023-10-05T15:45:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:01 smithi167 ceph-mon[133366]: pgmap v622: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 645 op/s 2023-10-05T15:45:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 385.0 s, 562.8 tps, lat 179.421 ms stddev 62.820 2023-10-05T15:45:04.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:03 smithi079 ceph-mon[132936]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 529 op/s 2023-10-05T15:45:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:03 smithi017 ceph-mon[129107]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 529 op/s 2023-10-05T15:45:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:03 smithi167 ceph-mon[133366]: pgmap v623: 129 pgs: 129 active+clean; 1.5 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 529 op/s 2023-10-05T15:45:06.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:05 smithi017 ceph-mon[129107]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 681 op/s 2023-10-05T15:45:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:05 smithi167 ceph-mon[133366]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 681 op/s 2023-10-05T15:45:06.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:05 smithi079 ceph-mon[132936]: pgmap v624: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.8 MiB/s wr, 681 op/s 2023-10-05T15:45:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 -- 172.21.15.17:0/1391879471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8100f10 msgr2=0x7f76f8101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 --2- 172.21.15.17:0/1391879471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8100f10 0x7f76f8101330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76e80098f0 tx=0x7f76e8009c00 comp rx=0 tx=0).stop 2023-10-05T15:45:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 -- 172.21.15.17:0/1391879471 shutdown_connections 2023-10-05T15:45:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 --2- 172.21.15.17:0/1391879471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8102a20 0x7f76f8109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 --2- 172.21.15.17:0/1391879471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8100f10 0x7f76f8101330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 --2- 172.21.15.17:0/1391879471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102060 0x7f76f81024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 -- 172.21.15.17:0/1391879471 >> 172.21.15.17:0/1391879471 conn(0x7f76f80fc460 msgr2=0x7f76f80fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 -- 172.21.15.17:0/1391879471 shutdown_connections 2023-10-05T15:45:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.399+0000 7f76fdfff700 1 -- 172.21.15.17:0/1391879471 wait complete. 2023-10-05T15:45:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 Processor -- start 2023-10-05T15:45:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 -- start start 2023-10-05T15:45:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8100f10 0x7f76f8198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8102060 0x7f76f8199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 0x7f76f819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f819a8d0 con 0x7f76f8100f10 2023-10-05T15:45:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f819aa40 con 0x7f76f8102060 2023-10-05T15:45:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.401+0000 7f76fdfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f819ac00 con 0x7f76f8102a20 2023-10-05T15:45:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.402+0000 7f76f7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 0x7f76f819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.402+0000 7f76f7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 0x7f76f819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44334/0 (socket says 172.21.15.17:44334) 2023-10-05T15:45:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.402+0000 7f76f7fff700 1 -- 172.21.15.17:0/780783816 learned_addr learned my addr 172.21.15.17:0/780783816 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f77fe700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8100f10 0x7f76f8198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8102060 0x7f76f8199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f7fff700 1 -- 172.21.15.17:0/780783816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8102060 msgr2=0x7f76f8199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f7fff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8102060 0x7f76f8199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f7fff700 1 -- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8100f10 msgr2=0x7f76f8198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f7fff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8100f10 0x7f76f8198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f7fff700 1 -- 172.21.15.17:0/780783816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0095f0 con 0x7f76f8102a20 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f77fe700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8100f10 0x7f76f8198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:45:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8102060 0x7f76f8199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:45:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.403+0000 7f76f7fff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 0x7f76f819a1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76f000ef30 tx=0x7f76f000c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.404+0000 7f76f4ff9700 1 -- 172.21.15.17:0/780783816 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0018070 con 0x7f76f8102a20 2023-10-05T15:45:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.404+0000 7f76f4ff9700 1 -- 172.21.15.17:0/780783816 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76f000f040 con 0x7f76f8102a20 2023-10-05T15:45:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.404+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e8009520 con 0x7f76f8102a20 2023-10-05T15:45:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.404+0000 7f76f4ff9700 1 -- 172.21.15.17:0/780783816 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0003d00 con 0x7f76f8102a20 2023-10-05T15:45:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.404+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f819b020 con 0x7f76f8102a20 2023-10-05T15:45:06.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.410+0000 7f76f4ff9700 1 -- 172.21.15.17:0/780783816 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f76f000caa0 con 0x7f76f8102a20 2023-10-05T15:45:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.411+0000 7f77118f4b80 1 Processor -- start 2023-10-05T15:45:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.411+0000 7f77118f4b80 1 -- start start 2023-10-05T15:45:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 0x55c640a99af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a9ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a9b1a0 0x55c640aa1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f77118f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6409f9400 con 0x55c640a9a7e0 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f77118f4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6409eabc0 con 0x55c640a996d0 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f77118f4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6409e84e0 con 0x55c640a9b1a0 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.412+0000 7f76f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 0x55c640a99af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 0x55c640a99af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54812/0 (socket says 172.21.15.17:54812) 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 -- 172.21.15.17:0/313279866 learned_addr learned my addr 172.21.15.17:0/313279866 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:06.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a9b1a0 0x55c640aa1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 -- 172.21.15.17:0/313279866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a9b1a0 msgr2=0x55c640aa1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a9b1a0 0x55c640aa1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 -- 172.21.15.17:0/313279866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 msgr2=0x55c640a9ac60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a9ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f6ffd700 1 -- 172.21.15.17:0/313279866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c64080ed80 con 0x55c640a996d0 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.413+0000 7f76f4ff9700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e00a1550 0x7f76e00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.414+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 0x55c640a99af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76ec012a70 tx=0x7f76ec009a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=868d62fd3e8869b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.414+0000 7f76f4ff9700 1 -- 172.21.15.17:0/780783816 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f76f00ccdd0 con 0x7f76f8102a20 2023-10-05T15:45:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.415+0000 7f76f77fe700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e00a1550 0x7f76e00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.415+0000 7f76ddffb700 1 -- 172.21.15.17:0/313279866 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec012e40 con 0x55c640a996d0 2023-10-05T15:45:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.415+0000 7f76ddffb700 1 -- 172.21.15.17:0/313279866 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec004030 con 0x55c640a996d0 2023-10-05T15:45:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.415+0000 7f76ddffb700 1 -- 172.21.15.17:0/313279866 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec010c00 con 0x55c640a996d0 2023-10-05T15:45:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.416+0000 7f77118f4b80 1 -- 172.21.15.17:0/313279866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 msgr2=0x55c640a99af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.416+0000 7f77118f4b80 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 0x55c640a99af0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76ec012a70 tx=0x7f76ec009a50 comp rx=0 tx=0).stop 2023-10-05T15:45:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.416+0000 7f76f77fe700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e00a1550 0x7f76e00a3a10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76e80098c0 tx=0x7f76e8019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 -- 172.21.15.17:0/313279866 shutdown_connections 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a9b1a0 0x55c640aa1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a996d0 0x55c640a99af0 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76ec012a70 tx=0x7f76ec009a50 comp rx=0 tx=0).stop 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 --2- 172.21.15.17:0/313279866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a9ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 -- 172.21.15.17:0/313279866 >> 172.21.15.17:0/313279866 conn(0x55c640a05200 msgr2=0x55c640a8bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 -- 172.21.15.17:0/313279866 shutdown_connections 2023-10-05T15:45:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.417+0000 7f77118f4b80 1 -- 172.21.15.17:0/313279866 wait complete. 2023-10-05T15:45:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.418+0000 7f77118f4b80 1 -- start start 2023-10-05T15:45:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 Processor -- start 2023-10-05T15:45:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a921b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a926f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640a97ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6409e3dd0 con 0x55c640a9a7e0 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6409806b0 con 0x55c640a9b1a0 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c640980350 con 0x55c640a97720 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.419+0000 7f77118f4b80 10 client.0 _ll_register_callbacks cb 0x55c6407dd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.420+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.420+0000 7f76f7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640a97ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.420+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a921b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60506/0 (socket says 172.21.15.17:60506) 2023-10-05T15:45:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.420+0000 7f76f77fe700 1 -- 172.21.15.17:0/1138367373 learned_addr learned my addr 172.21.15.17:0/1138367373 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.420+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76f77fe700 1 -- 172.21.15.17:0/1138367373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 msgr2=0x55c640a97ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76f77fe700 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640a97ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76f77fe700 1 -- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 msgr2=0x55c640a926f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76f77fe700 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a926f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76f77fe700 1 -- 172.21.15.17:0/1138367373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec01a040 con 0x55c640a9a7e0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76f77fe700 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a921b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f76e8016000 tx=0x7f76e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31263efac77369a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.421+0000 7f76d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.422+0000 7f76d6ffd700 1 -- 172.21.15.17:0/1138367373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8028070 con 0x55c640a9a7e0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.422+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c640a83d50 con 0x55c640a9a7e0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.422+0000 7f76d6ffd700 1 -- 172.21.15.17:0/1138367373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f76e800bb10 con 0x55c640a9a7e0 2023-10-05T15:45:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.422+0000 7f76d6ffd700 1 -- 172.21.15.17:0/1138367373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e801c040 con 0x55c640a9a7e0 2023-10-05T15:45:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.422+0000 7f77118f4b80 10 client.16683 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.422+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55c6407f7c00 con 0x55c640a9a7e0 2023-10-05T15:45:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f76d6ffd700 1 -- 172.21.15.17:0/1138367373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c640a83d50 con 0x55c640a9a7e0 2023-10-05T15:45:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f76d6ffd700 1 -- 172.21.15.17:0/1138367373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f76e8022410 con 0x55c640a9a7e0 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f77118f4b80 10 client.16683 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f77118f4b80 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f77118f4b80 20 client.16683 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f77118f4b80 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640ab7fb0 0x55c640aba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f77118f4b80 4 client.16683 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.423+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6409dcdb0 con 0x55c640ab7fb0 2023-10-05T15:45:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.424+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640ab7fb0 0x55c640aba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.424+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640ab7fb0 0x55c640aba3d0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23ce7a7d025f0dd server_cookie=e80c5118e112fc63 in_seq=0 out_seq=0 2023-10-05T15:45:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.424+0000 7f76d6ffd700 10 client.16683 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.425+0000 7f76d6ffd700 1 -- 172.21.15.17:0/1138367373 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c6409dcdb0 con 0x55c640ab7fb0 2023-10-05T15:45:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.425+0000 7f76d6ffd700 10 client.16683 handle_command_reply: tid=0 2023-10-05T15:45:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.426+0000 7f77118f4b80 1 client.16683 shutdown 2023-10-05T15:45:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.426+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 msgr2=0x55c640a921b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.426+0000 7f77118f4b80 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a921b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f76e8016000 tx=0x7f76e8009260 comp rx=0 tx=0).stop 2023-10-05T15:45:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.426+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 shutdown_connections 2023-10-05T15:45:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640ab7fb0 0x55c640aba3d0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640a97ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a921b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 --2- 172.21.15.17:0/1138367373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a926f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 >> 172.21.15.17:0/1138367373 conn(0x55c640a05200 msgr2=0x55c640a8b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f76d6ffd700 0 client.16683 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 shutdown_connections 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 1 -- 172.21.15.17:0/1138367373 wait complete. 2023-10-05T15:45:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.427+0000 7f77118f4b80 20 client.16683 trim_cache size 0 max 16384 2023-10-05T15:45:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.452+0000 7f77118f4b80 1 Processor -- start 2023-10-05T15:45:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.452+0000 7f77118f4b80 1 -- start start 2023-10-05T15:45:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a9e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a9e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f77118f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6408648c0 con 0x55c640a9a7e0 2023-10-05T15:45:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f77118f4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6409dcdb0 con 0x55c640a9b1a0 2023-10-05T15:45:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f77118f4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c640a99300 con 0x55c640a97720 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44364/0 (socket says 172.21.15.17:44364) 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.453+0000 7f76f77fe700 1 -- 172.21.15.17:0/2926464691 learned_addr learned my addr 172.21.15.17:0/2926464691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f7fff700 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a9e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f77fe700 1 -- 172.21.15.17:0/2926464691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 msgr2=0x55c640a9e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f77fe700 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a9e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f77fe700 1 -- 172.21.15.17:0/2926464691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 msgr2=0x55c640a9e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f77fe700 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a9e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f77fe700 1 -- 172.21.15.17:0/2926464691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6408351f0 con 0x55c640a97720 2023-10-05T15:45:06.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76f77fe700 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac7bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76e800f5d0 tx=0x7f76e8005c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30660e0836aedb41 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.454+0000 7f76de7fc700 1 -- 172.21.15.17:0/2926464691 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8028070 con 0x55c640a97720 2023-10-05T15:45:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.455+0000 7f76de7fc700 1 -- 172.21.15.17:0/2926464691 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e80056e0 con 0x55c640a97720 2023-10-05T15:45:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.455+0000 7f76de7fc700 1 -- 172.21.15.17:0/2926464691 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e801c040 con 0x55c640a97720 2023-10-05T15:45:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 -- 172.21.15.17:0/2926464691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 msgr2=0x55c640ac7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac7bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76e800f5d0 tx=0x7f76e8005c20 comp rx=0 tx=0).stop 2023-10-05T15:45:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 -- 172.21.15.17:0/2926464691 shutdown_connections 2023-10-05T15:45:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9b1a0 0x55c640a9e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac7bb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 --2- 172.21.15.17:0/2926464691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9a7e0 0x55c640a9e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 -- 172.21.15.17:0/2926464691 >> 172.21.15.17:0/2926464691 conn(0x55c640a05200 msgr2=0x55c640ab9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 -- 172.21.15.17:0/2926464691 shutdown_connections 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.456+0000 7f77118f4b80 1 -- 172.21.15.17:0/2926464691 wait complete. 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.457+0000 7f77118f4b80 1 -- start start 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.457+0000 7f77118f4b80 1 Processor -- start 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9a7e0 0x55c640ac6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9b1a0 0x55c640ac7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c640b0a540 con 0x55c640a9b1a0 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c640b0a680 con 0x55c640a9a7e0 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c640b0a840 con 0x55c640a97720 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f77118f4b80 10 client.0 _ll_register_callbacks cb 0x7f76e8010e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f76f77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44374/0 (socket says 172.21.15.17:44374) 2023-10-05T15:45:06.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.458+0000 7f76f77fe700 1 -- 172.21.15.17:0/433386743 learned_addr learned my addr 172.21.15.17:0/433386743 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f7fff700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9b1a0 0x55c640ac7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9a7e0 0x55c640ac6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f77fe700 1 -- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9a7e0 msgr2=0x55c640ac6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f77fe700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9a7e0 0x55c640ac6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f77fe700 1 -- 172.21.15.17:0/433386743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9b1a0 msgr2=0x55c640ac7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f77fe700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9b1a0 0x55c640ac7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f77fe700 1 -- 172.21.15.17:0/433386743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6407f7c00 con 0x55c640a97720 2023-10-05T15:45:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76f77fe700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac6680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76e8022be0 tx=0x7f76e80226a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a869b1fec809f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:06.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.459+0000 7f76d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.460+0000 7f76d6ffd700 1 -- 172.21.15.17:0/433386743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8028070 con 0x55c640a97720 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.460+0000 7f76d6ffd700 1 -- 172.21.15.17:0/433386743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f76e8005520 con 0x55c640a97720 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.460+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76ec004030 con 0x55c640a97720 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.461+0000 7f76d6ffd700 1 -- 172.21.15.17:0/433386743 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e80036f0 con 0x55c640a97720 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.461+0000 7f77118f4b80 10 client.26578 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.461+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55c64080d250 con 0x55c640a97720 2023-10-05T15:45:06.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.461+0000 7f76d6ffd700 1 -- 172.21.15.17:0/433386743 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec004030 con 0x55c640a97720 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f76d6ffd700 1 -- 172.21.15.17:0/433386743 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f76e8034040 con 0x55c640a97720 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f77118f4b80 10 client.26578 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f77118f4b80 10 client.26578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f77118f4b80 20 client.26578 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f77118f4b80 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640b0bcb0 0x55c640b0e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f77118f4b80 4 client.26578 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:45:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.462+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c6409dcad0 con 0x55c640b0bcb0 2023-10-05T15:45:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.463+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640b0bcb0 0x55c640b0e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.464+0000 7f76f6ffd700 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640b0bcb0 0x55c640b0e0a0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0e213b7718c4c8 server_cookie=5514f8a5d34e2fdb in_seq=0 out_seq=0 2023-10-05T15:45:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.464+0000 7f76d6ffd700 10 client.26578 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.480+0000 7f76d6ffd700 1 -- 172.21.15.17:0/433386743 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c6409dcad0 con 0x55c640b0bcb0 2023-10-05T15:45:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.480+0000 7f76d6ffd700 10 client.26578 handle_command_reply: tid=0 2023-10-05T15:45:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.480+0000 7f77118f4b80 1 client.26578 shutdown 2023-10-05T15:45:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.481+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 msgr2=0x55c640ac6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.481+0000 7f77118f4b80 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac6680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f76e8022be0 tx=0x7f76e80226a0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 shutdown_connections 2023-10-05T15:45:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c640b0bcb0 0x55c640b0e0a0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c640a9b1a0 0x55c640ac7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c640a97720 0x55c640ac6680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 --2- 172.21.15.17:0/433386743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c640a9a7e0 0x55c640ac6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 >> 172.21.15.17:0/433386743 conn(0x55c640a05200 msgr2=0x55c640a9e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f76d6ffd700 0 client.26578 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 shutdown_connections 2023-10-05T15:45:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.482+0000 7f77118f4b80 1 -- 172.21.15.17:0/433386743 wait complete. 2023-10-05T15:45:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.484+0000 7f77118f4b80 20 client.26578 trim_cache size 0 max 16384 2023-10-05T15:45:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:45:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:45:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:45:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:45:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e00a1550 msgr2=0x7f76e00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e00a1550 0x7f76e00a3a10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f76e80098c0 tx=0x7f76e8019040 comp rx=0 tx=0).stop 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 msgr2=0x7f76f819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 0x7f76f819a1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76f000ef30 tx=0x7f76f000c450 comp rx=0 tx=0).stop 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 shutdown_connections 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f76e00a1550 0x7f76e00a3a10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f8102a20 0x7f76f819a1c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f8100f10 0x7f76f8198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 --2- 172.21.15.17:0/780783816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76f8102060 0x7f76f8199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.485+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 >> 172.21.15.17:0/780783816 conn(0x7f76f80fc460 msgr2=0x7f76f80fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.486+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 shutdown_connections 2023-10-05T15:45:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:06.486+0000 7f76fdfff700 1 -- 172.21.15.17:0/780783816 wait complete. 2023-10-05T15:45:07.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:45:07.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:07 smithi017 ceph-mon[129107]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.8 MiB/s wr, 536 op/s 2023-10-05T15:45:07.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 -- 172.21.15.17:0/3868592648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8103110 msgr2=0x7f66a8103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/3868592648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8103110 0x7f66a8103530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f66a00099c0 tx=0x7f66a0009cd0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 -- 172.21.15.17:0/3868592648 shutdown_connections 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/3868592648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66a8104ca0 0x7f66a810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/3868592648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8103110 0x7f66a8103530 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/3868592648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66a8104300 0x7f66a8104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 -- 172.21.15.17:0/3868592648 >> 172.21.15.17:0/3868592648 conn(0x7f66a80fe6a0 msgr2=0x7f66a8100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 -- 172.21.15.17:0/3868592648 shutdown_connections 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.891+0000 7f66ad9ff700 1 -- 172.21.15.17:0/3868592648 wait complete. 2023-10-05T15:45:07.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.892+0000 7f66ad9ff700 1 Processor -- start 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 -- start start 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66a8103110 0x7f66a8078c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66a8104300 0x7f66a80791a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 0x7f66a80757f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8075f90 con 0x7f66a8103110 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8076100 con 0x7f66a8104ca0 2023-10-05T15:45:07.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.893+0000 7f66ad9ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80762c0 con 0x7f66a8104300 2023-10-05T15:45:07.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.894+0000 7f66a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66a8103110 0x7f66a8078c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.894+0000 7f66a77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 0x7f66a80757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.894+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66a8104300 0x7f66a80791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.894+0000 7f66a77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 0x7f66a80757f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54852/0 (socket says 172.21.15.17:54852) 2023-10-05T15:45:07.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.894+0000 7f66a77fe700 1 -- 172.21.15.17:0/356724735 learned_addr learned my addr 172.21.15.17:0/356724735 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:07.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.895+0000 7f66a77fe700 1 -- 172.21.15.17:0/356724735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66a8104300 msgr2=0x7f66a80791a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.895+0000 7f66a77fe700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66a8104300 0x7f66a80791a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.895+0000 7f66a77fe700 1 -- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66a8103110 msgr2=0x7f66a8078c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.895+0000 7f66a77fe700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66a8103110 0x7f66a8078c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.895+0000 7f66a77fe700 1 -- 172.21.15.17:0/356724735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00095f0 con 0x7f66a8104ca0 2023-10-05T15:45:07.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.895+0000 7f66a77fe700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 0x7f66a80757f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f669800ef30 tx=0x7f669800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:07.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.897+0000 7f66ac9fd700 1 -- 172.21.15.17:0/356724735 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698018070 con 0x7f66a8104ca0 2023-10-05T15:45:07.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.897+0000 7f66ac9fd700 1 -- 172.21.15.17:0/356724735 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669800f040 con 0x7f66a8104ca0 2023-10-05T15:45:07.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.897+0000 7f66ac9fd700 1 -- 172.21.15.17:0/356724735 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800cc70 con 0x7f66a8104ca0 2023-10-05T15:45:07.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.897+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a8198a10 con 0x7f66a8104ca0 2023-10-05T15:45:07.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.897+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a8198ed0 con 0x7f66a8104ca0 2023-10-05T15:45:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.904+0000 7f66c127cb80 1 Processor -- start 2023-10-05T15:45:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66ac9fd700 1 -- 172.21.15.17:0/356724735 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f6698007500 con 0x7f66a8104ca0 2023-10-05T15:45:07.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 -- start start 2023-10-05T15:45:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 0x555f192c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192c0a60 0x555f192c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f19227460 con 0x555f192bfbc0 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f19218c20 con 0x555f192c0a60 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66c127cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f19216540 con 0x555f192bf260 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.905+0000 7f66a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 0x555f192c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 0x555f192c0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60550/0 (socket says 172.21.15.17:60550) 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 -- 172.21.15.17:0/3117472657 learned_addr learned my addr 172.21.15.17:0/3117472657 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a67fc700 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192c0a60 0x555f192c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a67fc700 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 -- 172.21.15.17:0/3117472657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 msgr2=0x555f192bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192bf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 -- 172.21.15.17:0/3117472657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192c0a60 msgr2=0x555f192c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192c0a60 0x555f192c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.906+0000 7f66a6ffd700 1 -- 172.21.15.17:0/3117472657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f1903cde0 con 0x555f192bfbc0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.907+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 0x555f192c0480 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f66a0000c00 tx=0x7f66a0005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc897630f73a9f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.907+0000 7f66ac9fd700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f66940a1600 0x7f66940a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.907+0000 7f66ac9fd700 1 -- 172.21.15.17:0/356724735 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f66980ccb40 con 0x7f66a8104ca0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.907+0000 7f669dffb700 1 -- 172.21.15.17:0/3117472657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a001d040 con 0x555f192bfbc0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.908+0000 7f669dffb700 1 -- 172.21.15.17:0/3117472657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66a000b790 con 0x555f192bfbc0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.908+0000 7f669dffb700 1 -- 172.21.15.17:0/3117472657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0003a50 con 0x555f192bfbc0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.908+0000 7f66a67fc700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f66940a1600 0x7f66940a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.909+0000 7f66a67fc700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f66940a1600 0x7f66940a3ac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x555f192c0240 tx=0x7f6690005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:07.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 -- 172.21.15.17:0/3117472657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 msgr2=0x555f192c0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 0x555f192c0480 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f66a0000c00 tx=0x7f66a0005a90 comp rx=0 tx=0).stop 2023-10-05T15:45:07.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 -- 172.21.15.17:0/3117472657 shutdown_connections 2023-10-05T15:45:07.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192c0a60 0x555f192c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3117472657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bfbc0 0x555f192c0480 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.910+0000 7f66c127cb80 1 -- 172.21.15.17:0/3117472657 >> 172.21.15.17:0/3117472657 conn(0x555f19233260 msgr2=0x555f192ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:07.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.911+0000 7f66c127cb80 1 -- 172.21.15.17:0/3117472657 shutdown_connections 2023-10-05T15:45:07.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.911+0000 7f66c127cb80 1 -- 172.21.15.17:0/3117472657 wait complete. 2023-10-05T15:45:07.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.912+0000 7f66c127cb80 1 -- start start 2023-10-05T15:45:07.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.912+0000 7f66c127cb80 1 Processor -- start 2023-10-05T15:45:07.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f19211e30 con 0x555f192c0a60 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f191ae710 con 0x555f192bfbc0 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f191ae3b0 con 0x555f192bf260 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.913+0000 7f66c127cb80 10 client.0 _ll_register_callbacks cb 0x555f1900b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54866/0 (socket says 172.21.15.17:54866) 2023-10-05T15:45:07.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 -- 172.21.15.17:0/247030979 learned_addr learned my addr 172.21.15.17:0/247030979 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 -- 172.21.15.17:0/247030979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 msgr2=0x555f192c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 -- 172.21.15.17:0/247030979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 msgr2=0x555f192d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.914+0000 7f66a67fc700 1 -- 172.21.15.17:0/247030979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a810bea0 con 0x555f192bfbc0 2023-10-05T15:45:07.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.915+0000 7f66a67fc700 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192c9530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6690003de0 tx=0x7f6690004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0fdde60728852 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:07.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.915+0000 7f6686ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:45:07.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f6686ffd700 1 -- 172.21.15.17:0/247030979 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690025070 con 0x555f192bfbc0 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f6686ffd700 1 -- 172.21.15.17:0/247030979 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6690012050 con 0x555f192bfbc0 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f192b1f10 con 0x555f192bfbc0 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f6686ffd700 1 -- 172.21.15.17:0/247030979 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6690003ec0 con 0x555f192bfbc0 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f66c127cb80 10 client.26600 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555f19025c60 con 0x555f192bfbc0 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.916+0000 7f6686ffd700 1 -- 172.21.15.17:0/247030979 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f192b1f10 con 0x555f192bfbc0 2023-10-05T15:45:07.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f6686ffd700 1 -- 172.21.15.17:0/247030979 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f669001f440 con 0x555f192bfbc0 2023-10-05T15:45:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66c127cb80 10 client.26600 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66c127cb80 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66c127cb80 20 client.26600 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66c127cb80 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f192f6e30 0x555f192f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66c127cb80 4 client.26600 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:45:07.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f1920ae10 con 0x555f192f6e30 2023-10-05T15:45:07.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.917+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f192f6e30 0x555f192f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.919+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f192f6e30 0x555f192f9270 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69d1a0ecdc24fe8 server_cookie=363977c514e728dd in_seq=0 out_seq=0 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.919+0000 7f6686ffd700 10 client.26600 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.920+0000 7f6686ffd700 1 -- 172.21.15.17:0/247030979 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f1920ae10 con 0x555f192f6e30 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.920+0000 7f6686ffd700 10 client.26600 handle_command_reply: tid=0 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.920+0000 7f66c127cb80 1 client.26600 shutdown 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 msgr2=0x555f192c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192c9530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6690003de0 tx=0x7f6690004750 comp rx=0 tx=0).stop 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 shutdown_connections 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f192f6e30 0x555f192f9270 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 --2- 172.21.15.17:0/247030979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192c9530 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 >> 172.21.15.17:0/247030979 conn(0x555f19233260 msgr2=0x555f192b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f6686ffd700 0 client.26600 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 shutdown_connections 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.921+0000 7f66c127cb80 1 -- 172.21.15.17:0/247030979 wait complete. 2023-10-05T15:45:07.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.922+0000 7f66c127cb80 20 client.26600 trim_cache size 0 max 16384 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 Processor -- start 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 -- start start 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f19092920 con 0x555f192c0a60 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f192bb8a0 con 0x555f192bfbc0 2023-10-05T15:45:07.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.953+0000 7f66c127cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f192b4570 con 0x555f192bf260 2023-10-05T15:45:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.954+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.954+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54882/0 (socket says 172.21.15.17:54882) 2023-10-05T15:45:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.954+0000 7f66a67fc700 1 -- 172.21.15.17:0/2079277088 learned_addr learned my addr 172.21.15.17:0/2079277088 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.954+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.954+0000 7f66a77fe700 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a67fc700 1 -- 172.21.15.17:0/2079277088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 msgr2=0x555f192d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a67fc700 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a67fc700 1 -- 172.21.15.17:0/2079277088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 msgr2=0x555f192c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a67fc700 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a67fc700 1 -- 172.21.15.17:0/2079277088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f192b6140 con 0x555f192bfbc0 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a77fe700 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f66a67fc700 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192d0490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6690004290 tx=0x7f6690012d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f13ea08cc85fbc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f669e7fc700 1 -- 172.21.15.17:0/2079277088 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690025040 con 0x555f192bfbc0 2023-10-05T15:45:07.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f669e7fc700 1 -- 172.21.15.17:0/2079277088 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669001f440 con 0x555f192bfbc0 2023-10-05T15:45:07.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.955+0000 7f669e7fc700 1 -- 172.21.15.17:0/2079277088 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690034c60 con 0x555f192bfbc0 2023-10-05T15:45:07.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.956+0000 7f66c127cb80 1 -- 172.21.15.17:0/2079277088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 msgr2=0x555f192d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.956+0000 7f66c127cb80 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192d0490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6690004290 tx=0x7f6690012d00 comp rx=0 tx=0).stop 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 -- 172.21.15.17:0/2079277088 shutdown_connections 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192c0a60 0x555f192c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192bf260 0x555f192d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 --2- 172.21.15.17:0/2079277088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192d0490 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 -- 172.21.15.17:0/2079277088 >> 172.21.15.17:0/2079277088 conn(0x555f19233260 msgr2=0x555f192c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 -- 172.21.15.17:0/2079277088 shutdown_connections 2023-10-05T15:45:07.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.957+0000 7f66c127cb80 1 -- 172.21.15.17:0/2079277088 wait complete. 2023-10-05T15:45:07.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.958+0000 7f66c127cb80 1 -- start start 2023-10-05T15:45:07.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.958+0000 7f66c127cb80 1 Processor -- start 2023-10-05T15:45:07.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bf260 0x555f192ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192c0a60 0x555f192cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f192cfb00 con 0x555f192bf260 2023-10-05T15:45:07.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f192cfc70 con 0x555f192bfbc0 2023-10-05T15:45:07.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f192cfe30 con 0x555f192c0a60 2023-10-05T15:45:07.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.959+0000 7f66c127cb80 10 client.0 _ll_register_callbacks cb 0x7f669000bde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:07.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54898/0 (socket says 172.21.15.17:54898) 2023-10-05T15:45:07.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a67fc700 1 -- 172.21.15.17:0/3697436847 learned_addr learned my addr 172.21.15.17:0/3697436847 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:07.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a77fe700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192c0a60 0x555f192cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bf260 0x555f192ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a77fe700 1 -- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 msgr2=0x555f192ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a77fe700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a77fe700 1 -- 172.21.15.17:0/3697436847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bf260 msgr2=0x555f192ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a77fe700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bf260 0x555f192ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.960+0000 7f66a77fe700 1 -- 172.21.15.17:0/3697436847 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f19025c60 con 0x555f192c0a60 2023-10-05T15:45:07.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.961+0000 7f66a67fc700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.961+0000 7f66a77fe700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192c0a60 0x555f192cf5c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66980ca610 tx=0x7f669809a090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5f665808f2cd012 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.961+0000 7f6686ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.961+0000 7f6686ffd700 1 -- 172.21.15.17:0/3697436847 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669809a250 con 0x555f192c0a60 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.961+0000 7f6686ffd700 1 -- 172.21.15.17:0/3697436847 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f6698099b50 con 0x555f192c0a60 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.962+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66a000b790 con 0x555f192c0a60 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.962+0000 7f6686ffd700 1 -- 172.21.15.17:0/3697436847 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669809dca0 con 0x555f192c0a60 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.962+0000 7f66c127cb80 10 client.26593 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:07.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.962+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x555f19063250 con 0x555f192c0a60 2023-10-05T15:45:07.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.963+0000 7f6686ffd700 1 -- 172.21.15.17:0/3697436847 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66a000b790 con 0x555f192c0a60 2023-10-05T15:45:07.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.963+0000 7f6686ffd700 1 -- 172.21.15.17:0/3697436847 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66980a19c0 con 0x555f192c0a60 2023-10-05T15:45:07.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.964+0000 7f66c127cb80 10 client.26593 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:07.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.964+0000 7f66c127cb80 10 client.26593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:07.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.964+0000 7f66c127cb80 20 client.26593 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:07.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.964+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f1934ba00 0x555f1934de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:07.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.964+0000 7f66c127cb80 4 client.26593 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:45:07.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.964+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555f1920ab30 con 0x555f1934ba00 2023-10-05T15:45:07.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.965+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f1934ba00 0x555f1934de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:07.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.966+0000 7f66a6ffd700 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f1934ba00 0x555f1934de20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adfa62cb6b073d2 server_cookie=5ab2780a8b05762a in_seq=0 out_seq=0 2023-10-05T15:45:07.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.966+0000 7f6686ffd700 10 client.26593 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:07.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f6686ffd700 1 -- 172.21.15.17:0/3697436847 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555f1920ab30 con 0x555f1934ba00 2023-10-05T15:45:07.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f6686ffd700 10 client.26593 handle_command_reply: tid=0 2023-10-05T15:45:07.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 client.26593 shutdown 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192c0a60 msgr2=0x555f192cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192c0a60 0x555f192cf5c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66980ca610 tx=0x7f669809a090 comp rx=0 tx=0).stop 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 shutdown_connections 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555f1934ba00 0x555f1934de20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f192c0a60 0x555f192cf5c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555f192bf260 0x555f192ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 --2- 172.21.15.17:0/3697436847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f192bfbc0 0x555f192ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f6686ffd700 0 client.26593 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:07.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.967+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 >> 172.21.15.17:0/3697436847 conn(0x555f19233260 msgr2=0x555f192c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:07.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.968+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 shutdown_connections 2023-10-05T15:45:07.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.968+0000 7f66c127cb80 1 -- 172.21.15.17:0/3697436847 wait complete. 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.969+0000 7f66c127cb80 20 client.26593 trim_cache size 0 max 16384 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:45:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:45:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:45:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:45:07.972 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:45:07.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f66940a1600 msgr2=0x7f66940a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f66940a1600 0x7f66940a3ac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x555f192c0240 tx=0x7f6690005d20 comp rx=0 tx=0).stop 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 msgr2=0x7f66a80757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 0x7f66a80757f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f669800ef30 tx=0x7f669800c3a0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 shutdown_connections 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f66940a1600 0x7f66940a3ac0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a8104ca0 0x7f66a80757f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66a8103110 0x7f66a8078c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 --2- 172.21.15.17:0/356724735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66a8104300 0x7f66a80791a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 >> 172.21.15.17:0/356724735 conn(0x7f66a80fe6a0 msgr2=0x7f66a8100950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.970+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 shutdown_connections 2023-10-05T15:45:07.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:07.971+0000 7f66ad9ff700 1 -- 172.21.15.17:0/356724735 wait complete. 2023-10-05T15:45:08.002 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:45:08.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:07 smithi167 ceph-mon[133366]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.8 MiB/s wr, 536 op/s 2023-10-05T15:45:08.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:07 smithi079 ceph-mon[132936]: pgmap v625: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.8 MiB/s wr, 536 op/s 2023-10-05T15:45:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 390.0 s, 659.2 tps, lat 151.179 ms stddev 71.061 2023-10-05T15:45:09.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:08 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:45:09.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:08 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:45:09.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:08 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:45:10.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:09 smithi079 ceph-mon[132936]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 611 op/s 2023-10-05T15:45:10.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:09 smithi017 ceph-mon[129107]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 611 op/s 2023-10-05T15:45:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:09 smithi167 ceph-mon[133366]: pgmap v626: 129 pgs: 129 active+clean; 1.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 611 op/s 2023-10-05T15:45:11.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:45:11.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:45:11.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:45:11.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:45:11.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:45:11.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:45:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:45:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:45:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:45:12.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:11 smithi079 ceph-mon[132936]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 645 op/s 2023-10-05T15:45:12.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:11 smithi017 ceph-mon[129107]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 645 op/s 2023-10-05T15:45:12.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:11 smithi167 ceph-mon[133366]: pgmap v627: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 645 op/s 2023-10-05T15:45:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 395.0 s, 501.6 tps, lat 197.330 ms stddev 68.153 2023-10-05T15:45:14.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:13 smithi079 ceph-mon[132936]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 560 op/s 2023-10-05T15:45:14.203 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:13 smithi017 ceph-mon[129107]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 560 op/s 2023-10-05T15:45:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:13 smithi167 ceph-mon[133366]: pgmap v628: 129 pgs: 129 active+clean; 1.5 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 560 op/s 2023-10-05T15:45:16.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:15 smithi017 ceph-mon[129107]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.3 MiB/s wr, 713 op/s 2023-10-05T15:45:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:15 smithi167 ceph-mon[133366]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.3 MiB/s wr, 713 op/s 2023-10-05T15:45:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:15 smithi079 ceph-mon[132936]: pgmap v629: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.3 MiB/s wr, 713 op/s 2023-10-05T15:45:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 400.0 s, 528.3 tps, lat 186.686 ms stddev 64.769 2023-10-05T15:45:18.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:17 smithi017 ceph-mon[129107]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2023-10-05T15:45:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:17 smithi167 ceph-mon[133366]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2023-10-05T15:45:18.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:17 smithi079 ceph-mon[132936]: pgmap v630: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2023-10-05T15:45:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.957+0000 7ff5c43ff700 1 -- 172.21.15.17:0/1549732670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 msgr2=0x7ff5bc1082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.957+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/1549732670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 0x7ff5bc1082d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009f90 tx=0x7ff5b400b330 comp rx=0 tx=0).stop 2023-10-05T15:45:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.958+0000 7ff5c43ff700 1 -- 172.21.15.17:0/1549732670 shutdown_connections 2023-10-05T15:45:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.958+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/1549732670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc111a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.958+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/1549732670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 0x7ff5bc1082d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.958+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/1549732670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc108810 0x7ff5bc108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.958+0000 7ff5c43ff700 1 -- 172.21.15.17:0/1549732670 >> 172.21.15.17:0/1549732670 conn(0x7ff5bc06e0b0 msgr2=0x7ff5bc070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.958+0000 7ff5c43ff700 1 -- 172.21.15.17:0/1549732670 shutdown_connections 2023-10-05T15:45:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.959+0000 7ff5c43ff700 1 -- 172.21.15.17:0/1549732670 wait complete. 2023-10-05T15:45:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.960+0000 7ff5c43ff700 1 Processor -- start 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.960+0000 7ff5c43ff700 1 -- start start 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c43ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 0x7ff5bc10e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c43ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5bc108810 0x7ff5bc10ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c43ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c43ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1102a0 con 0x7ff5bc108810 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c43ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc110410 con 0x7ff5bc1091d0 2023-10-05T15:45:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c43ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1105d0 con 0x7ff5bc107eb0 2023-10-05T15:45:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c299c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c299c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44680/0 (socket says 172.21.15.17:44680) 2023-10-05T15:45:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.961+0000 7ff5c299c700 1 -- 172.21.15.17:0/4123831020 learned_addr learned my addr 172.21.15.17:0/4123831020 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.962+0000 7ff5c199a700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5bc108810 0x7ff5bc10ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.962+0000 7ff5c299c700 1 -- 172.21.15.17:0/4123831020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 msgr2=0x7ff5bc10e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.962+0000 7ff5c299c700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 0x7ff5bc10e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.962+0000 7ff5c299c700 1 -- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5bc108810 msgr2=0x7ff5bc10ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.962+0000 7ff5c299c700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5bc108810 0x7ff5bc10ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.962+0000 7ff5c299c700 1 -- 172.21.15.17:0/4123831020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009c40 con 0x7ff5bc1091d0 2023-10-05T15:45:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.963+0000 7ff5c299c700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc10fc40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e970 tx=0x7ff5b800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.963+0000 7ff5b37fe700 1 -- 172.21.15.17:0/4123831020 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800cbd0 con 0x7ff5bc1091d0 2023-10-05T15:45:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.964+0000 7ff5b37fe700 1 -- 172.21.15.17:0/4123831020 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b800ee50 con 0x7ff5bc1091d0 2023-10-05T15:45:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.964+0000 7ff5b37fe700 1 -- 172.21.15.17:0/4123831020 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80054e0 con 0x7ff5bc1091d0 2023-10-05T15:45:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.964+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc1108b0 con 0x7ff5bc1091d0 2023-10-05T15:45:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.964+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc115080 con 0x7ff5bc1091d0 2023-10-05T15:45:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.972+0000 7ff5d7cd1b80 1 Processor -- start 2023-10-05T15:45:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.974+0000 7ff5b37fe700 1 -- 172.21.15.17:0/4123831020 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff5b8004750 con 0x7ff5bc1091d0 2023-10-05T15:45:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.976+0000 7ff5d7cd1b80 1 -- start start 2023-10-05T15:45:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef5082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef509450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef510220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef470400 con 0x5600ef507ec0 2023-10-05T15:45:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef461bc0 con 0x5600ef509990 2023-10-05T15:45:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef45f4e0 con 0x5600ef508fd0 2023-10-05T15:45:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.977+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef510220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef510220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44694/0 (socket says 172.21.15.17:44694) 2023-10-05T15:45:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 -- 172.21.15.17:0/1001573450 learned_addr learned my addr 172.21.15.17:0/1001573450 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5b37fe700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5a80a1680 0x7ff5a80a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5b37fe700 1 -- 172.21.15.17:0/4123831020 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff5b8014070 con 0x7ff5bc1091d0 2023-10-05T15:45:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 -- 172.21.15.17:0/1001573450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 msgr2=0x5600ef509450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef509450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 -- 172.21.15.17:0/1001573450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 msgr2=0x5600ef5082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef5082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.978+0000 7ff5c199a700 1 -- 172.21.15.17:0/1001573450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600ef285d80 con 0x5600ef509990 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.979+0000 7ff5c199a700 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef510220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009d00 tx=0x7ff5ac012730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94d3c433629ff8f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.979+0000 7ff5b0bfe700 1 -- 172.21.15.17:0/1001573450 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac012e60 con 0x5600ef509990 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.980+0000 7ff5b0bfe700 1 -- 172.21.15.17:0/1001573450 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5ac00f8c0 con 0x5600ef509990 2023-10-05T15:45:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.980+0000 7ff5b0bfe700 1 -- 172.21.15.17:0/1001573450 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac01a7d0 con 0x5600ef509990 2023-10-05T15:45:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.980+0000 7ff5c299c700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5a80a1680 0x7ff5a80a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.980+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/1001573450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 msgr2=0x5600ef510220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.980+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef510220 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009d00 tx=0x7ff5ac012730 comp rx=0 tx=0).stop 2023-10-05T15:45:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.981+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/1001573450 shutdown_connections 2023-10-05T15:45:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.981+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef510220 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.981+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef5082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.982+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/1001573450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef509450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.982+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/1001573450 >> 172.21.15.17:0/1001573450 conn(0x5600ef47c200 msgr2=0x5600ef502bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.982+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/1001573450 shutdown_connections 2023-10-05T15:45:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.982+0000 7ff5c299c700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5a80a1680 0x7ff5a80a3b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80ca980 tx=0x7ff5b800cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.982+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/1001573450 wait complete. 2023-10-05T15:45:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.983+0000 7ff5d7cd1b80 1 -- start start 2023-10-05T15:45:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.983+0000 7ff5d7cd1b80 1 Processor -- start 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef511b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef5120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef5190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef45add0 con 0x5600ef507ec0 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef3f76b0 con 0x5600ef509990 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef3f7350 con 0x5600ef508fd0 2023-10-05T15:45:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.984+0000 7ff5d7cd1b80 10 client.0 _ll_register_callbacks cb 0x5600ef2547a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.985+0000 7ff5c219b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef5120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.985+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef5190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.985+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef511b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.985+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef511b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42874/0 (socket says 172.21.15.17:42874) 2023-10-05T15:45:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.985+0000 7ff5c199a700 1 -- 172.21.15.17:0/2410389416 learned_addr learned my addr 172.21.15.17:0/2410389416 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.986+0000 7ff5c199a700 1 -- 172.21.15.17:0/2410389416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 msgr2=0x5600ef5120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.986+0000 7ff5c199a700 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef5120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.986+0000 7ff5c199a700 1 -- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 msgr2=0x5600ef5190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.986+0000 7ff5c199a700 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef5190f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.986+0000 7ff5c199a700 1 -- 172.21.15.17:0/2410389416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac0099e0 con 0x5600ef507ec0 2023-10-05T15:45:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.987+0000 7ff5c199a700 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef511b70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00fe80 tx=0x7ff5ac0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ab3ab4f88ae45b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.987+0000 7ff5a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:45:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.990+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/2410389416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac005680 con 0x5600ef507ec0 2023-10-05T15:45:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.990+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/2410389416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff5ac003680 con 0x5600ef507ec0 2023-10-05T15:45:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.990+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600ef4fad50 con 0x5600ef507ec0 2023-10-05T15:45:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.991+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/2410389416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5ac003840 con 0x5600ef507ec0 2023-10-05T15:45:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.991+0000 7ff5d7cd1b80 10 client.16710 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.991+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5600ef26ec00 con 0x5600ef507ec0 2023-10-05T15:45:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/2410389416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5600ef4fad50 con 0x5600ef507ec0 2023-10-05T15:45:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/2410389416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff5ac01aa60 con 0x5600ef507ec0 2023-10-05T15:45:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5d7cd1b80 10 client.16710 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5d7cd1b80 10 client.16710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5d7cd1b80 20 client.16710 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef51d840 0x5600ef51fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5d7cd1b80 4 client.16710 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:45:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.993+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600ef453db0 con 0x5600ef51d840 2023-10-05T15:45:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.996+0000 7ff5c219b700 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef51d840 0x5600ef51fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.997+0000 7ff5c219b700 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef51d840 0x5600ef51fc60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa6a1d12af9bfa6 server_cookie=9f286ff432fce8fa in_seq=0 out_seq=0 2023-10-05T15:45:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.997+0000 7ff5a5ffb700 10 client.16710 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.997+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/2410389416 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5600ef453db0 con 0x5600ef51d840 2023-10-05T15:45:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.997+0000 7ff5a5ffb700 10 client.16710 handle_command_reply: tid=0 2023-10-05T15:45:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 client.16710 shutdown 2023-10-05T15:45:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 msgr2=0x5600ef511b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef511b70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00fe80 tx=0x7ff5ac0096c0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 shutdown_connections 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef51d840 0x5600ef51fc60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef5190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef511b70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.998+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/2410389416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef508fd0 0x5600ef5120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.999+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 >> 172.21.15.17:0/2410389416 conn(0x5600ef47c200 msgr2=0x5600ef502250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.999+0000 7ff5a5ffb700 0 client.16710 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.999+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 shutdown_connections 2023-10-05T15:45:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:19.999+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/2410389416 wait complete. 2023-10-05T15:45:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.000+0000 7ff5d7cd1b80 20 client.16710 trim_cache size 0 max 16384 2023-10-05T15:45:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.027+0000 7ff5d7cd1b80 1 Processor -- start 2023-10-05T15:45:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.027+0000 7ff5d7cd1b80 1 -- start start 2023-10-05T15:45:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.028+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef51f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.028+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef508fd0 0x5600ef5190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.028+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef509990 0x5600ef50fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.028+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef511740 con 0x5600ef507ec0 2023-10-05T15:45:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.028+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef2db8c0 con 0x5600ef508fd0 2023-10-05T15:45:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.028+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef512cf0 con 0x5600ef509990 2023-10-05T15:45:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.029+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef509990 0x5600ef50fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.029+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef51f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.029+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef51f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42882/0 (socket says 172.21.15.17:42882) 2023-10-05T15:45:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.029+0000 7ff5c199a700 1 -- 172.21.15.17:0/6315157 learned_addr learned my addr 172.21.15.17:0/6315157 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.029+0000 7ff5c219b700 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef508fd0 0x5600ef5190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.030+0000 7ff5c219b700 1 -- 172.21.15.17:0/6315157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef509990 msgr2=0x5600ef50fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.030+0000 7ff5c219b700 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef509990 0x5600ef50fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.030+0000 7ff5c219b700 1 -- 172.21.15.17:0/6315157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 msgr2=0x5600ef51f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.030+0000 7ff5c219b700 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef51f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.031+0000 7ff5c219b700 1 -- 172.21.15.17:0/6315157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600ef2ac1f0 con 0x5600ef508fd0 2023-10-05T15:45:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.031+0000 7ff5c199a700 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef51f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:45:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.031+0000 7ff5c219b700 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef508fd0 0x5600ef5190b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5600ef520520 tx=0x7ff5b40094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3846c3c0faa115d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.032+0000 7ff5b13ff700 1 -- 172.21.15.17:0/6315157 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400e040 con 0x5600ef508fd0 2023-10-05T15:45:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.032+0000 7ff5b13ff700 1 -- 172.21.15.17:0/6315157 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b40073e0 con 0x5600ef508fd0 2023-10-05T15:45:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.032+0000 7ff5b13ff700 1 -- 172.21.15.17:0/6315157 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400bc50 con 0x5600ef508fd0 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/6315157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef508fd0 msgr2=0x5600ef5190b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef508fd0 0x5600ef5190b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5600ef520520 tx=0x7ff5b40094c0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/6315157 shutdown_connections 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef509990 0x5600ef50fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef507ec0 0x5600ef51f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/6315157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef508fd0 0x5600ef5190b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.033+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/6315157 >> 172.21.15.17:0/6315157 conn(0x5600ef47c200 msgr2=0x5600ef510860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.034+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/6315157 shutdown_connections 2023-10-05T15:45:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.034+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/6315157 wait complete. 2023-10-05T15:45:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.034+0000 7ff5d7cd1b80 1 -- start start 2023-10-05T15:45:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.034+0000 7ff5d7cd1b80 1 Processor -- start 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 0x5600ef516750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef508fd0 0x5600ef516c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef517ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef5181e0 con 0x5600ef508fd0 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef518350 con 0x5600ef509990 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ef518510 con 0x5600ef507ec0 2023-10-05T15:45:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.035+0000 7ff5d7cd1b80 10 client.0 _ll_register_callbacks cb 0x7ff5ac00fd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.038+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 0x5600ef516750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.038+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef517ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.038+0000 7ff5c199a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 0x5600ef516750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:40504/0 (socket says 172.21.15.17:40504) 2023-10-05T15:45:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.038+0000 7ff5c199a700 1 -- 172.21.15.17:0/3614600772 learned_addr learned my addr 172.21.15.17:0/3614600772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c199a700 1 -- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 msgr2=0x5600ef517ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c219b700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef508fd0 0x5600ef516c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c199a700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef517ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c199a700 1 -- 172.21.15.17:0/3614600772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef508fd0 msgr2=0x5600ef516c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c199a700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef508fd0 0x5600ef516c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c199a700 1 -- 172.21.15.17:0/3614600772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600ef26ec00 con 0x5600ef507ec0 2023-10-05T15:45:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c219b700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef508fd0 0x5600ef516c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:45:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5c199a700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 0x5600ef516750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac01ae10 tx=0x7ff5ac009db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2634f64625824b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.039+0000 7ff5a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.040+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/3614600772 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac01a5f0 con 0x5600ef507ec0 2023-10-05T15:45:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.040+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/3614600772 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff5ac000e40 con 0x5600ef507ec0 2023-10-05T15:45:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.040+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600ef453ad0 con 0x5600ef507ec0 2023-10-05T15:45:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.041+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/3614600772 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5ac01a750 con 0x5600ef507ec0 2023-10-05T15:45:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.041+0000 7ff5d7cd1b80 10 client.26605 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.041+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7ff5bc109cf0 con 0x5600ef507ec0 2023-10-05T15:45:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/3614600772 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5600ef453ad0 con 0x5600ef507ec0 2023-10-05T15:45:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/3614600772 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff5ac045020 con 0x5600ef507ec0 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5d7cd1b80 10 client.26605 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5d7cd1b80 10 client.26605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5d7cd1b80 20 client.26605 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef571ba0 0x5600ef573fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5d7cd1b80 4 client.26605 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5600ef2a6f10 con 0x5600ef571ba0 2023-10-05T15:45:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.042+0000 7ff5c219b700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef571ba0 0x5600ef573fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.043+0000 7ff5c219b700 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef571ba0 0x5600ef573fc0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b61b6b1ead5232 server_cookie=d70c3fe86e41dfc8 in_seq=0 out_seq=0 2023-10-05T15:45:20.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.043+0000 7ff5a5ffb700 10 client.26605 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.061+0000 7ff5a5ffb700 1 -- 172.21.15.17:0/3614600772 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5600ef2a6f10 con 0x5600ef571ba0 2023-10-05T15:45:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.061+0000 7ff5a5ffb700 10 client.26605 handle_command_reply: tid=0 2023-10-05T15:45:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.061+0000 7ff5d7cd1b80 1 client.26605 shutdown 2023-10-05T15:45:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 msgr2=0x5600ef516750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 0x5600ef516750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac01ae10 tx=0x7ff5ac009db0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 shutdown_connections 2023-10-05T15:45:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5600ef571ba0 0x5600ef573fc0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5600ef509990 0x5600ef517ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600ef507ec0 0x5600ef516750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 --2- 172.21.15.17:0/3614600772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ef508fd0 0x5600ef516c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 >> 172.21.15.17:0/3614600772 conn(0x5600ef47c200 msgr2=0x5600ef51f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.064+0000 7ff5a5ffb700 0 client.26605 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.066+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 shutdown_connections 2023-10-05T15:45:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.067+0000 7ff5d7cd1b80 1 -- 172.21.15.17:0/3614600772 wait complete. 2023-10-05T15:45:20.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.067+0000 7ff5d7cd1b80 20 client.26605 trim_cache size 0 max 16384 2023-10-05T15:45:20.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.069+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5a80a1680 msgr2=0x7ff5a80a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.069+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5a80a1680 0x7ff5a80a3b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80ca980 tx=0x7ff5b800cf50 comp rx=0 tx=0).stop 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.069+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 msgr2=0x7ff5bc10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:20.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.069+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc10fc40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e970 tx=0x7ff5b800ed30 comp rx=0 tx=0).stop 2023-10-05T15:45:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.070+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 shutdown_connections 2023-10-05T15:45:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.070+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff5a80a1680 0x7ff5a80a3b40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.070+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5bc1091d0 0x7ff5bc10fc40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.070+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5bc107eb0 0x7ff5bc10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.070+0000 7ff5c43ff700 1 --2- 172.21.15.17:0/4123831020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5bc108810 0x7ff5bc10ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.070+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 >> 172.21.15.17:0/4123831020 conn(0x7ff5bc06e0b0 msgr2=0x7ff5bc070320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.071+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 shutdown_connections 2023-10-05T15:45:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:20.071+0000 7ff5c43ff700 1 -- 172.21.15.17:0/4123831020 wait complete. 2023-10-05T15:45:20.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:19 smithi017 ceph-mon[129107]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 592 op/s 2023-10-05T15:45:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:19 smithi167 ceph-mon[133366]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 592 op/s 2023-10-05T15:45:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:19 smithi079 ceph-mon[132936]: pgmap v631: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 592 op/s 2023-10-05T15:45:22.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:21 smithi017 ceph-mon[129107]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 634 op/s 2023-10-05T15:45:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:21 smithi167 ceph-mon[133366]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 634 op/s 2023-10-05T15:45:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:21 smithi079 ceph-mon[132936]: pgmap v632: 129 pgs: 129 active+clean; 1.5 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.8 MiB/s wr, 634 op/s 2023-10-05T15:45:23.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 405.0 s, 573.6 tps, lat 177.656 ms stddev 70.822 2023-10-05T15:45:23.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:22 smithi017 ceph-mon[129107]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 491 op/s 2023-10-05T15:45:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:22 smithi167 ceph-mon[133366]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 491 op/s 2023-10-05T15:45:23.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:22 smithi079 ceph-mon[132936]: pgmap v633: 129 pgs: 129 active+clean; 1.5 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 491 op/s 2023-10-05T15:45:26.201 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:25 smithi017 ceph-mon[129107]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.3 MiB/s wr, 709 op/s 2023-10-05T15:45:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:25 smithi167 ceph-mon[133366]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.3 MiB/s wr, 709 op/s 2023-10-05T15:45:26.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:25 smithi079 ceph-mon[132936]: pgmap v634: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.3 MiB/s wr, 709 op/s 2023-10-05T15:45:28.084 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:27 smithi167 ceph-mon[133366]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 554 op/s 2023-10-05T15:45:28.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:27 smithi079 ceph-mon[132936]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 554 op/s 2023-10-05T15:45:28.491 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 410.0 s, 495.3 tps, lat 202.390 ms stddev 103.718 2023-10-05T15:45:28.491 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:27 smithi017 ceph-mon[129107]: pgmap v635: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.8 MiB/s wr, 554 op/s 2023-10-05T15:45:30.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:29 smithi079 ceph-mon[132936]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2023-10-05T15:45:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:29 smithi017 ceph-mon[129107]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2023-10-05T15:45:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:29 smithi167 ceph-mon[133366]: pgmap v636: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2023-10-05T15:45:32.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:31 smithi079 ceph-mon[132936]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 638 op/s 2023-10-05T15:45:32.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:31 smithi017 ceph-mon[129107]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 638 op/s 2023-10-05T15:45:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:31 smithi167 ceph-mon[133366]: pgmap v637: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.3 MiB/s wr, 638 op/s 2023-10-05T15:45:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 415.0 s, 625.0 tps, lat 158.987 ms stddev 50.683 2023-10-05T15:45:34.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:33 smithi079 ceph-mon[132936]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2023-10-05T15:45:34.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:33 smithi017 ceph-mon[129107]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2023-10-05T15:45:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:33 smithi167 ceph-mon[133366]: pgmap v638: 129 pgs: 129 active+clean; 1.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2023-10-05T15:45:36.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:35 smithi017 ceph-mon[129107]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.0 MiB/s wr, 727 op/s 2023-10-05T15:45:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:35 smithi167 ceph-mon[133366]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.0 MiB/s wr, 727 op/s 2023-10-05T15:45:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:35 smithi079 ceph-mon[132936]: pgmap v639: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.0 MiB/s wr, 727 op/s 2023-10-05T15:45:37.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.700+0000 7f51379ff700 1 -- 172.21.15.17:0/2017085297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130074ef0 msgr2=0x7f5130073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.700+0000 7f51379ff700 1 --2- 172.21.15.17:0/2017085297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130074ef0 0x7f5130073340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f512800b0a0 tx=0x7f512800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.703+0000 7f51379ff700 1 -- 172.21.15.17:0/2017085297 shutdown_connections 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.703+0000 7f51379ff700 1 --2- 172.21.15.17:0/2017085297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f513010d4d0 0x7f513010f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.703+0000 7f51379ff700 1 --2- 172.21.15.17:0/2017085297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130074ef0 0x7f5130073340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.703+0000 7f51379ff700 1 --2- 172.21.15.17:0/2017085297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130073910 0x7f5130073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.703+0000 7f51379ff700 1 -- 172.21.15.17:0/2017085297 >> 172.21.15.17:0/2017085297 conn(0x7f51300fc430 msgr2=0x7f51300fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:37.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.704+0000 7f51379ff700 1 -- 172.21.15.17:0/2017085297 shutdown_connections 2023-10-05T15:45:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.704+0000 7f51379ff700 1 -- 172.21.15.17:0/2017085297 wait complete. 2023-10-05T15:45:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.705+0000 7f51379ff700 1 Processor -- start 2023-10-05T15:45:37.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.705+0000 7f51379ff700 1 -- start start 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f51379ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 0x7f513006f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f51379ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130074ef0 0x7f513006fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f51379ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f513010d4d0 0x7f5130070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f51379ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51300712c0 con 0x7f5130074ef0 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f51379ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5130071430 con 0x7f5130073910 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f51379ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51300715f0 con 0x7f513010d4d0 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f513579b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 0x7f513006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f513579b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 0x7f513006f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45236/0 (socket says 172.21.15.17:45236) 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f513579b700 1 -- 172.21.15.17:0/3055634613 learned_addr learned my addr 172.21.15.17:0/3055634613 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f5134f9a700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130074ef0 0x7f513006fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.706+0000 7f5135f9c700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f513010d4d0 0x7f5130070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f513579b700 1 -- 172.21.15.17:0/3055634613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f513010d4d0 msgr2=0x7f5130070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f513579b700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f513010d4d0 0x7f5130070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f513579b700 1 -- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130074ef0 msgr2=0x7f513006fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f513579b700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130074ef0 0x7f513006fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f513579b700 1 -- 172.21.15.17:0/3055634613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120009520 con 0x7f5130073910 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f513579b700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 0x7f513006f850 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f512800b070 tx=0x7f512800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.707+0000 7f51267fc700 1 -- 172.21.15.17:0/3055634613 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800e040 con 0x7f5130073910 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.708+0000 7f51267fc700 1 -- 172.21.15.17:0/3055634613 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5128004e60 con 0x7f5130073910 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.708+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5128009d00 con 0x7f5130073910 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.708+0000 7f51267fc700 1 -- 172.21.15.17:0/3055634613 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512801b6c0 con 0x7f5130073910 2023-10-05T15:45:37.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.708+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5130071ea0 con 0x7f5130073910 2023-10-05T15:45:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.712+0000 7f51267fc700 1 -- 172.21.15.17:0/3055634613 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f512801b820 con 0x7f5130073910 2023-10-05T15:45:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.714+0000 7f51267fc700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f511c0a15d0 0x7f511c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.714+0000 7f51267fc700 1 -- 172.21.15.17:0/3055634613 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f51280ce4a0 con 0x7f5130073910 2023-10-05T15:45:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.716+0000 7f5134f9a700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f511c0a15d0 0x7f511c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.717+0000 7f5134f9a700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f511c0a15d0 0x7f511c0a3a90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f51300708a0 tx=0x7f512c009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:37.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.744+0000 7f514b3aeb80 1 Processor -- start 2023-10-05T15:45:37.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.744+0000 7f514b3aeb80 1 -- start start 2023-10-05T15:45:37.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 0x5645a26c6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a262d400 con 0x5645a26c6990 2023-10-05T15:45:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a261ebc0 con 0x5645a26c5fd0 2023-10-05T15:45:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a261c4e0 con 0x5645a26c4ec0 2023-10-05T15:45:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.745+0000 7f5134f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 0x5645a26c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 0x5645a26c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45252/0 (socket says 172.21.15.17:45252) 2023-10-05T15:45:37.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 -- 172.21.15.17:0/128801999 learned_addr learned my addr 172.21.15.17:0/128801999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 -- 172.21.15.17:0/128801999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 msgr2=0x5645a26c52e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:45:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26c52e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 -- 172.21.15.17:0/128801999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 msgr2=0x5645a26cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.746+0000 7f5134f9a700 1 -- 172.21.15.17:0/128801999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a2442d80 con 0x5645a26c5fd0 2023-10-05T15:45:37.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.747+0000 7f5134f9a700 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 0x5645a26c6450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f512c00e9b0 tx=0x7f512c011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=553d2ebb729ad2bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.748+0000 7f511b7fe700 1 -- 172.21.15.17:0/128801999 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c015480 con 0x5645a26c5fd0 2023-10-05T15:45:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.748+0000 7f511b7fe700 1 -- 172.21.15.17:0/128801999 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f512c015a70 con 0x5645a26c5fd0 2023-10-05T15:45:37.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.748+0000 7f511b7fe700 1 -- 172.21.15.17:0/128801999 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c013960 con 0x5645a26c5fd0 2023-10-05T15:45:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.749+0000 7f514b3aeb80 1 -- 172.21.15.17:0/128801999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 msgr2=0x5645a26c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.749+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 0x5645a26c6450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f512c00e9b0 tx=0x7f512c011000 comp rx=0 tx=0).stop 2023-10-05T15:45:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.750+0000 7f514b3aeb80 1 -- 172.21.15.17:0/128801999 shutdown_connections 2023-10-05T15:45:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.750+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.750+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.750+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/128801999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c5fd0 0x5645a26c6450 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.750+0000 7f514b3aeb80 1 -- 172.21.15.17:0/128801999 >> 172.21.15.17:0/128801999 conn(0x5645a2639200 msgr2=0x5645a26bfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:37.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.753+0000 7f514b3aeb80 1 -- 172.21.15.17:0/128801999 shutdown_connections 2023-10-05T15:45:37.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.754+0000 7f514b3aeb80 1 -- 172.21.15.17:0/128801999 wait complete. 2023-10-05T15:45:37.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.754+0000 7f514b3aeb80 1 -- start start 2023-10-05T15:45:37.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.755+0000 7f514b3aeb80 1 Processor -- start 2023-10-05T15:45:37.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c4ec0 0x5645a26cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 0x5645a26cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a2617dd0 con 0x5645a26c6990 2023-10-05T15:45:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a25b46b0 con 0x5645a26c4ec0 2023-10-05T15:45:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a25b4350 con 0x5645a26c5fd0 2023-10-05T15:45:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f514b3aeb80 10 client.0 _ll_register_callbacks cb 0x5645a24117a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f5134f9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 0x5645a26cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f5134f9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 0x5645a26cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:32966/0 (socket says 172.21.15.17:32966) 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f5134f9a700 1 -- 172.21.15.17:0/2953401707 learned_addr learned my addr 172.21.15.17:0/2953401707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.756+0000 7f5135f9c700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f513579b700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c4ec0 0x5645a26cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f5134f9a700 1 -- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c4ec0 msgr2=0x5645a26cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f5134f9a700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c4ec0 0x5645a26cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f5134f9a700 1 -- 172.21.15.17:0/2953401707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 msgr2=0x5645a26d6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f5134f9a700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f5134f9a700 1 -- 172.21.15.17:0/2953401707 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c00e690 con 0x5645a26c5fd0 2023-10-05T15:45:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.757+0000 7f5135f9c700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:45:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.758+0000 7f5134f9a700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 0x5645a26cf110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f512c013490 tx=0x7f512c015720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fb41fb3f64afa43 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.759+0000 7f5118ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.759+0000 7f5118ff9700 1 -- 172.21.15.17:0/2953401707 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c013af0 con 0x5645a26c5fd0 2023-10-05T15:45:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.759+0000 7f5118ff9700 1 -- 172.21.15.17:0/2953401707 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f512c013c50 con 0x5645a26c5fd0 2023-10-05T15:45:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.759+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645a26b7d50 con 0x5645a26c5fd0 2023-10-05T15:45:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.761+0000 7f5118ff9700 1 -- 172.21.15.17:0/2953401707 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f512c013e10 con 0x5645a26c5fd0 2023-10-05T15:45:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.761+0000 7f514b3aeb80 10 client.26614 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.761+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5645a242bc00 con 0x5645a26c5fd0 2023-10-05T15:45:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.762+0000 7f5118ff9700 1 -- 172.21.15.17:0/2953401707 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5645a26b7d50 con 0x5645a26c5fd0 2023-10-05T15:45:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.762+0000 7f5118ff9700 1 -- 172.21.15.17:0/2953401707 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f512c03c420 con 0x5645a26c5fd0 2023-10-05T15:45:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f514b3aeb80 10 client.26614 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f514b3aeb80 10 client.26614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f514b3aeb80 20 client.26614 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a26eb910 0x5645a26edd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f514b3aeb80 4 client.26614 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:45:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645a2610db0 con 0x5645a26eb910 2023-10-05T15:45:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.763+0000 7f513579b700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a26eb910 0x5645a26edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.764+0000 7f513579b700 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a26eb910 0x5645a26edd30 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355bf4617aa342b7 server_cookie=a99a082858b58eb8 in_seq=0 out_seq=0 2023-10-05T15:45:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.764+0000 7f5118ff9700 10 client.26614 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.767+0000 7f5118ff9700 1 -- 172.21.15.17:0/2953401707 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5645a2610db0 con 0x5645a26eb910 2023-10-05T15:45:37.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.767+0000 7f5118ff9700 10 client.26614 handle_command_reply: tid=0 2023-10-05T15:45:37.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 client.26614 shutdown 2023-10-05T15:45:37.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 msgr2=0x5645a26cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 0x5645a26cf110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f512c013490 tx=0x7f512c015720 comp rx=0 tx=0).stop 2023-10-05T15:45:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 shutdown_connections 2023-10-05T15:45:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a26eb910 0x5645a26edd30 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c4ec0 0x5645a26cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/2953401707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c5fd0 0x5645a26cf110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.768+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 >> 172.21.15.17:0/2953401707 conn(0x5645a2639200 msgr2=0x5645a26bf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.770+0000 7f5118ff9700 0 client.26614 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.770+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 shutdown_connections 2023-10-05T15:45:37.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.770+0000 7f514b3aeb80 1 -- 172.21.15.17:0/2953401707 wait complete. 2023-10-05T15:45:37.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.771+0000 7f514b3aeb80 20 client.26614 trim_cache size 0 max 16384 2023-10-05T15:45:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.795+0000 7f514b3aeb80 1 Processor -- start 2023-10-05T15:45:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.795+0000 7f514b3aeb80 1 -- start start 2023-10-05T15:45:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c6990 0x5645a26d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26cd380 0x5645a26cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a24988c0 con 0x5645a26cd380 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a26cf850 con 0x5645a26c6990 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a26bc860 con 0x5645a26c4ec0 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.796+0000 7f513579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:32974/0 (socket says 172.21.15.17:32974) 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 -- 172.21.15.17:0/1788946007 learned_addr learned my addr 172.21.15.17:0/1788946007 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f5135f9c700 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26cd380 0x5645a26cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 -- 172.21.15.17:0/1788946007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c6990 msgr2=0x5645a26d6110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c6990 0x5645a26d6110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 -- 172.21.15.17:0/1788946007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26cd380 msgr2=0x5645a26cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26cd380 0x5645a26cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.797+0000 7f513579b700 1 -- 172.21.15.17:0/1788946007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645a24691f0 con 0x5645a26c4ec0 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.798+0000 7f513579b700 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26cce40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f512800b780 tx=0x7f5128086050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89f0c6e89564d1be server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.798+0000 7f511bfff700 1 -- 172.21.15.17:0/1788946007 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512809bb50 con 0x5645a26c4ec0 2023-10-05T15:45:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.798+0000 7f511bfff700 1 -- 172.21.15.17:0/1788946007 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f512809b450 con 0x5645a26c4ec0 2023-10-05T15:45:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.798+0000 7f511bfff700 1 -- 172.21.15.17:0/1788946007 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128099910 con 0x5645a26c4ec0 2023-10-05T15:45:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.799+0000 7f514b3aeb80 1 -- 172.21.15.17:0/1788946007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 msgr2=0x5645a26cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.799+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26cce40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f512800b780 tx=0x7f5128086050 comp rx=0 tx=0).stop 2023-10-05T15:45:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 -- 172.21.15.17:0/1788946007 shutdown_connections 2023-10-05T15:45:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26cd380 0x5645a26cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26cce40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/1788946007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26c6990 0x5645a26d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 -- 172.21.15.17:0/1788946007 >> 172.21.15.17:0/1788946007 conn(0x5645a2639200 msgr2=0x5645a26ed920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 -- 172.21.15.17:0/1788946007 shutdown_connections 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 -- 172.21.15.17:0/1788946007 wait complete. 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.800+0000 7f514b3aeb80 1 -- start start 2023-10-05T15:45:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.801+0000 7f514b3aeb80 1 Processor -- start 2023-10-05T15:45:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26d3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26cd380 0x5645a26d5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a26d59b0 con 0x5645a26c6990 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a26d5b20 con 0x5645a26cd380 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645a26d5ce0 con 0x5645a26c4ec0 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.802+0000 7f514b3aeb80 10 client.0 _ll_register_callbacks cb 0x7f512c00e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.803+0000 7f513579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26d3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.803+0000 7f5135f9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26cd380 0x5645a26d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.803+0000 7f5135f9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26cd380 0x5645a26d5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45286/0 (socket says 172.21.15.17:45286) 2023-10-05T15:45:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.803+0000 7f5135f9c700 1 -- 172.21.15.17:0/3167798730 learned_addr learned my addr 172.21.15.17:0/3167798730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.803+0000 7f5134f9a700 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f513579b700 1 -- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26cd380 msgr2=0x5645a26d5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f513579b700 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26cd380 0x5645a26d5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f513579b700 1 -- 172.21.15.17:0/3167798730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 msgr2=0x5645a26d4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f513579b700 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f513579b700 1 -- 172.21.15.17:0/3167798730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5130071ea0 con 0x5645a26c4ec0 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f513579b700 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26d3f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x5645a26ce860 tx=0x7f51280a3750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa4435261f16993 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.804+0000 7f5118ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.807+0000 7f5118ff9700 1 -- 172.21.15.17:0/3167798730 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512809bb50 con 0x5645a26c4ec0 2023-10-05T15:45:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.807+0000 7f5118ff9700 1 -- 172.21.15.17:0/3167798730 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f512809f170 con 0x5645a26c4ec0 2023-10-05T15:45:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.807+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f512c015a70 con 0x5645a26c4ec0 2023-10-05T15:45:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.807+0000 7f5118ff9700 1 -- 172.21.15.17:0/3167798730 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f512809f330 con 0x5645a26c4ec0 2023-10-05T15:45:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.808+0000 7f514b3aeb80 10 client.26620 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.808+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5645a2441250 con 0x5645a26c4ec0 2023-10-05T15:45:37.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.810+0000 7f5118ff9700 1 -- 172.21.15.17:0/3167798730 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f512c015a70 con 0x5645a26c4ec0 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.810+0000 7f5118ff9700 1 -- 172.21.15.17:0/3167798730 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f512809aa50 con 0x5645a26c4ec0 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f514b3aeb80 10 client.26620 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f514b3aeb80 10 client.26620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f514b3aeb80 20 client.26620 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a27402f0 0x5645a2742710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f514b3aeb80 4 client.26620 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:45:37.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5645a2610ad0 con 0x5645a27402f0 2023-10-05T15:45:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.811+0000 7f5134f9a700 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a27402f0 0x5645a2742710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.812+0000 7f5134f9a700 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a27402f0 0x5645a2742710 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636b0822021b6e0d server_cookie=56d74ecac790075b in_seq=0 out_seq=0 2023-10-05T15:45:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.812+0000 7f5118ff9700 10 client.26620 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.828+0000 7f5118ff9700 1 -- 172.21.15.17:0/3167798730 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5645a2610ad0 con 0x5645a27402f0 2023-10-05T15:45:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.828+0000 7f5118ff9700 10 client.26620 handle_command_reply: tid=0 2023-10-05T15:45:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.829+0000 7f514b3aeb80 1 client.26620 shutdown 2023-10-05T15:45:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 msgr2=0x5645a26d3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26d3f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x5645a26ce860 tx=0x7f51280a3750 comp rx=0 tx=0).stop 2023-10-05T15:45:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 shutdown_connections 2023-10-05T15:45:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5645a27402f0 0x5645a2742710 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5645a26cd380 0x5645a26d5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645a26c4ec0 0x5645a26d3f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.830+0000 7f514b3aeb80 1 --2- 172.21.15.17:0/3167798730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645a26c6990 0x5645a26d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.831+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 >> 172.21.15.17:0/3167798730 conn(0x5645a2639200 msgr2=0x5645a26cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.831+0000 7f5118ff9700 0 client.26620 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.833+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 shutdown_connections 2023-10-05T15:45:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.833+0000 7f514b3aeb80 1 -- 172.21.15.17:0/3167798730 wait complete. 2023-10-05T15:45:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.837+0000 7f514b3aeb80 20 client.26620 trim_cache size 0 max 16384 2023-10-05T15:45:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:45:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:45:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:45:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:45:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.838+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f511c0a15d0 msgr2=0x7f511c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.838+0000 7f51379ff700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f511c0a15d0 0x7f511c0a3a90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f51300708a0 tx=0x7f512c009190 comp rx=0 tx=0).stop 2023-10-05T15:45:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.838+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 msgr2=0x7f513006f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.838+0000 7f51379ff700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 0x7f513006f850 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f512800b070 tx=0x7f512800bce0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.840+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 shutdown_connections 2023-10-05T15:45:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.840+0000 7f51379ff700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f511c0a15d0 0x7f511c0a3a90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.840+0000 7f51379ff700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f513010d4d0 0x7f5130070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.840+0000 7f51379ff700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5130073910 0x7f513006f850 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.840+0000 7f51379ff700 1 --2- 172.21.15.17:0/3055634613 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5130074ef0 0x7f513006fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.840+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 >> 172.21.15.17:0/3055634613 conn(0x7f51300fc430 msgr2=0x7f51300fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.842+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 shutdown_connections 2023-10-05T15:45:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:37.843+0000 7f51379ff700 1 -- 172.21.15.17:0/3055634613 wait complete. 2023-10-05T15:45:38.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:45:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 420.0 s, 515.6 tps, lat 193.344 ms stddev 58.233 2023-10-05T15:45:38.193 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:37 smithi017 ceph-mon[129107]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 522 op/s 2023-10-05T15:45:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:37 smithi167 ceph-mon[133366]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 522 op/s 2023-10-05T15:45:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:37 smithi079 ceph-mon[132936]: pgmap v640: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 522 op/s 2023-10-05T15:45:38.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.480+0000 7f34283ff700 1 -- 172.21.15.17:0/57408315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010d1f0 msgr2=0x7f342010d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.480+0000 7f34283ff700 1 --2- 172.21.15.17:0/57408315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010d1f0 0x7f342010d6a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f341c009990 tx=0x7f341c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 -- 172.21.15.17:0/57408315 shutdown_connections 2023-10-05T15:45:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 --2- 172.21.15.17:0/57408315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010d1f0 0x7f342010d6a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 --2- 172.21.15.17:0/57408315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3420107eb0 0x7f342010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 --2- 172.21.15.17:0/57408315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f342010a820 0x7f342010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 -- 172.21.15.17:0/57408315 >> 172.21.15.17:0/57408315 conn(0x7f342006dc90 msgr2=0x7f34200700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 -- 172.21.15.17:0/57408315 shutdown_connections 2023-10-05T15:45:38.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.481+0000 7f34283ff700 1 -- 172.21.15.17:0/57408315 wait complete. 2023-10-05T15:45:38.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.483+0000 7f34283ff700 1 Processor -- start 2023-10-05T15:45:38.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.484+0000 7f34283ff700 1 -- start start 2023-10-05T15:45:38.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f34283ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3420107eb0 0x7f34201174c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f34283ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 0x7f3420117a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f34283ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342010d1f0 0x7f3420118a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f34283ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420119010 con 0x7f342010d1f0 2023-10-05T15:45:38.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f34283ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420119180 con 0x7f342010a820 2023-10-05T15:45:38.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f34283ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420119340 con 0x7f3420107eb0 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.485+0000 7f342599a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 0x7f3420117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 0x7f3420117a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45312/0 (socket says 172.21.15.17:45312) 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 -- 172.21.15.17:0/3953599690 learned_addr learned my addr 172.21.15.17:0/3953599690 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342619b700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3420107eb0 0x7f34201174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342699c700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342010d1f0 0x7f3420118a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 -- 172.21.15.17:0/3953599690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3420107eb0 msgr2=0x7f34201174c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3420107eb0 0x7f34201174c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 -- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342010d1f0 msgr2=0x7f3420118a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342010d1f0 0x7f3420118a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.486+0000 7f342599a700 1 -- 172.21.15.17:0/3953599690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0095f0 con 0x7f342010a820 2023-10-05T15:45:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.487+0000 7f342599a700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 0x7f3420117a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3418007e00 tx=0x7f341800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.487+0000 7f34177fe700 1 -- 172.21.15.17:0/3953599690 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341800ad40 con 0x7f342010a820 2023-10-05T15:45:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.488+0000 7f34177fe700 1 -- 172.21.15.17:0/3953599690 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34180128b0 con 0x7f342010a820 2023-10-05T15:45:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.488+0000 7f34177fe700 1 -- 172.21.15.17:0/3953599690 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418011650 con 0x7f342010a820 2023-10-05T15:45:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.488+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34201195c0 con 0x7f342010a820 2023-10-05T15:45:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.488+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3420119a80 con 0x7f342010a820 2023-10-05T15:45:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.494+0000 7f343bddeb80 1 Processor -- start 2023-10-05T15:45:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 -- start start 2023-10-05T15:45:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b35680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b36480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 0x5598f2b36ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2a9d460 con 0x5598f2b35260 2023-10-05T15:45:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2a8ec20 con 0x5598f2b35bc0 2023-10-05T15:45:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.496+0000 7f343bddeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2a8c540 con 0x5598f2b36a60 2023-10-05T15:45:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.498+0000 7f342619b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b36480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.498+0000 7f342619b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b36480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45326/0 (socket says 172.21.15.17:45326) 2023-10-05T15:45:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.498+0000 7f342619b700 1 -- 172.21.15.17:0/4209675496 learned_addr learned my addr 172.21.15.17:0/4209675496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f342619b700 1 -- 172.21.15.17:0/4209675496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 msgr2=0x5598f2b36ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:45:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f342619b700 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 0x5598f2b36ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f342619b700 1 -- 172.21.15.17:0/4209675496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 msgr2=0x5598f2b35680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f342619b700 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b35680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f342619b700 1 -- 172.21.15.17:0/4209675496 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598f28b2de0 con 0x5598f2b35bc0 2023-10-05T15:45:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f34177fe700 1 -- 172.21.15.17:0/3953599690 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3418012a20 con 0x7f342010a820 2023-10-05T15:45:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.499+0000 7f342619b700 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b36480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f341000ad00 tx=0x7f341000f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ccfbed202b4faaf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.500+0000 7f3414bfe700 1 -- 172.21.15.17:0/4209675496 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410004a30 con 0x5598f2b35bc0 2023-10-05T15:45:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.500+0000 7f3414bfe700 1 -- 172.21.15.17:0/4209675496 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f341000fec0 con 0x5598f2b35bc0 2023-10-05T15:45:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.500+0000 7f3414bfe700 1 -- 172.21.15.17:0/4209675496 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100186a0 con 0x5598f2b35bc0 2023-10-05T15:45:38.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.501+0000 7f34177fe700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f340c0a1550 0x7f340c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.501+0000 7f343bddeb80 1 -- 172.21.15.17:0/4209675496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 msgr2=0x5598f2b36480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.501+0000 7f343bddeb80 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b36480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f341000ad00 tx=0x7f341000f6a0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.501+0000 7f34177fe700 1 -- 172.21.15.17:0/3953599690 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f34180cd400 con 0x7f342010a820 2023-10-05T15:45:38.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f342699c700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f340c0a1550 0x7f340c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 -- 172.21.15.17:0/4209675496 shutdown_connections 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 0x5598f2b36ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b35680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 --2- 172.21.15.17:0/4209675496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b36480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 -- 172.21.15.17:0/4209675496 >> 172.21.15.17:0/4209675496 conn(0x5598f2aa9260 msgr2=0x5598f2b30140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 -- 172.21.15.17:0/4209675496 shutdown_connections 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.502+0000 7f343bddeb80 1 -- 172.21.15.17:0/4209675496 wait complete. 2023-10-05T15:45:38.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.503+0000 7f343bddeb80 1 -- start start 2023-10-05T15:45:38.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.503+0000 7f342699c700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f340c0a1550 0x7f340c0a3a10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f341c009350 tx=0x7f341c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:38.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.503+0000 7f343bddeb80 1 Processor -- start 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35260 0x5598f2b3f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 0x5598f2b3f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b46660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2a87e30 con 0x5598f2b35bc0 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2a24710 con 0x5598f2b36a60 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2a243b0 con 0x5598f2b35260 2023-10-05T15:45:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.504+0000 7f343bddeb80 10 client.0 _ll_register_callbacks cb 0x5598f2881800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 0x5598f2b3f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 0x5598f2b3f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54104/0 (socket says 172.21.15.17:54104) 2023-10-05T15:45:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 -- 172.21.15.17:0/863140588 learned_addr learned my addr 172.21.15.17:0/863140588 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342699c700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b46660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342619b700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35260 0x5598f2b3f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 -- 172.21.15.17:0/863140588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35260 msgr2=0x5598f2b3f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35260 0x5598f2b3f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 -- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 msgr2=0x5598f2b46660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b46660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 -- 172.21.15.17:0/863140588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341000a9c0 con 0x5598f2b35bc0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.505+0000 7f342599a700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 0x5598f2b3f620 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f341809a2b0 tx=0x7f3418012e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26ead3836a4c00d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f3409ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f3409ffb700 1 -- 172.21.15.17:0/863140588 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341809a320 con 0x5598f2b35bc0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f3409ffb700 1 -- 172.21.15.17:0/863140588 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f341809e470 con 0x5598f2b35bc0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598f2a80e10 con 0x5598f2b35bc0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f3409ffb700 1 -- 172.21.15.17:0/863140588 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f341809a0f0 con 0x5598f2b35bc0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f343bddeb80 10 client.16731 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.506+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5598f289bc60 con 0x5598f2b35bc0 2023-10-05T15:45:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f3409ffb700 1 -- 172.21.15.17:0/863140588 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598f2a80e10 con 0x5598f2b35bc0 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f3409ffb700 1 -- 172.21.15.17:0/863140588 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f341807b020 con 0x5598f2b35bc0 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f343bddeb80 10 client.16731 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f343bddeb80 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f343bddeb80 20 client.16731 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f343bddeb80 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b4ae40 0x5598f2b4d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f343bddeb80 4 client.16731 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:45:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598f2a80b30 con 0x5598f2b4ae40 2023-10-05T15:45:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.507+0000 7f342619b700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b4ae40 0x5598f2b4d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.508+0000 7f342619b700 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b4ae40 0x5598f2b4d260 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca4e1f4a74a0edb server_cookie=3b9c9ff4e1215c44 in_seq=0 out_seq=0 2023-10-05T15:45:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.508+0000 7f3409ffb700 10 client.16731 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.509+0000 7f3409ffb700 1 -- 172.21.15.17:0/863140588 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5598f2a80b30 con 0x5598f2b4ae40 2023-10-05T15:45:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.509+0000 7f3409ffb700 10 client.16731 handle_command_reply: tid=0 2023-10-05T15:45:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.509+0000 7f343bddeb80 1 client.16731 shutdown 2023-10-05T15:45:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.511+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 msgr2=0x5598f2b3f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.511+0000 7f343bddeb80 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 0x5598f2b3f620 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f341809a2b0 tx=0x7f3418012e60 comp rx=0 tx=0).stop 2023-10-05T15:45:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 shutdown_connections 2023-10-05T15:45:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b4ae40 0x5598f2b4d260 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b46660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35260 0x5598f2b3f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f3409ffb700 0 client.16731 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 --2- 172.21.15.17:0/863140588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35bc0 0x5598f2b3f620 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 >> 172.21.15.17:0/863140588 conn(0x5598f2aa9260 msgr2=0x5598f2b2ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 shutdown_connections 2023-10-05T15:45:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.512+0000 7f343bddeb80 1 -- 172.21.15.17:0/863140588 wait complete. 2023-10-05T15:45:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.514+0000 7f343bddeb80 20 client.16731 trim_cache size 0 max 16384 2023-10-05T15:45:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.540+0000 7f343bddeb80 1 Processor -- start 2023-10-05T15:45:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.540+0000 7f343bddeb80 1 -- start start 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b46ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 0x5598f2b2ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f343bddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2908920 con 0x5598f2b35260 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f343bddeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2b34e90 con 0x5598f2b35bc0 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f343bddeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2b3a5f0 con 0x5598f2b36a60 2023-10-05T15:45:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f342599a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f342599a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45342/0 (socket says 172.21.15.17:45342) 2023-10-05T15:45:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.541+0000 7f342599a700 1 -- 172.21.15.17:0/3878598520 learned_addr learned my addr 172.21.15.17:0/3878598520 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.542+0000 7f342599a700 1 -- 172.21.15.17:0/3878598520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 msgr2=0x5598f2b2ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.542+0000 7f342599a700 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 0x5598f2b2ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.542+0000 7f342599a700 1 -- 172.21.15.17:0/3878598520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 msgr2=0x5598f2b46ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.542+0000 7f342599a700 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b46ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.542+0000 7f342599a700 1 -- 172.21.15.17:0/3878598520 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598f28d9250 con 0x5598f2b35bc0 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.542+0000 7f342599a700 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b465f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3418007c70 tx=0x7f34180966e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e55f3b82091f8bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.543+0000 7f34153ff700 1 -- 172.21.15.17:0/3878598520 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341809e470 con 0x5598f2b35bc0 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.543+0000 7f34153ff700 1 -- 172.21.15.17:0/3878598520 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f341809a320 con 0x5598f2b35bc0 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.543+0000 7f34153ff700 1 -- 172.21.15.17:0/3878598520 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418099810 con 0x5598f2b35bc0 2023-10-05T15:45:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 -- 172.21.15.17:0/3878598520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 msgr2=0x5598f2b465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b465f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3418007c70 tx=0x7f34180966e0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 -- 172.21.15.17:0/3878598520 shutdown_connections 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b36a60 0x5598f2b2ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b46ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 --2- 172.21.15.17:0/3878598520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b35bc0 0x5598f2b465f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 -- 172.21.15.17:0/3878598520 >> 172.21.15.17:0/3878598520 conn(0x5598f2aa9260 msgr2=0x5598f2b51bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.544+0000 7f343bddeb80 1 -- 172.21.15.17:0/3878598520 shutdown_connections 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.545+0000 7f343bddeb80 1 -- 172.21.15.17:0/3878598520 wait complete. 2023-10-05T15:45:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.545+0000 7f343bddeb80 1 -- start start 2023-10-05T15:45:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 Processor -- start 2023-10-05T15:45:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b45f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 0x5598f2b46480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b44550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2b44b30 con 0x5598f2b35260 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2b44ca0 con 0x5598f2b36a60 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598f2b44e60 con 0x5598f2b35bc0 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.546+0000 7f343bddeb80 10 client.0 _ll_register_callbacks cb 0x5598f2881800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.547+0000 7f342699c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b44550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.547+0000 7f342599a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 0x5598f2b46480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.547+0000 7f342619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b45f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.547+0000 7f342599a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 0x5598f2b46480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33032/0 (socket says 172.21.15.17:33032) 2023-10-05T15:45:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.547+0000 7f342599a700 1 -- 172.21.15.17:0/2797130013 learned_addr learned my addr 172.21.15.17:0/2797130013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f342599a700 1 -- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 msgr2=0x5598f2b44550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f342599a700 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b44550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f342599a700 1 -- 172.21.15.17:0/2797130013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 msgr2=0x5598f2b45f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f342599a700 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b45f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f342599a700 1 -- 172.21.15.17:0/2797130013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598f289bc60 con 0x5598f2b35bc0 2023-10-05T15:45:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f342599a700 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 0x5598f2b46480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f341809a2b0 tx=0x7f3418000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395188e5caa00294 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f3409ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:38.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.548+0000 7f3409ffb700 1 -- 172.21.15.17:0/2797130013 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341809e470 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f3409ffb700 1 -- 172.21.15.17:0/2797130013 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3418012490 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598f2b27f10 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f3409ffb700 1 -- 172.21.15.17:0/2797130013 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3418012650 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f343bddeb80 10 client.26629 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5598f28b12b0 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f3409ffb700 1 -- 172.21.15.17:0/2797130013 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598f2b27f10 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.549+0000 7f3409ffb700 1 -- 172.21.15.17:0/2797130013 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f341807b030 con 0x5598f2b35bc0 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f343bddeb80 10 client.26629 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f343bddeb80 10 client.26629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:38.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f343bddeb80 20 client.26629 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f343bddeb80 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b9fb40 0x5598f2ba1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f343bddeb80 4 client.26629 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:45:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5598f28d3f70 con 0x5598f2b9fb40 2023-10-05T15:45:38.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.550+0000 7f342619b700 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b9fb40 0x5598f2ba1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.551+0000 7f3409ffb700 10 client.26629 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.551+0000 7f342619b700 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b9fb40 0x5598f2ba1f60 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54230e24429d6af server_cookie=51ba715007e20b8e in_seq=0 out_seq=0 2023-10-05T15:45:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.552+0000 7f3409ffb700 1 -- 172.21.15.17:0/2797130013 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5598f28d3f70 con 0x5598f2b9fb40 2023-10-05T15:45:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.552+0000 7f3409ffb700 10 client.26629 handle_command_reply: tid=0 2023-10-05T15:45:38.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.552+0000 7f343bddeb80 1 client.26629 shutdown 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 msgr2=0x5598f2b46480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 0x5598f2b46480 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f341809a2b0 tx=0x7f3418000f40 comp rx=0 tx=0).stop 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 shutdown_connections 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5598f2b9fb40 0x5598f2ba1f60 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5598f2b36a60 0x5598f2b44550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598f2b35260 0x5598f2b45f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 --2- 172.21.15.17:0/2797130013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5598f2b35bc0 0x5598f2b46480 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 >> 172.21.15.17:0/2797130013 conn(0x5598f2aa9260 msgr2=0x5598f2b46ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f3409ffb700 0 client.26629 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 shutdown_connections 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.554+0000 7f343bddeb80 1 -- 172.21.15.17:0/2797130013 wait complete. 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.555+0000 7f343bddeb80 20 client.26629 trim_cache size 0 max 16384 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:45:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:45:38.560 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.555+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f340c0a1550 msgr2=0x7f340c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.555+0000 7f34283ff700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f340c0a1550 0x7f340c0a3a10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f341c009350 tx=0x7f341c005fb0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.555+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 msgr2=0x7f3420117a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.555+0000 7f34283ff700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 0x7f3420117a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3418007e00 tx=0x7f341800a340 comp rx=0 tx=0).stop 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.556+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 shutdown_connections 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.556+0000 7f34283ff700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f340c0a1550 0x7f340c0a3a10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.556+0000 7f34283ff700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f342010d1f0 0x7f3420118a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.556+0000 7f34283ff700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3420107eb0 0x7f34201174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.556+0000 7f34283ff700 1 --2- 172.21.15.17:0/3953599690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f342010a820 0x7f3420117a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:38.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.556+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 >> 172.21.15.17:0/3953599690 conn(0x7f342006dc90 msgr2=0x7f3420070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:38.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.558+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 shutdown_connections 2023-10-05T15:45:38.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:45:38.558+0000 7f34283ff700 1 -- 172.21.15.17:0/3953599690 wait complete. 2023-10-05T15:45:38.602 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:45:40.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:39 smithi017 ceph-mon[129107]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.5 MiB/s wr, 573 op/s 2023-10-05T15:45:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:39 smithi167 ceph-mon[133366]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.5 MiB/s wr, 573 op/s 2023-10-05T15:45:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:39 smithi079 ceph-mon[132936]: pgmap v641: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.5 MiB/s wr, 573 op/s 2023-10-05T15:45:42.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:41 smithi017 ceph-mon[129107]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 632 op/s 2023-10-05T15:45:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:41 smithi167 ceph-mon[133366]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 632 op/s 2023-10-05T15:45:42.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:41 smithi079 ceph-mon[132936]: pgmap v642: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 632 op/s 2023-10-05T15:45:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 425.0 s, 524.8 tps, lat 191.466 ms stddev 57.438 2023-10-05T15:45:44.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:43 smithi017 ceph-mon[129107]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.5 MiB/s wr, 537 op/s 2023-10-05T15:45:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:43 smithi167 ceph-mon[133366]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.5 MiB/s wr, 537 op/s 2023-10-05T15:45:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:43 smithi079 ceph-mon[132936]: pgmap v643: 129 pgs: 129 active+clean; 1.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.5 MiB/s wr, 537 op/s 2023-10-05T15:45:46.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:45 smithi017 ceph-mon[129107]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 655 op/s 2023-10-05T15:45:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:45 smithi167 ceph-mon[133366]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 655 op/s 2023-10-05T15:45:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:45 smithi079 ceph-mon[132936]: pgmap v644: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.1 MiB/s wr, 655 op/s 2023-10-05T15:45:48.105 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:47 smithi079 ceph-mon[132936]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 490 op/s 2023-10-05T15:45:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 430.0 s, 545.5 tps, lat 183.802 ms stddev 156.032 2023-10-05T15:45:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:47 smithi017 ceph-mon[129107]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 490 op/s 2023-10-05T15:45:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:47 smithi167 ceph-mon[133366]: pgmap v645: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.7 MiB/s wr, 490 op/s 2023-10-05T15:45:50.104 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:49 smithi079 ceph-mon[132936]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.9 MiB/s wr, 601 op/s 2023-10-05T15:45:50.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:49 smithi017 ceph-mon[129107]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.9 MiB/s wr, 601 op/s 2023-10-05T15:45:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:49 smithi167 ceph-mon[133366]: pgmap v646: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.9 MiB/s wr, 601 op/s 2023-10-05T15:45:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.197+0000 7f18241ff700 1 -- 172.21.15.17:0/3232456000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c100ea0 msgr2=0x7f181c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.197+0000 7f18241ff700 1 --2- 172.21.15.17:0/3232456000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c100ea0 0x7f181c1012c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f181000b0a0 tx=0x7f181000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.202+0000 7f18241ff700 1 -- 172.21.15.17:0/3232456000 shutdown_connections 2023-10-05T15:45:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.202+0000 7f18241ff700 1 --2- 172.21.15.17:0/3232456000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c102a40 0x7f181c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.202+0000 7f18241ff700 1 --2- 172.21.15.17:0/3232456000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c100ea0 0x7f181c1012c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.202+0000 7f18241ff700 1 --2- 172.21.15.17:0/3232456000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102080 0x7f181c102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.202+0000 7f18241ff700 1 -- 172.21.15.17:0/3232456000 >> 172.21.15.17:0/3232456000 conn(0x7f181c0fc460 msgr2=0x7f181c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.209+0000 7f18241ff700 1 -- 172.21.15.17:0/3232456000 shutdown_connections 2023-10-05T15:45:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.210+0000 7f18241ff700 1 -- 172.21.15.17:0/3232456000 wait complete. 2023-10-05T15:45:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.211+0000 7f18241ff700 1 Processor -- start 2023-10-05T15:45:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.212+0000 7f18241ff700 1 -- start start 2023-10-05T15:45:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f18241ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 0x7f181c19d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f18241ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c102080 0x7f181c19d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f18241ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102a40 0x7f181c19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f18241ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19eda0 con 0x7f181c102a40 2023-10-05T15:45:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f18241ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19ef10 con 0x7f181c100ea0 2023-10-05T15:45:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f18241ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c19f0d0 con 0x7f181c102080 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f1821f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 0x7f181c19d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f1821f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 0x7f181c19d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45076/0 (socket says 172.21.15.17:45076) 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f1821f9b700 1 -- 172.21.15.17:0/3177775026 learned_addr learned my addr 172.21.15.17:0/3177775026 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.213+0000 7f182179a700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c102080 0x7f181c19d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f182279c700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102a40 0x7f181c19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f1821f9b700 1 -- 172.21.15.17:0/3177775026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c102080 msgr2=0x7f181c19d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f1821f9b700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c102080 0x7f181c19d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f1821f9b700 1 -- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102a40 msgr2=0x7f181c19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f1821f9b700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102a40 0x7f181c19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f1821f9b700 1 -- 172.21.15.17:0/3177775026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009d00 con 0x7f181c100ea0 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f182279c700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102a40 0x7f181c19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f1821f9b700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 0x7f181c19d380 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f181000b070 tx=0x7f1810004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f181affd700 1 -- 172.21.15.17:0/3177775026 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000e040 con 0x7f181c100ea0 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f181affd700 1 -- 172.21.15.17:0/3177775026 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18100094c0 con 0x7f181c100ea0 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f181affd700 1 -- 172.21.15.17:0/3177775026 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100058a0 con 0x7f181c100ea0 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.214+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c19f350 con 0x7f181c100ea0 2023-10-05T15:45:51.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.215+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c1a5b70 con 0x7f181c100ea0 2023-10-05T15:45:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.222+0000 7f1837a90b80 1 Processor -- start 2023-10-05T15:45:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 -- start start 2023-10-05T15:45:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b863872e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b86388450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b8638f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b862ef400 con 0x561b86387fd0 2023-10-05T15:45:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b862e0bc0 con 0x561b86388990 2023-10-05T15:45:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.223+0000 7f1837a90b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b862de4e0 con 0x561b86386ec0 2023-10-05T15:45:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182279c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b863872e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182279c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b863872e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57490/0 (socket says 172.21.15.17:57490) 2023-10-05T15:45:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182279c700 1 -- 172.21.15.17:0/1193449863 learned_addr learned my addr 172.21.15.17:0/1193449863 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182179a700 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b8638f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182279c700 1 -- 172.21.15.17:0/1193449863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 msgr2=0x561b8638f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182279c700 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b8638f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.224+0000 7f182279c700 1 -- 172.21.15.17:0/1193449863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 msgr2=0x561b86388450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.225+0000 7f182279c700 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b86388450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.225+0000 7f182279c700 1 -- 172.21.15.17:0/1193449863 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b86104d80 con 0x561b86386ec0 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.225+0000 7f182179a700 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b8638f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.225+0000 7f181affd700 1 -- 172.21.15.17:0/3177775026 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f181001b860 con 0x7f181c100ea0 2023-10-05T15:45:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.225+0000 7f182279c700 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b863872e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1814009c80 tx=0x7f1814009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1353b71fece8a4ba server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.225+0000 7f1807fff700 1 -- 172.21.15.17:0/1193449863 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181400eb50 con 0x561b86386ec0 2023-10-05T15:45:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.226+0000 7f1807fff700 1 -- 172.21.15.17:0/1193449863 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1814004cc0 con 0x561b86386ec0 2023-10-05T15:45:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.226+0000 7f1807fff700 1 -- 172.21.15.17:0/1193449863 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814005690 con 0x561b86386ec0 2023-10-05T15:45:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 -- 172.21.15.17:0/1193449863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 msgr2=0x561b863872e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b863872e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1814009c80 tx=0x7f1814009f90 comp rx=0 tx=0).stop 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f181affd700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f180c0a1550 0x7f180c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 -- 172.21.15.17:0/1193449863 shutdown_connections 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b8638f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b863872e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1193449863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b86388450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f1837a90b80 1 -- 172.21.15.17:0/1193449863 >> 172.21.15.17:0/1193449863 conn(0x561b862fb200 msgr2=0x561b86381bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.227+0000 7f181affd700 1 -- 172.21.15.17:0/3177775026 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f18100ced80 con 0x7f181c100ea0 2023-10-05T15:45:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.228+0000 7f182279c700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f180c0a1550 0x7f180c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.230+0000 7f1837a90b80 1 -- 172.21.15.17:0/1193449863 shutdown_connections 2023-10-05T15:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.231+0000 7f1837a90b80 1 -- 172.21.15.17:0/1193449863 wait complete. 2023-10-05T15:45:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.231+0000 7f1837a90b80 1 -- start start 2023-10-05T15:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.232+0000 7f1837a90b80 1 Processor -- start 2023-10-05T15:45:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.232+0000 7f182279c700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f180c0a1550 0x7f180c0a3a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1814005850 tx=0x7f181400efa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b86390ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b86398120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b862d9dd0 con 0x561b86387fd0 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b862766b0 con 0x561b86388990 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b86276350 con 0x561b86386ec0 2023-10-05T15:45:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.233+0000 7f1837a90b80 10 client.0 _ll_register_callbacks cb 0x561b860d37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.234+0000 7f1821f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b86390ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.234+0000 7f1821f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b86390ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57506/0 (socket says 172.21.15.17:57506) 2023-10-05T15:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.234+0000 7f1821f9b700 1 -- 172.21.15.17:0/4084814801 learned_addr learned my addr 172.21.15.17:0/4084814801 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.234+0000 7f182179a700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.235+0000 7f182279c700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b86398120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.235+0000 7f1821f9b700 1 -- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 msgr2=0x561b86398120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.235+0000 7f1821f9b700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b86398120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.235+0000 7f1821f9b700 1 -- 172.21.15.17:0/4084814801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 msgr2=0x561b863910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.235+0000 7f1821f9b700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863910e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.235+0000 7f1821f9b700 1 -- 172.21.15.17:0/4084814801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140098b0 con 0x561b86386ec0 2023-10-05T15:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.236+0000 7f182179a700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.236+0000 7f1821f9b700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b86390ba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f181009ba30 tx=0x7f181009bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72903faeee86737 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.236+0000 7f18057fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.236+0000 7f18057fa700 1 -- 172.21.15.17:0/4084814801 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181009bd30 con 0x561b86386ec0 2023-10-05T15:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.237+0000 7f18057fa700 1 -- 172.21.15.17:0/4084814801 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f18100b4540 con 0x561b86386ec0 2023-10-05T15:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.237+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b86379d50 con 0x561b86386ec0 2023-10-05T15:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.237+0000 7f18057fa700 1 -- 172.21.15.17:0/4084814801 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f181009fe80 con 0x561b86386ec0 2023-10-05T15:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.237+0000 7f1837a90b80 10 client.26641 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.237+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x561b860edc00 con 0x561b86386ec0 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f18057fa700 1 -- 172.21.15.17:0/4084814801 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561b86379d50 con 0x561b86386ec0 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f18057fa700 1 -- 172.21.15.17:0/4084814801 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f181001bb10 con 0x561b86386ec0 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f1837a90b80 10 client.26641 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f1837a90b80 10 client.26641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f1837a90b80 20 client.26641 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f1837a90b80 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b863ad700 0x561b863afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f1837a90b80 4 client.26641 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:45:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.238+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b862d2db0 con 0x561b863ad700 2023-10-05T15:45:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.239+0000 7f182179a700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b863ad700 0x561b863afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.248+0000 7f182179a700 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b863ad700 0x561b863afaf0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b1ccde4f3b106d7 server_cookie=4a8c4268d287fec5 in_seq=0 out_seq=0 2023-10-05T15:45:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.248+0000 7f18057fa700 10 client.26641 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.249+0000 7f18057fa700 1 -- 172.21.15.17:0/4084814801 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561b862d2db0 con 0x561b863ad700 2023-10-05T15:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.249+0000 7f18057fa700 10 client.26641 handle_command_reply: tid=0 2023-10-05T15:45:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.249+0000 7f1837a90b80 1 client.26641 shutdown 2023-10-05T15:45:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 msgr2=0x561b86390ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b86390ba0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f181009ba30 tx=0x7f181009bbb0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 shutdown_connections 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b863ad700 0x561b863afaf0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86388990 0x561b86398120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86386ec0 0x561b86390ba0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 --2- 172.21.15.17:0/4084814801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 >> 172.21.15.17:0/4084814801 conn(0x561b862fb200 msgr2=0x561b86381250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f18057fa700 0 client.26641 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 shutdown_connections 2023-10-05T15:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.250+0000 7f1837a90b80 1 -- 172.21.15.17:0/4084814801 wait complete. 2023-10-05T15:45:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.251+0000 7f1837a90b80 20 client.26641 trim_cache size 0 max 16384 2023-10-05T15:45:51.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.284+0000 7f1837a90b80 1 Processor -- start 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 -- start start 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 0x561b863af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863980e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b863a9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b8615a8c0 con 0x561b86387fd0 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b863ad520 con 0x561b86386ec0 2023-10-05T15:45:51.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1837a90b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b86383320 con 0x561b86388990 2023-10-05T15:45:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1821f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 0x561b863af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1821f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 0x561b863af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45102/0 (socket says 172.21.15.17:45102) 2023-10-05T15:45:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.285+0000 7f1821f9b700 1 -- 172.21.15.17:0/655916438 learned_addr learned my addr 172.21.15.17:0/655916438 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f182179a700 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f182279c700 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b863a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f1821f9b700 1 -- 172.21.15.17:0/655916438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 msgr2=0x561b863a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f1821f9b700 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b863a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f1821f9b700 1 -- 172.21.15.17:0/655916438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 msgr2=0x561b863980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f1821f9b700 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f1821f9b700 1 -- 172.21.15.17:0/655916438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b8612b1f0 con 0x561b86386ec0 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.286+0000 7f182279c700 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b863a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.287+0000 7f1821f9b700 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 0x561b863af710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1810004e50 tx=0x7f181001bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3124e5661645180 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.287+0000 7f1818ff9700 1 -- 172.21.15.17:0/655916438 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181009c240 con 0x561b86386ec0 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.287+0000 7f1818ff9700 1 -- 172.21.15.17:0/655916438 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1810009960 con 0x561b86386ec0 2023-10-05T15:45:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.287+0000 7f1818ff9700 1 -- 172.21.15.17:0/655916438 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181009bd30 con 0x561b86386ec0 2023-10-05T15:45:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 -- 172.21.15.17:0/655916438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 msgr2=0x561b863af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 0x561b863af710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1810004e50 tx=0x7f181001bf60 comp rx=0 tx=0).stop 2023-10-05T15:45:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 -- 172.21.15.17:0/655916438 shutdown_connections 2023-10-05T15:45:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b863a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86386ec0 0x561b863af710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 --2- 172.21.15.17:0/655916438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86387fd0 0x561b863980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.288+0000 7f1837a90b80 1 -- 172.21.15.17:0/655916438 >> 172.21.15.17:0/655916438 conn(0x561b862fb200 msgr2=0x561b8638f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.289+0000 7f1837a90b80 1 -- 172.21.15.17:0/655916438 shutdown_connections 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.289+0000 7f1837a90b80 1 -- 172.21.15.17:0/655916438 wait complete. 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.289+0000 7f1837a90b80 1 -- start start 2023-10-05T15:45:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.290+0000 7f1837a90b80 1 Processor -- start 2023-10-05T15:45:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86386ec0 0x561b86393ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86387fd0 0x561b86393ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b86397010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b86397550 con 0x561b86386ec0 2023-10-05T15:45:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b863976c0 con 0x561b86387fd0 2023-10-05T15:45:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b86397880 con 0x561b86388990 2023-10-05T15:45:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.294+0000 7f1837a90b80 10 client.0 _ll_register_callbacks cb 0x561b860d37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:45:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.296+0000 7f182179a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86387fd0 0x561b86393ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.296+0000 7f182179a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86387fd0 0x561b86393ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45108/0 (socket says 172.21.15.17:45108) 2023-10-05T15:45:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.296+0000 7f182179a700 1 -- 172.21.15.17:0/1481724913 learned_addr learned my addr 172.21.15.17:0/1481724913 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:45:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.296+0000 7f182279c700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b86397010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.297+0000 7f1821f9b700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86386ec0 0x561b86393ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.298+0000 7f182279c700 1 -- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86387fd0 msgr2=0x561b86393ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.298+0000 7f182279c700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86387fd0 0x561b86393ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.298+0000 7f182279c700 1 -- 172.21.15.17:0/1481724913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86386ec0 msgr2=0x561b86393ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:45:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.298+0000 7f182279c700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86386ec0 0x561b86393ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.298+0000 7f182279c700 1 -- 172.21.15.17:0/1481724913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b860edc00 con 0x561b86388990 2023-10-05T15:45:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.298+0000 7f1821f9b700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86386ec0 0x561b86393ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:45:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.299+0000 7f182279c700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b86397010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f181400e680 tx=0x7f1814009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=805717642a273e18 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:45:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.299+0000 7f18057fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:45:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.299+0000 7f18057fa700 1 -- 172.21.15.17:0/1481724913 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181402f070 con 0x561b86388990 2023-10-05T15:45:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.299+0000 7f18057fa700 1 -- 172.21.15.17:0/1481724913 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f181400eb60 con 0x561b86388990 2023-10-05T15:45:51.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.299+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1814004cc0 con 0x561b86388990 2023-10-05T15:45:51.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.300+0000 7f18057fa700 1 -- 172.21.15.17:0/1481724913 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1814021070 con 0x561b86388990 2023-10-05T15:45:51.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.300+0000 7f1837a90b80 10 client.26644 fetch_fsmap learned FSMap version 39 2023-10-05T15:45:51.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.300+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x561b86103250 con 0x561b86388990 2023-10-05T15:45:51.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.300+0000 7f18057fa700 1 -- 172.21.15.17:0/1481724913 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1814004cc0 con 0x561b86388990 2023-10-05T15:45:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.301+0000 7f18057fa700 1 -- 172.21.15.17:0/1481724913 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1814011c00 con 0x561b86388990 2023-10-05T15:45:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1837a90b80 10 client.26644 fetch_fsmap finished waiting for FSMap version 39 2023-10-05T15:45:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1837a90b80 10 client.26644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:45:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1837a90b80 20 client.26644 populate_metadata read hostname 'smithi017' 2023-10-05T15:45:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b864130c0 0x561b864154e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:45:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1837a90b80 4 client.26644 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:45:51.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561b862d2ad0 con 0x561b864130c0 2023-10-05T15:45:51.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.302+0000 7f1821f9b700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b864130c0 0x561b864154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:45:51.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.303+0000 7f1821f9b700 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b864130c0 0x561b864154e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0f0180d61ef2dd server_cookie=cff98541cd54b0e6 in_seq=0 out_seq=0 2023-10-05T15:45:51.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.303+0000 7f18057fa700 10 client.26644 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.319+0000 7f18057fa700 1 -- 172.21.15.17:0/1481724913 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561b862d2ad0 con 0x561b864130c0 2023-10-05T15:45:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.319+0000 7f18057fa700 10 client.26644 handle_command_reply: tid=0 2023-10-05T15:45:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.321+0000 7f1837a90b80 1 client.26644 shutdown 2023-10-05T15:45:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 msgr2=0x561b86397010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b86397010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f181400e680 tx=0x7f1814009f90 comp rx=0 tx=0).stop 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 shutdown_connections 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561b864130c0 0x561b864154e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561b86388990 0x561b86397010 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561b86386ec0 0x561b86393ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 --2- 172.21.15.17:0/1481724913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561b86387fd0 0x561b86393ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 >> 172.21.15.17:0/1481724913 conn(0x561b862fb200 msgr2=0x561b863af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.322+0000 7f18057fa700 0 client.26644 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:45:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.326+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 shutdown_connections 2023-10-05T15:45:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.326+0000 7f1837a90b80 1 -- 172.21.15.17:0/1481724913 wait complete. 2023-10-05T15:45:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.326+0000 7f1837a90b80 20 client.26644 trim_cache size 0 max 16384 2023-10-05T15:45:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:45:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:45:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:45:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:45:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f180c0a1550 msgr2=0x7f180c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f180c0a1550 0x7f180c0a3a10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1814005850 tx=0x7f181400efa0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 msgr2=0x7f181c19d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:45:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 0x7f181c19d380 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f181000b070 tx=0x7f1810004d30 comp rx=0 tx=0).stop 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 shutdown_connections 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f180c0a1550 0x7f180c0a3a10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f181c102a40 0x7f181c19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f181c100ea0 0x7f181c19d380 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 --2- 172.21.15.17:0/3177775026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f181c102080 0x7f181c19d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 >> 172.21.15.17:0/3177775026 conn(0x7f181c0fc460 msgr2=0x7f181c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:45:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 shutdown_connections 2023-10-05T15:45:51.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:45:51.328+0000 7f18241ff700 1 -- 172.21.15.17:0/3177775026 wait complete. 2023-10-05T15:45:52.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:51 smithi017 ceph-mon[129107]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2023-10-05T15:45:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:51 smithi167 ceph-mon[133366]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2023-10-05T15:45:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:51 smithi079 ceph-mon[132936]: pgmap v647: 129 pgs: 129 active+clean; 1.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 647 op/s 2023-10-05T15:45:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 435.0 s, 499.2 tps, lat 199.866 ms stddev 60.953 2023-10-05T15:45:54.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:53 smithi017 ceph-mon[129107]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.2 MiB/s wr, 530 op/s 2023-10-05T15:45:54.441 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:53 smithi079 ceph-mon[132936]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.2 MiB/s wr, 530 op/s 2023-10-05T15:45:54.442 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:53 smithi167 ceph-mon[133366]: pgmap v648: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.2 MiB/s wr, 530 op/s 2023-10-05T15:45:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:55 smithi017 ceph-mon[129107]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 691 op/s 2023-10-05T15:45:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:55 smithi167 ceph-mon[133366]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 691 op/s 2023-10-05T15:45:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:55 smithi079 ceph-mon[132936]: pgmap v649: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 691 op/s 2023-10-05T15:45:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 440.0 s, 535.1 tps, lat 187.167 ms stddev 59.283 2023-10-05T15:45:58.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:57 smithi017 ceph-mon[129107]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 522 op/s 2023-10-05T15:45:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:57 smithi167 ceph-mon[133366]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 522 op/s 2023-10-05T15:45:58.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:57 smithi079 ceph-mon[132936]: pgmap v650: 129 pgs: 129 active+clean; 1.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 522 op/s 2023-10-05T15:46:00.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:45:59 smithi017 ceph-mon[129107]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 582 op/s 2023-10-05T15:46:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:45:59 smithi167 ceph-mon[133366]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 582 op/s 2023-10-05T15:46:00.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:45:59 smithi079 ceph-mon[132936]: pgmap v651: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.9 MiB/s wr, 582 op/s 2023-10-05T15:46:02.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:01 smithi017 ceph-mon[129107]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2023-10-05T15:46:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:01 smithi167 ceph-mon[133366]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2023-10-05T15:46:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:01 smithi079 ceph-mon[132936]: pgmap v652: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2023-10-05T15:46:03.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 445.0 s, 606.8 tps, lat 163.751 ms stddev 54.307 2023-10-05T15:46:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:03 smithi017 ceph-mon[129107]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.4 MiB/s wr, 466 op/s 2023-10-05T15:46:04.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:03 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:46:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:03 smithi167 ceph-mon[133366]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.4 MiB/s wr, 466 op/s 2023-10-05T15:46:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:03 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:46:04.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:03 smithi079 ceph-mon[132936]: pgmap v653: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.4 MiB/s wr, 466 op/s 2023-10-05T15:46:04.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:03 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:46:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.677+0000 7fd5323ff700 1 -- 172.21.15.17:0/3337147081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c074e90 msgr2=0x7fd52c0732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.677+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3337147081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c074e90 0x7fd52c0732e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009990 tx=0x7fd51c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.679+0000 7fd5323ff700 1 -- 172.21.15.17:0/3337147081 shutdown_connections 2023-10-05T15:46:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.679+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3337147081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd52c108dc0 0x7fd52c10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.679+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3337147081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c074e90 0x7fd52c0732e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.679+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3337147081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52c0738b0 0x7fd52c073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.679+0000 7fd5323ff700 1 -- 172.21.15.17:0/3337147081 >> 172.21.15.17:0/3337147081 conn(0x7fd52c0fc460 msgr2=0x7fd52c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.682+0000 7fd5323ff700 1 -- 172.21.15.17:0/3337147081 shutdown_connections 2023-10-05T15:46:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.683+0000 7fd5323ff700 1 -- 172.21.15.17:0/3337147081 wait complete. 2023-10-05T15:46:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.688+0000 7fd5323ff700 1 Processor -- start 2023-10-05T15:46:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.688+0000 7fd5323ff700 1 -- start start 2023-10-05T15:46:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd5323ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 0x7fd52c198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd5323ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd52c074e90 0x7fd52c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd5323ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52c108dc0 0x7fd52c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd5323ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c19a920 con 0x7fd52c108dc0 2023-10-05T15:46:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd5323ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c19aa90 con 0x7fd52c0738b0 2023-10-05T15:46:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd5323ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c19ac50 con 0x7fd52c074e90 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 0x7fd52c198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 0x7fd52c198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35128/0 (socket says 172.21.15.17:35128) 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd52bfff700 1 -- 172.21.15.17:0/3951389247 learned_addr learned my addr 172.21.15.17:0/3951389247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd523fff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd52c074e90 0x7fd52c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.689+0000 7fd53099c700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52c108dc0 0x7fd52c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.690+0000 7fd52bfff700 1 -- 172.21.15.17:0/3951389247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd52c074e90 msgr2=0x7fd52c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.690+0000 7fd52bfff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd52c074e90 0x7fd52c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.690+0000 7fd52bfff700 1 -- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52c108dc0 msgr2=0x7fd52c19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.690+0000 7fd52bfff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52c108dc0 0x7fd52c19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.690+0000 7fd52bfff700 1 -- 172.21.15.17:0/3951389247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0095f0 con 0x7fd52c0738b0 2023-10-05T15:46:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.690+0000 7fd52bfff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 0x7fd52c198f00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd51c003a80 tx=0x7fd51c003ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.692+0000 7fd529ffb700 1 -- 172.21.15.17:0/3951389247 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c01d070 con 0x7fd52c0738b0 2023-10-05T15:46:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.692+0000 7fd529ffb700 1 -- 172.21.15.17:0/3951389247 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd51c00bd50 con 0x7fd52c0738b0 2023-10-05T15:46:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.692+0000 7fd529ffb700 1 -- 172.21.15.17:0/3951389247 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00fdd0 con 0x7fd52c0738b0 2023-10-05T15:46:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.692+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c19aed0 con 0x7fd52c0738b0 2023-10-05T15:46:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.692+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c100900 con 0x7fd52c0738b0 2023-10-05T15:46:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.699+0000 7fd545d4fb80 1 Processor -- start 2023-10-05T15:46:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 -- start start 2023-10-05T15:46:04.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c3f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c40450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c47220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981ba7400 con 0x562981c3ffd0 2023-10-05T15:46:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981b98bc0 con 0x562981c3eec0 2023-10-05T15:46:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.700+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981b964e0 con 0x562981c40990 2023-10-05T15:46:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.701+0000 7fd529ffb700 1 -- 172.21.15.17:0/3951389247 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd51c00f460 con 0x7fd52c0738b0 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.701+0000 7fd53099c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c3f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.701+0000 7fd53099c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c3f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35132/0 (socket says 172.21.15.17:35132) 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.701+0000 7fd53099c700 1 -- 172.21.15.17:0/458334325 learned_addr learned my addr 172.21.15.17:0/458334325 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.701+0000 7fd523fff700 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c47220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd52bfff700 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c40450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd53099c700 1 -- 172.21.15.17:0/458334325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 msgr2=0x562981c47220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd53099c700 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c47220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd53099c700 1 -- 172.21.15.17:0/458334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 msgr2=0x562981c40450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd53099c700 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c40450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd53099c700 1 -- 172.21.15.17:0/458334325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629819bcd80 con 0x562981c3eec0 2023-10-05T15:46:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd52bfff700 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c40450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:46:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.702+0000 7fd53099c700 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c3f2e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd52400a430 tx=0x7fd524009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef25fc39110fdaeb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.704+0000 7fd529ffb700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd50c0a1580 0x7fd50c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.704+0000 7fd5227fc700 1 -- 172.21.15.17:0/458334325 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524010040 con 0x562981c3eec0 2023-10-05T15:46:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.704+0000 7fd5227fc700 1 -- 172.21.15.17:0/458334325 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd524014ab0 con 0x562981c3eec0 2023-10-05T15:46:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.704+0000 7fd5227fc700 1 -- 172.21.15.17:0/458334325 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5240139a0 con 0x562981c3eec0 2023-10-05T15:46:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.704+0000 7fd529ffb700 1 -- 172.21.15.17:0/3951389247 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd51c0cdd80 con 0x7fd52c0738b0 2023-10-05T15:46:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.704+0000 7fd52bfff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd50c0a1580 0x7fd50c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.705+0000 7fd52bfff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd50c0a1580 0x7fd50c0a3a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0977a0 tx=0x7fd51c028000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.707+0000 7fd545d4fb80 1 -- 172.21.15.17:0/458334325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 msgr2=0x562981c3f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.707+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c3f2e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd52400a430 tx=0x7fd524009650 comp rx=0 tx=0).stop 2023-10-05T15:46:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.708+0000 7fd545d4fb80 1 -- 172.21.15.17:0/458334325 shutdown_connections 2023-10-05T15:46:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.708+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c47220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.708+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c3f2e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.708+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/458334325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c40450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.708+0000 7fd545d4fb80 1 -- 172.21.15.17:0/458334325 >> 172.21.15.17:0/458334325 conn(0x562981bb3200 msgr2=0x562981c39bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.711+0000 7fd545d4fb80 1 -- 172.21.15.17:0/458334325 shutdown_connections 2023-10-05T15:46:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.711+0000 7fd545d4fb80 1 -- 172.21.15.17:0/458334325 wait complete. 2023-10-05T15:46:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.711+0000 7fd545d4fb80 1 -- start start 2023-10-05T15:46:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.712+0000 7fd545d4fb80 1 Processor -- start 2023-10-05T15:46:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c48b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c49070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981b91dd0 con 0x562981c3ffd0 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981b2e6b0 con 0x562981c3eec0 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981b2e350 con 0x562981c40990 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.713+0000 7fd545d4fb80 10 client.0 _ll_register_callbacks cb 0x56298198b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c49070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c49070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53000/0 (socket says 172.21.15.17:53000) 2023-10-05T15:46:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 -- 172.21.15.17:0/3872895337 learned_addr learned my addr 172.21.15.17:0/3872895337 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 -- 172.21.15.17:0/3872895337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 msgr2=0x562981c500b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c500b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 -- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 msgr2=0x562981c48b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c48b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.714+0000 7fd523fff700 1 -- 172.21.15.17:0/3872895337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd524009c60 con 0x562981c3ffd0 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.715+0000 7fd523fff700 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c49070 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd514011610 tx=0x7fd5140119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5044fdc284574e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.715+0000 7fd51b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:46:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.716+0000 7fd51b7fe700 1 -- 172.21.15.17:0/3872895337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514009740 con 0x562981c3ffd0 2023-10-05T15:46:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.716+0000 7fd51b7fe700 1 -- 172.21.15.17:0/3872895337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd514013670 con 0x562981c3ffd0 2023-10-05T15:46:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.717+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562981c31d50 con 0x562981c3ffd0 2023-10-05T15:46:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.717+0000 7fd51b7fe700 1 -- 172.21.15.17:0/3872895337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd514013830 con 0x562981c3ffd0 2023-10-05T15:46:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.717+0000 7fd545d4fb80 10 client.16752 fetch_fsmap learned FSMap version 40 2023-10-05T15:46:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.717+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5629819a5c00 con 0x562981c3ffd0 2023-10-05T15:46:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.718+0000 7fd51b7fe700 1 -- 172.21.15.17:0/3872895337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562981c31d50 con 0x562981c3ffd0 2023-10-05T15:46:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.718+0000 7fd51b7fe700 1 -- 172.21.15.17:0/3872895337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd51401b020 con 0x562981c3ffd0 2023-10-05T15:46:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.718+0000 7fd545d4fb80 10 client.16752 fetch_fsmap finished waiting for FSMap version 40 2023-10-05T15:46:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.718+0000 7fd545d4fb80 10 client.16752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.718+0000 7fd545d4fb80 20 client.16752 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.719+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981c659c0 0x562981c67de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.719+0000 7fd545d4fb80 4 client.16752 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.719+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562981b8adb0 con 0x562981c659c0 2023-10-05T15:46:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.719+0000 7fd53099c700 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981c659c0 0x562981c67de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.720+0000 7fd53099c700 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981c659c0 0x562981c67de0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b20df7649da4b461 server_cookie=32f440b837b9d666 in_seq=0 out_seq=0 2023-10-05T15:46:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.720+0000 7fd51b7fe700 10 client.16752 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:04.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.721+0000 7fd51b7fe700 1 -- 172.21.15.17:0/3872895337 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562981b8adb0 con 0x562981c659c0 2023-10-05T15:46:04.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.721+0000 7fd51b7fe700 10 client.16752 handle_command_reply: tid=0 2023-10-05T15:46:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.722+0000 7fd545d4fb80 1 client.16752 shutdown 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 msgr2=0x562981c49070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c49070 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd514011610 tx=0x7fd5140119d0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 shutdown_connections 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981c659c0 0x562981c67de0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c40990 0x562981c500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3eec0 0x562981c48b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/3872895337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3ffd0 0x562981c49070 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 >> 172.21.15.17:0/3872895337 conn(0x562981bb3200 msgr2=0x562981c39250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd51b7fe700 0 client.16752 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 shutdown_connections 2023-10-05T15:46:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.723+0000 7fd545d4fb80 1 -- 172.21.15.17:0/3872895337 wait complete. 2023-10-05T15:46:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.724+0000 7fd545d4fb80 20 client.16752 trim_cache size 0 max 16384 2023-10-05T15:46:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.750+0000 7fd545d4fb80 1 Processor -- start 2023-10-05T15:46:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 -- start start 2023-10-05T15:46:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3eec0 0x562981c679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 0x562981c4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c40990 0x562981c48af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981a128c0 con 0x562981c3eec0 2023-10-05T15:46:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981c342a0 con 0x562981c40990 2023-10-05T15:46:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981c46b90 con 0x562981c3ffd0 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd523fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 0x562981c4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.751+0000 7fd53099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3eec0 0x562981c679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 0x562981c4ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44240/0 (socket says 172.21.15.17:44240) 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 -- 172.21.15.17:0/924096900 learned_addr learned my addr 172.21.15.17:0/924096900 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd53099c700 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c40990 0x562981c48af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 -- 172.21.15.17:0/924096900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c40990 msgr2=0x562981c48af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c40990 0x562981c48af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 -- 172.21.15.17:0/924096900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3eec0 msgr2=0x562981c679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3eec0 0x562981c679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 -- 172.21.15.17:0/924096900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629819e31f0 con 0x562981c3ffd0 2023-10-05T15:46:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd53099c700 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c40990 0x562981c48af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:46:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.752+0000 7fd523fff700 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 0x562981c4ffd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd5140048a0 tx=0x7fd514011e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3bc1e2d97d5bd63 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.753+0000 7fd522ffd700 1 -- 172.21.15.17:0/924096900 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514014640 con 0x562981c3ffd0 2023-10-05T15:46:04.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.753+0000 7fd522ffd700 1 -- 172.21.15.17:0/924096900 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd514009200 con 0x562981c3ffd0 2023-10-05T15:46:04.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.753+0000 7fd522ffd700 1 -- 172.21.15.17:0/924096900 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140138d0 con 0x562981c3ffd0 2023-10-05T15:46:04.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.754+0000 7fd545d4fb80 1 -- 172.21.15.17:0/924096900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 msgr2=0x562981c4ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.754+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 0x562981c4ffd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd5140048a0 tx=0x7fd514011e80 comp rx=0 tx=0).stop 2023-10-05T15:46:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.761+0000 7fd545d4fb80 1 -- 172.21.15.17:0/924096900 shutdown_connections 2023-10-05T15:46:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.761+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c40990 0x562981c48af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.761+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c3eec0 0x562981c679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.761+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/924096900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3ffd0 0x562981c4ffd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.761+0000 7fd545d4fb80 1 -- 172.21.15.17:0/924096900 >> 172.21.15.17:0/924096900 conn(0x562981bb3200 msgr2=0x562981c618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.766+0000 7fd545d4fb80 1 -- 172.21.15.17:0/924096900 shutdown_connections 2023-10-05T15:46:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.766+0000 7fd545d4fb80 1 -- 172.21.15.17:0/924096900 wait complete. 2023-10-05T15:46:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.766+0000 7fd545d4fb80 1 -- start start 2023-10-05T15:46:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.766+0000 7fd545d4fb80 1 Processor -- start 2023-10-05T15:46:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 0x562981c4ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3ffd0 0x562981c4e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c40990 0x562981c4f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981c4f960 con 0x562981c40990 2023-10-05T15:46:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981c4fad0 con 0x562981c3ffd0 2023-10-05T15:46:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562981c4fc90 con 0x562981c3eec0 2023-10-05T15:46:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.767+0000 7fd545d4fb80 10 client.0 _ll_register_callbacks cb 0x7fd514009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.768+0000 7fd53099c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 0x562981c4ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.768+0000 7fd53099c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 0x562981c4ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44252/0 (socket says 172.21.15.17:44252) 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.768+0000 7fd53099c700 1 -- 172.21.15.17:0/613014005 learned_addr learned my addr 172.21.15.17:0/613014005 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.768+0000 7fd53099c700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c40990 0x562981c4f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd523fff700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3ffd0 0x562981c4e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd53099c700 1 -- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3ffd0 msgr2=0x562981c4e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd53099c700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3ffd0 0x562981c4e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd53099c700 1 -- 172.21.15.17:0/613014005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c40990 msgr2=0x562981c4f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd53099c700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c40990 0x562981c4f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd53099c700 1 -- 172.21.15.17:0/613014005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629819a5c00 con 0x562981c3eec0 2023-10-05T15:46:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd53099c700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 0x562981c4ded0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd524009730 tx=0x7fd524004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14f42efb82a09e58 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.769+0000 7fd51b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.770+0000 7fd51b7fe700 1 -- 172.21.15.17:0/613014005 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524022040 con 0x562981c3eec0 2023-10-05T15:46:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.770+0000 7fd51b7fe700 1 -- 172.21.15.17:0/613014005 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd524006e40 con 0x562981c3eec0 2023-10-05T15:46:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.770+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd524014ab0 con 0x562981c3eec0 2023-10-05T15:46:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.771+0000 7fd51b7fe700 1 -- 172.21.15.17:0/613014005 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd524026510 con 0x562981c3eec0 2023-10-05T15:46:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd545d4fb80 10 client.26656 fetch_fsmap learned FSMap version 40 2023-10-05T15:46:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5629819bb250 con 0x562981c3eec0 2023-10-05T15:46:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd51b7fe700 1 -- 172.21.15.17:0/613014005 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd524014ab0 con 0x562981c3eec0 2023-10-05T15:46:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd51b7fe700 1 -- 172.21.15.17:0/613014005 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd524008030 con 0x562981c3eec0 2023-10-05T15:46:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd545d4fb80 10 client.26656 fetch_fsmap finished waiting for FSMap version 40 2023-10-05T15:46:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd545d4fb80 10 client.26656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.772+0000 7fd545d4fb80 20 client.26656 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.773+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981cba8b0 0x562981cbccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.773+0000 7fd545d4fb80 4 client.26656 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:46:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.773+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562981b8aad0 con 0x562981cba8b0 2023-10-05T15:46:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.773+0000 7fd523fff700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981cba8b0 0x562981cbccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.774+0000 7fd523fff700 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981cba8b0 0x562981cbccd0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5148be5a38706dfd server_cookie=7a24dcbc2b9e8ce in_seq=0 out_seq=0 2023-10-05T15:46:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.774+0000 7fd51b7fe700 10 client.26656 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.800+0000 7fd51b7fe700 1 -- 172.21.15.17:0/613014005 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562981b8aad0 con 0x562981cba8b0 2023-10-05T15:46:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.800+0000 7fd51b7fe700 10 client.26656 handle_command_reply: tid=0 2023-10-05T15:46:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.800+0000 7fd545d4fb80 1 client.26656 shutdown 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 msgr2=0x562981c4ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 0x562981c4ded0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd524009730 tx=0x7fd524004ad0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 shutdown_connections 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562981cba8b0 0x562981cbccd0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562981c40990 0x562981c4f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562981c3eec0 0x562981c4ded0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 --2- 172.21.15.17:0/613014005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562981c3ffd0 0x562981c4e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd51b7fe700 0 client.26656 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 >> 172.21.15.17:0/613014005 conn(0x562981bb3200 msgr2=0x562981c618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 shutdown_connections 2023-10-05T15:46:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.803+0000 7fd545d4fb80 1 -- 172.21.15.17:0/613014005 wait complete. 2023-10-05T15:46:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.804+0000 7fd545d4fb80 20 client.26656 trim_cache size 0 max 16384 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.804+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd50c0a1580 msgr2=0x7fd50c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.804+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd50c0a1580 0x7fd50c0a3a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0977a0 tx=0x7fd51c028000 comp rx=0 tx=0).stop 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.804+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 msgr2=0x7fd52c198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.804+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 0x7fd52c198f00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd51c003a80 tx=0x7fd51c003ab0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.807+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 shutdown_connections 2023-10-05T15:46:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.807+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd50c0a1580 0x7fd50c0a3a40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.807+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd52c108dc0 0x7fd52c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.807+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd52c0738b0 0x7fd52c198f00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.807+0000 7fd5323ff700 1 --2- 172.21.15.17:0/3951389247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd52c074e90 0x7fd52c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.807+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 >> 172.21.15.17:0/3951389247 conn(0x7fd52c0fc460 msgr2=0x7fd52c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.808+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 shutdown_connections 2023-10-05T15:46:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:04.809+0000 7fd5323ff700 1 -- 172.21.15.17:0/3951389247 wait complete. 2023-10-05T15:46:05.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:04 smithi167 ceph-mon[133366]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2023-10-05T15:46:05.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:04 smithi079 ceph-mon[132936]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2023-10-05T15:46:05.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:04 smithi017 ceph-mon[129107]: pgmap v654: 129 pgs: 129 active+clean; 1.5 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2023-10-05T15:46:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 450.0 s, 569.0 tps, lat 172.573 ms stddev 54.087 2023-10-05T15:46:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:07 smithi017 ceph-mon[129107]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.6 MiB/s wr, 507 op/s 2023-10-05T15:46:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:07 smithi167 ceph-mon[133366]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.6 MiB/s wr, 507 op/s 2023-10-05T15:46:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:07 smithi079 ceph-mon[132936]: pgmap v655: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.6 MiB/s wr, 507 op/s 2023-10-05T15:46:08.604 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:46:08.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.978+0000 7ff49e9ff700 1 -- 172.21.15.17:0/4290067887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 msgr2=0x7ff498108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:08.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.978+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/4290067887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff498108200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff49000b1a0 tx=0x7ff49000b4b0 comp rx=0 tx=0).stop 2023-10-05T15:46:08.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.981+0000 7ff49e9ff700 1 -- 172.21.15.17:0/4290067887 shutdown_connections 2023-10-05T15:46:08.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.981+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/4290067887 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff498108200 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:08.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.981+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/4290067887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4980ffdc0 0x7ff4981001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:08.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.981+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/4290067887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff498100fb0 0x7ff498101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:08.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.981+0000 7ff49e9ff700 1 -- 172.21.15.17:0/4290067887 >> 172.21.15.17:0/4290067887 conn(0x7ff4980fb330 msgr2=0x7ff4980fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:08.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.983+0000 7ff49e9ff700 1 -- 172.21.15.17:0/4290067887 shutdown_connections 2023-10-05T15:46:08.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.984+0000 7ff49e9ff700 1 -- 172.21.15.17:0/4290067887 wait complete. 2023-10-05T15:46:08.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.985+0000 7ff49e9ff700 1 Processor -- start 2023-10-05T15:46:08.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.987+0000 7ff49e9ff700 1 -- start start 2023-10-05T15:46:08.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.988+0000 7ff49e9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4980ffdc0 0x7ff49806f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.988+0000 7ff49e9ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff498100fb0 0x7ff49806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.988+0000 7ff49e9ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff4981ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.988+0000 7ff49e9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49810dbb0 con 0x7ff4980ffdc0 2023-10-05T15:46:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.988+0000 7ff49e9ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49810dd20 con 0x7ff498100fb0 2023-10-05T15:46:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.988+0000 7ff49e9ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498072c00 con 0x7ff498101950 2023-10-05T15:46:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff4981ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff4981ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44266/0 (socket says 172.21.15.17:44266) 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2870290587 learned_addr learned my addr 172.21.15.17:0/2870290587 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff497fff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4980ffdc0 0x7ff49806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2870290587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff498100fb0 msgr2=0x7ff49806fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff498100fb0 0x7ff49806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4980ffdc0 msgr2=0x7ff49806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4980ffdc0 0x7ff49806f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.989+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2870290587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009d00 con 0x7ff498101950 2023-10-05T15:46:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.990+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff4981ad6a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff490009bb0 tx=0x7ff490008cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.990+0000 7ff4957fa700 1 -- 172.21.15.17:0/2870290587 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490008e90 con 0x7ff498101950 2023-10-05T15:46:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.991+0000 7ff4957fa700 1 -- 172.21.15.17:0/2870290587 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff490005760 con 0x7ff498101950 2023-10-05T15:46:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.991+0000 7ff4957fa700 1 -- 172.21.15.17:0/2870290587 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490022980 con 0x7ff498101950 2023-10-05T15:46:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.991+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff498072df0 con 0x7ff498101950 2023-10-05T15:46:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.991+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981addc0 con 0x7ff498101950 2023-10-05T15:46:09.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.997+0000 7ff4b23abb80 1 Processor -- start 2023-10-05T15:46:09.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.997+0000 7ff4957fa700 1 -- 172.21.15.17:0/2870290587 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff49001f070 con 0x7ff498101950 2023-10-05T15:46:09.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 -- start start 2023-10-05T15:46:09.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef33680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef34480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef34ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee9b460 con 0x55fc7ef34a60 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee8cc20 con 0x55fc7ef33bc0 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee8a540 con 0x55fc7ef33260 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.998+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef33680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef33680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44278/0 (socket says 172.21.15.17:44278) 2023-10-05T15:46:09.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff4977fe700 1 -- 172.21.15.17:0/1250197902 learned_addr learned my addr 172.21.15.17:0/1250197902 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:09.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff497fff700 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef34480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff497fff700 1 -- 172.21.15.17:0/1250197902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 msgr2=0x55fc7ef33680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff497fff700 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef33680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff497fff700 1 -- 172.21.15.17:0/1250197902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 msgr2=0x55fc7ef34ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff497fff700 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef34ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:08.999+0000 7ff497fff700 1 -- 172.21.15.17:0/1250197902 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc7ecb0de0 con 0x55fc7ef33bc0 2023-10-05T15:46:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.000+0000 7ff497fff700 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef34480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff48800bc60 tx=0x7ff48800bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c559707bd21eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.000+0000 7ff47e7fc700 1 -- 172.21.15.17:0/1250197902 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488010ca0 con 0x55fc7ef33bc0 2023-10-05T15:46:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.000+0000 7ff47e7fc700 1 -- 172.21.15.17:0/1250197902 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff488015070 con 0x55fc7ef33bc0 2023-10-05T15:46:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.000+0000 7ff47e7fc700 1 -- 172.21.15.17:0/1250197902 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488003d60 con 0x55fc7ef33bc0 2023-10-05T15:46:09.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.001+0000 7ff4957fa700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4800a1550 0x7ff4800a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.001+0000 7ff4957fa700 1 -- 172.21.15.17:0/2870290587 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff4900ce6c0 con 0x7ff498101950 2023-10-05T15:46:09.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.002+0000 7ff4b23abb80 1 -- 172.21.15.17:0/1250197902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 msgr2=0x55fc7ef34480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:09.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.002+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef34480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff48800bc60 tx=0x7ff48800bf70 comp rx=0 tx=0).stop 2023-10-05T15:46:09.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.002+0000 7ff4977fe700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4800a1550 0x7ff4800a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.002+0000 7ff4b23abb80 1 -- 172.21.15.17:0/1250197902 shutdown_connections 2023-10-05T15:46:09.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.002+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef34ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.002+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef33680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.003+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/1250197902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef34480 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.003+0000 7ff4b23abb80 1 -- 172.21.15.17:0/1250197902 >> 172.21.15.17:0/1250197902 conn(0x55fc7eea7260 msgr2=0x55fc7ef2e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.003+0000 7ff4977fe700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4800a1550 0x7ff4800a3a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55fc7ef34240 tx=0x7ff48c00c530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.004+0000 7ff4b23abb80 1 -- 172.21.15.17:0/1250197902 shutdown_connections 2023-10-05T15:46:09.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.004+0000 7ff4b23abb80 1 -- 172.21.15.17:0/1250197902 wait complete. 2023-10-05T15:46:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.005+0000 7ff4b23abb80 1 -- start start 2023-10-05T15:46:09.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.006+0000 7ff4b23abb80 1 Processor -- start 2023-10-05T15:46:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33260 0x55fc7ef3d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef3d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef44580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee85e30 con 0x55fc7ef33260 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee22710 con 0x55fc7ef34a60 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee223b0 con 0x55fc7ef33bc0 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff4b23abb80 10 client.0 _ll_register_callbacks cb 0x55fc7ec7f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff497fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33260 0x55fc7ef3d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.008+0000 7ff497fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33260 0x55fc7ef3d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53078/0 (socket says 172.21.15.17:53078) 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff497fff700 1 -- 172.21.15.17:0/17799524 learned_addr learned my addr 172.21.15.17:0/17799524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef44580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff49cf9c700 1 -- 172.21.15.17:0/17799524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33bc0 msgr2=0x55fc7ef3d540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef3d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff49cf9c700 1 -- 172.21.15.17:0/17799524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33260 msgr2=0x55fc7ef3d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33260 0x55fc7ef3d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.009+0000 7ff49cf9c700 1 -- 172.21.15.17:0/17799524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48800b8c0 con 0x55fc7ef34a60 2023-10-05T15:46:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.010+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef44580 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4900078e0 tx=0x7ff49009b2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760a2d17d4061243 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.010+0000 7ff4777fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:46:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.010+0000 7ff4777fe700 1 -- 172.21.15.17:0/17799524 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49009f7c0 con 0x55fc7ef34a60 2023-10-05T15:46:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.010+0000 7ff4777fe700 1 -- 172.21.15.17:0/17799524 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff4900a3970 con 0x55fc7ef34a60 2023-10-05T15:46:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.010+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc7ef25f10 con 0x55fc7ef34a60 2023-10-05T15:46:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4777fe700 1 -- 172.21.15.17:0/17799524 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4900ce380 con 0x55fc7ef34a60 2023-10-05T15:46:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 10 client.26696 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55fc7ec99c60 con 0x55fc7ef34a60 2023-10-05T15:46:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4777fe700 1 -- 172.21.15.17:0/17799524 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fc7ef25f10 con 0x55fc7ef34a60 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4777fe700 1 -- 172.21.15.17:0/17799524 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff4900a34e0 con 0x55fc7ef34a60 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 10 client.26696 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 10 client.26696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 20 client.26696 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef489c0 0x55fc7ef4add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 4 client.26696 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.011+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc7ee7ee10 con 0x55fc7ef489c0 2023-10-05T15:46:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.012+0000 7ff497fff700 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef489c0 0x55fc7ef4add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.013+0000 7ff497fff700 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef489c0 0x55fc7ef4add0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee0001d14cf28153 server_cookie=7e2585fc2a6aba21 in_seq=0 out_seq=0 2023-10-05T15:46:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.013+0000 7ff4777fe700 10 client.26696 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.014+0000 7ff4777fe700 1 -- 172.21.15.17:0/17799524 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc7ee7ee10 con 0x55fc7ef489c0 2023-10-05T15:46:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.014+0000 7ff4777fe700 10 client.26696 handle_command_reply: tid=0 2023-10-05T15:46:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.014+0000 7ff4b23abb80 1 client.26696 shutdown 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 msgr2=0x55fc7ef44580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef44580 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4900078e0 tx=0x7ff49009b2e0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 shutdown_connections 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef489c0 0x55fc7ef4add0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef44580 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33260 0x55fc7ef3d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/17799524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef3d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.016+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 >> 172.21.15.17:0/17799524 conn(0x55fc7eea7260 msgr2=0x55fc7ef2df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:09.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.017+0000 7ff4777fe700 0 client.26696 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.019+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 shutdown_connections 2023-10-05T15:46:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.019+0000 7ff4b23abb80 1 -- 172.21.15.17:0/17799524 wait complete. 2023-10-05T15:46:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.019+0000 7ff4b23abb80 20 client.26696 trim_cache size 0 max 16384 2023-10-05T15:46:09.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.047+0000 7ff4b23abb80 1 Processor -- start 2023-10-05T15:46:09.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 -- start start 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef37a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef44540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef37f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ed06920 con 0x55fc7ef34a60 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ef28300 con 0x55fc7ef33bc0 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.048+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ee7ee40 con 0x55fc7ef33260 2023-10-05T15:46:09.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef37f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef44540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef37f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53094/0 (socket says 172.21.15.17:53094) 2023-10-05T15:46:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2719767281 learned_addr learned my addr 172.21.15.17:0/2719767281 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef44540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35210/0 (socket says 172.21.15.17:35210) 2023-10-05T15:46:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff497fff700 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef37a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2719767281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 msgr2=0x55fc7ef37a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef37a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2719767281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 msgr2=0x55fc7ef44540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef44540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.049+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2719767281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc7ecd7250 con 0x55fc7ef34a60 2023-10-05T15:46:09.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.050+0000 7ff49cf9c700 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef37f50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff49009b600 tx=0x7ff490007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d359c8440c5007 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.051+0000 7ff47effd700 1 -- 172.21.15.17:0/2719767281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900a3970 con 0x55fc7ef34a60 2023-10-05T15:46:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.051+0000 7ff47effd700 1 -- 172.21.15.17:0/2719767281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff49009f7c0 con 0x55fc7ef34a60 2023-10-05T15:46:09.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.051+0000 7ff47effd700 1 -- 172.21.15.17:0/2719767281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900975f0 con 0x55fc7ef34a60 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2719767281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 msgr2=0x55fc7ef37f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef37f50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff49009b600 tx=0x7ff490007520 comp rx=0 tx=0).stop 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2719767281 shutdown_connections 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef34a60 0x55fc7ef37f50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2719767281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef44540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.052+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2719767281 >> 172.21.15.17:0/2719767281 conn(0x55fc7eea7260 msgr2=0x55fc7ef4a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.053+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2719767281 shutdown_connections 2023-10-05T15:46:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.053+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2719767281 wait complete. 2023-10-05T15:46:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.054+0000 7ff4b23abb80 1 -- start start 2023-10-05T15:46:09.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.054+0000 7ff4b23abb80 1 Processor -- start 2023-10-05T15:46:09.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef438c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ef43e00 con 0x55fc7ef33bc0 2023-10-05T15:46:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ef43f70 con 0x55fc7ef34a60 2023-10-05T15:46:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7ef44130 con 0x55fc7ef33260 2023-10-05T15:46:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4b23abb80 10 client.0 _ll_register_callbacks cb 0x7ff49009b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:09.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff4977fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff49cf9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff49cf9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35226/0 (socket says 172.21.15.17:35226) 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff49cf9c700 1 -- 172.21.15.17:0/2623564038 learned_addr learned my addr 172.21.15.17:0/2623564038 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.055+0000 7ff497fff700 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.056+0000 7ff497fff700 1 -- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 msgr2=0x55fc7ef438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.056+0000 7ff497fff700 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.056+0000 7ff497fff700 1 -- 172.21.15.17:0/2623564038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33bc0 msgr2=0x55fc7ef428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.056+0000 7ff497fff700 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.056+0000 7ff497fff700 1 -- 172.21.15.17:0/2623564038 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc7ec99c60 con 0x55fc7ef33260 2023-10-05T15:46:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.057+0000 7ff497fff700 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef42370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55fc7ef4b6f0 tx=0x7ff488029b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b945280bf33589 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:09.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.057+0000 7ff4777fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:09.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.058+0000 7ff4777fe700 1 -- 172.21.15.17:0/2623564038 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488010cb0 con 0x55fc7ef33260 2023-10-05T15:46:09.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.058+0000 7ff4777fe700 1 -- 172.21.15.17:0/2623564038 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff488017070 con 0x55fc7ef33260 2023-10-05T15:46:09.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.059+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff488015070 con 0x55fc7ef33260 2023-10-05T15:46:09.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.059+0000 7ff4777fe700 1 -- 172.21.15.17:0/2623564038 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff488010e10 con 0x55fc7ef33260 2023-10-05T15:46:09.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 10 client.26671 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:09.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55fc7ecaf2b0 con 0x55fc7ef33260 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4777fe700 1 -- 172.21.15.17:0/2623564038 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff488015070 con 0x55fc7ef33260 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4777fe700 1 -- 172.21.15.17:0/2623564038 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff488004710 con 0x55fc7ef33260 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 10 client.26671 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 10 client.26671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 20 client.26671 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef9d7f0 0x55fc7ef9fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 4 client.26671 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:46:09.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.060+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc7ee7eb30 con 0x55fc7ef9d7f0 2023-10-05T15:46:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.061+0000 7ff4977fe700 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef9d7f0 0x55fc7ef9fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.062+0000 7ff4977fe700 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef9d7f0 0x55fc7ef9fc10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ddc259f48e5ec13 server_cookie=2c7011a3b16c74a4 in_seq=0 out_seq=0 2023-10-05T15:46:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.062+0000 7ff4777fe700 10 client.26671 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.062+0000 7ff4777fe700 1 -- 172.21.15.17:0/2623564038 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fc7ee7eb30 con 0x55fc7ef9d7f0 2023-10-05T15:46:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.062+0000 7ff4777fe700 10 client.26671 handle_command_reply: tid=0 2023-10-05T15:46:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 client.26671 shutdown 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 msgr2=0x55fc7ef42370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef42370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55fc7ef4b6f0 tx=0x7ff488029b20 comp rx=0 tx=0).stop 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 shutdown_connections 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fc7ef9d7f0 0x55fc7ef9fc10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fc7ef34a60 0x55fc7ef438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fc7ef33260 0x55fc7ef42370 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 --2- 172.21.15.17:0/2623564038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fc7ef33bc0 0x55fc7ef428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 >> 172.21.15.17:0/2623564038 conn(0x55fc7eea7260 msgr2=0x55fc7ef37a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4777fe700 0 client.26671 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.063+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 shutdown_connections 2023-10-05T15:46:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.064+0000 7ff4b23abb80 1 -- 172.21.15.17:0/2623564038 wait complete. 2023-10-05T15:46:09.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.064+0000 7ff4b23abb80 20 client.26671 trim_cache size 0 max 16384 2023-10-05T15:46:09.067 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:46:09.068 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:46:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.066+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4800a1550 msgr2=0x7ff4800a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.066+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4800a1550 0x7ff4800a3a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55fc7ef34240 tx=0x7ff48c00c530 comp rx=0 tx=0).stop 2023-10-05T15:46:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.066+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 msgr2=0x7ff4981ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.066+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff4981ad6a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff490009bb0 tx=0x7ff490008cf0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.067+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 shutdown_connections 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.067+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4800a1550 0x7ff4800a3a10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.067+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff498101950 0x7ff4981ad6a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.067+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4980ffdc0 0x7ff49806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.067+0000 7ff49e9ff700 1 --2- 172.21.15.17:0/2870290587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff498100fb0 0x7ff49806fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.067+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 >> 172.21.15.17:0/2870290587 conn(0x7ff4980fb330 msgr2=0x7ff4980fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:09.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.068+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 shutdown_connections 2023-10-05T15:46:09.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:09.068+0000 7ff49e9ff700 1 -- 172.21.15.17:0/2870290587 wait complete. 2023-10-05T15:46:09.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:08 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:46:09.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:08 smithi017 ceph-mon[129107]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.3 MiB/s wr, 600 op/s 2023-10-05T15:46:09.099 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:46:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:08 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:46:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:08 smithi167 ceph-mon[133366]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.3 MiB/s wr, 600 op/s 2023-10-05T15:46:09.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:08 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:46:09.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:08 smithi079 ceph-mon[132936]: pgmap v656: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.3 MiB/s wr, 600 op/s 2023-10-05T15:46:10.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:10 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:46:10.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:10 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:46:10.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:10 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:46:11.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:11 smithi017 ceph-mon[129107]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.4 MiB/s wr, 652 op/s 2023-10-05T15:46:11.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:11 smithi167 ceph-mon[133366]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.4 MiB/s wr, 652 op/s 2023-10-05T15:46:11.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:11 smithi079 ceph-mon[132936]: pgmap v657: 129 pgs: 129 active+clean; 1.5 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.4 MiB/s wr, 652 op/s 2023-10-05T15:46:12.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:46:12.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:46:12.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:46:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:46:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:46:12.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:46:12.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:46:12.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:46:12.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:46:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 455.0 s, 541.2 tps, lat 189.349 ms stddev 91.272 2023-10-05T15:46:13.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:13 smithi017 ceph-mon[129107]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 580 op/s 2023-10-05T15:46:13.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:13 smithi167 ceph-mon[133366]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 580 op/s 2023-10-05T15:46:13.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:13 smithi079 ceph-mon[132936]: pgmap v658: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 580 op/s 2023-10-05T15:46:16.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:15 smithi017 ceph-mon[129107]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-10-05T15:46:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:15 smithi167 ceph-mon[133366]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-10-05T15:46:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:15 smithi079 ceph-mon[132936]: pgmap v659: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 770 op/s 2023-10-05T15:46:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.096+0000 7fc04a3ff700 1 -- 172.21.15.17:0/642396395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 msgr2=0x7fc044100340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.096+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/642396395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 0x7fc044100340 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc038009990 tx=0x7fc038009ca0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 -- 172.21.15.17:0/642396395 shutdown_connections 2023-10-05T15:46:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/642396395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc044105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/642396395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 0x7fc0440ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/642396395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 0x7fc044100340 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 -- 172.21.15.17:0/642396395 >> 172.21.15.17:0/642396395 conn(0x7fc0440fa690 msgr2=0x7fc0440fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 -- 172.21.15.17:0/642396395 shutdown_connections 2023-10-05T15:46:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.098+0000 7fc04a3ff700 1 -- 172.21.15.17:0/642396395 wait complete. 2023-10-05T15:46:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 Processor -- start 2023-10-05T15:46:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 -- start start 2023-10-05T15:46:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 0x7fc04419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 0x7fc04419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc04419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04419ec90 con 0x7fc044100880 2023-10-05T15:46:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04419ee00 con 0x7fc0440ffec0 2023-10-05T15:46:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.100+0000 7fc04a3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04419efc0 con 0x7fc0440fed90 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.101+0000 7fc04899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc04419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.101+0000 7fc04899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc04419e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60328/0 (socket says 172.21.15.17:60328) 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.101+0000 7fc04899c700 1 -- 172.21.15.17:0/3097591234 learned_addr learned my addr 172.21.15.17:0/3097591234 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.101+0000 7fc043fff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 0x7fc04419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.101+0000 7fc0437fe700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 0x7fc04419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc043fff700 1 -- 172.21.15.17:0/3097591234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 msgr2=0x7fc04419d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc043fff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 0x7fc04419d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc043fff700 1 -- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 msgr2=0x7fc04419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc043fff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc04419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc043fff700 1 -- 172.21.15.17:0/3097591234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380095f0 con 0x7fc0440fed90 2023-10-05T15:46:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc04899c700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc04419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:46:18.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.102+0000 7fc043fff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 0x7fc04419d270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc03400d950 tx=0x7fc03400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.103+0000 7fc0417fa700 1 -- 172.21.15.17:0/3097591234 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400f890 con 0x7fc0440fed90 2023-10-05T15:46:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.103+0000 7fc0417fa700 1 -- 172.21.15.17:0/3097591234 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03400fe80 con 0x7fc0440fed90 2023-10-05T15:46:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.103+0000 7fc0417fa700 1 -- 172.21.15.17:0/3097591234 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400e3b0 con 0x7fc0440fed90 2023-10-05T15:46:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.103+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04419f2a0 con 0x7fc0440fed90 2023-10-05T15:46:18.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.103+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0441a5a60 con 0x7fc0440fed90 2023-10-05T15:46:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.111+0000 7fc0417fa700 1 -- 172.21.15.17:0/3097591234 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc03400f9f0 con 0x7fc0440fed90 2023-10-05T15:46:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.112+0000 7fc05dc55b80 1 Processor -- start 2023-10-05T15:46:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.112+0000 7fc05dc55b80 1 -- start start 2023-10-05T15:46:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b0622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b063450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6afca400 con 0x560d6b062fd0 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6afbbbc0 con 0x560d6b061ec0 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6afb94e0 con 0x560d6b063990 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc04899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b0622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc04899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b0622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:58186/0 (socket says 172.21.15.17:58186) 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc04899c700 1 -- 172.21.15.17:0/1619405751 learned_addr learned my addr 172.21.15.17:0/1619405751 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.113+0000 7fc0437fe700 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.114+0000 7fc04899c700 1 -- 172.21.15.17:0/1619405751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 msgr2=0x560d6b06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.114+0000 7fc04899c700 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.114+0000 7fc04899c700 1 -- 172.21.15.17:0/1619405751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 msgr2=0x560d6b063450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.114+0000 7fc04899c700 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.114+0000 7fc04899c700 1 -- 172.21.15.17:0/1619405751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d6addfd80 con 0x560d6b061ec0 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.115+0000 7fc0417fa700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc02c0a15d0 0x7fc02c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.115+0000 7fc04899c700 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b0622e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009500 tx=0x7fc03c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43eea835c3114c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.115+0000 7fc0417fa700 1 -- 172.21.15.17:0/3097591234 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc0340ccd00 con 0x7fc0440fed90 2023-10-05T15:46:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.116+0000 7fc02a7fc700 1 -- 172.21.15.17:0/1619405751 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00e900 con 0x560d6b061ec0 2023-10-05T15:46:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.116+0000 7fc02a7fc700 1 -- 172.21.15.17:0/1619405751 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03c00f040 con 0x560d6b061ec0 2023-10-05T15:46:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.116+0000 7fc02a7fc700 1 -- 172.21.15.17:0/1619405751 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c017c10 con 0x560d6b061ec0 2023-10-05T15:46:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.116+0000 7fc043fff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc02c0a15d0 0x7fc02c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1619405751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 msgr2=0x560d6b0622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b0622e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009500 tx=0x7fc03c009920 comp rx=0 tx=0).stop 2023-10-05T15:46:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc043fff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc02c0a15d0 0x7fc02c0a3a90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc034096120 tx=0x7fc034010000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1619405751 shutdown_connections 2023-10-05T15:46:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b06a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b0622e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1619405751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b063450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.117+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1619405751 >> 172.21.15.17:0/1619405751 conn(0x560d6afd6200 msgr2=0x560d6b05cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.118+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1619405751 shutdown_connections 2023-10-05T15:46:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.118+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1619405751 wait complete. 2023-10-05T15:46:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.118+0000 7fc05dc55b80 1 -- start start 2023-10-05T15:46:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.119+0000 7fc05dc55b80 1 Processor -- start 2023-10-05T15:46:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.120+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b061ec0 0x560d6b06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.120+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b063990 0x560d6b073140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6afb4dd0 con 0x560d6b061ec0 2023-10-05T15:46:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6af516b0 con 0x560d6b063990 2023-10-05T15:46:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6af51350 con 0x560d6b062fd0 2023-10-05T15:46:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc05dc55b80 10 client.0 _ll_register_callbacks cb 0x560d6adae7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc04899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b061ec0 0x560d6b06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc04899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b061ec0 0x560d6b06bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60350/0 (socket says 172.21.15.17:60350) 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc04899c700 1 -- 172.21.15.17:0/1031390298 learned_addr learned my addr 172.21.15.17:0/1031390298 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.121+0000 7fc04899c700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b063990 0x560d6b073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc0437fe700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc04899c700 1 -- 172.21.15.17:0/1031390298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 msgr2=0x560d6b06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc04899c700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc04899c700 1 -- 172.21.15.17:0/1031390298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b061ec0 msgr2=0x560d6b06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc04899c700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b061ec0 0x560d6b06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc04899c700 1 -- 172.21.15.17:0/1031390298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03c0091e0 con 0x560d6b063990 2023-10-05T15:46:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc0437fe700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:46:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.122+0000 7fc04899c700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b063990 0x560d6b073140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009020 tx=0x7fc03c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=582c2032113c457e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.123+0000 7fc0237fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:46:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.123+0000 7fc0237fe700 1 -- 172.21.15.17:0/1031390298 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c018eb0 con 0x560d6b063990 2023-10-05T15:46:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.123+0000 7fc0237fe700 1 -- 172.21.15.17:0/1031390298 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc03c00e700 con 0x560d6b063990 2023-10-05T15:46:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.123+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d6b054d50 con 0x560d6b063990 2023-10-05T15:46:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.124+0000 7fc0237fe700 1 -- 172.21.15.17:0/1031390298 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc03c00e8c0 con 0x560d6b063990 2023-10-05T15:46:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.124+0000 7fc05dc55b80 10 client.26714 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.124+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x560d6adc8c00 con 0x560d6b063990 2023-10-05T15:46:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.125+0000 7fc0237fe700 1 -- 172.21.15.17:0/1031390298 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03c032030 con 0x560d6b063990 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.126+0000 7fc0237fe700 1 -- 172.21.15.17:0/1031390298 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc03c0046c0 con 0x560d6b063990 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc05dc55b80 10 client.26714 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc05dc55b80 10 client.26714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc05dc55b80 20 client.26714 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b077910 0x560d6b079d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc05dc55b80 4 client.26714 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d6afaddb0 con 0x560d6b077910 2023-10-05T15:46:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.127+0000 7fc0437fe700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b077910 0x560d6b079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.128+0000 7fc0437fe700 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b077910 0x560d6b079d30 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83a5f72c7b778af2 server_cookie=2504cbe627ba4bc1 in_seq=0 out_seq=0 2023-10-05T15:46:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.128+0000 7fc0237fe700 10 client.26714 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.129+0000 7fc0237fe700 1 -- 172.21.15.17:0/1031390298 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560d6afaddb0 con 0x560d6b077910 2023-10-05T15:46:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.129+0000 7fc0237fe700 10 client.26714 handle_command_reply: tid=0 2023-10-05T15:46:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.129+0000 7fc05dc55b80 1 client.26714 shutdown 2023-10-05T15:46:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.130+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b063990 msgr2=0x560d6b073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.130+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b063990 0x560d6b073140 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009020 tx=0x7fc03c00b040 comp rx=0 tx=0).stop 2023-10-05T15:46:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 shutdown_connections 2023-10-05T15:46:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b077910 0x560d6b079d30 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b063990 0x560d6b073140 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b061ec0 0x560d6b06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1031390298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 >> 172.21.15.17:0/1031390298 conn(0x560d6afd6200 msgr2=0x560d6b05c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc0237fe700 0 client.26714 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 shutdown_connections 2023-10-05T15:46:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.131+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1031390298 wait complete. 2023-10-05T15:46:18.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.133+0000 7fc05dc55b80 20 client.26714 trim_cache size 0 max 16384 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.156+0000 7fc05dc55b80 1 Processor -- start 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.157+0000 7fc05dc55b80 1 -- start start 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b063990 0x560d6b0668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6ae358c0 con 0x560d6b063990 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6b062740 con 0x560d6b061ec0 2023-10-05T15:46:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6b066480 con 0x560d6b062fd0 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc0437fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc04899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc0437fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b073100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:40582/0 (socket says 172.21.15.17:40582) 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc04899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b069dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:58202/0 (socket says 172.21.15.17:58202) 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.158+0000 7fc0437fe700 1 -- 172.21.15.17:0/1923048848 learned_addr learned my addr 172.21.15.17:0/1923048848 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.159+0000 7fc04899c700 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b063990 0x560d6b0668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.159+0000 7fc04899c700 1 -- 172.21.15.17:0/1923048848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 msgr2=0x560d6b073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.159+0000 7fc04899c700 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.159+0000 7fc04899c700 1 -- 172.21.15.17:0/1923048848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b063990 msgr2=0x560d6b0668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.159+0000 7fc04899c700 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b063990 0x560d6b0668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.159+0000 7fc04899c700 1 -- 172.21.15.17:0/1923048848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d6ae061f0 con 0x560d6b061ec0 2023-10-05T15:46:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.160+0000 7fc04899c700 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b069dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009020 tx=0x7fc03c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2f3626f85eff3b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.160+0000 7fc02affd700 1 -- 172.21.15.17:0/1923048848 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c020800 con 0x560d6b061ec0 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.160+0000 7fc02affd700 1 -- 172.21.15.17:0/1923048848 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03c032070 con 0x560d6b061ec0 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.160+0000 7fc02affd700 1 -- 172.21.15.17:0/1923048848 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c017b30 con 0x560d6b061ec0 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1923048848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 msgr2=0x560d6b069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b069dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009020 tx=0x7fc03c000f40 comp rx=0 tx=0).stop 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1923048848 shutdown_connections 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b063990 0x560d6b0668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b069dd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/1923048848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b062fd0 0x560d6b073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.161+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1923048848 >> 172.21.15.17:0/1923048848 conn(0x560d6afd6200 msgr2=0x560d6b079920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.162+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1923048848 shutdown_connections 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.162+0000 7fc05dc55b80 1 -- 172.21.15.17:0/1923048848 wait complete. 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.162+0000 7fc05dc55b80 1 -- start start 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.163+0000 7fc05dc55b80 1 Processor -- start 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6b071e00 con 0x560d6b062fd0 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6b071f70 con 0x560d6b061ec0 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d6b072130 con 0x560d6b063990 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc05dc55b80 10 client.0 _ll_register_callbacks cb 0x7fc03c003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc04899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc04899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:58206/0 (socket says 172.21.15.17:58206) 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc04899c700 1 -- 172.21.15.17:0/264165216 learned_addr learned my addr 172.21.15.17:0/264165216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.164+0000 7fc04899c700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.165+0000 7fc0437fe700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.166+0000 7fc0437fe700 1 -- 172.21.15.17:0/264165216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 msgr2=0x560d6b0718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.166+0000 7fc0437fe700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b0718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.166+0000 7fc0437fe700 1 -- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 msgr2=0x560d6b070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.166+0000 7fc0437fe700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.166+0000 7fc0437fe700 1 -- 172.21.15.17:0/264165216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d6adc8c00 con 0x560d6b062fd0 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.167+0000 7fc0437fe700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b0708b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc038005f50 tx=0x7fc03800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ec0a961fa73017 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.167+0000 7fc0237fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.167+0000 7fc0237fe700 1 -- 172.21.15.17:0/264165216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03801d040 con 0x560d6b062fd0 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.167+0000 7fc0237fe700 1 -- 172.21.15.17:0/264165216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc0380056b0 con 0x560d6b062fd0 2023-10-05T15:46:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.167+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc03c00f040 con 0x560d6b062fd0 2023-10-05T15:46:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc0237fe700 1 -- 172.21.15.17:0/264165216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc038003a90 con 0x560d6b062fd0 2023-10-05T15:46:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc05dc55b80 10 client.16782 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x560d6adde250 con 0x560d6b062fd0 2023-10-05T15:46:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc0237fe700 1 -- 172.21.15.17:0/264165216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc03c00f040 con 0x560d6b062fd0 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc0237fe700 1 -- 172.21.15.17:0/264165216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc038004500 con 0x560d6b062fd0 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc05dc55b80 10 client.16782 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.168+0000 7fc05dc55b80 10 client.16782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.169+0000 7fc05dc55b80 20 client.16782 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.169+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b0cbcb0 0x560d6b0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.169+0000 7fc05dc55b80 4 client.16782 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.169+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d6afadad0 con 0x560d6b0cbcb0 2023-10-05T15:46:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.169+0000 7fc04899c700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b0cbcb0 0x560d6b0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.170+0000 7fc04899c700 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b0cbcb0 0x560d6b0ce0a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beaa9590e7db3fae server_cookie=5829c2925aa496e1 in_seq=0 out_seq=0 2023-10-05T15:46:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.170+0000 7fc0237fe700 10 client.16782 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.187+0000 7fc0237fe700 1 -- 172.21.15.17:0/264165216 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d6afadad0 con 0x560d6b0cbcb0 2023-10-05T15:46:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.187+0000 7fc0237fe700 10 client.16782 handle_command_reply: tid=0 2023-10-05T15:46:18.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 client.16782 shutdown 2023-10-05T15:46:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 msgr2=0x560d6b0708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b0708b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc038005f50 tx=0x7fc03800b260 comp rx=0 tx=0).stop 2023-10-05T15:46:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 shutdown_connections 2023-10-05T15:46:18.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x560d6b0cbcb0 0x560d6b0ce0a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560d6b063990 0x560d6b0718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560d6b061ec0 0x560d6b070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 --2- 172.21.15.17:0/264165216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560d6b062fd0 0x560d6b0708b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.188+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 >> 172.21.15.17:0/264165216 conn(0x560d6afd6200 msgr2=0x560d6b069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.189+0000 7fc0237fe700 0 client.16782 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.189+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 shutdown_connections 2023-10-05T15:46:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.189+0000 7fc05dc55b80 1 -- 172.21.15.17:0/264165216 wait complete. 2023-10-05T15:46:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 460.0 s, 652.8 tps, lat 152.959 ms stddev 51.861 2023-10-05T15:46:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.190+0000 7fc05dc55b80 20 client.16782 trim_cache size 0 max 16384 2023-10-05T15:46:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:46:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:46:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc02c0a15d0 msgr2=0x7fc02c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc02c0a15d0 0x7fc02c0a3a90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc034096120 tx=0x7fc034010000 comp rx=0 tx=0).stop 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 msgr2=0x7fc04419d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 0x7fc04419d270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc03400d950 tx=0x7fc03400dc60 comp rx=0 tx=0).stop 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 shutdown_connections 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc02c0a15d0 0x7fc02c0a3a90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc044100880 0x7fc04419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0440fed90 0x7fc04419d270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 --2- 172.21.15.17:0/3097591234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0440ffec0 0x7fc04419d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.191+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 >> 172.21.15.17:0/3097591234 conn(0x7fc0440fa690 msgr2=0x7fc0440fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.192+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 shutdown_connections 2023-10-05T15:46:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:18.192+0000 7fc04a3ff700 1 -- 172.21.15.17:0/3097591234 wait complete. 2023-10-05T15:46:18.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:17 smithi017 ceph-mon[129107]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.2 MiB/s wr, 552 op/s 2023-10-05T15:46:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:17 smithi167 ceph-mon[133366]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.2 MiB/s wr, 552 op/s 2023-10-05T15:46:18.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:17 smithi079 ceph-mon[132936]: pgmap v660: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.2 MiB/s wr, 552 op/s 2023-10-05T15:46:19.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:18 smithi017 ceph-mon[129107]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 643 op/s 2023-10-05T15:46:19.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:18 smithi167 ceph-mon[133366]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 643 op/s 2023-10-05T15:46:19.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:18 smithi079 ceph-mon[132936]: pgmap v661: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 643 op/s 2023-10-05T15:46:22.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:21 smithi017 ceph-mon[129107]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2023-10-05T15:46:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:21 smithi167 ceph-mon[133366]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2023-10-05T15:46:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:21 smithi079 ceph-mon[132936]: pgmap v662: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.8 MiB/s wr, 660 op/s 2023-10-05T15:46:23.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 465.0 s, 615.6 tps, lat 161.951 ms stddev 52.119 2023-10-05T15:46:24.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:23 smithi017 ceph-mon[129107]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.2 MiB/s wr, 573 op/s 2023-10-05T15:46:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:23 smithi167 ceph-mon[133366]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.2 MiB/s wr, 573 op/s 2023-10-05T15:46:24.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:23 smithi079 ceph-mon[132936]: pgmap v663: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.2 MiB/s wr, 573 op/s 2023-10-05T15:46:25.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:24 smithi167 ceph-mon[133366]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 744 op/s 2023-10-05T15:46:25.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:24 smithi079 ceph-mon[132936]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 744 op/s 2023-10-05T15:46:25.451 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:24 smithi017 ceph-mon[129107]: pgmap v664: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 744 op/s 2023-10-05T15:46:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 470.0 s, 579.5 tps, lat 172.736 ms stddev 59.215 2023-10-05T15:46:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:27 smithi017 ceph-mon[129107]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 549 op/s 2023-10-05T15:46:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:27 smithi167 ceph-mon[133366]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 549 op/s 2023-10-05T15:46:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:27 smithi079 ceph-mon[132936]: pgmap v665: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 549 op/s 2023-10-05T15:46:30.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:29 smithi017 ceph-mon[129107]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.3 MiB/s wr, 639 op/s 2023-10-05T15:46:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:29 smithi167 ceph-mon[133366]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.3 MiB/s wr, 639 op/s 2023-10-05T15:46:30.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:29 smithi079 ceph-mon[132936]: pgmap v666: 129 pgs: 129 active+clean; 1.5 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 9.3 MiB/s wr, 639 op/s 2023-10-05T15:46:31.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:30 smithi017 ceph-mon[129107]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.3 MiB/s wr, 672 op/s 2023-10-05T15:46:31.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:30 smithi167 ceph-mon[133366]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.3 MiB/s wr, 672 op/s 2023-10-05T15:46:31.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:30 smithi079 ceph-mon[132936]: pgmap v667: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.3 MiB/s wr, 672 op/s 2023-10-05T15:46:31.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.497+0000 7fa23abff700 1 -- 172.21.15.17:0/770990622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234077470 msgr2=0x7fa234077cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.497+0000 7fa23abff700 1 --2- 172.21.15.17:0/770990622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234077470 0x7fa234077cf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b0a0 tx=0x7fa22c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 -- 172.21.15.17:0/770990622 shutdown_connections 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 --2- 172.21.15.17:0/770990622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234077470 0x7fa234077cf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 --2- 172.21.15.17:0/770990622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa234075870 0x7fa234075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 --2- 172.21.15.17:0/770990622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234076ab0 0x7fa234076f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 -- 172.21.15.17:0/770990622 >> 172.21.15.17:0/770990622 conn(0x7fa2340fe6a0 msgr2=0x7fa234100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 -- 172.21.15.17:0/770990622 shutdown_connections 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.498+0000 7fa23abff700 1 -- 172.21.15.17:0/770990622 wait complete. 2023-10-05T15:46:31.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.499+0000 7fa23abff700 1 Processor -- start 2023-10-05T15:46:31.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.499+0000 7fa23abff700 1 -- start start 2023-10-05T15:46:31.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23abff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 0x7fa23419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23abff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234076ab0 0x7fa23419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23abff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa234077470 0x7fa23419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23abff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23419ec50 con 0x7fa234076ab0 2023-10-05T15:46:31.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23abff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23419edc0 con 0x7fa234075870 2023-10-05T15:46:31.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23abff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23419ef80 con 0x7fa234077470 2023-10-05T15:46:31.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23899b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 0x7fa23419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23899b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 0x7fa23419d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51740/0 (socket says 172.21.15.17:51740) 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa23899b700 1 -- 172.21.15.17:0/3843149315 learned_addr learned my addr 172.21.15.17:0/3843149315 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.500+0000 7fa233fff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234076ab0 0x7fa23419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.501+0000 7fa23919c700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa234077470 0x7fa23419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.501+0000 7fa23899b700 1 -- 172.21.15.17:0/3843149315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa234077470 msgr2=0x7fa23419e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.501+0000 7fa23899b700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa234077470 0x7fa23419e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.501+0000 7fa23899b700 1 -- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234076ab0 msgr2=0x7fa23419d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.501+0000 7fa23899b700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234076ab0 0x7fa23419d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.501+0000 7fa23899b700 1 -- 172.21.15.17:0/3843149315 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c009d00 con 0x7fa234075870 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.502+0000 7fa23899b700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 0x7fa23419d230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa22000b550 tx=0x7fa22000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.502+0000 7fa231ffb700 1 -- 172.21.15.17:0/3843149315 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220011830 con 0x7fa234075870 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.502+0000 7fa231ffb700 1 -- 172.21.15.17:0/3843149315 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa220011e20 con 0x7fa234075870 2023-10-05T15:46:31.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.502+0000 7fa231ffb700 1 -- 172.21.15.17:0/3843149315 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220010cf0 con 0x7fa234075870 2023-10-05T15:46:31.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.502+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23419f260 con 0x7fa234075870 2023-10-05T15:46:31.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.502+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2341a5a20 con 0x7fa234075870 2023-10-05T15:46:31.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.508+0000 7fa231ffb700 1 -- 172.21.15.17:0/3843149315 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa220011990 con 0x7fa234075870 2023-10-05T15:46:31.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.509+0000 7fa24e4a4b80 1 Processor -- start 2023-10-05T15:46:31.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.509+0000 7fa24e4a4b80 1 -- start start 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.511+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 0x56430f4712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.511+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f472450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.511+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f479220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.511+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f3d9400 con 0x56430f471fd0 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.511+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f3cabc0 con 0x56430f472990 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.511+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f3c84e0 con 0x56430f470ec0 2023-10-05T15:46:31.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 0x56430f4712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 0x56430f4712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:47348/0 (socket says 172.21.15.17:47348) 2023-10-05T15:46:31.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 -- 172.21.15.17:0/178432531 learned_addr learned my addr 172.21.15.17:0/178432531 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23899b700 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f472450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa233fff700 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f479220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 -- 172.21.15.17:0/178432531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 msgr2=0x56430f479220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f479220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 -- 172.21.15.17:0/178432531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 msgr2=0x56430f472450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f472450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.512+0000 7fa23919c700 1 -- 172.21.15.17:0/178432531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56430f1eed80 con 0x56430f470ec0 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.513+0000 7fa23919c700 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 0x56430f4712e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b0a0 tx=0x7fa22c007c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fff31cab658b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.513+0000 7fa21effd700 1 -- 172.21.15.17:0/178432531 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00e040 con 0x56430f470ec0 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.513+0000 7fa21effd700 1 -- 172.21.15.17:0/178432531 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa22c009450 con 0x56430f470ec0 2023-10-05T15:46:31.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.513+0000 7fa21effd700 1 -- 172.21.15.17:0/178432531 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c01c6a0 con 0x56430f470ec0 2023-10-05T15:46:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.513+0000 7fa231ffb700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2240a15d0 0x7fa2240a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa231ffb700 1 -- 172.21.15.17:0/3843149315 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa2200cc6b0 con 0x7fa234075870 2023-10-05T15:46:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/178432531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 msgr2=0x56430f4712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 0x56430f4712e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b0a0 tx=0x7fa22c007c80 comp rx=0 tx=0).stop 2023-10-05T15:46:31.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/178432531 shutdown_connections 2023-10-05T15:46:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f479220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f470ec0 0x56430f4712e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/178432531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f472450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/178432531 >> 172.21.15.17:0/178432531 conn(0x56430f3e5200 msgr2=0x56430f46bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa23899b700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2240a15d0 0x7fa2240a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.514+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/178432531 shutdown_connections 2023-10-05T15:46:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.515+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/178432531 wait complete. 2023-10-05T15:46:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.515+0000 7fa23899b700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2240a15d0 0x7fa2240a3a90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa220000c00 tx=0x7fa220011f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.515+0000 7fa24e4a4b80 1 -- start start 2023-10-05T15:46:31.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 Processor -- start 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f470ec0 0x56430f47abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f482170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f3c3dd0 con 0x56430f470ec0 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f3606b0 con 0x56430f472990 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f360350 con 0x56430f471fd0 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.516+0000 7fa24e4a4b80 10 client.0 _ll_register_callbacks cb 0x56430f1bd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.517+0000 7fa23919c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f482170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.517+0000 7fa23919c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f482170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51754/0 (socket says 172.21.15.17:51754) 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.517+0000 7fa23919c700 1 -- 172.21.15.17:0/3264770081 learned_addr learned my addr 172.21.15.17:0/3264770081 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:31.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.517+0000 7fa233fff700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.517+0000 7fa23919c700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f470ec0 0x56430f47abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa233fff700 1 -- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 msgr2=0x56430f482170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa233fff700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f482170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa233fff700 1 -- 172.21.15.17:0/3264770081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f470ec0 msgr2=0x56430f47abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa233fff700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f470ec0 0x56430f47abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa233fff700 1 -- 172.21.15.17:0/3264770081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa234078720 con 0x56430f471fd0 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa233fff700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47b130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa228012700 tx=0x7fa228012a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc97999c17a76dd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa213fff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.518+0000 7fa213fff700 1 -- 172.21.15.17:0/3264770081 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228004520 con 0x56430f471fd0 2023-10-05T15:46:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.519+0000 7fa213fff700 1 -- 172.21.15.17:0/3264770081 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa228004830 con 0x56430f471fd0 2023-10-05T15:46:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.519+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56430f463d50 con 0x56430f471fd0 2023-10-05T15:46:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.519+0000 7fa213fff700 1 -- 172.21.15.17:0/3264770081 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2280049f0 con 0x56430f471fd0 2023-10-05T15:46:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.519+0000 7fa24e4a4b80 10 client.26698 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.519+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56430f1d7c00 con 0x56430f471fd0 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa213fff700 1 -- 172.21.15.17:0/3264770081 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56430f463d50 con 0x56430f471fd0 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa213fff700 1 -- 172.21.15.17:0/3264770081 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa2280266b0 con 0x56430f471fd0 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa24e4a4b80 10 client.26698 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa24e4a4b80 10 client.26698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa24e4a4b80 20 client.26698 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f486aa0 0x56430f488ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa24e4a4b80 4 client.26698 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56430f3bcdb0 con 0x56430f486aa0 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.520+0000 7fa23919c700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f486aa0 0x56430f488ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.521+0000 7fa23919c700 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f486aa0 0x56430f488ec0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=decb00dfc82455c5 server_cookie=d4e70a8b4531d9b3 in_seq=0 out_seq=0 2023-10-05T15:46:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.521+0000 7fa213fff700 10 client.26698 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.522+0000 7fa213fff700 1 -- 172.21.15.17:0/3264770081 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56430f3bcdb0 con 0x56430f486aa0 2023-10-05T15:46:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.522+0000 7fa213fff700 10 client.26698 handle_command_reply: tid=0 2023-10-05T15:46:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.522+0000 7fa24e4a4b80 1 client.26698 shutdown 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 msgr2=0x56430f47b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47b130 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa228012700 tx=0x7fa228012a10 comp rx=0 tx=0).stop 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 shutdown_connections 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f486aa0 0x56430f488ec0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f472990 0x56430f482170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f470ec0 0x56430f47abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3264770081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47b130 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 >> 172.21.15.17:0/3264770081 conn(0x56430f3e5200 msgr2=0x56430f46b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa213fff700 0 client.26698 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.523+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 shutdown_connections 2023-10-05T15:46:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.524+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3264770081 wait complete. 2023-10-05T15:46:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.524+0000 7fa24e4a4b80 20 client.26698 trim_cache size 0 max 16384 2023-10-05T15:46:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.554+0000 7fa24e4a4b80 1 Processor -- start 2023-10-05T15:46:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 -- start start 2023-10-05T15:46:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f4758e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f475e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f472990 0x56430f482130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f2448c0 con 0x56430f471fd0 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f46ca00 con 0x56430f470ec0 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.555+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f483e60 con 0x56430f472990 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f4758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa233fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f475e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f4758e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51764/0 (socket says 172.21.15.17:51764) 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 -- 172.21.15.17:0/3463096329 learned_addr learned my addr 172.21.15.17:0/3463096329 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f472990 0x56430f482130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 -- 172.21.15.17:0/3463096329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f472990 msgr2=0x56430f482130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f472990 0x56430f482130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 -- 172.21.15.17:0/3463096329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 msgr2=0x56430f475e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f475e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa23919c700 1 -- 172.21.15.17:0/3463096329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56430f2151f0 con 0x56430f470ec0 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.556+0000 7fa233fff700 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f475e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.557+0000 7fa23919c700 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f4758e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b070 tx=0x7fa22c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f8acdb7c59921 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.557+0000 7fa21f7fe700 1 -- 172.21.15.17:0/3463096329 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00e040 con 0x56430f470ec0 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.557+0000 7fa21f7fe700 1 -- 172.21.15.17:0/3463096329 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa22c003c90 con 0x56430f470ec0 2023-10-05T15:46:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.557+0000 7fa21f7fe700 1 -- 172.21.15.17:0/3463096329 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c031ac0 con 0x56430f470ec0 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3463096329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 msgr2=0x56430f4758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f4758e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b070 tx=0x7fa22c000f40 comp rx=0 tx=0).stop 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3463096329 shutdown_connections 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f472990 0x56430f482130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f4758e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3463096329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f471fd0 0x56430f475e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3463096329 >> 172.21.15.17:0/3463096329 conn(0x56430f3e5200 msgr2=0x56430f478db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.558+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3463096329 shutdown_connections 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.559+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3463096329 wait complete. 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.559+0000 7fa24e4a4b80 1 -- start start 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.559+0000 7fa24e4a4b80 1 Processor -- start 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.560+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f47d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.560+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.560+0000 7fa24e4a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f472990 0x56430f480dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.560+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f481310 con 0x56430f472990 2023-10-05T15:46:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.560+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f481480 con 0x56430f470ec0 2023-10-05T15:46:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.560+0000 7fa24e4a4b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56430f4815f0 con 0x56430f471fd0 2023-10-05T15:46:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.561+0000 7fa24e4a4b80 10 client.0 _ll_register_callbacks cb 0x7fa228009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.561+0000 7fa23919c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f47d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.561+0000 7fa233fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.561+0000 7fa233fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:47390/0 (socket says 172.21.15.17:47390) 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.561+0000 7fa233fff700 1 -- 172.21.15.17:0/3211031324 learned_addr learned my addr 172.21.15.17:0/3211031324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.562+0000 7fa23919c700 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f472990 0x56430f480dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.562+0000 7fa233fff700 1 -- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 msgr2=0x56430f47d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.562+0000 7fa233fff700 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f47d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.562+0000 7fa233fff700 1 -- 172.21.15.17:0/3211031324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f472990 msgr2=0x56430f480dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:31.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.562+0000 7fa233fff700 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f472990 0x56430f480dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.562+0000 7fa233fff700 1 -- 172.21.15.17:0/3211031324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56430f1d7c00 con 0x56430f471fd0 2023-10-05T15:46:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.563+0000 7fa233fff700 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47ddb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa228009ed0 tx=0x7fa228026750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af275adbc4e19873 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.563+0000 7fa213fff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.563+0000 7fa213fff700 1 -- 172.21.15.17:0/3211031324 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228003a90 con 0x56430f471fd0 2023-10-05T15:46:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.563+0000 7fa213fff700 1 -- 172.21.15.17:0/3211031324 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa228000e40 con 0x56430f471fd0 2023-10-05T15:46:31.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.564+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56430f3bcad0 con 0x56430f471fd0 2023-10-05T15:46:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.564+0000 7fa213fff700 1 -- 172.21.15.17:0/3211031324 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa228005ce0 con 0x56430f471fd0 2023-10-05T15:46:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.564+0000 7fa24e4a4b80 10 client.26704 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.564+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7fa22c02c040 con 0x56430f471fd0 2023-10-05T15:46:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa213fff700 1 -- 172.21.15.17:0/3211031324 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56430f3bcad0 con 0x56430f471fd0 2023-10-05T15:46:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa213fff700 1 -- 172.21.15.17:0/3211031324 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa228037070 con 0x56430f471fd0 2023-10-05T15:46:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa24e4a4b80 10 client.26704 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa24e4a4b80 10 client.26704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa24e4a4b80 20 client.26704 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f4fd120 0x56430f4ff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa24e4a4b80 4 client.26704 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:46:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.565+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56430f20ff10 con 0x56430f4fd120 2023-10-05T15:46:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.566+0000 7fa23919c700 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f4fd120 0x56430f4ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.566+0000 7fa23919c700 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f4fd120 0x56430f4ff540 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43e2e64fbb728db6 server_cookie=5ef6982823261d37 in_seq=0 out_seq=0 2023-10-05T15:46:31.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.566+0000 7fa213fff700 10 client.26704 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:31.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.585+0000 7fa213fff700 1 -- 172.21.15.17:0/3211031324 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56430f20ff10 con 0x56430f4fd120 2023-10-05T15:46:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.585+0000 7fa213fff700 10 client.26704 handle_command_reply: tid=0 2023-10-05T15:46:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.585+0000 7fa24e4a4b80 1 client.26704 shutdown 2023-10-05T15:46:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 msgr2=0x56430f47ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47ddb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa228009ed0 tx=0x7fa228026750 comp rx=0 tx=0).stop 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 shutdown_connections 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56430f4fd120 0x56430f4ff540 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa213fff700 0 client.26704 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56430f472990 0x56430f480dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56430f470ec0 0x56430f47d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 --2- 172.21.15.17:0/3211031324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56430f471fd0 0x56430f47ddb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.586+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 >> 172.21.15.17:0/3211031324 conn(0x56430f3e5200 msgr2=0x56430f4758e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.587+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 shutdown_connections 2023-10-05T15:46:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.587+0000 7fa24e4a4b80 1 -- 172.21.15.17:0/3211031324 wait complete. 2023-10-05T15:46:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.588+0000 7fa24e4a4b80 20 client.26704 trim_cache size 0 max 16384 2023-10-05T15:46:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:46:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:46:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:46:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:46:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.589+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2240a15d0 msgr2=0x7fa2240a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2240a15d0 0x7fa2240a3a90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa220000c00 tx=0x7fa220011f90 comp rx=0 tx=0).stop 2023-10-05T15:46:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 msgr2=0x7fa23419d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 0x7fa23419d230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa22000b550 tx=0x7fa22000b860 comp rx=0 tx=0).stop 2023-10-05T15:46:31.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 shutdown_connections 2023-10-05T15:46:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa2240a15d0 0x7fa2240a3a90 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa220000c00 tx=0x7fa220011f90 comp rx=0 tx=0).stop 2023-10-05T15:46:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa234077470 0x7fa23419e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa234075870 0x7fa23419d230 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa22000b550 tx=0x7fa22000b860 comp rx=0 tx=0).stop 2023-10-05T15:46:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 --2- 172.21.15.17:0/3843149315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa234076ab0 0x7fa23419d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.590+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 >> 172.21.15.17:0/3843149315 conn(0x7fa2340fe6a0 msgr2=0x7fa234100350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.592+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 shutdown_connections 2023-10-05T15:46:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:31.592+0000 7fa23abff700 1 -- 172.21.15.17:0/3843149315 wait complete. 2023-10-05T15:46:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 475.0 s, 561.9 tps, lat 178.785 ms stddev 91.364 2023-10-05T15:46:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:33 smithi017 ceph-mon[129107]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 8.0 MiB/s wr, 572 op/s 2023-10-05T15:46:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:33 smithi167 ceph-mon[133366]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 8.0 MiB/s wr, 572 op/s 2023-10-05T15:46:34.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:33 smithi079 ceph-mon[132936]: pgmap v668: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 8.0 MiB/s wr, 572 op/s 2023-10-05T15:46:36.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:35 smithi017 ceph-mon[129107]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 10 MiB/s wr, 749 op/s 2023-10-05T15:46:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:35 smithi167 ceph-mon[133366]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 10 MiB/s wr, 749 op/s 2023-10-05T15:46:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:35 smithi079 ceph-mon[132936]: pgmap v669: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 10 MiB/s wr, 749 op/s 2023-10-05T15:46:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 480.0 s, 558.8 tps, lat 177.216 ms stddev 78.517 2023-10-05T15:46:38.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:37 smithi017 ceph-mon[129107]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.2 MiB/s wr, 550 op/s 2023-10-05T15:46:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:37 smithi167 ceph-mon[133366]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.2 MiB/s wr, 550 op/s 2023-10-05T15:46:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:37 smithi079 ceph-mon[132936]: pgmap v670: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.2 MiB/s wr, 550 op/s 2023-10-05T15:46:39.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:46:40.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:39 smithi017 ceph-mon[129107]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.0 MiB/s wr, 616 op/s 2023-10-05T15:46:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:39 smithi167 ceph-mon[133366]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.0 MiB/s wr, 616 op/s 2023-10-05T15:46:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:39 smithi079 ceph-mon[132936]: pgmap v671: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.0 MiB/s wr, 616 op/s 2023-10-05T15:46:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 -- 172.21.15.17:0/4156255026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac0ff790 msgr2=0x7fb2ac0ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/4156255026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac0ff790 0x7fb2ac0ffbb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b0a0 tx=0x7fb2a400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 -- 172.21.15.17:0/4156255026 shutdown_connections 2023-10-05T15:46:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/4156255026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/4156255026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac0ff790 0x7fb2ac0ffbb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/4156255026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2ac1000f0 0x7fb2ac100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 -- 172.21.15.17:0/4156255026 >> 172.21.15.17:0/4156255026 conn(0x7fb2ac0fb330 msgr2=0x7fb2ac0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 -- 172.21.15.17:0/4156255026 shutdown_connections 2023-10-05T15:46:41.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.930+0000 7fb2b35ff700 1 -- 172.21.15.17:0/4156255026 wait complete. 2023-10-05T15:46:41.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.931+0000 7fb2b35ff700 1 Processor -- start 2023-10-05T15:46:41.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.931+0000 7fb2b35ff700 1 -- start start 2023-10-05T15:46:41.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.932+0000 7fb2b35ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2ac0ff790 0x7fb2ac19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.932+0000 7fb2b35ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac1000f0 0x7fb2ac19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.932+0000 7fb2b35ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac1a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.932+0000 7fb2b35ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1a4dd0 con 0x7fb2ac100ab0 2023-10-05T15:46:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.932+0000 7fb2b35ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1a4f10 con 0x7fb2ac0ff790 2023-10-05T15:46:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.932+0000 7fb2b35ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1a50a0 con 0x7fb2ac1000f0 2023-10-05T15:46:41.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b1b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac1a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b1b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac1a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57298/0 (socket says 172.21.15.17:57298) 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b1b9c700 1 -- 172.21.15.17:0/2100652049 learned_addr learned my addr 172.21.15.17:0/2100652049 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac1000f0 0x7fb2ac19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b139b700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2ac0ff790 0x7fb2ac19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/2100652049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2ac0ff790 msgr2=0x7fb2ac19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2ac0ff790 0x7fb2ac19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 msgr2=0x7fb2ac1a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:41.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac1a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.933+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/2100652049 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009d00 con 0x7fb2ac1000f0 2023-10-05T15:46:41.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2b1b9c700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac1a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:46:41.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac1000f0 0x7fb2ac19d790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800e9f0 tx=0x7fb2a800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:41.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2a27fc700 1 -- 172.21.15.17:0/2100652049 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800c9c0 con 0x7fb2ac1000f0 2023-10-05T15:46:41.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac1a5380 con 0x7fb2ac1000f0 2023-10-05T15:46:41.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac1a58e0 con 0x7fb2ac1000f0 2023-10-05T15:46:41.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2a27fc700 1 -- 172.21.15.17:0/2100652049 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a8010430 con 0x7fb2ac1000f0 2023-10-05T15:46:41.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.934+0000 7fb2a27fc700 1 -- 172.21.15.17:0/2100652049 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8018680 con 0x7fb2ac1000f0 2023-10-05T15:46:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.941+0000 7fb2a27fc700 1 -- 172.21.15.17:0/2100652049 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb2a800cb20 con 0x7fb2ac1000f0 2023-10-05T15:46:41.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.942+0000 7fb2c6ebeb80 1 Processor -- start 2023-10-05T15:46:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 -- start start 2023-10-05T15:46:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633260 0x557e43633680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633bc0 0x557e43634480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e43634ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4359b460 con 0x557e43634a60 2023-10-05T15:46:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4358cc20 con 0x557e43633bc0 2023-10-05T15:46:41.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.943+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4358a540 con 0x557e43633260 2023-10-05T15:46:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.944+0000 7fb2b0b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e43634ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.944+0000 7fb2b1b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633260 0x557e43633680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.944+0000 7fb2b0b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e43634ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57314/0 (socket says 172.21.15.17:57314) 2023-10-05T15:46:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.944+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/1638080468 learned_addr learned my addr 172.21.15.17:0/1638080468 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.944+0000 7fb2b139b700 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633bc0 0x557e43634480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b1b9c700 1 -- 172.21.15.17:0/1638080468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633bc0 msgr2=0x557e43634480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b1b9c700 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633bc0 0x557e43634480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b1b9c700 1 -- 172.21.15.17:0/1638080468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 msgr2=0x557e43634ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b1b9c700 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e43634ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b1b9c700 1 -- 172.21.15.17:0/1638080468 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e433b0de0 con 0x557e43633260 2023-10-05T15:46:41.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e43634ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:46:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2a27fc700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2980a1580 0x7fb2980a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2b1b9c700 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633260 0x557e43633680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb29c010480 tx=0x7fb29c010790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a880cfbf1f8d843e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:41.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.945+0000 7fb2a27fc700 1 -- 172.21.15.17:0/2100652049 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb2a8014070 con 0x7fb2ac1000f0 2023-10-05T15:46:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.948+0000 7fb2977fe700 1 -- 172.21.15.17:0/1638080468 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c01c680 con 0x557e43633260 2023-10-05T15:46:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.949+0000 7fb2977fe700 1 -- 172.21.15.17:0/1638080468 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb29c015070 con 0x557e43633260 2023-10-05T15:46:41.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.949+0000 7fb2977fe700 1 -- 172.21.15.17:0/1638080468 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c01a690 con 0x557e43633260 2023-10-05T15:46:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.949+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1638080468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633260 msgr2=0x557e43633680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.949+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633260 0x557e43633680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb29c010480 tx=0x7fb29c010790 comp rx=0 tx=0).stop 2023-10-05T15:46:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.950+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1638080468 shutdown_connections 2023-10-05T15:46:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.950+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e43634ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.950+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633260 0x557e43633680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.950+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1638080468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633bc0 0x557e43634480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.950+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1638080468 >> 172.21.15.17:0/1638080468 conn(0x557e435a7260 msgr2=0x557e4362e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.952+0000 7fb2b139b700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2980a1580 0x7fb2980a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.953+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1638080468 shutdown_connections 2023-10-05T15:46:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.953+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1638080468 wait complete. 2023-10-05T15:46:41.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.953+0000 7fb2b139b700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2980a1580 0x7fb2980a3a40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009fd0 tx=0x7fb2a400b740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.954+0000 7fb2c6ebeb80 1 -- start start 2023-10-05T15:46:41.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.954+0000 7fb2c6ebeb80 1 Processor -- start 2023-10-05T15:46:41.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4364e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633bc0 0x557e4364e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43634a60 0x557e43655610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e43585e30 con 0x557e43633bc0 2023-10-05T15:46:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e43522710 con 0x557e43633260 2023-10-05T15:46:41.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e435223b0 con 0x557e43634a60 2023-10-05T15:46:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2c6ebeb80 10 client.0 _ll_register_callbacks cb 0x557e4337f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2b139b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4364e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2b139b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4364e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:58014/0 (socket says 172.21.15.17:58014) 2023-10-05T15:46:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.955+0000 7fb2b139b700 1 -- 172.21.15.17:0/1859339886 learned_addr learned my addr 172.21.15.17:0/1859339886 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:41.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.956+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633bc0 0x557e4364e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.956+0000 7fb2b139b700 1 -- 172.21.15.17:0/1859339886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43634a60 msgr2=0x557e43655610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:46:41.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.956+0000 7fb2b139b700 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43634a60 0x557e43655610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.956+0000 7fb2b139b700 1 -- 172.21.15.17:0/1859339886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633bc0 msgr2=0x557e4364e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:41.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.956+0000 7fb2b139b700 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633bc0 0x557e4364e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.956+0000 7fb2b139b700 1 -- 172.21.15.17:0/1859339886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c00bce0 con 0x557e43633260 2023-10-05T15:46:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.957+0000 7fb2b139b700 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4364e090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009bf0 tx=0x7fb2a40099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f980f66f1f301d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.957+0000 7fb294ff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:46:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.957+0000 7fb294ff9700 1 -- 172.21.15.17:0/1859339886 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400e040 con 0x557e43633260 2023-10-05T15:46:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.957+0000 7fb294ff9700 1 -- 172.21.15.17:0/1859339886 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb2a4005040 con 0x557e43633260 2023-10-05T15:46:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.957+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e43625f10 con 0x557e43633260 2023-10-05T15:46:41.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.958+0000 7fb294ff9700 1 -- 172.21.15.17:0/1859339886 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a4005200 con 0x557e43633260 2023-10-05T15:46:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.958+0000 7fb2c6ebeb80 10 client.26747 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:41.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.958+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557e43399c60 con 0x557e43633260 2023-10-05T15:46:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.958+0000 7fb294ff9700 1 -- 172.21.15.17:0/1859339886 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557e43625f10 con 0x557e43633260 2023-10-05T15:46:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb294ff9700 1 -- 172.21.15.17:0/1859339886 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb2a402e020 con 0x557e43633260 2023-10-05T15:46:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb2c6ebeb80 10 client.26747 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb2c6ebeb80 10 client.26747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb2c6ebeb80 20 client.26747 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e43659ee0 0x557e4365c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb2c6ebeb80 4 client.26747 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.959+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e4357ee10 con 0x557e43659ee0 2023-10-05T15:46:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.960+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e43659ee0 0x557e4365c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.961+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e43659ee0 0x557e4365c300 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d4f6af69cccdee server_cookie=eb6640e95eca0398 in_seq=0 out_seq=0 2023-10-05T15:46:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.961+0000 7fb294ff9700 10 client.26747 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.961+0000 7fb294ff9700 1 -- 172.21.15.17:0/1859339886 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e4357ee10 con 0x557e43659ee0 2023-10-05T15:46:41.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.961+0000 7fb294ff9700 10 client.26747 handle_command_reply: tid=0 2023-10-05T15:46:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 client.26747 shutdown 2023-10-05T15:46:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 msgr2=0x557e4364e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4364e090 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009bf0 tx=0x7fb2a40099e0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 shutdown_connections 2023-10-05T15:46:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e43659ee0 0x557e4365c300 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43634a60 0x557e43655610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4364e090 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/1859339886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633bc0 0x557e4364e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 >> 172.21.15.17:0/1859339886 conn(0x557e435a7260 msgr2=0x557e4362df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.962+0000 7fb294ff9700 0 client.26747 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.963+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 shutdown_connections 2023-10-05T15:46:41.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.963+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/1859339886 wait complete. 2023-10-05T15:46:41.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.963+0000 7fb2c6ebeb80 20 client.26747 trim_cache size 0 max 16384 2023-10-05T15:46:41.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.988+0000 7fb2c6ebeb80 1 Processor -- start 2023-10-05T15:46:41.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.988+0000 7fb2c6ebeb80 1 -- start start 2023-10-05T15:46:41.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4362df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e436555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e4363ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e43406920 con 0x557e43634a60 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e43628540 con 0x557e43633260 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e4362d240 con 0x557e43633bc0 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2b0b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e436555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2b0b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e436555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:41394/0 (socket says 172.21.15.17:41394) 2023-10-05T15:46:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.989+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/782307647 learned_addr learned my addr 172.21.15.17:0/782307647 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b1b9c700 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e4363ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b139b700 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4362df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/782307647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 msgr2=0x557e4362df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4362df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/782307647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 msgr2=0x557e4363ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e4363ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.990+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/782307647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e433d7250 con 0x557e43633bc0 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.991+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e436555a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800e9c0 tx=0x7fb2a80cd100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feec5908a1e52f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.991+0000 7fb297fff700 1 -- 172.21.15.17:0/782307647 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a809a6d0 con 0x557e43633bc0 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.991+0000 7fb297fff700 1 -- 172.21.15.17:0/782307647 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a8099fd0 con 0x557e43633bc0 2023-10-05T15:46:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.991+0000 7fb297fff700 1 -- 172.21.15.17:0/782307647 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8098370 con 0x557e43633bc0 2023-10-05T15:46:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/782307647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 msgr2=0x557e436555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e436555a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800e9c0 tx=0x7fb2a80cd100 comp rx=0 tx=0).stop 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/782307647 shutdown_connections 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43634a60 0x557e4363ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43633260 0x557e4362df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/782307647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e436555a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/782307647 >> 172.21.15.17:0/782307647 conn(0x557e435a7260 msgr2=0x557e4364cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/782307647 shutdown_connections 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.992+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/782307647 wait complete. 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.993+0000 7fb2c6ebeb80 1 -- start start 2023-10-05T15:46:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.993+0000 7fb2c6ebeb80 1 Processor -- start 2023-10-05T15:46:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 0x557e436553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e43651e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43634a60 0x557e436523c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e43652990 con 0x557e43633260 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e43652b00 con 0x557e43634a60 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e436adda0 con 0x557e43633bc0 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.994+0000 7fb2c6ebeb80 10 client.0 _ll_register_callbacks cb 0x557e4337f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b139b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 0x557e436553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b139b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 0x557e436553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57326/0 (socket says 172.21.15.17:57326) 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b139b700 1 -- 172.21.15.17:0/2651644710 learned_addr learned my addr 172.21.15.17:0/2651644710 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:41.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e43651e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43634a60 msgr2=0x557e436523c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43634a60 0x557e436523c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/2651644710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 msgr2=0x557e436553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 0x557e436553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b0b9a700 1 -- 172.21.15.17:0/2651644710 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac1a58e0 con 0x557e43633bc0 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.995+0000 7fb2b139b700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 0x557e436553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.996+0000 7fb2b0b9a700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e43651e80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x557e4362aa40 tx=0x7fb2a8005d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a44699df9e8fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.996+0000 7fb294ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.996+0000 7fb294ff9700 1 -- 172.21.15.17:0/2651644710 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a809e120 con 0x557e43633bc0 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.996+0000 7fb294ff9700 1 -- 172.21.15.17:0/2651644710 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb2a809a230 con 0x557e43633bc0 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.996+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb29c015070 con 0x557e43633bc0 2023-10-05T15:46:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.997+0000 7fb294ff9700 1 -- 172.21.15.17:0/2651644710 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a809a3f0 con 0x557e43633bc0 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.997+0000 7fb2c6ebeb80 10 client.26719 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.997+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557e433af2b0 con 0x557e43633bc0 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.997+0000 7fb294ff9700 1 -- 172.21.15.17:0/2651644710 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a807c020 con 0x557e43633bc0 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb294ff9700 1 -- 172.21.15.17:0/2651644710 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb2a80995e0 con 0x557e43633bc0 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb2c6ebeb80 10 client.26719 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb2c6ebeb80 10 client.26719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb2c6ebeb80 20 client.26719 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e436af2f0 0x557e436b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb2c6ebeb80 4 client.26719 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:46:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.998+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557e4357eb30 con 0x557e436af2f0 2023-10-05T15:46:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.999+0000 7fb2b139b700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e436af2f0 0x557e436b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.999+0000 7fb2b139b700 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e436af2f0 0x557e436b1710 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a030d7824c688315 server_cookie=ba0519576173e5cb in_seq=0 out_seq=0 2023-10-05T15:46:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:41.999+0000 7fb294ff9700 10 client.26719 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb294ff9700 1 -- 172.21.15.17:0/2651644710 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557e4357eb30 con 0x557e436af2f0 2023-10-05T15:46:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb294ff9700 10 client.26719 handle_command_reply: tid=0 2023-10-05T15:46:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 client.26719 shutdown 2023-10-05T15:46:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 msgr2=0x557e43651e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e43651e80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x557e4362aa40 tx=0x7fb2a8005d00 comp rx=0 tx=0).stop 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 shutdown_connections 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557e436af2f0 0x557e436b1710 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557e43634a60 0x557e436523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb294ff9700 0 client.26719 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557e43633260 0x557e436553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 --2- 172.21.15.17:0/2651644710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557e43633bc0 0x557e43651e80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 >> 172.21.15.17:0/2651644710 conn(0x557e435a7260 msgr2=0x557e4364cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 shutdown_connections 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.000+0000 7fb2c6ebeb80 1 -- 172.21.15.17:0/2651644710 wait complete. 2023-10-05T15:46:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.001+0000 7fb2c6ebeb80 20 client.26719 trim_cache size 0 max 16384 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:46:42.004 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:46:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2980a1580 msgr2=0x7fb2980a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2980a1580 0x7fb2980a3a40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009fd0 tx=0x7fb2a400b740 comp rx=0 tx=0).stop 2023-10-05T15:46:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac1000f0 msgr2=0x7fb2ac19d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac1000f0 0x7fb2ac19d790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800e9f0 tx=0x7fb2a800ed00 comp rx=0 tx=0).stop 2023-10-05T15:46:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 shutdown_connections 2023-10-05T15:46:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb2980a1580 0x7fb2980a3a40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2ac100ab0 0x7fb2ac1a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2ac0ff790 0x7fb2ac19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 --2- 172.21.15.17:0/2100652049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2ac1000f0 0x7fb2ac19d790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.002+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 >> 172.21.15.17:0/2100652049 conn(0x7fb2ac0fb330 msgr2=0x7fb2ac0fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.003+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 shutdown_connections 2023-10-05T15:46:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:46:42.003+0000 7fb2b35ff700 1 -- 172.21.15.17:0/2100652049 wait complete. 2023-10-05T15:46:42.035 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:46:42.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:41 smithi017 ceph-mon[129107]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.5 MiB/s wr, 627 op/s 2023-10-05T15:46:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:41 smithi167 ceph-mon[133366]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.5 MiB/s wr, 627 op/s 2023-10-05T15:46:42.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:41 smithi079 ceph-mon[132936]: pgmap v672: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.5 MiB/s wr, 627 op/s 2023-10-05T15:46:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 485.0 s, 542.4 tps, lat 185.433 ms stddev 84.769 2023-10-05T15:46:44.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:43 smithi017 ceph-mon[129107]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 524 op/s 2023-10-05T15:46:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:43 smithi167 ceph-mon[133366]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 524 op/s 2023-10-05T15:46:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:43 smithi079 ceph-mon[132936]: pgmap v673: 129 pgs: 129 active+clean; 1.5 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 524 op/s 2023-10-05T15:46:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.848+0000 7f7cd57ff700 1 -- 172.21.15.17:0/3312337497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0103130 msgr2=0x7f7cd0103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.848+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/3312337497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0103130 0x7f7cd0103550 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009920 tx=0x7f7cb8009c30 comp rx=0 tx=0).stop 2023-10-05T15:46:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.852+0000 7f7cd57ff700 1 -- 172.21.15.17:0/3312337497 shutdown_connections 2023-10-05T15:46:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.852+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/3312337497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cd0104cc0 0x7f7cd010b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.852+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/3312337497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0103130 0x7f7cd0103550 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.852+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/3312337497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cd0104320 0x7f7cd0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.852+0000 7f7cd57ff700 1 -- 172.21.15.17:0/3312337497 >> 172.21.15.17:0/3312337497 conn(0x7f7cd00fe6a0 msgr2=0x7f7cd0100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:44.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.853+0000 7f7cd57ff700 1 -- 172.21.15.17:0/3312337497 shutdown_connections 2023-10-05T15:46:44.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.853+0000 7f7cd57ff700 1 -- 172.21.15.17:0/3312337497 wait complete. 2023-10-05T15:46:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.854+0000 7f7cd57ff700 1 Processor -- start 2023-10-05T15:46:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.854+0000 7f7cd57ff700 1 -- start start 2023-10-05T15:46:44.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7cd57ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cd0103130 0x7f7cd010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7cd57ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cd0104320 0x7f7cd0110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7cd57ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 0x7f7cd0111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7cd57ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd01117c0 con 0x7f7cd0104320 2023-10-05T15:46:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7cd57ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0111930 con 0x7f7cd0104cc0 2023-10-05T15:46:44.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7cd57ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0111af0 con 0x7f7cd0103130 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.855+0000 7f7ccf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 0x7f7cd0111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 0x7f7cd0111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50858/0 (socket says 172.21.15.17:50858) 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/2486098228 learned_addr learned my addr 172.21.15.17:0/2486098228 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cd0104320 0x7f7cd0110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7cceffd700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cd0103130 0x7f7cd010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/2486098228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cd0103130 msgr2=0x7f7cd010fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cd0103130 0x7f7cd010fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cd0104320 msgr2=0x7f7cd0110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cd0104320 0x7f7cd0110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.856+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/2486098228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8009520 con 0x7f7cd0104cc0 2023-10-05T15:46:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.861+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 0x7f7cd0111160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8007ee0 tx=0x7f7cc800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.861+0000 7f7cccff9700 1 -- 172.21.15.17:0/2486098228 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8017070 con 0x7f7cd0104cc0 2023-10-05T15:46:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.861+0000 7f7cccff9700 1 -- 172.21.15.17:0/2486098228 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cc800f040 con 0x7f7cd0104cc0 2023-10-05T15:46:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.861+0000 7f7cccff9700 1 -- 172.21.15.17:0/2486098228 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8005710 con 0x7f7cd0104cc0 2023-10-05T15:46:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.864+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd0111dd0 con 0x7f7cd0104cc0 2023-10-05T15:46:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.864+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0114590 con 0x7f7cd0104cc0 2023-10-05T15:46:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.872+0000 7f7cccff9700 1 -- 172.21.15.17:0/2486098228 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7cc8005870 con 0x7f7cd0104cc0 2023-10-05T15:46:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.872+0000 7f7ce9215b80 1 Processor -- start 2023-10-05T15:46:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.873+0000 7f7ce9215b80 1 -- start start 2023-10-05T15:46:44.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1aec0 0x563b10d1b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1bfd0 0x563b10d1c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1c990 0x563b10d23220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10c83400 con 0x563b10d1bfd0 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10c74bc0 con 0x563b10d1c990 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10c724e0 con 0x563b10d1aec0 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1aec0 0x563b10d1b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1aec0 0x563b10d1b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:52480/0 (socket says 172.21.15.17:52480) 2023-10-05T15:46:44.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7cc67fc700 1 -- 172.21.15.17:0/1449988344 learned_addr learned my addr 172.21.15.17:0/1449988344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1c990 0x563b10d23220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.874+0000 7f7cceffd700 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1bfd0 0x563b10d1c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.875+0000 7f7cceffd700 1 -- 172.21.15.17:0/1449988344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1aec0 msgr2=0x563b10d1b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.875+0000 7f7cceffd700 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1aec0 0x563b10d1b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.875+0000 7f7cceffd700 1 -- 172.21.15.17:0/1449988344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1c990 msgr2=0x563b10d23220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.875+0000 7f7cceffd700 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1c990 0x563b10d23220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.875+0000 7f7cceffd700 1 -- 172.21.15.17:0/1449988344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b10a98d80 con 0x563b10d1bfd0 2023-10-05T15:46:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.876+0000 7f7cceffd700 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1bfd0 0x563b10d1c450 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db860ace0c49fb36 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.876+0000 7f7cccff9700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7cbc0a1600 0x7f7cbc0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.877+0000 7f7cccff9700 1 -- 172.21.15.17:0/2486098228 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7cc80cbe30 con 0x7f7cd0104cc0 2023-10-05T15:46:44.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.877+0000 7f7cc57fa700 1 -- 172.21.15.17:0/1449988344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800fe60 con 0x563b10d1bfd0 2023-10-05T15:46:44.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.877+0000 7f7cc57fa700 1 -- 172.21.15.17:0/1449988344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cb801d040 con 0x563b10d1bfd0 2023-10-05T15:46:44.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.877+0000 7f7cc57fa700 1 -- 172.21.15.17:0/1449988344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80052a0 con 0x563b10d1bfd0 2023-10-05T15:46:44.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.877+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7cbc0a1600 0x7f7cbc0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1449988344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1bfd0 msgr2=0x563b10d1c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1bfd0 0x563b10d1c450 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8009f80 comp rx=0 tx=0).stop 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1449988344 shutdown_connections 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1c990 0x563b10d23220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1aec0 0x563b10d1b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1449988344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1bfd0 0x563b10d1c450 secure :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8000c00 tx=0x7f7cb8009f80 comp rx=0 tx=0).stop 2023-10-05T15:46:44.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.878+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1449988344 >> 172.21.15.17:0/1449988344 conn(0x563b10c8f200 msgr2=0x563b10d15bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:44.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.879+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7cbc0a1600 0x7f7cbc0a3ac0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x563b10d1ac60 tx=0x7f7cc0009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.880+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1449988344 shutdown_connections 2023-10-05T15:46:44.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.880+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1449988344 wait complete. 2023-10-05T15:46:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.881+0000 7f7ce9215b80 1 -- start start 2023-10-05T15:46:44.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 Processor -- start 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d24d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d25260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d2c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10c6ddd0 con 0x563b10d2a290 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10c0a6b0 con 0x563b10d1aec0 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10c0a350 con 0x563b10d1c990 2023-10-05T15:46:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.882+0000 7f7ce9215b80 10 client.0 _ll_register_callbacks cb 0x563b10a677a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d24d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d24d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50878/0 (socket says 172.21.15.17:50878) 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 -- 172.21.15.17:0/2820785800 learned_addr learned my addr 172.21.15.17:0/2820785800 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d25260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d2c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 -- 172.21.15.17:0/2820785800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 msgr2=0x563b10d25260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d25260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 -- 172.21.15.17:0/2820785800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 msgr2=0x563b10d2c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d2c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.883+0000 7f7cceffd700 1 -- 172.21.15.17:0/2820785800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd010bec0 con 0x563b10d1aec0 2023-10-05T15:46:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.885+0000 7f7cceffd700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d24d20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006010 tx=0x7f7cb800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf336b0df4d1eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.885+0000 7f7cb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:46:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.885+0000 7f7cb67fc700 1 -- 172.21.15.17:0/2820785800 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8005450 con 0x563b10d1aec0 2023-10-05T15:46:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.885+0000 7f7cb67fc700 1 -- 172.21.15.17:0/2820785800 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7cb80055b0 con 0x563b10d1aec0 2023-10-05T15:46:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.886+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b10d0dd50 con 0x563b10d1aec0 2023-10-05T15:46:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.886+0000 7f7cb67fc700 1 -- 172.21.15.17:0/2820785800 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cb800bbe0 con 0x563b10d1aec0 2023-10-05T15:46:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.886+0000 7f7ce9215b80 10 client.26762 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.886+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x563b10a81c00 con 0x563b10d1aec0 2023-10-05T15:46:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.887+0000 7f7cb67fc700 1 -- 172.21.15.17:0/2820785800 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563b10d0dd50 con 0x563b10d1aec0 2023-10-05T15:46:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.887+0000 7f7cb67fc700 1 -- 172.21.15.17:0/2820785800 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7cb8028030 con 0x563b10d1aec0 2023-10-05T15:46:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7ce9215b80 10 client.26762 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7ce9215b80 10 client.26762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:44.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7ce9215b80 20 client.26762 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d30a30 0x563b10d32e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7ce9215b80 4 client.26762 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b10c66db0 con 0x563b10d30a30 2023-10-05T15:46:44.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.888+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d30a30 0x563b10d32e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.889+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d30a30 0x563b10d32e20 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1676a9b93761ccb server_cookie=18533a109ec5d685 in_seq=0 out_seq=0 2023-10-05T15:46:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.890+0000 7f7cb67fc700 10 client.26762 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:44.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.890+0000 7f7cb67fc700 1 -- 172.21.15.17:0/2820785800 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563b10c66db0 con 0x563b10d30a30 2023-10-05T15:46:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.890+0000 7f7cb67fc700 10 client.26762 handle_command_reply: tid=0 2023-10-05T15:46:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.890+0000 7f7ce9215b80 1 client.26762 shutdown 2023-10-05T15:46:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 msgr2=0x563b10d24d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d24d20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8006010 tx=0x7f7cb800f690 comp rx=0 tx=0).stop 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 shutdown_connections 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d30a30 0x563b10d32e20 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d2c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d24d20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/2820785800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d25260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 >> 172.21.15.17:0/2820785800 conn(0x563b10c8f200 msgr2=0x563b10d15ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:44.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.891+0000 7f7cb67fc700 0 client.26762 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.892+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 shutdown_connections 2023-10-05T15:46:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.892+0000 7f7ce9215b80 1 -- 172.21.15.17:0/2820785800 wait complete. 2023-10-05T15:46:44.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.892+0000 7f7ce9215b80 20 client.26762 trim_cache size 0 max 16384 2023-10-05T15:46:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.919+0000 7f7ce9215b80 1 Processor -- start 2023-10-05T15:46:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.919+0000 7f7ce9215b80 1 -- start start 2023-10-05T15:46:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d243d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d22fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10aee8c0 con 0x563b10d2a290 2023-10-05T15:46:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10d12860 con 0x563b10d1aec0 2023-10-05T15:46:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10d40b80 con 0x563b10d1c990 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d243d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50884/0 (socket says 172.21.15.17:50884) 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:52500/0 (socket says 172.21.15.17:52500) 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.920+0000 7f7cceffd700 1 -- 172.21.15.17:0/1446759841 learned_addr learned my addr 172.21.15.17:0/1446759841 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d22fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/1446759841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 msgr2=0x563b10d40610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/1446759841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 msgr2=0x563b10d243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 -- 172.21.15.17:0/1446759841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b10abf1f0 con 0x563b10d2a290 2023-10-05T15:46:44.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.921+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d22fc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8098ce0 tx=0x7f7cc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b091ef05b784ffe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:44.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.922+0000 7f7cc5ffb700 1 -- 172.21.15.17:0/1446759841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80112b0 con 0x563b10d2a290 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.922+0000 7f7cc5ffb700 1 -- 172.21.15.17:0/1446759841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cc8099450 con 0x563b10d2a290 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.922+0000 7f7cc5ffb700 1 -- 172.21.15.17:0/1446759841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc80a10e0 con 0x563b10d2a290 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1446759841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 msgr2=0x563b10d22fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d22fc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8098ce0 tx=0x7f7cc800b040 comp rx=0 tx=0).stop 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1446759841 shutdown_connections 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d2a290 0x563b10d22fc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d1aec0 0x563b10d243d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/1446759841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1446759841 >> 172.21.15.17:0/1446759841 conn(0x563b10c8f200 msgr2=0x563b10d147b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1446759841 shutdown_connections 2023-10-05T15:46:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.923+0000 7f7ce9215b80 1 -- 172.21.15.17:0/1446759841 wait complete. 2023-10-05T15:46:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.924+0000 7f7ce9215b80 1 -- start start 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.924+0000 7f7ce9215b80 1 Processor -- start 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1aec0 0x563b10d3fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d2a290 0x563b10d83460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10d839a0 con 0x563b10d1aec0 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10d83ae0 con 0x563b10d2a290 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b10d83ca0 con 0x563b10d1c990 2023-10-05T15:46:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7ce9215b80 10 client.0 _ll_register_callbacks cb 0x7f7cc0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:52510/0 (socket says 172.21.15.17:52510) 2023-10-05T15:46:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.925+0000 7f7cc67fc700 1 -- 172.21.15.17:0/3239270330 learned_addr learned my addr 172.21.15.17:0/3239270330 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7ccf7fe700 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d2a290 0x563b10d83460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cc67fc700 1 -- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d2a290 msgr2=0x563b10d83460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d2a290 0x563b10d83460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cc67fc700 1 -- 172.21.15.17:0/3239270330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1aec0 msgr2=0x563b10d3fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1aec0 0x563b10d3fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cc67fc700 1 -- 172.21.15.17:0/3239270330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0114590 con 0x563b10d1c990 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cc67fc700 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x563b10d33740 tx=0x7f7cc0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60953053c2dc5df3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.926+0000 7f7cb67fc700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.927+0000 7f7cb67fc700 1 -- 172.21.15.17:0/3239270330 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0016070 con 0x563b10d1c990 2023-10-05T15:46:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.927+0000 7f7cb67fc700 1 -- 172.21.15.17:0/3239270330 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7cc002faf0 con 0x563b10d1c990 2023-10-05T15:46:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.927+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7cb801d040 con 0x563b10d1c990 2023-10-05T15:46:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.928+0000 7f7cb67fc700 1 -- 172.21.15.17:0/3239270330 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cc002fcb0 con 0x563b10d1c990 2023-10-05T15:46:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.928+0000 7f7ce9215b80 10 client.26737 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.928+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x563b10a97250 con 0x563b10d1c990 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7cb67fc700 1 -- 172.21.15.17:0/3239270330 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cb801d040 con 0x563b10d1c990 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7cb67fc700 1 -- 172.21.15.17:0/3239270330 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7cc00053e0 con 0x563b10d1c990 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7ce9215b80 10 client.26737 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7ce9215b80 10 client.26737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7ce9215b80 20 client.26737 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d85620 0x563b10d87ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7ce9215b80 4 client.26737 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:46:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.929+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563b10c66ad0 con 0x563b10d85620 2023-10-05T15:46:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.930+0000 7f7cceffd700 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d85620 0x563b10d87ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.934+0000 7f7cb67fc700 10 client.26737 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:44.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.934+0000 7f7cceffd700 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d85620 0x563b10d87ae0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd79b3002bca2141 server_cookie=ee73ce31b000b589 in_seq=0 out_seq=0 2023-10-05T15:46:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.952+0000 7f7cb67fc700 1 -- 172.21.15.17:0/3239270330 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563b10c66ad0 con 0x563b10d85620 2023-10-05T15:46:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.952+0000 7f7cb67fc700 10 client.26737 handle_command_reply: tid=0 2023-10-05T15:46:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.952+0000 7f7ce9215b80 1 client.26737 shutdown 2023-10-05T15:46:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 msgr2=0x563b10d40070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x563b10d33740 tx=0x7f7cc0004750 comp rx=0 tx=0).stop 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 shutdown_connections 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x563b10d85620 0x563b10d87ae0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b10d2a290 0x563b10d83460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563b10d1aec0 0x563b10d3fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 --2- 172.21.15.17:0/3239270330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b10d1c990 0x563b10d40070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7cb67fc700 0 client.26737 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.953+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 >> 172.21.15.17:0/3239270330 conn(0x563b10c8f200 msgr2=0x563b10d168b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.954+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 shutdown_connections 2023-10-05T15:46:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.954+0000 7f7ce9215b80 1 -- 172.21.15.17:0/3239270330 wait complete. 2023-10-05T15:46:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.954+0000 7f7ce9215b80 20 client.26737 trim_cache size 0 max 16384 2023-10-05T15:46:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:46:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:46:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:46:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:46:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7cbc0a1600 msgr2=0x7f7cbc0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7cbc0a1600 0x7f7cbc0a3ac0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x563b10d1ac60 tx=0x7f7cc0009310 comp rx=0 tx=0).stop 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 msgr2=0x7f7cd0111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 0x7f7cd0111160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8007ee0 tx=0x7f7cc800d3b0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 shutdown_connections 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7cbc0a1600 0x7f7cbc0a3ac0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cd0104cc0 0x7f7cd0111160 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cd0103130 0x7f7cd010fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 --2- 172.21.15.17:0/2486098228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cd0104320 0x7f7cd0110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.955+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 >> 172.21.15.17:0/2486098228 conn(0x7f7cd00fe6a0 msgr2=0x7f7cd00ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.956+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 shutdown_connections 2023-10-05T15:46:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:44.956+0000 7f7cd57ff700 1 -- 172.21.15.17:0/2486098228 wait complete. 2023-10-05T15:46:46.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:45 smithi017 ceph-mon[129107]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.6 MiB/s wr, 701 op/s 2023-10-05T15:46:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:45 smithi167 ceph-mon[133366]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.6 MiB/s wr, 701 op/s 2023-10-05T15:46:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:45 smithi079 ceph-mon[132936]: pgmap v674: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.6 MiB/s wr, 701 op/s 2023-10-05T15:46:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 490.0 s, 571.4 tps, lat 174.818 ms stddev 71.470 2023-10-05T15:46:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:47 smithi017 ceph-mon[129107]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 498 op/s 2023-10-05T15:46:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:47 smithi167 ceph-mon[133366]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 498 op/s 2023-10-05T15:46:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:47 smithi079 ceph-mon[132936]: pgmap v675: 129 pgs: 129 active+clean; 1.5 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.6 MiB/s wr, 498 op/s 2023-10-05T15:46:50.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:49 smithi017 ceph-mon[129107]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 575 op/s 2023-10-05T15:46:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:49 smithi167 ceph-mon[133366]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 575 op/s 2023-10-05T15:46:50.443 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:49 smithi079 ceph-mon[132936]: pgmap v676: 129 pgs: 129 active+clean; 1.5 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 575 op/s 2023-10-05T15:46:52.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:51 smithi017 ceph-mon[129107]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.1 MiB/s wr, 610 op/s 2023-10-05T15:46:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:51 smithi167 ceph-mon[133366]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.1 MiB/s wr, 610 op/s 2023-10-05T15:46:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:51 smithi079 ceph-mon[132936]: pgmap v677: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.1 MiB/s wr, 610 op/s 2023-10-05T15:46:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 495.0 s, 604.0 tps, lat 165.713 ms stddev 54.552 2023-10-05T15:46:54.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:53 smithi017 ceph-mon[129107]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.1 MiB/s wr, 534 op/s 2023-10-05T15:46:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:53 smithi167 ceph-mon[133366]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.1 MiB/s wr, 534 op/s 2023-10-05T15:46:54.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:53 smithi079 ceph-mon[132936]: pgmap v678: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.1 MiB/s wr, 534 op/s 2023-10-05T15:46:56.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:55 smithi017 ceph-mon[129107]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.2 MiB/s wr, 727 op/s 2023-10-05T15:46:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:55 smithi167 ceph-mon[133366]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.2 MiB/s wr, 727 op/s 2023-10-05T15:46:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:55 smithi079 ceph-mon[132936]: pgmap v679: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.2 MiB/s wr, 727 op/s 2023-10-05T15:46:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 500.0 s, 564.8 tps, lat 176.976 ms stddev 66.139 2023-10-05T15:46:58.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:57 smithi017 ceph-mon[129107]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 562 op/s 2023-10-05T15:46:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 -- 172.21.15.17:0/215431733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410aae0 msgr2=0x7f857410cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 --2- 172.21.15.17:0/215431733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410aae0 0x7f857410cf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f856800af90 tx=0x7f8568008850 comp rx=0 tx=0).stop 2023-10-05T15:46:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 -- 172.21.15.17:0/215431733 shutdown_connections 2023-10-05T15:46:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 --2- 172.21.15.17:0/215431733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f857410d5c0 0x7f857410fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 --2- 172.21.15.17:0/215431733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8574108120 0x7f857410a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 --2- 172.21.15.17:0/215431733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410aae0 0x7f857410cf30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.201+0000 7f85791ff700 1 -- 172.21.15.17:0/215431733 >> 172.21.15.17:0/215431733 conn(0x7f857406e0b0 msgr2=0x7f8574070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.202+0000 7f85791ff700 1 -- 172.21.15.17:0/215431733 shutdown_connections 2023-10-05T15:46:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.202+0000 7f85791ff700 1 -- 172.21.15.17:0/215431733 wait complete. 2023-10-05T15:46:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.203+0000 7f85791ff700 1 Processor -- start 2023-10-05T15:46:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.204+0000 7f85791ff700 1 -- start start 2023-10-05T15:46:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.204+0000 7f85791ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8574108120 0x7f857419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.204+0000 7f85791ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f857410aae0 0x7f857419d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f85791ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410d5c0 0x7f857419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f85791ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857419ed00 con 0x7f857410aae0 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f85791ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857419ee70 con 0x7f8574108120 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f85791ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857419f030 con 0x7f857410d5c0 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f857259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f857410aae0 0x7f857419d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f857259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f857410aae0 0x7f857419d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59474/0 (socket says 172.21.15.17:59474) 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f857359e700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410d5c0 0x7f857419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f857259c700 1 -- 172.21.15.17:0/1005980457 learned_addr learned my addr 172.21.15.17:0/1005980457 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.205+0000 7f8572d9d700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8574108120 0x7f857419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f857359e700 1 -- 172.21.15.17:0/1005980457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8574108120 msgr2=0x7f857419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f857359e700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8574108120 0x7f857419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f857359e700 1 -- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f857410aae0 msgr2=0x7f857419d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f857359e700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f857410aae0 0x7f857419d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f857359e700 1 -- 172.21.15.17:0/1005980457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680081d0 con 0x7f857410d5c0 2023-10-05T15:46:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f857359e700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410d5c0 0x7f857419e6a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f856c0078d0 tx=0x7f856c007be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.206+0000 7f855bfff700 1 -- 172.21.15.17:0/1005980457 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c010040 con 0x7f857410d5c0 2023-10-05T15:46:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.207+0000 7f855bfff700 1 -- 172.21.15.17:0/1005980457 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f856c004830 con 0x7f857410d5c0 2023-10-05T15:46:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.207+0000 7f855bfff700 1 -- 172.21.15.17:0/1005980457 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0054e0 con 0x7f857410d5c0 2023-10-05T15:46:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.207+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857419f310 con 0x7f857410d5c0 2023-10-05T15:46:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.207+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85741a5ad0 con 0x7f857410d5c0 2023-10-05T15:46:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.213+0000 7f855bfff700 1 -- 172.21.15.17:0/1005980457 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f856c004230 con 0x7f857410d5c0 2023-10-05T15:46:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.214+0000 7f858cab8b80 1 Processor -- start 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 -- start start 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85d97450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85d9e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85cfe400 con 0x564a85d97990 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85cefbc0 con 0x564a85d96fd0 2023-10-05T15:46:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.217+0000 7f858cab8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85ced4e0 con 0x564a85d95ec0 2023-10-05T15:46:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.218+0000 7f857259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.218+0000 7f857259c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60954/0 (socket says 172.21.15.17:60954) 2023-10-05T15:46:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.218+0000 7f857259c700 1 -- 172.21.15.17:0/4190080921 learned_addr learned my addr 172.21.15.17:0/4190080921 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.218+0000 7f8572d9d700 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85d97450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.218+0000 7f857259c700 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85d9e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f8572d9d700 1 -- 172.21.15.17:0/4190080921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 msgr2=0x564a85d962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f8572d9d700 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f8572d9d700 1 -- 172.21.15.17:0/4190080921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 msgr2=0x564a85d9e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f855bfff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f855c0a1580 0x7f855c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f8572d9d700 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85d9e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f8572d9d700 1 -- 172.21.15.17:0/4190080921 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a85b13d80 con 0x564a85d96fd0 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f855bfff700 1 -- 172.21.15.17:0/1005980457 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f856c0ccd90 con 0x7f857410d5c0 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.219+0000 7f8572d9d700 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85d97450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f856400a430 tx=0x7f85640096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f41e42240cccd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.220+0000 7f857259c700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f855c0a1580 0x7f855c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.220+0000 7f85597fa700 1 -- 172.21.15.17:0/4190080921 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564010040 con 0x564a85d96fd0 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.220+0000 7f85597fa700 1 -- 172.21.15.17:0/4190080921 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8564014ab0 con 0x564a85d96fd0 2023-10-05T15:46:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.220+0000 7f85597fa700 1 -- 172.21.15.17:0/4190080921 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564013950 con 0x564a85d96fd0 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 -- 172.21.15.17:0/4190080921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 msgr2=0x564a85d97450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85d97450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f856400a430 tx=0x7f85640096d0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f857259c700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f855c0a1580 0x7f855c0a3a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x564a85d95c60 tx=0x7f8568025040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 -- 172.21.15.17:0/4190080921 shutdown_connections 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85d9e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 --2- 172.21.15.17:0/4190080921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85d97450 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 -- 172.21.15.17:0/4190080921 >> 172.21.15.17:0/4190080921 conn(0x564a85d0a200 msgr2=0x564a85d90bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 -- 172.21.15.17:0/4190080921 shutdown_connections 2023-10-05T15:46:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.221+0000 7f858cab8b80 1 -- 172.21.15.17:0/4190080921 wait complete. 2023-10-05T15:46:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.222+0000 7f858cab8b80 1 -- start start 2023-10-05T15:46:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.222+0000 7f858cab8b80 1 Processor -- start 2023-10-05T15:46:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d9fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85d9fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85da7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85ce8dd0 con 0x564a85d96fd0 2023-10-05T15:46:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85c856b0 con 0x564a85d97990 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85c85350 con 0x564a85d95ec0 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.223+0000 7f858cab8b80 10 client.0 _ll_register_callbacks cb 0x564a85ae27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.224+0000 7f857359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85da7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.224+0000 7f857359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85da7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60574/0 (socket says 172.21.15.17:60574) 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.224+0000 7f857359e700 1 -- 172.21.15.17:0/147426050 learned_addr learned my addr 172.21.15.17:0/147426050 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.224+0000 7f857259c700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85d9fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.224+0000 7f8572d9d700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d9fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f857359e700 1 -- 172.21.15.17:0/147426050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 msgr2=0x564a85d9fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f857359e700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d9fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f857359e700 1 -- 172.21.15.17:0/147426050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 msgr2=0x564a85d9fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f857359e700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85d9fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f857359e700 1 -- 172.21.15.17:0/147426050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8564009c20 con 0x564a85d97990 2023-10-05T15:46:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f857359e700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85da7030 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856c0a1b10 tx=0x7f856c099e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=448e00f27b89aa84 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f8556ff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:46:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.225+0000 7f8556ff5700 1 -- 172.21.15.17:0/147426050 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c01ce70 con 0x564a85d97990 2023-10-05T15:46:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.226+0000 7f8556ff5700 1 -- 172.21.15.17:0/147426050 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f856c005640 con 0x564a85d97990 2023-10-05T15:46:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.226+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a85d88d50 con 0x564a85d97990 2023-10-05T15:46:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.227+0000 7f8556ff5700 1 -- 172.21.15.17:0/147426050 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f856c0991a0 con 0x564a85d97990 2023-10-05T15:46:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.227+0000 7f858cab8b80 10 client.26780 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.227+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x564a85afcc00 con 0x564a85d97990 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f8556ff5700 1 -- 172.21.15.17:0/147426050 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a85d88d50 con 0x564a85d97990 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f8556ff5700 1 -- 172.21.15.17:0/147426050 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f856c095aa0 con 0x564a85d97990 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f858cab8b80 10 client.26780 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f858cab8b80 10 client.26780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f858cab8b80 20 client.26780 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f858cab8b80 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85dab7c0 0x564a85dadbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f858cab8b80 4 client.26780 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:46:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a85ce1db0 con 0x564a85dab7c0 2023-10-05T15:46:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.228+0000 7f8572d9d700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85dab7c0 0x564a85dadbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.229+0000 7f8572d9d700 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85dab7c0 0x564a85dadbe0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64b7618af416459 server_cookie=ec34c6d34903366a in_seq=0 out_seq=0 2023-10-05T15:46:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.229+0000 7f8556ff5700 10 client.26780 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.230+0000 7f8556ff5700 1 -- 172.21.15.17:0/147426050 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a85ce1db0 con 0x564a85dab7c0 2023-10-05T15:46:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.230+0000 7f8556ff5700 10 client.26780 handle_command_reply: tid=0 2023-10-05T15:46:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.230+0000 7f858cab8b80 1 client.26780 shutdown 2023-10-05T15:46:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 msgr2=0x564a85da7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85da7030 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856c0a1b10 tx=0x7f856c099e30 comp rx=0 tx=0).stop 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 shutdown_connections 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85dab7c0 0x564a85dadbe0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85da7030 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85d9fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 --2- 172.21.15.17:0/147426050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85d9fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 >> 172.21.15.17:0/147426050 conn(0x564a85d0a200 msgr2=0x564a85d90250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f8556ff5700 0 client.26780 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 shutdown_connections 2023-10-05T15:46:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.231+0000 7f858cab8b80 1 -- 172.21.15.17:0/147426050 wait complete. 2023-10-05T15:46:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.233+0000 7f858cab8b80 20 client.26780 trim_cache size 0 max 16384 2023-10-05T15:46:58.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.259+0000 7f858cab8b80 1 Processor -- start 2023-10-05T15:46:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 -- start start 2023-10-05T15:46:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85dad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85da6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85d9dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85b698c0 con 0x564a85d96fd0 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85d9f620 con 0x564a85d97990 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.260+0000 7f858cab8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85d922f0 con 0x564a85d95ec0 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.261+0000 7f8572d9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85dad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.261+0000 7f8572d9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85dad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60966/0 (socket says 172.21.15.17:60966) 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.261+0000 7f8572d9d700 1 -- 172.21.15.17:0/975253634 learned_addr learned my addr 172.21.15.17:0/975253634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.261+0000 7f857359e700 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85d9dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.261+0000 7f857259c700 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85da6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.262+0000 7f857359e700 1 -- 172.21.15.17:0/975253634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 msgr2=0x564a85dad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.262+0000 7f857359e700 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85dad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.262+0000 7f857359e700 1 -- 172.21.15.17:0/975253634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 msgr2=0x564a85da6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.262+0000 7f857359e700 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85da6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.262+0000 7f857359e700 1 -- 172.21.15.17:0/975253634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a85b3a1f0 con 0x564a85d97990 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.262+0000 7f857359e700 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85d9dd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f856c099960 tx=0x7f856c098260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7eb00c04b65e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.263+0000 7f8559ffb700 1 -- 172.21.15.17:0/975253634 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c01ce70 con 0x564a85d97990 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.263+0000 7f8559ffb700 1 -- 172.21.15.17:0/975253634 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f856c095aa0 con 0x564a85d97990 2023-10-05T15:46:58.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.263+0000 7f8559ffb700 1 -- 172.21.15.17:0/975253634 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856c0a1df0 con 0x564a85d97990 2023-10-05T15:46:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 -- 172.21.15.17:0/975253634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 msgr2=0x564a85d9dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85d9dd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f856c099960 tx=0x7f856c098260 comp rx=0 tx=0).stop 2023-10-05T15:46:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 -- 172.21.15.17:0/975253634 shutdown_connections 2023-10-05T15:46:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d97990 0x564a85d9dd20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85dad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 --2- 172.21.15.17:0/975253634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d96fd0 0x564a85da6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 -- 172.21.15.17:0/975253634 >> 172.21.15.17:0/975253634 conn(0x564a85d0a200 msgr2=0x564a85d8f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.264+0000 7f858cab8b80 1 -- 172.21.15.17:0/975253634 shutdown_connections 2023-10-05T15:46:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.265+0000 7f858cab8b80 1 -- 172.21.15.17:0/975253634 wait complete. 2023-10-05T15:46:58.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.265+0000 7f858cab8b80 1 -- start start 2023-10-05T15:46:58.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.267+0000 7f858cab8b80 1 Processor -- start 2023-10-05T15:46:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.268+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85da24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.268+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85da29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.268+0000 7f858cab8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85da5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.268+0000 7f858cab8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85da5f50 con 0x564a85d97990 2023-10-05T15:46:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.268+0000 7f858cab8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85da60c0 con 0x564a85d96fd0 2023-10-05T15:46:58.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.268+0000 7f858cab8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a85da6280 con 0x564a85d95ec0 2023-10-05T15:46:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.269+0000 7f858cab8b80 10 client.0 _ll_register_callbacks cb 0x7f856c099700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:46:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.269+0000 7f857259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85da29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.269+0000 7f857259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85da29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60584/0 (socket says 172.21.15.17:60584) 2023-10-05T15:46:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.269+0000 7f857259c700 1 -- 172.21.15.17:0/3783807147 learned_addr learned my addr 172.21.15.17:0/3783807147 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:46:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.269+0000 7f857359e700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85da5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.269+0000 7f8572d9d700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85da24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.270+0000 7f8572d9d700 1 -- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 msgr2=0x564a85da29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.270+0000 7f8572d9d700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85da29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.270+0000 7f8572d9d700 1 -- 172.21.15.17:0/3783807147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 msgr2=0x564a85da5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.270+0000 7f8572d9d700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85da5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.270+0000 7f8572d9d700 1 -- 172.21.15.17:0/3783807147 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a85afcc00 con 0x564a85d95ec0 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.271+0000 7f8572d9d700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85da24b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x564a85d8d960 tx=0x7f8564009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1c8151546ada18 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:46:58.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.271+0000 7f8556ff5700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:46:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.271+0000 7f8556ff5700 1 -- 172.21.15.17:0/3783807147 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564010040 con 0x564a85d95ec0 2023-10-05T15:46:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.271+0000 7f8556ff5700 1 -- 172.21.15.17:0/3783807147 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8564023050 con 0x564a85d95ec0 2023-10-05T15:46:58.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.272+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8564014ab0 con 0x564a85d95ec0 2023-10-05T15:46:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.272+0000 7f8556ff5700 1 -- 172.21.15.17:0/3783807147 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8564014910 con 0x564a85d95ec0 2023-10-05T15:46:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.272+0000 7f858cab8b80 10 client.26755 fetch_fsmap learned FSMap version 41 2023-10-05T15:46:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.272+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x564a85b12250 con 0x564a85d95ec0 2023-10-05T15:46:58.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.273+0000 7f8556ff5700 1 -- 172.21.15.17:0/3783807147 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8564014ab0 con 0x564a85d95ec0 2023-10-05T15:46:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.273+0000 7f8556ff5700 1 -- 172.21.15.17:0/3783807147 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8564008030 con 0x564a85d95ec0 2023-10-05T15:46:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f858cab8b80 10 client.26755 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:46:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f858cab8b80 10 client.26755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:46:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f858cab8b80 20 client.26755 populate_metadata read hostname 'smithi017' 2023-10-05T15:46:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f858cab8b80 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85e10ca0 0x564a85e130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:46:58.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f858cab8b80 4 client.26755 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:46:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a85ce1ad0 con 0x564a85e10ca0 2023-10-05T15:46:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.274+0000 7f857259c700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85e10ca0 0x564a85e130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:46:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.275+0000 7f857259c700 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85e10ca0 0x564a85e130c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=669cfa5d7d7fe907 server_cookie=f5940b0c3e766527 in_seq=0 out_seq=0 2023-10-05T15:46:58.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.275+0000 7f8556ff5700 10 client.26755 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.297+0000 7f8556ff5700 1 -- 172.21.15.17:0/3783807147 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a85ce1ad0 con 0x564a85e10ca0 2023-10-05T15:46:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.297+0000 7f8556ff5700 10 client.26755 handle_command_reply: tid=0 2023-10-05T15:46:58.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.297+0000 7f858cab8b80 1 client.26755 shutdown 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 msgr2=0x564a85da24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85da24b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x564a85d8d960 tx=0x7f8564009870 comp rx=0 tx=0).stop 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 shutdown_connections 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564a85e10ca0 0x564a85e130c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564a85d97990 0x564a85da5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564a85d95ec0 0x564a85da24b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 --2- 172.21.15.17:0/3783807147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564a85d96fd0 0x564a85da29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 >> 172.21.15.17:0/3783807147 conn(0x564a85d0a200 msgr2=0x564a85dad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.299+0000 7f8556ff5700 0 client.26755 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:46:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.300+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 shutdown_connections 2023-10-05T15:46:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.300+0000 7f858cab8b80 1 -- 172.21.15.17:0/3783807147 wait complete. 2023-10-05T15:46:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.301+0000 7f858cab8b80 20 client.26755 trim_cache size 0 max 16384 2023-10-05T15:46:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:46:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:46:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:46:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f855c0a1580 msgr2=0x7f855c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f855c0a1580 0x7f855c0a3a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x564a85d95c60 tx=0x7f8568025040 comp rx=0 tx=0).stop 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410d5c0 msgr2=0x7f857419e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410d5c0 0x7f857419e6a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f856c0078d0 tx=0x7f856c007be0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 shutdown_connections 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f855c0a1580 0x7f855c0a3a40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f857410d5c0 0x7f857419e6a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8574108120 0x7f857419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 --2- 172.21.15.17:0/1005980457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f857410aae0 0x7f857419d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:46:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.303+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 >> 172.21.15.17:0/1005980457 conn(0x7f857406e0b0 msgr2=0x7f8574108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:46:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.304+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 shutdown_connections 2023-10-05T15:46:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:46:58.304+0000 7f85791ff700 1 -- 172.21.15.17:0/1005980457 wait complete. 2023-10-05T15:46:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:57 smithi167 ceph-mon[133366]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 562 op/s 2023-10-05T15:46:58.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:57 smithi079 ceph-mon[132936]: pgmap v680: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.2 MiB/s wr, 562 op/s 2023-10-05T15:47:00.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:46:59 smithi017 ceph-mon[129107]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.0 MiB/s wr, 642 op/s 2023-10-05T15:47:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:46:59 smithi167 ceph-mon[133366]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.0 MiB/s wr, 642 op/s 2023-10-05T15:47:00.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:46:59 smithi079 ceph-mon[132936]: pgmap v681: 129 pgs: 129 active+clean; 1.5 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.0 MiB/s wr, 642 op/s 2023-10-05T15:47:02.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:01 smithi017 ceph-mon[129107]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.2 MiB/s wr, 687 op/s 2023-10-05T15:47:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:01 smithi167 ceph-mon[133366]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.2 MiB/s wr, 687 op/s 2023-10-05T15:47:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:01 smithi079 ceph-mon[132936]: pgmap v682: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 8.2 MiB/s wr, 687 op/s 2023-10-05T15:47:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 505.0 s, 538.4 tps, lat 185.699 ms stddev 57.692 2023-10-05T15:47:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:03 smithi017 ceph-mon[129107]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.9 MiB/s wr, 586 op/s 2023-10-05T15:47:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:03 smithi167 ceph-mon[133366]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.9 MiB/s wr, 586 op/s 2023-10-05T15:47:04.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:03 smithi079 ceph-mon[132936]: pgmap v683: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.9 MiB/s wr, 586 op/s 2023-10-05T15:47:05.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:04 smithi167 ceph-mon[133366]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.0 MiB/s wr, 756 op/s 2023-10-05T15:47:05.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:04 smithi079 ceph-mon[132936]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.0 MiB/s wr, 756 op/s 2023-10-05T15:47:05.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:04 smithi017 ceph-mon[129107]: pgmap v684: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.0 MiB/s wr, 756 op/s 2023-10-05T15:47:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 510.0 s, 571.8 tps, lat 174.795 ms stddev 95.690 2023-10-05T15:47:08.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:07 smithi017 ceph-mon[129107]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.3 MiB/s wr, 540 op/s 2023-10-05T15:47:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:07 smithi167 ceph-mon[133366]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.3 MiB/s wr, 540 op/s 2023-10-05T15:47:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:07 smithi079 ceph-mon[132936]: pgmap v685: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.3 MiB/s wr, 540 op/s 2023-10-05T15:47:10.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:09 smithi017 ceph-mon[129107]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.6 MiB/s wr, 595 op/s 2023-10-05T15:47:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:09 smithi167 ceph-mon[133366]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.6 MiB/s wr, 595 op/s 2023-10-05T15:47:10.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:09 smithi079 ceph-mon[132936]: pgmap v686: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.6 MiB/s wr, 595 op/s 2023-10-05T15:47:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.584+0000 7f8b727ff700 1 -- 172.21.15.17:0/1016902969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10d1f0 msgr2=0x7f8b6c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.584+0000 7f8b727ff700 1 --2- 172.21.15.17:0/1016902969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c10d670 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009990 tx=0x7f8b64009ca0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 -- 172.21.15.17:0/1016902969 shutdown_connections 2023-10-05T15:47:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 --2- 172.21.15.17:0/1016902969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c10d670 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 --2- 172.21.15.17:0/1016902969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c107eb0 0x7f8b6c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 --2- 172.21.15.17:0/1016902969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c10a820 0x7f8b6c10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 -- 172.21.15.17:0/1016902969 >> 172.21.15.17:0/1016902969 conn(0x7f8b6c06dd10 msgr2=0x7f8b6c070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 -- 172.21.15.17:0/1016902969 shutdown_connections 2023-10-05T15:47:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.585+0000 7f8b727ff700 1 -- 172.21.15.17:0/1016902969 wait complete. 2023-10-05T15:47:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.587+0000 7f8b727ff700 1 Processor -- start 2023-10-05T15:47:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.588+0000 7f8b727ff700 1 -- start start 2023-10-05T15:47:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b727ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c107eb0 0x7f8b6c1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b727ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10a820 0x7f8b6c1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b727ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c1a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b727ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1a73b0 con 0x7f8b6c107eb0 2023-10-05T15:47:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b727ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1a7520 con 0x7f8b6c10a820 2023-10-05T15:47:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b727ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c1a76e0 con 0x7f8b6c10d1f0 2023-10-05T15:47:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c1a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c1a6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60674/0 (socket says 172.21.15.17:60674) 2023-10-05T15:47:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b70d9c700 1 -- 172.21.15.17:0/4292173332 learned_addr learned my addr 172.21.15.17:0/4292173332 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.589+0000 7f8b63fff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10a820 0x7f8b6c1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.590+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c107eb0 0x7f8b6c1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.590+0000 7f8b6bfff700 1 -- 172.21.15.17:0/4292173332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c10d1f0 msgr2=0x7f8b6c1a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.590+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c1a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.590+0000 7f8b6bfff700 1 -- 172.21.15.17:0/4292173332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10a820 msgr2=0x7f8b6c1a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.590+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10a820 0x7f8b6c1a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.590+0000 7f8b6bfff700 1 -- 172.21.15.17:0/4292173332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640095f0 con 0x7f8b6c107eb0 2023-10-05T15:47:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.591+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c107eb0 0x7f8b6c1a5990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00ada0 tx=0x7f8b5c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.592+0000 7f8b69ffb700 1 -- 172.21.15.17:0/4292173332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00f070 con 0x7f8b6c107eb0 2023-10-05T15:47:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.592+0000 7f8b69ffb700 1 -- 172.21.15.17:0/4292173332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b5c00ce10 con 0x7f8b6c107eb0 2023-10-05T15:47:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.592+0000 7f8b69ffb700 1 -- 172.21.15.17:0/4292173332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c005310 con 0x7f8b6c107eb0 2023-10-05T15:47:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.593+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6c1a79c0 con 0x7f8b6c107eb0 2023-10-05T15:47:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.594+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c1ae180 con 0x7f8b6c107eb0 2023-10-05T15:47:11.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.600+0000 7f8b860a0b80 1 Processor -- start 2023-10-05T15:47:11.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.600+0000 7f8b860a0b80 1 -- start start 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fb52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fb6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb6990 0x556850fbd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850f1d400 con 0x556850fb4ec0 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850f0ebc0 con 0x556850fb5fd0 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850f0c4e0 con 0x556850fb6990 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.601+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fb52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.602+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fb52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59942/0 (socket says 172.21.15.17:59942) 2023-10-05T15:47:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.602+0000 7f8b70d9c700 1 -- 172.21.15.17:0/3217608790 learned_addr learned my addr 172.21.15.17:0/3217608790 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.602+0000 7f8b63fff700 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb6990 0x556850fbd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.602+0000 7f8b69ffb700 1 -- 172.21.15.17:0/4292173332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8b5c004ad0 con 0x7f8b6c107eb0 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.602+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fb6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.603+0000 7f8b70d9c700 1 -- 172.21.15.17:0/3217608790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb6990 msgr2=0x556850fbd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.603+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb6990 0x556850fbd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.603+0000 7f8b70d9c700 1 -- 172.21.15.17:0/3217608790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 msgr2=0x556850fb6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.603+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fb6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.603+0000 7f8b70d9c700 1 -- 172.21.15.17:0/3217608790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556850d32d80 con 0x556850fb4ec0 2023-10-05T15:47:11.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.604+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fb52e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009f10 tx=0x7f8b64009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35a78cc03fa03b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.605+0000 7f8b69ffb700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b580a1650 0x7f8b580a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.605+0000 7f8b627fc700 1 -- 172.21.15.17:0/3217608790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6401d070 con 0x556850fb4ec0 2023-10-05T15:47:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.605+0000 7f8b69ffb700 1 -- 172.21.15.17:0/4292173332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8b5c0cc2f0 con 0x7f8b6c107eb0 2023-10-05T15:47:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.605+0000 7f8b627fc700 1 -- 172.21.15.17:0/3217608790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b6401e040 con 0x556850fb4ec0 2023-10-05T15:47:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.605+0000 7f8b627fc700 1 -- 172.21.15.17:0/3217608790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64004760 con 0x556850fb4ec0 2023-10-05T15:47:11.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.606+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b580a1650 0x7f8b580a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.608+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3217608790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 msgr2=0x556850fb52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.608+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fb52e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009f10 tx=0x7f8b64009f40 comp rx=0 tx=0).stop 2023-10-05T15:47:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.608+0000 7f8b6bfff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b580a1650 0x7f8b580a3b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0a1070 tx=0x7f8b5c0cfe30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.609+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3217608790 shutdown_connections 2023-10-05T15:47:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.609+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb6990 0x556850fbd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.609+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fb52e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.609+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3217608790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fb6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.609+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3217608790 >> 172.21.15.17:0/3217608790 conn(0x556850f29200 msgr2=0x556850fafbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.611+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3217608790 shutdown_connections 2023-10-05T15:47:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.612+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3217608790 wait complete. 2023-10-05T15:47:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.613+0000 7f8b860a0b80 1 -- start start 2023-10-05T15:47:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 Processor -- start 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fcfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fd0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb6990 0x556850fd7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850f07dd0 con 0x556850fb6990 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850ea46b0 con 0x556850fb5fd0 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850ea4350 con 0x556850fb4ec0 2023-10-05T15:47:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.614+0000 7f8b860a0b80 10 client.0 _ll_register_callbacks cb 0x556850d017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.615+0000 7f8b63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fd0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.615+0000 7f8b63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fd0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35382/0 (socket says 172.21.15.17:35382) 2023-10-05T15:47:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.615+0000 7f8b63fff700 1 -- 172.21.15.17:0/378566479 learned_addr learned my addr 172.21.15.17:0/378566479 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.615+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fcfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb6990 0x556850fd7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b63fff700 1 -- 172.21.15.17:0/378566479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 msgr2=0x556850fcfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b63fff700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fcfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b63fff700 1 -- 172.21.15.17:0/378566479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb6990 msgr2=0x556850fd7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b63fff700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb6990 0x556850fd7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b63fff700 1 -- 172.21.15.17:0/378566479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c10e290 con 0x556850fb5fd0 2023-10-05T15:47:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.616+0000 7f8b63fff700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fd0140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d960 tx=0x7f8b5400dc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57feefade458b328 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.617+0000 7f8b4b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.617+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/378566479 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54004230 con 0x556850fb5fd0 2023-10-05T15:47:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.617+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/378566479 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8b54011440 con 0x556850fb5fd0 2023-10-05T15:47:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.617+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556850fa7d50 con 0x556850fb5fd0 2023-10-05T15:47:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.618+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/378566479 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b54011600 con 0x556850fb5fd0 2023-10-05T15:47:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.620+0000 7f8b860a0b80 10 client.26798 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.620+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x556850d1bc00 con 0x556850fb5fd0 2023-10-05T15:47:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.620+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/378566479 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556850fa7d50 con 0x556850fb5fd0 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/378566479 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8b5401b8c0 con 0x556850fb5fd0 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b860a0b80 10 client.26798 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b860a0b80 10 client.26798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b860a0b80 20 client.26798 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556850fdba30 0x556850fdde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b860a0b80 4 client.26798 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:47:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.621+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556850f00db0 con 0x556850fdba30 2023-10-05T15:47:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.622+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556850fdba30 0x556850fdde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.623+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556850fdba30 0x556850fdde50 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62340c5d85611881 server_cookie=725f85c27110ef49 in_seq=0 out_seq=0 2023-10-05T15:47:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.623+0000 7f8b4b7fe700 10 client.26798 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.624+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/378566479 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556850f00db0 con 0x556850fdba30 2023-10-05T15:47:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.624+0000 7f8b4b7fe700 10 client.26798 handle_command_reply: tid=0 2023-10-05T15:47:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.624+0000 7f8b860a0b80 1 client.26798 shutdown 2023-10-05T15:47:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 msgr2=0x556850fd0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fd0140 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d960 tx=0x7f8b5400dc70 comp rx=0 tx=0).stop 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 shutdown_connections 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556850fdba30 0x556850fdde50 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb6990 0x556850fd7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fcfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/378566479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb5fd0 0x556850fd0140 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d960 tx=0x7f8b5400dc70 comp rx=0 tx=0).stop 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 >> 172.21.15.17:0/378566479 conn(0x556850f29200 msgr2=0x556850faf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.625+0000 7f8b4b7fe700 0 client.26798 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.626+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 shutdown_connections 2023-10-05T15:47:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.626+0000 7f8b860a0b80 1 -- 172.21.15.17:0/378566479 wait complete. 2023-10-05T15:47:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.626+0000 7f8b860a0b80 20 client.26798 trim_cache size 0 max 16384 2023-10-05T15:47:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.651+0000 7f8b860a0b80 1 Processor -- start 2023-10-05T15:47:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 -- start start 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850faf980 0x556850fdda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850d888c0 con 0x556850fb4ec0 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850fb9450 con 0x556850fb6990 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.652+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850fd0860 con 0x556850faf980 2023-10-05T15:47:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59962/0 (socket says 172.21.15.17:59962) 2023-10-05T15:47:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b70d9c700 1 -- 172.21.15.17:0/3144584611 learned_addr learned my addr 172.21.15.17:0/3144584611 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b63fff700 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850faf980 0x556850fdda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b63fff700 1 -- 172.21.15.17:0/3144584611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850faf980 msgr2=0x556850fdda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b63fff700 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850faf980 0x556850fdda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b63fff700 1 -- 172.21.15.17:0/3144584611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 msgr2=0x556850fce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b63fff700 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.653+0000 7f8b63fff700 1 -- 172.21.15.17:0/3144584611 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556850d591f0 con 0x556850fb6990 2023-10-05T15:47:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.654+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:47:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.654+0000 7f8b63fff700 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd70a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556850f7a8a0 tx=0x7f8b54005f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec7b178158a578f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.654+0000 7f8b62ffd700 1 -- 172.21.15.17:0/3144584611 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54004230 con 0x556850fb6990 2023-10-05T15:47:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.654+0000 7f8b62ffd700 1 -- 172.21.15.17:0/3144584611 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b54004010 con 0x556850fb6990 2023-10-05T15:47:11.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.654+0000 7f8b62ffd700 1 -- 172.21.15.17:0/3144584611 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b54005700 con 0x556850fb6990 2023-10-05T15:47:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3144584611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 msgr2=0x556850fd70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd70a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x556850f7a8a0 tx=0x7f8b54005f60 comp rx=0 tx=0).stop 2023-10-05T15:47:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3144584611 shutdown_connections 2023-10-05T15:47:11.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850faf980 0x556850fdda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850fb4ec0 0x556850fce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/3144584611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd70a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.655+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3144584611 >> 172.21.15.17:0/3144584611 conn(0x556850f29200 msgr2=0x556850faf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.656+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3144584611 shutdown_connections 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.656+0000 7f8b860a0b80 1 -- 172.21.15.17:0/3144584611 wait complete. 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.656+0000 7f8b860a0b80 1 -- start start 2023-10-05T15:47:11.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 Processor -- start 2023-10-05T15:47:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850faf980 0x556850fd4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fd5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850fd6560 con 0x556850faf980 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850fd66d0 con 0x556850fb6990 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556850fd6890 con 0x556850fb4ec0 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.657+0000 7f8b860a0b80 10 client.0 _ll_register_callbacks cb 0x7f8b54004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.658+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.658+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850faf980 0x556850fd4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.658+0000 7f8b70d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850faf980 0x556850fd4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59970/0 (socket says 172.21.15.17:59970) 2023-10-05T15:47:11.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.658+0000 7f8b70d9c700 1 -- 172.21.15.17:0/2189965673 learned_addr learned my addr 172.21.15.17:0/2189965673 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b70d9c700 1 -- 172.21.15.17:0/2189965673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 msgr2=0x556850fd5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fd5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b70d9c700 1 -- 172.21.15.17:0/2189965673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850faf980 msgr2=0x556850fd4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850faf980 0x556850fd4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b70d9c700 1 -- 172.21.15.17:0/2189965673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556850d1bc00 con 0x556850fb6990 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b70d9c700 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd6020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c010 tx=0x7f8b64009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fb0c2f5dcdd01bd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.659+0000 7f8b4b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.660+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/2189965673 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6403e070 con 0x556850fb6990 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.660+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/2189965673 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8b64000e40 con 0x556850fb6990 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.660+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b6401e040 con 0x556850fb6990 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.661+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/2189965673 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b6401d040 con 0x556850fb6990 2023-10-05T15:47:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.661+0000 7f8b860a0b80 10 client.26804 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.661+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x556850d31250 con 0x556850fb6990 2023-10-05T15:47:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.661+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/2189965673 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b6401e040 con 0x556850fb6990 2023-10-05T15:47:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/2189965673 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8b6400bb20 con 0x556850fb6990 2023-10-05T15:47:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b860a0b80 10 client.26804 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b860a0b80 10 client.26804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b860a0b80 20 client.26804 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:11.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556851030030 0x556851032450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b860a0b80 4 client.26804 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:47:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.662+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556850f00ad0 con 0x556851030030 2023-10-05T15:47:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.663+0000 7f8b63fff700 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556851030030 0x556851032450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.664+0000 7f8b63fff700 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556851030030 0x556851032450 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d743abb55a70f043 server_cookie=3717835375006c72 in_seq=0 out_seq=0 2023-10-05T15:47:11.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.664+0000 7f8b4b7fe700 10 client.26804 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.683+0000 7f8b4b7fe700 1 -- 172.21.15.17:0/2189965673 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556850f00ad0 con 0x556851030030 2023-10-05T15:47:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.683+0000 7f8b4b7fe700 10 client.26804 handle_command_reply: tid=0 2023-10-05T15:47:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.683+0000 7f8b860a0b80 1 client.26804 shutdown 2023-10-05T15:47:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.683+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 msgr2=0x556850fd6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.683+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd6020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c010 tx=0x7f8b64009f40 comp rx=0 tx=0).stop 2023-10-05T15:47:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 shutdown_connections 2023-10-05T15:47:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556851030030 0x556851032450 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556850fb6990 0x556850fd6020 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556850faf980 0x556850fd4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 --2- 172.21.15.17:0/2189965673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556850fb4ec0 0x556850fd5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b4b7fe700 0 client.26804 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 >> 172.21.15.17:0/2189965673 conn(0x556850f29200 msgr2=0x556850fce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 shutdown_connections 2023-10-05T15:47:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.684+0000 7f8b860a0b80 1 -- 172.21.15.17:0/2189965673 wait complete. 2023-10-05T15:47:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.685+0000 7f8b860a0b80 20 client.26804 trim_cache size 0 max 16384 2023-10-05T15:47:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:47:11.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:47:11.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:47:11.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:47:11.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.685+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b580a1650 msgr2=0x7f8b580a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.685+0000 7f8b727ff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b580a1650 0x7f8b580a3b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0a1070 tx=0x7f8b5c0cfe30 comp rx=0 tx=0).stop 2023-10-05T15:47:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.685+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c107eb0 msgr2=0x7f8b6c1a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.685+0000 7f8b727ff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c107eb0 0x7f8b6c1a5990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00ada0 tx=0x7f8b5c00c330 comp rx=0 tx=0).stop 2023-10-05T15:47:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 shutdown_connections 2023-10-05T15:47:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8b580a1650 0x7f8b580a3b10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b6c10d1f0 0x7f8b6c1a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b6c107eb0 0x7f8b6c1a5990 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 --2- 172.21.15.17:0/4292173332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b6c10a820 0x7f8b6c1a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 >> 172.21.15.17:0/4292173332 conn(0x7f8b6c06dd10 msgr2=0x7f8b6c109770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 shutdown_connections 2023-10-05T15:47:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:11.686+0000 7f8b727ff700 1 -- 172.21.15.17:0/4292173332 wait complete. 2023-10-05T15:47:12.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:47:12.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:11 smithi017 ceph-mon[129107]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.1 MiB/s wr, 617 op/s 2023-10-05T15:47:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:11 smithi167 ceph-mon[133366]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.1 MiB/s wr, 617 op/s 2023-10-05T15:47:12.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:11 smithi079 ceph-mon[132936]: pgmap v687: 129 pgs: 129 active+clean; 1.5 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.1 MiB/s wr, 617 op/s 2023-10-05T15:47:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.397+0000 7f40f9bff700 1 -- 172.21.15.17:0/12255642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 msgr2=0x7f40f4108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.397+0000 7f40f9bff700 1 --2- 172.21.15.17:0/12255642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 0x7f40f4108200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01c100 tx=0x7f40ec01c410 comp rx=0 tx=0).stop 2023-10-05T15:47:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.398+0000 7f40f9bff700 1 -- 172.21.15.17:0/12255642 shutdown_connections 2023-10-05T15:47:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.398+0000 7f40f9bff700 1 --2- 172.21.15.17:0/12255642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 0x7f40f4108200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.398+0000 7f40f9bff700 1 --2- 172.21.15.17:0/12255642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f40ffdc0 0x7f40f41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.398+0000 7f40f9bff700 1 --2- 172.21.15.17:0/12255642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f4100fb0 0x7f40f4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.398+0000 7f40f9bff700 1 -- 172.21.15.17:0/12255642 >> 172.21.15.17:0/12255642 conn(0x7f40f40fb330 msgr2=0x7f40f40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.398+0000 7f40f9bff700 1 -- 172.21.15.17:0/12255642 shutdown_connections 2023-10-05T15:47:12.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.399+0000 7f40f9bff700 1 -- 172.21.15.17:0/12255642 wait complete. 2023-10-05T15:47:12.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.400+0000 7f40f9bff700 1 Processor -- start 2023-10-05T15:47:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 -- start start 2023-10-05T15:47:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f40ffdc0 0x7f40f4071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 0x7f40f4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 0x7f40f4072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f419c4b0 con 0x7f40f40ffdc0 2023-10-05T15:47:12.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f419c620 con 0x7f40f4101950 2023-10-05T15:47:12.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.401+0000 7f40f9bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f419c7e0 con 0x7f40f4100fb0 2023-10-05T15:47:12.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.402+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 0x7f40f4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.402+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 0x7f40f4071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60734/0 (socket says 172.21.15.17:60734) 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.402+0000 7f40f2ffd700 1 -- 172.21.15.17:0/1693258754 learned_addr learned my addr 172.21.15.17:0/1693258754 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.402+0000 7f40f37fe700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f40ffdc0 0x7f40f4071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f2ffd700 1 -- 172.21.15.17:0/1693258754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 msgr2=0x7f40f4072000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 0x7f40f4072000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f2ffd700 1 -- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f40ffdc0 msgr2=0x7f40f4071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f40ffdc0 0x7f40f4071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f2ffd700 1 -- 172.21.15.17:0/1693258754 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec01ad10 con 0x7f40f4100fb0 2023-10-05T15:47:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 0x7f40f4071ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f40e800c9b0 tx=0x7f40e800cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:12.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.403+0000 7f40f37fe700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f40ffdc0 0x7f40f4071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:47:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.405+0000 7f40f0ff9700 1 -- 172.21.15.17:0/1693258754 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8007b00 con 0x7f40f4100fb0 2023-10-05T15:47:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.405+0000 7f40f0ff9700 1 -- 172.21.15.17:0/1693258754 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40e8007c60 con 0x7f40f4100fb0 2023-10-05T15:47:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.405+0000 7f40f0ff9700 1 -- 172.21.15.17:0/1693258754 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e610 con 0x7f40f4100fb0 2023-10-05T15:47:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.405+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f419cac0 con 0x7f40f4100fb0 2023-10-05T15:47:12.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.405+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f419cf80 con 0x7f40f4100fb0 2023-10-05T15:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.412+0000 7f410d5e2b80 1 Processor -- start 2023-10-05T15:47:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.413+0000 7f410d5e2b80 1 -- start start 2023-10-05T15:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.414+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6721690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.414+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6721bd0 0x5632c6722490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.414+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6722a70 0x5632c6722ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.414+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6678460 con 0x5632c6721270 2023-10-05T15:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.414+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6669c20 con 0x5632c6722a70 2023-10-05T15:47:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.414+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6667540 con 0x5632c6721bd0 2023-10-05T15:47:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.415+0000 7f40f37fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6721bd0 0x5632c6722490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.415+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6721690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.415+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6721690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59984/0 (socket says 172.21.15.17:59984) 2023-10-05T15:47:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.415+0000 7f40f3fff700 1 -- 172.21.15.17:0/3845332089 learned_addr learned my addr 172.21.15.17:0/3845332089 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.416+0000 7f40f3fff700 1 -- 172.21.15.17:0/3845332089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6721bd0 msgr2=0x5632c6722490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.416+0000 7f40f3fff700 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6721bd0 0x5632c6722490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.416+0000 7f40f3fff700 1 -- 172.21.15.17:0/3845332089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6722a70 msgr2=0x5632c6722ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.416+0000 7f40f3fff700 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6722a70 0x5632c6722ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.416+0000 7f40f3fff700 1 -- 172.21.15.17:0/3845332089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632c648dde0 con 0x5632c6721270 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.417+0000 7f40f0ff9700 1 -- 172.21.15.17:0/1693258754 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f40e800e830 con 0x7f40f4100fb0 2023-10-05T15:47:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.417+0000 7f40f3fff700 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6721690 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01c0d0 tx=0x7f40ec019c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae51af6e30783d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.418+0000 7f40d9ffb700 1 -- 172.21.15.17:0/3845332089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec01f040 con 0x5632c6721270 2023-10-05T15:47:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.418+0000 7f40d9ffb700 1 -- 172.21.15.17:0/3845332089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40ec019ed0 con 0x5632c6721270 2023-10-05T15:47:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.418+0000 7f40d9ffb700 1 -- 172.21.15.17:0/3845332089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec003ea0 con 0x5632c6721270 2023-10-05T15:47:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.419+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3845332089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 msgr2=0x5632c6721690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.419+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6721690 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01c0d0 tx=0x7f40ec019c80 comp rx=0 tx=0).stop 2023-10-05T15:47:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.419+0000 7f40f0ff9700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40dc0a1650 0x7f40dc0a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.419+0000 7f40f0ff9700 1 -- 172.21.15.17:0/1693258754 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f40e80cd3f0 con 0x7f40f4100fb0 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f40f3fff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40dc0a1650 0x7f40dc0a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3845332089 shutdown_connections 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6722a70 0x5632c6722ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6721690 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3845332089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6721bd0 0x5632c6722490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3845332089 >> 172.21.15.17:0/3845332089 conn(0x5632c6684260 msgr2=0x5632c670b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.420+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3845332089 shutdown_connections 2023-10-05T15:47:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.421+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3845332089 wait complete. 2023-10-05T15:47:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.421+0000 7f40f3fff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40dc0a1650 0x7f40dc0a3b10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01a040 tx=0x7f40ec01c410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.421+0000 7f410d5e2b80 1 -- start start 2023-10-05T15:47:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.422+0000 7f410d5e2b80 1 Processor -- start 2023-10-05T15:47:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c672b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c672b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6662e30 con 0x5632c6721270 2023-10-05T15:47:12.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c65ff710 con 0x5632c6721bd0 2023-10-05T15:47:12.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c65ff3b0 con 0x5632c6722a70 2023-10-05T15:47:12.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f410d5e2b80 10 client.0 _ll_register_callbacks cb 0x5632c645c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:12.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c672b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c672b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35416/0 (socket says 172.21.15.17:35416) 2023-10-05T15:47:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.423+0000 7f40f2ffd700 1 -- 172.21.15.17:0/3268713332 learned_addr learned my addr 172.21.15.17:0/3268713332 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.424+0000 7f40f37fe700 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c672b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.424+0000 7f40f3fff700 1 -- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 msgr2=0x5632c672b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.424+0000 7f40f3fff700 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c672b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.424+0000 7f40f3fff700 1 -- 172.21.15.17:0/3268713332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 msgr2=0x5632c672b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.424+0000 7f40f3fff700 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c672b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.424+0000 7f40f3fff700 1 -- 172.21.15.17:0/3268713332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f4108b50 con 0x5632c6722a70 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.425+0000 7f40f3fff700 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67325f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01aa30 tx=0x7f40ec01ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a313d2ea48ac70c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.425+0000 7f40d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.425+0000 7f40d2ffd700 1 -- 172.21.15.17:0/3268713332 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec02c8a0 con 0x5632c6722a70 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.425+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5632c6702f10 con 0x5632c6722a70 2023-10-05T15:47:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.425+0000 7f40d2ffd700 1 -- 172.21.15.17:0/3268713332 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f40ec01a3e0 con 0x5632c6722a70 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f40d2ffd700 1 -- 172.21.15.17:0/3268713332 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ec02ca00 con 0x5632c6722a70 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f410d5e2b80 10 client.26773 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5632c6476c60 con 0x5632c6722a70 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f40d2ffd700 1 -- 172.21.15.17:0/3268713332 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5632c6702f10 con 0x5632c6722a70 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f40d2ffd700 1 -- 172.21.15.17:0/3268713332 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f40ec04abf0 con 0x5632c6722a70 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f410d5e2b80 10 client.26773 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f410d5e2b80 10 client.26773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f410d5e2b80 20 client.26773 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:12.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.426+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c67369a0 0x5632c6738dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.427+0000 7f410d5e2b80 4 client.26773 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:47:12.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.427+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632c665be10 con 0x5632c67369a0 2023-10-05T15:47:12.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.427+0000 7f40f37fe700 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c67369a0 0x5632c6738dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.428+0000 7f40f37fe700 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c67369a0 0x5632c6738dc0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d21ddaa9038917de server_cookie=3a3349219140072e in_seq=0 out_seq=0 2023-10-05T15:47:12.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.428+0000 7f40d2ffd700 10 client.26773 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:12.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.429+0000 7f40d2ffd700 1 -- 172.21.15.17:0/3268713332 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5632c665be10 con 0x5632c67369a0 2023-10-05T15:47:12.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.429+0000 7f40d2ffd700 10 client.26773 handle_command_reply: tid=0 2023-10-05T15:47:12.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.429+0000 7f410d5e2b80 1 client.26773 shutdown 2023-10-05T15:47:12.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.430+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 msgr2=0x5632c67325f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.430+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67325f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01aa30 tx=0x7f40ec01ab90 comp rx=0 tx=0).stop 2023-10-05T15:47:12.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 shutdown_connections 2023-10-05T15:47:12.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c67369a0 0x5632c6738dc0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67325f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c672b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/3268713332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c672b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f40d2ffd700 0 client.26773 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:12.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.433+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 >> 172.21.15.17:0/3268713332 conn(0x5632c6684260 msgr2=0x5632c670af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:12.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.434+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 shutdown_connections 2023-10-05T15:47:12.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.434+0000 7f410d5e2b80 1 -- 172.21.15.17:0/3268713332 wait complete. 2023-10-05T15:47:12.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.435+0000 7f410d5e2b80 20 client.26773 trim_cache size 0 max 16384 2023-10-05T15:47:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 Processor -- start 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 -- start start 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6728ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c6732510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c672ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c672aa80 con 0x5632c6721270 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c64e3920 con 0x5632c6721bd0 2023-10-05T15:47:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.467+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c672a520 con 0x5632c6722a70 2023-10-05T15:47:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.468+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c6732510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.468+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c6732510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35424/0 (socket says 172.21.15.17:35424) 2023-10-05T15:47:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.468+0000 7f40f2ffd700 1 -- 172.21.15.17:0/118070333 learned_addr learned my addr 172.21.15.17:0/118070333 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.468+0000 7f40f37fe700 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6728ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.468+0000 7f40f3fff700 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c672ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.469+0000 7f40f2ffd700 1 -- 172.21.15.17:0/118070333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 msgr2=0x5632c672ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.469+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c672ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.469+0000 7f40f2ffd700 1 -- 172.21.15.17:0/118070333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 msgr2=0x5632c6728ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.469+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6728ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.469+0000 7f40f2ffd700 1 -- 172.21.15.17:0/118070333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632c64b4250 con 0x5632c6721bd0 2023-10-05T15:47:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.469+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c6732510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f40e80967c0 tx=0x7f40e809aa60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403d94b594e72575 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:12.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.470+0000 7f40da7fc700 1 -- 172.21.15.17:0/118070333 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e809e460 con 0x5632c6721bd0 2023-10-05T15:47:12.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.470+0000 7f40da7fc700 1 -- 172.21.15.17:0/118070333 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40e80a26a0 con 0x5632c6721bd0 2023-10-05T15:47:12.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.470+0000 7f40da7fc700 1 -- 172.21.15.17:0/118070333 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e809a570 con 0x5632c6721bd0 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 -- 172.21.15.17:0/118070333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 msgr2=0x5632c6732510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c6732510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f40e80967c0 tx=0x7f40e809aa60 comp rx=0 tx=0).stop 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 -- 172.21.15.17:0/118070333 shutdown_connections 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c672ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6728ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/118070333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c6732510 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.471+0000 7f410d5e2b80 1 -- 172.21.15.17:0/118070333 >> 172.21.15.17:0/118070333 conn(0x5632c6684260 msgr2=0x5632c6729d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:12.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.472+0000 7f410d5e2b80 1 -- 172.21.15.17:0/118070333 shutdown_connections 2023-10-05T15:47:12.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.472+0000 7f410d5e2b80 1 -- 172.21.15.17:0/118070333 wait complete. 2023-10-05T15:47:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.472+0000 7f410d5e2b80 1 -- start start 2023-10-05T15:47:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 Processor -- start 2023-10-05T15:47:12.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6731e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c67323d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6730b90 con 0x5632c6721270 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6730d00 con 0x5632c6721bd0 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.473+0000 7f410d5e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632c6730ec0 con 0x5632c6722a70 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.474+0000 7f410d5e2b80 10 client.0 _ll_register_callbacks cb 0x7f40ec018800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.475+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c67323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.475+0000 7f40f2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c67323d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35434/0 (socket says 172.21.15.17:35434) 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.475+0000 7f40f2ffd700 1 -- 172.21.15.17:0/494164458 learned_addr learned my addr 172.21.15.17:0/494164458 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.475+0000 7f40f3fff700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.476+0000 7f40f37fe700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6731e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.476+0000 7f40f2ffd700 1 -- 172.21.15.17:0/494164458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 msgr2=0x5632c67304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.476+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.476+0000 7f40f2ffd700 1 -- 172.21.15.17:0/494164458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 msgr2=0x5632c6731e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.476+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6731e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.476+0000 7f40f2ffd700 1 -- 172.21.15.17:0/494164458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f419cf80 con 0x5632c6721bd0 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.477+0000 7f40f2ffd700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c67323d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f40e80cd6e0 tx=0x7f40e8007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4015d4aa3223bf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:12.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.477+0000 7f40d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.478+0000 7f40d2ffd700 1 -- 172.21.15.17:0/494164458 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80cac00 con 0x5632c6721bd0 2023-10-05T15:47:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.478+0000 7f40d2ffd700 1 -- 172.21.15.17:0/494164458 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f40e80b0020 con 0x5632c6721bd0 2023-10-05T15:47:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.478+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40ec019ed0 con 0x5632c6721bd0 2023-10-05T15:47:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.478+0000 7f40d2ffd700 1 -- 172.21.15.17:0/494164458 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40e809e460 con 0x5632c6721bd0 2023-10-05T15:47:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.478+0000 7f410d5e2b80 10 client.26816 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:12.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5632c648c2b0 con 0x5632c6721bd0 2023-10-05T15:47:12.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f40d2ffd700 1 -- 172.21.15.17:0/494164458 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40ec019ed0 con 0x5632c6721bd0 2023-10-05T15:47:12.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f40d2ffd700 1 -- 172.21.15.17:0/494164458 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f40e80a22a0 con 0x5632c6721bd0 2023-10-05T15:47:12.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 10 client.26816 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:12.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 10 client.26816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:12.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 20 client.26816 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:12.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c678b7f0 0x5632c678dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:12.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 4 client.26816 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:47:12.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.479+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5632c665bb30 con 0x5632c678b7f0 2023-10-05T15:47:12.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.480+0000 7f40f37fe700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c678b7f0 0x5632c678dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:12.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f40f37fe700 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c678b7f0 0x5632c678dc10 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a0cc4cd107e834 server_cookie=7fef26ee5c0f17ea in_seq=0 out_seq=0 2023-10-05T15:47:12.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f40d2ffd700 10 client.26816 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:12.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f40d2ffd700 1 -- 172.21.15.17:0/494164458 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5632c665bb30 con 0x5632c678b7f0 2023-10-05T15:47:12.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f40d2ffd700 10 client.26816 handle_command_reply: tid=0 2023-10-05T15:47:12.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f410d5e2b80 1 client.26816 shutdown 2023-10-05T15:47:12.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 msgr2=0x5632c67323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.481+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c67323d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f40e80cd6e0 tx=0x7f40e8007f10 comp rx=0 tx=0).stop 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 shutdown_connections 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5632c678b7f0 0x5632c678dc10 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5632c6722a70 0x5632c67304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5632c6721270 0x5632c6731e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 --2- 172.21.15.17:0/494164458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5632c6721bd0 0x5632c67323d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 >> 172.21.15.17:0/494164458 conn(0x5632c6684260 msgr2=0x5632c6725a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f40d2ffd700 0 client.26816 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 shutdown_connections 2023-10-05T15:47:12.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.482+0000 7f410d5e2b80 1 -- 172.21.15.17:0/494164458 wait complete. 2023-10-05T15:47:12.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.483+0000 7f410d5e2b80 20 client.26816 trim_cache size 0 max 16384 2023-10-05T15:47:12.486 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:47:12.486 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:47:12.487 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40dc0a1650 msgr2=0x7f40dc0a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40dc0a1650 0x7f40dc0a3b10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f40ec01a040 tx=0x7f40ec01c410 comp rx=0 tx=0).stop 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 msgr2=0x7f40f4071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 0x7f40f4071ac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f40e800c9b0 tx=0x7f40e800cd70 comp rx=0 tx=0).stop 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 shutdown_connections 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40dc0a1650 0x7f40dc0a3b10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f4101950 0x7f40f4072000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40f40ffdc0 0x7f40f4071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 --2- 172.21.15.17:0/1693258754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40f4100fb0 0x7f40f4071ac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:12.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.484+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 >> 172.21.15.17:0/1693258754 conn(0x7f40f40fb330 msgr2=0x7f40f40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:12.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.485+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 shutdown_connections 2023-10-05T15:47:12.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:12.485+0000 7f40f9bff700 1 -- 172.21.15.17:0/1693258754 wait complete. 2023-10-05T15:47:12.517 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:47:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 515.0 s, 586.0 tps, lat 170.972 ms stddev 51.364 2023-10-05T15:47:13.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:12 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:47:13.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:12 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:47:13.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:12 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:47:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:13 smithi167 ceph-mon[133366]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 506 op/s 2023-10-05T15:47:14.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:13 smithi079 ceph-mon[132936]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 506 op/s 2023-10-05T15:47:14.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:13 smithi017 ceph-mon[129107]: pgmap v688: 129 pgs: 129 active+clean; 1.5 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 506 op/s 2023-10-05T15:47:15.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:14 smithi167 ceph-mon[133366]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2023-10-05T15:47:15.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:14 smithi079 ceph-mon[132936]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2023-10-05T15:47:15.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:14 smithi017 ceph-mon[129107]: pgmap v689: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.3 MiB/s wr, 701 op/s 2023-10-05T15:47:17.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:17 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:17 smithi167 ceph-mon[133366]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.8 MiB/s wr, 508 op/s 2023-10-05T15:47:17.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:17 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:17 smithi079 ceph-mon[132936]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.8 MiB/s wr, 508 op/s 2023-10-05T15:47:17.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:17 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:17.948 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:17 smithi017 ceph-mon[129107]: pgmap v690: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.8 MiB/s wr, 508 op/s 2023-10-05T15:47:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 520.0 s, 547.4 tps, lat 182.043 ms stddev 68.693 2023-10-05T15:47:20.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:19 smithi017 ceph-mon[129107]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.5 MiB/s wr, 616 op/s 2023-10-05T15:47:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:19 smithi167 ceph-mon[133366]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.5 MiB/s wr, 616 op/s 2023-10-05T15:47:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:19 smithi079 ceph-mon[132936]: pgmap v691: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.5 MiB/s wr, 616 op/s 2023-10-05T15:47:22.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:21 smithi017 ceph-mon[129107]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.7 MiB/s wr, 630 op/s 2023-10-05T15:47:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:21 smithi167 ceph-mon[133366]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.7 MiB/s wr, 630 op/s 2023-10-05T15:47:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:21 smithi079 ceph-mon[132936]: pgmap v692: 129 pgs: 129 active+clean; 1.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.7 MiB/s wr, 630 op/s 2023-10-05T15:47:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 525.0 s, 514.8 tps, lat 193.616 ms stddev 64.508 2023-10-05T15:47:23.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:22 smithi167 ceph-mon[133366]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 539 op/s 2023-10-05T15:47:23.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:22 smithi079 ceph-mon[132936]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 539 op/s 2023-10-05T15:47:23.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:22 smithi017 ceph-mon[129107]: pgmap v693: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 539 op/s 2023-10-05T15:47:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 -- 172.21.15.17:0/3070989667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a601090c0 msgr2=0x7f0a6010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 --2- 172.21.15.17:0/3070989667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a601090c0 0x7f0a6010f970 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0a5801c100 tx=0x7f0a5801c410 comp rx=0 tx=0).stop 2023-10-05T15:47:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 -- 172.21.15.17:0/3070989667 shutdown_connections 2023-10-05T15:47:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 --2- 172.21.15.17:0/3070989667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a601090c0 0x7f0a6010f970 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 --2- 172.21.15.17:0/3070989667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a60107530 0x7f0a60107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 --2- 172.21.15.17:0/3070989667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a60108720 0x7f0a60108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.961+0000 7f0a67dff700 1 -- 172.21.15.17:0/3070989667 >> 172.21.15.17:0/3070989667 conn(0x7f0a600764b0 msgr2=0x7f0a60078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.963+0000 7f0a67dff700 1 -- 172.21.15.17:0/3070989667 shutdown_connections 2023-10-05T15:47:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.964+0000 7f0a67dff700 1 -- 172.21.15.17:0/3070989667 wait complete. 2023-10-05T15:47:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.965+0000 7f0a67dff700 1 Processor -- start 2023-10-05T15:47:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.966+0000 7f0a67dff700 1 -- start start 2023-10-05T15:47:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.968+0000 7f0a67dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 0x7f0a60197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.968+0000 7f0a67dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a60108720 0x7f0a60199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.968+0000 7f0a67dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a601090c0 0x7f0a6019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.968+0000 7f0a67dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6019c7a0 con 0x7f0a60108720 2023-10-05T15:47:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.968+0000 7f0a67dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6019c910 con 0x7f0a60107530 2023-10-05T15:47:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.968+0000 7f0a67dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6019cad0 con 0x7f0a601090c0 2023-10-05T15:47:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.969+0000 7f0a65b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 0x7f0a60197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.969+0000 7f0a65b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 0x7f0a60197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50024/0 (socket says 172.21.15.17:50024) 2023-10-05T15:47:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.969+0000 7f0a65b9b700 1 -- 172.21.15.17:0/1506390302 learned_addr learned my addr 172.21.15.17:0/1506390302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.969+0000 7f0a6639c700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a601090c0 0x7f0a6019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.970+0000 7f0a6639c700 1 -- 172.21.15.17:0/1506390302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 msgr2=0x7f0a60197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.970+0000 7f0a6639c700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 0x7f0a60197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.970+0000 7f0a6639c700 1 -- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a60108720 msgr2=0x7f0a60199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.970+0000 7f0a6639c700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a60108720 0x7f0a60199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.970+0000 7f0a6639c700 1 -- 172.21.15.17:0/1506390302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5801ad10 con 0x7f0a601090c0 2023-10-05T15:47:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.970+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 0x7f0a60197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:47:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.971+0000 7f0a6639c700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a601090c0 0x7f0a6019bfd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a5801ace0 tx=0x7f0a5801a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.972+0000 7f0a56ffd700 1 -- 172.21.15.17:0/1506390302 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5801f040 con 0x7f0a601090c0 2023-10-05T15:47:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.972+0000 7f0a56ffd700 1 -- 172.21.15.17:0/1506390302 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a580054d0 con 0x7f0a601090c0 2023-10-05T15:47:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.972+0000 7f0a56ffd700 1 -- 172.21.15.17:0/1506390302 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5802c840 con 0x7f0a601090c0 2023-10-05T15:47:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.972+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a60079700 con 0x7f0a601090c0 2023-10-05T15:47:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.972+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a60079c40 con 0x7f0a601090c0 2023-10-05T15:47:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.980+0000 7f0a56ffd700 1 -- 172.21.15.17:0/1506390302 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0a58005040 con 0x7f0a601090c0 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.981+0000 7f0a7b7a1b80 1 Processor -- start 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.981+0000 7f0a7b7a1b80 1 -- start start 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.981+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 0x555832b622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b63450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b6a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832aca400 con 0x555832b61ec0 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832abbbc0 con 0x555832b63990 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832ab94e0 con 0x555832b62fd0 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a65b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b63450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a65b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b63450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42624/0 (socket says 172.21.15.17:42624) 2023-10-05T15:47:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.982+0000 7f0a65b9b700 1 -- 172.21.15.17:0/2211612761 learned_addr learned my addr 172.21.15.17:0/2211612761 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.983+0000 7f0a65b9b700 1 -- 172.21.15.17:0/2211612761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 msgr2=0x555832b6a220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.983+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b6a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.983+0000 7f0a65b9b700 1 -- 172.21.15.17:0/2211612761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 msgr2=0x555832b622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.983+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 0x555832b622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.983+0000 7f0a65b9b700 1 -- 172.21.15.17:0/2211612761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558328dfd80 con 0x555832b62fd0 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.985+0000 7f0a56ffd700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a4c0a1580 0x7f0a4c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.985+0000 7f0a56ffd700 1 -- 172.21.15.17:0/1506390302 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0a580df950 con 0x7f0a601090c0 2023-10-05T15:47:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.985+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b63450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009d80 tx=0x7f0a5c0304c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96fc4799bd92e6ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.986+0000 7f0a6539a700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a4c0a1580 0x7f0a4c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.986+0000 7f0a4bfff700 1 -- 172.21.15.17:0/2211612761 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0099e0 con 0x555832b62fd0 2023-10-05T15:47:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.986+0000 7f0a4bfff700 1 -- 172.21.15.17:0/2211612761 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a5c030c70 con 0x555832b62fd0 2023-10-05T15:47:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.986+0000 7f0a4bfff700 1 -- 172.21.15.17:0/2211612761 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c034640 con 0x555832b62fd0 2023-10-05T15:47:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.987+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/2211612761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 msgr2=0x555832b63450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.987+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b63450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009d80 tx=0x7f0a5c0304c0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a6539a700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a4c0a1580 0x7f0a4c0a3a40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x555832b61c60 tx=0x7f0a50006d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/2211612761 shutdown_connections 2023-10-05T15:47:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b6a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 0x555832b622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/2211612761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b63450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/2211612761 >> 172.21.15.17:0/2211612761 conn(0x555832ad6200 msgr2=0x555832b5cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.988+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/2211612761 shutdown_connections 2023-10-05T15:47:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.993+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/2211612761 wait complete. 2023-10-05T15:47:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.994+0000 7f0a7b7a1b80 1 -- start start 2023-10-05T15:47:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.994+0000 7f0a7b7a1b80 1 Processor -- start 2023-10-05T15:47:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.994+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b61ec0 0x555832b6bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.995+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b62fd0 0x555832b6c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.995+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.995+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832ab4dd0 con 0x555832b62fd0 2023-10-05T15:47:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.995+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832a516b0 con 0x555832b63990 2023-10-05T15:47:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.995+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832a51350 con 0x555832b61ec0 2023-10-05T15:47:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.995+0000 7f0a7b7a1b80 10 client.0 _ll_register_callbacks cb 0x5558328ae7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.996+0000 7f0a6539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b62fd0 0x555832b6c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.996+0000 7f0a6539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b62fd0 0x555832b6c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33168/0 (socket says 172.21.15.17:33168) 2023-10-05T15:47:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.996+0000 7f0a6539a700 1 -- 172.21.15.17:0/3246935545 learned_addr learned my addr 172.21.15.17:0/3246935545 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a6639c700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b61ec0 0x555832b6bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a65b9b700 1 -- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 msgr2=0x555832b730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a65b9b700 1 -- 172.21.15.17:0/3246935545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b62fd0 msgr2=0x555832b6c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b62fd0 0x555832b6c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:24.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.997+0000 7f0a65b9b700 1 -- 172.21.15.17:0/3246935545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c02f040 con 0x555832b61ec0 2023-10-05T15:47:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.998+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b61ec0 0x555832b6bb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009d50 tx=0x7f0a5c0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92d457971a35f8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.998+0000 7f0a497fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:47:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.998+0000 7f0a497fa700 1 -- 172.21.15.17:0/3246935545 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0359d0 con 0x555832b61ec0 2023-10-05T15:47:25.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.998+0000 7f0a497fa700 1 -- 172.21.15.17:0/3246935545 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0a5c03e660 con 0x555832b61ec0 2023-10-05T15:47:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.999+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555832b54d50 con 0x555832b61ec0 2023-10-05T15:47:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.999+0000 7f0a497fa700 1 -- 172.21.15.17:0/3246935545 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5c03e840 con 0x555832b61ec0 2023-10-05T15:47:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.999+0000 7f0a7b7a1b80 10 client.26788 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:25.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:24.999+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5558328c8c00 con 0x555832b61ec0 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.005+0000 7f0a497fa700 1 -- 172.21.15.17:0/3246935545 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555832b54d50 con 0x555832b61ec0 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.005+0000 7f0a497fa700 1 -- 172.21.15.17:0/3246935545 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0a5c051b80 con 0x555832b61ec0 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.006+0000 7f0a7b7a1b80 10 client.26788 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.006+0000 7f0a7b7a1b80 10 client.26788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.006+0000 7f0a7b7a1b80 20 client.26788 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.006+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832b77850 0x555832b79c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.006+0000 7f0a7b7a1b80 4 client.26788 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:47:25.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.006+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555832aaddb0 con 0x555832b77850 2023-10-05T15:47:25.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.007+0000 7f0a6539a700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832b77850 0x555832b79c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.008+0000 7f0a6539a700 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832b77850 0x555832b79c70 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3437310ad60d870a server_cookie=76d3e026c4f48268 in_seq=0 out_seq=0 2023-10-05T15:47:25.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.009+0000 7f0a497fa700 10 client.26788 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.009+0000 7f0a497fa700 1 -- 172.21.15.17:0/3246935545 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555832aaddb0 con 0x555832b77850 2023-10-05T15:47:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.009+0000 7f0a497fa700 10 client.26788 handle_command_reply: tid=0 2023-10-05T15:47:25.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.009+0000 7f0a7b7a1b80 1 client.26788 shutdown 2023-10-05T15:47:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.010+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b61ec0 msgr2=0x555832b6bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.010+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b61ec0 0x555832b6bb60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009d50 tx=0x7f0a5c0099e0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 shutdown_connections 2023-10-05T15:47:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832b77850 0x555832b79c70 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b61ec0 0x555832b6bb60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3246935545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b62fd0 0x555832b6c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 >> 172.21.15.17:0/3246935545 conn(0x555832ad6200 msgr2=0x555832b5c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.011+0000 7f0a497fa700 0 client.26788 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.012+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 shutdown_connections 2023-10-05T15:47:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.012+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3246935545 wait complete. 2023-10-05T15:47:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.012+0000 7f0a7b7a1b80 20 client.26788 trim_cache size 0 max 16384 2023-10-05T15:47:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.042+0000 7f0a7b7a1b80 1 Processor -- start 2023-10-05T15:47:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.043+0000 7f0a7b7a1b80 1 -- start start 2023-10-05T15:47:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.044+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 0x555832b69d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.044+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b6a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.044+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b63990 0x555832b73000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.044+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558329358c0 con 0x555832b63990 2023-10-05T15:47:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.044+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832b73540 con 0x555832b61ec0 2023-10-05T15:47:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.044+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832b59860 con 0x555832b62fd0 2023-10-05T15:47:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.045+0000 7f0a65b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 0x555832b69d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.045+0000 7f0a65b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 0x555832b69d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50038/0 (socket says 172.21.15.17:50038) 2023-10-05T15:47:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.045+0000 7f0a65b9b700 1 -- 172.21.15.17:0/1365059579 learned_addr learned my addr 172.21.15.17:0/1365059579 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.045+0000 7f0a6539a700 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b6a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a65b9b700 1 -- 172.21.15.17:0/1365059579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 msgr2=0x555832b6a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b6a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a65b9b700 1 -- 172.21.15.17:0/1365059579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b63990 msgr2=0x555832b73000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a6639c700 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b63990 0x555832b73000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b63990 0x555832b73000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a65b9b700 1 -- 172.21.15.17:0/1365059579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558329061f0 con 0x555832b61ec0 2023-10-05T15:47:25.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.046+0000 7f0a6639c700 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b63990 0x555832b73000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:47:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.047+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 0x555832b69d20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c031010 tx=0x7f0a5c0304c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da540020185d63a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.048+0000 7f0a54bff700 1 -- 172.21.15.17:0/1365059579 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0359d0 con 0x555832b61ec0 2023-10-05T15:47:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.048+0000 7f0a54bff700 1 -- 172.21.15.17:0/1365059579 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a5c047e40 con 0x555832b61ec0 2023-10-05T15:47:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.048+0000 7f0a54bff700 1 -- 172.21.15.17:0/1365059579 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c03ead0 con 0x555832b61ec0 2023-10-05T15:47:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.049+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/1365059579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 msgr2=0x555832b69d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.049+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 0x555832b69d20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c031010 tx=0x7f0a5c0304c0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.050+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/1365059579 shutdown_connections 2023-10-05T15:47:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.050+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b63990 0x555832b73000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.050+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b61ec0 0x555832b69d20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.050+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/1365059579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b6a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.050+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/1365059579 >> 172.21.15.17:0/1365059579 conn(0x555832ad6200 msgr2=0x555832b66850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:25.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.057+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/1365059579 shutdown_connections 2023-10-05T15:47:25.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.057+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/1365059579 wait complete. 2023-10-05T15:47:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.058+0000 7f0a7b7a1b80 1 -- start start 2023-10-05T15:47:25.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.058+0000 7f0a7b7a1b80 1 Processor -- start 2023-10-05T15:47:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.060+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 0x555832b70b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.060+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b71070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.060+0000 7f0a7b7a1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b72080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.061+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832b725c0 con 0x555832b61ec0 2023-10-05T15:47:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.061+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832b72730 con 0x555832b63990 2023-10-05T15:47:25.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.061+0000 7f0a7b7a1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555832b728f0 con 0x555832b62fd0 2023-10-05T15:47:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.061+0000 7f0a7b7a1b80 10 client.0 _ll_register_callbacks cb 0x7f0a5c009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:25.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.062+0000 7f0a6539a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b71070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.062+0000 7f0a6539a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b71070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:42654/0 (socket says 172.21.15.17:42654) 2023-10-05T15:47:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.062+0000 7f0a6539a700 1 -- 172.21.15.17:0/3637950841 learned_addr learned my addr 172.21.15.17:0/3637950841 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:25.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.062+0000 7f0a6639c700 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b72080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.063+0000 7f0a6639c700 1 -- 172.21.15.17:0/3637950841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 msgr2=0x555832b71070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.063+0000 7f0a6639c700 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b71070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.063+0000 7f0a6639c700 1 -- 172.21.15.17:0/3637950841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 msgr2=0x555832b70b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.063+0000 7f0a6639c700 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 0x555832b70b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.063+0000 7f0a6639c700 1 -- 172.21.15.17:0/3637950841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558328c8c00 con 0x555832b63990 2023-10-05T15:47:25.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.064+0000 7f0a6639c700 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b72080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0a580dd050 tx=0x7f0a58005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1853838c447546b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.066+0000 7f0a497fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.066+0000 7f0a497fa700 1 -- 172.21.15.17:0/3637950841 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580cc270 con 0x555832b63990 2023-10-05T15:47:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.066+0000 7f0a497fa700 1 -- 172.21.15.17:0/3637950841 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0a580b0a50 con 0x555832b63990 2023-10-05T15:47:25.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.067+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a5c030c70 con 0x555832b63990 2023-10-05T15:47:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.067+0000 7f0a497fa700 1 -- 172.21.15.17:0/3637950841 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a580b4c00 con 0x555832b63990 2023-10-05T15:47:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.067+0000 7f0a7b7a1b80 10 client.26831 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:25.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.067+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5558328de250 con 0x555832b63990 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a497fa700 1 -- 172.21.15.17:0/3637950841 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a5c030c70 con 0x555832b63990 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a497fa700 1 -- 172.21.15.17:0/3637950841 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0a580abef0 con 0x555832b63990 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a7b7a1b80 10 client.26831 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a7b7a1b80 10 client.26831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a7b7a1b80 20 client.26831 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832bcbeb0 0x555832bce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a7b7a1b80 4 client.26831 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:47:25.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.068+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555832aadad0 con 0x555832bcbeb0 2023-10-05T15:47:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.069+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832bcbeb0 0x555832bce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:25.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.070+0000 7f0a65b9b700 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832bcbeb0 0x555832bce2a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=406be196d3a081ae server_cookie=fba8d0a6219557e8 in_seq=0 out_seq=0 2023-10-05T15:47:25.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.070+0000 7f0a497fa700 10 client.26831 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.089+0000 7f0a497fa700 1 -- 172.21.15.17:0/3637950841 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555832aadad0 con 0x555832bcbeb0 2023-10-05T15:47:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.089+0000 7f0a497fa700 10 client.26831 handle_command_reply: tid=0 2023-10-05T15:47:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.089+0000 7f0a7b7a1b80 1 client.26831 shutdown 2023-10-05T15:47:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.090+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 msgr2=0x555832b72080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:25.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.090+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b72080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0a580dd050 tx=0x7f0a58005420 comp rx=0 tx=0).stop 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.091+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 shutdown_connections 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.091+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x555832bcbeb0 0x555832bce2a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.091+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555832b63990 0x555832b72080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.091+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555832b61ec0 0x555832b70b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.091+0000 7f0a7b7a1b80 1 --2- 172.21.15.17:0/3637950841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555832b62fd0 0x555832b71070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.091+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 >> 172.21.15.17:0/3637950841 conn(0x555832ad6200 msgr2=0x555832b66850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:25.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.092+0000 7f0a497fa700 0 client.26831 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:25.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.093+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 shutdown_connections 2023-10-05T15:47:25.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.093+0000 7f0a7b7a1b80 1 -- 172.21.15.17:0/3637950841 wait complete. 2023-10-05T15:47:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.096+0000 7f0a7b7a1b80 20 client.26831 trim_cache size 0 max 16384 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.097+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a4c0a1580 msgr2=0x7f0a4c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.097+0000 7f0a67dff700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a4c0a1580 0x7f0a4c0a3a40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x555832b61c60 tx=0x7f0a50006d90 comp rx=0 tx=0).stop 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.097+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a601090c0 msgr2=0x7f0a6019bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:25.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.097+0000 7f0a67dff700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a601090c0 0x7f0a6019bfd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a5801ace0 tx=0x7f0a5801a440 comp rx=0 tx=0).stop 2023-10-05T15:47:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.098+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 shutdown_connections 2023-10-05T15:47:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.098+0000 7f0a67dff700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0a4c0a1580 0x7f0a4c0a3a40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.098+0000 7f0a67dff700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a601090c0 0x7f0a6019bfd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.098+0000 7f0a67dff700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a60107530 0x7f0a60197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.098+0000 7f0a67dff700 1 --2- 172.21.15.17:0/1506390302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a60108720 0x7f0a60199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:25.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.098+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 >> 172.21.15.17:0/1506390302 conn(0x7f0a600764b0 msgr2=0x7f0a6006fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.100+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 shutdown_connections 2023-10-05T15:47:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:25.103+0000 7f0a67dff700 1 -- 172.21.15.17:0/1506390302 wait complete. 2023-10-05T15:47:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:25 smithi167 ceph-mon[133366]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.8 MiB/s wr, 676 op/s 2023-10-05T15:47:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:25 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:26.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:25 smithi079 ceph-mon[132936]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.8 MiB/s wr, 676 op/s 2023-10-05T15:47:26.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:26.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:25 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:26.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:25 smithi017 ceph-mon[129107]: pgmap v694: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.8 MiB/s wr, 676 op/s 2023-10-05T15:47:26.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:26.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:25 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:28.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 530.0 s, 435.8 tps, lat 232.486 ms stddev 215.604 2023-10-05T15:47:28.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:27 smithi017 ceph-mon[129107]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 487 op/s 2023-10-05T15:47:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:47:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:47:28.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:28.344 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:27 smithi167 ceph-mon[133366]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 487 op/s 2023-10-05T15:47:28.345 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:47:28.345 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:47:28.345 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:27 smithi079 ceph-mon[132936]: pgmap v695: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.7 MiB/s wr, 487 op/s 2023-10-05T15:47:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:47:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:47:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:47:30.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:29 smithi017 ceph-mon[129107]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2023-10-05T15:47:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:29 smithi167 ceph-mon[133366]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2023-10-05T15:47:30.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:29 smithi079 ceph-mon[132936]: pgmap v696: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2023-10-05T15:47:32.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:31 smithi017 ceph-mon[129107]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.2 MiB/s wr, 585 op/s 2023-10-05T15:47:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:31 smithi167 ceph-mon[133366]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.2 MiB/s wr, 585 op/s 2023-10-05T15:47:32.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:31 smithi079 ceph-mon[132936]: pgmap v697: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.2 MiB/s wr, 585 op/s 2023-10-05T15:47:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 535.0 s, 572.2 tps, lat 173.885 ms stddev 68.322 2023-10-05T15:47:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:33 smithi017 ceph-mon[129107]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 498 op/s 2023-10-05T15:47:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:33 smithi167 ceph-mon[133366]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 498 op/s 2023-10-05T15:47:34.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:33 smithi079 ceph-mon[132936]: pgmap v698: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 498 op/s 2023-10-05T15:47:36.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:35 smithi017 ceph-mon[129107]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.6 MiB/s wr, 678 op/s 2023-10-05T15:47:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:35 smithi167 ceph-mon[133366]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.6 MiB/s wr, 678 op/s 2023-10-05T15:47:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:35 smithi079 ceph-mon[132936]: pgmap v699: 129 pgs: 129 active+clean; 1.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.6 MiB/s wr, 678 op/s 2023-10-05T15:47:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 540.0 s, 589.6 tps, lat 169.590 ms stddev 50.858 2023-10-05T15:47:38.202 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:37 smithi017 ceph-mon[129107]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 520 op/s 2023-10-05T15:47:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:37 smithi167 ceph-mon[133366]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 520 op/s 2023-10-05T15:47:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:37 smithi079 ceph-mon[132936]: pgmap v700: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 520 op/s 2023-10-05T15:47:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.396+0000 7f27c85ff700 1 -- 172.21.15.17:0/782343675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c00ff760 msgr2=0x7f27c0101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.396+0000 7f27c85ff700 1 --2- 172.21.15.17:0/782343675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c00ff760 0x7f27c0101b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009990 tx=0x7f27bc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 -- 172.21.15.17:0/782343675 shutdown_connections 2023-10-05T15:47:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 --2- 172.21.15.17:0/782343675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0104aa0 0x7f27c0104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 --2- 172.21.15.17:0/782343675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c00ff760 0x7f27c0101b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 --2- 172.21.15.17:0/782343675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c01020d0 0x7f27c0104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 -- 172.21.15.17:0/782343675 >> 172.21.15.17:0/782343675 conn(0x7f27c00fb340 msgr2=0x7f27c00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 -- 172.21.15.17:0/782343675 shutdown_connections 2023-10-05T15:47:38.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.397+0000 7f27c85ff700 1 -- 172.21.15.17:0/782343675 wait complete. 2023-10-05T15:47:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.399+0000 7f27c85ff700 1 Processor -- start 2023-10-05T15:47:38.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.399+0000 7f27c85ff700 1 -- start start 2023-10-05T15:47:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c85ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 0x7f27c019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c85ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c01020d0 0x7f27c019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c85ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0104aa0 0x7f27c019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c85ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c019ec30 con 0x7f27c0104aa0 2023-10-05T15:47:38.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c85ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c019eda0 con 0x7f27c01020d0 2023-10-05T15:47:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c85ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c019ef60 con 0x7f27c00ff760 2023-10-05T15:47:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c639b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 0x7f27c019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c639b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 0x7f27c019d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44330/0 (socket says 172.21.15.17:44330) 2023-10-05T15:47:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c639b700 1 -- 172.21.15.17:0/2752089487 learned_addr learned my addr 172.21.15.17:0/2752089487 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:38.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.400+0000 7f27c5b9a700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c01020d0 0x7f27c019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.401+0000 7f27c639b700 1 -- 172.21.15.17:0/2752089487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c01020d0 msgr2=0x7f27c019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.401+0000 7f27c639b700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c01020d0 0x7f27c019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.401+0000 7f27c639b700 1 -- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0104aa0 msgr2=0x7f27c019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.401+0000 7f27c639b700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0104aa0 0x7f27c019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.401+0000 7f27c639b700 1 -- 172.21.15.17:0/2752089487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc0095f0 con 0x7f27c00ff760 2023-10-05T15:47:38.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.402+0000 7f27c639b700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 0x7f27c019d210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27bc000c00 tx=0x7f27bc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:38.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.404+0000 7f27b77fe700 1 -- 172.21.15.17:0/2752089487 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc01d070 con 0x7f27c00ff760 2023-10-05T15:47:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.404+0000 7f27b77fe700 1 -- 172.21.15.17:0/2752089487 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27bc00bdb0 con 0x7f27c00ff760 2023-10-05T15:47:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.404+0000 7f27b77fe700 1 -- 172.21.15.17:0/2752089487 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc00fd50 con 0x7f27c00ff760 2023-10-05T15:47:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.404+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c019f1e0 con 0x7f27c00ff760 2023-10-05T15:47:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.404+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c01a5a00 con 0x7f27c00ff760 2023-10-05T15:47:38.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.413+0000 7f27b77fe700 1 -- 172.21.15.17:0/2752089487 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f27bc00f4f0 con 0x7f27c00ff760 2023-10-05T15:47:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.415+0000 7f27dbeb3b80 1 Processor -- start 2023-10-05T15:47:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 -- start start 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0cec0 0x55c190f0d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0dfd0 0x55c190f0e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f15220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190e75400 con 0x55c190f0cec0 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190e66bc0 con 0x55c190f0dfd0 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.416+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190e644e0 con 0x55c190f0e990 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.417+0000 7f27c5b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f15220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.417+0000 7f27c5b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f15220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44346/0 (socket says 172.21.15.17:44346) 2023-10-05T15:47:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.417+0000 7f27c5b9a700 1 -- 172.21.15.17:0/4125535144 learned_addr learned my addr 172.21.15.17:0/4125535144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.418+0000 7f27c5b9a700 1 -- 172.21.15.17:0/4125535144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0dfd0 msgr2=0x55c190f0e450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:47:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.418+0000 7f27c5b9a700 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0dfd0 0x55c190f0e450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.418+0000 7f27c5b9a700 1 -- 172.21.15.17:0/4125535144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0cec0 msgr2=0x55c190f0d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.418+0000 7f27c5b9a700 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0cec0 0x55c190f0d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.418+0000 7f27c5b9a700 1 -- 172.21.15.17:0/4125535144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c190c8ad80 con 0x55c190f0e990 2023-10-05T15:47:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.419+0000 7f27b77fe700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f27ac0a1680 0x7f27ac0a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.419+0000 7f27b77fe700 1 -- 172.21.15.17:0/2752089487 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f27bc0ce670 con 0x7f27c00ff760 2023-10-05T15:47:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.419+0000 7f27c5b9a700 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f15220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009d80 tx=0x7f27b0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebbd6e681444e602 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.420+0000 7f27c6b9c700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f27ac0a1680 0x7f27ac0a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.420+0000 7f27b4bfe700 1 -- 172.21.15.17:0/4125535144 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0004230 con 0x55c190f0e990 2023-10-05T15:47:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.420+0000 7f27b4bfe700 1 -- 172.21.15.17:0/4125535144 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27b0004390 con 0x55c190f0e990 2023-10-05T15:47:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.420+0000 7f27b4bfe700 1 -- 172.21.15.17:0/4125535144 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0019790 con 0x55c190f0e990 2023-10-05T15:47:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.421+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4125535144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 msgr2=0x55c190f15220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.421+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f15220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009d80 tx=0x7f27b0011720 comp rx=0 tx=0).stop 2023-10-05T15:47:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.421+0000 7f27c6b9c700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f27ac0a1680 0x7f27ac0a3b40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f27b80060b0 tx=0x7f27b800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4125535144 shutdown_connections 2023-10-05T15:47:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f15220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0cec0 0x55c190f0d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4125535144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0dfd0 0x55c190f0e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4125535144 >> 172.21.15.17:0/4125535144 conn(0x55c190e81200 msgr2=0x55c190f07bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4125535144 shutdown_connections 2023-10-05T15:47:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.422+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4125535144 wait complete. 2023-10-05T15:47:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.423+0000 7f27dbeb3b80 1 -- start start 2023-10-05T15:47:38.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.423+0000 7f27dbeb3b80 1 Processor -- start 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0cec0 0x55c190f16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 0x55c190f1e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190e5fdd0 con 0x55c190f0dfd0 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190dfc6b0 con 0x55c190f0e990 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190dfc350 con 0x55c190f0cec0 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.424+0000 7f27dbeb3b80 10 client.0 _ll_register_callbacks cb 0x55c190c597a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.425+0000 7f27c5b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.425+0000 7f27c6b9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 0x55c190f1e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.425+0000 7f27c6b9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 0x55c190f1e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36766/0 (socket says 172.21.15.17:36766) 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.425+0000 7f27c6b9c700 1 -- 172.21.15.17:0/853397678 learned_addr learned my addr 172.21.15.17:0/853397678 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.425+0000 7f27c639b700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0cec0 0x55c190f16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c6b9c700 1 -- 172.21.15.17:0/853397678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0cec0 msgr2=0x55c190f16c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c6b9c700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0cec0 0x55c190f16c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c6b9c700 1 -- 172.21.15.17:0/853397678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 msgr2=0x55c190f171a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c6b9c700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f171a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c6b9c700 1 -- 172.21.15.17:0/853397678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b00099e0 con 0x55c190f0e990 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c639b700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0cec0 0x55c190f16c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.426+0000 7f27c6b9c700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 0x55c190f1e1e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f27b8015dc0 tx=0x7f27b8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f94cb9d9534bd73a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.427+0000 7f27a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.427+0000 7f27a9ffb700 1 -- 172.21.15.17:0/853397678 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b800ee30 con 0x55c190f0e990 2023-10-05T15:47:38.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.427+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c190effd50 con 0x55c190f0e990 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.427+0000 7f27a9ffb700 1 -- 172.21.15.17:0/853397678 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f27b8013be0 con 0x55c190f0e990 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.428+0000 7f27a9ffb700 1 -- 172.21.15.17:0/853397678 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27b8013da0 con 0x55c190f0e990 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.428+0000 7f27dbeb3b80 10 client.26840 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.428+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55c190c73c00 con 0x55c190f0e990 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.428+0000 7f27a9ffb700 1 -- 172.21.15.17:0/853397678 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c190effd50 con 0x55c190f0e990 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27a9ffb700 1 -- 172.21.15.17:0/853397678 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f27b801f3f0 con 0x55c190f0e990 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27dbeb3b80 10 client.26840 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27dbeb3b80 10 client.26840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27dbeb3b80 20 client.26840 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f22ac0 0x55c190f24ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27dbeb3b80 4 client.26840 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:47:38.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.429+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c190e58db0 con 0x55c190f22ac0 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.431+0000 7f27c639b700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f22ac0 0x55c190f24ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.432+0000 7f27c639b700 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f22ac0 0x55c190f24ee0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=484c1f55da0b1ff8 server_cookie=dfe4599811de65bb in_seq=0 out_seq=0 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.432+0000 7f27a9ffb700 10 client.26840 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.434+0000 7f27a9ffb700 1 -- 172.21.15.17:0/853397678 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c190e58db0 con 0x55c190f22ac0 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.434+0000 7f27a9ffb700 10 client.26840 handle_command_reply: tid=0 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.434+0000 7f27dbeb3b80 1 client.26840 shutdown 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 msgr2=0x55c190f1e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 0x55c190f1e1e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f27b8015dc0 tx=0x7f27b8009920 comp rx=0 tx=0).stop 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 shutdown_connections 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f22ac0 0x55c190f24ee0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0e990 0x55c190f1e1e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0cec0 0x55c190f16c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/853397678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f171a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 >> 172.21.15.17:0/853397678 conn(0x55c190e81200 msgr2=0x55c190f07250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27a9ffb700 0 client.26840 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 shutdown_connections 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.435+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/853397678 wait complete. 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.436+0000 7f27dbeb3b80 20 client.26840 trim_cache size 0 max 16384 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.461+0000 7f27dbeb3b80 1 Processor -- start 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 -- start start 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f1e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f1e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f11a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190f16670 con 0x55c190f0dfd0 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190ce08c0 con 0x55c190f0cec0 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.462+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190f167d0 con 0x55c190f0e990 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.463+0000 7f27c639b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f1e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.463+0000 7f27c639b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f1e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36768/0 (socket says 172.21.15.17:36768) 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.463+0000 7f27c639b700 1 -- 172.21.15.17:0/4057949530 learned_addr learned my addr 172.21.15.17:0/4057949530 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.464+0000 7f27c639b700 1 -- 172.21.15.17:0/4057949530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 msgr2=0x55c190f11a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.464+0000 7f27c639b700 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f11a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.464+0000 7f27c639b700 1 -- 172.21.15.17:0/4057949530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 msgr2=0x55c190f1e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.464+0000 7f27c639b700 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f1e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.464+0000 7f27c639b700 1 -- 172.21.15.17:0/4057949530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c190cb11f0 con 0x55c190f0cec0 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.465+0000 7f27c639b700 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f1e9b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27bc09b320 tx=0x7f27bc086040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c0a855a1d484a7d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.465+0000 7f27b53ff700 1 -- 172.21.15.17:0/4057949530 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc09af80 con 0x55c190f0cec0 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.465+0000 7f27b53ff700 1 -- 172.21.15.17:0/4057949530 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27bc016e40 con 0x55c190f0cec0 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.465+0000 7f27b53ff700 1 -- 172.21.15.17:0/4057949530 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0a39b0 con 0x55c190f0cec0 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4057949530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 msgr2=0x55c190f1e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f1e9b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27bc09b320 tx=0x7f27bc086040 comp rx=0 tx=0).stop 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4057949530 shutdown_connections 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0e990 0x55c190f11a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f1e9b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/4057949530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0dfd0 0x55c190f1e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.466+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4057949530 >> 172.21.15.17:0/4057949530 conn(0x55c190e81200 msgr2=0x55c190f15860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.467+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4057949530 shutdown_connections 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.467+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/4057949530 wait complete. 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.467+0000 7f27dbeb3b80 1 -- start start 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.467+0000 7f27dbeb3b80 1 Processor -- start 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f19d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0dfd0 0x55c190f1a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0e990 0x55c190f1d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190f1d810 con 0x55c190f0e990 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190f1d980 con 0x55c190f0cec0 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c190f1db40 con 0x55c190f0dfd0 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.468+0000 7f27dbeb3b80 10 client.0 _ll_register_callbacks cb 0x55c190c597a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c5b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0dfd0 0x55c190f1a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c6b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0e990 0x55c190f1d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c5b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0dfd0 0x55c190f1a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44374/0 (socket says 172.21.15.17:44374) 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c5b9a700 1 -- 172.21.15.17:0/2146559772 learned_addr learned my addr 172.21.15.17:0/2146559772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f19d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 -- 172.21.15.17:0/2146559772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0dfd0 msgr2=0x55c190f1a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0dfd0 0x55c190f1a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 -- 172.21.15.17:0/2146559772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0e990 msgr2=0x55c190f1d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0e990 0x55c190f1d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 -- 172.21.15.17:0/2146559772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c01a5a00 con 0x55c190f0cec0 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27c639b700 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f19d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55c190f16080 tx=0x7f27bc0cbce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8e56018d2b751a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.469+0000 7f27a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.470+0000 7f27a9ffb700 1 -- 172.21.15.17:0/2146559772 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc07e070 con 0x55c190f0cec0 2023-10-05T15:47:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.470+0000 7f27a9ffb700 1 -- 172.21.15.17:0/2146559772 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f27bc09b620 con 0x55c190f0cec0 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.470+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27b0004390 con 0x55c190f0cec0 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.470+0000 7f27a9ffb700 1 -- 172.21.15.17:0/2146559772 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27bc09bd20 con 0x55c190f0cec0 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.470+0000 7f27dbeb3b80 10 client.26846 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.470+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55c190c89250 con 0x55c190f0cec0 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27a9ffb700 1 -- 172.21.15.17:0/2146559772 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27b0004390 con 0x55c190f0cec0 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27a9ffb700 1 -- 172.21.15.17:0/2146559772 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f27bc09b880 con 0x55c190f0cec0 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27dbeb3b80 10 client.26846 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27dbeb3b80 10 client.26846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27dbeb3b80 20 client.26846 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f882f0 0x55c190f8a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27dbeb3b80 4 client.26846 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:47:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c190e58ad0 con 0x55c190f882f0 2023-10-05T15:47:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.471+0000 7f27c5b9a700 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f882f0 0x55c190f8a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.473+0000 7f27c5b9a700 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f882f0 0x55c190f8a6e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5bb6dcbf18c45c server_cookie=bd88d281cd482f2f in_seq=0 out_seq=0 2023-10-05T15:47:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.473+0000 7f27a9ffb700 10 client.26846 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.503+0000 7f27a9ffb700 1 -- 172.21.15.17:0/2146559772 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c190e58ad0 con 0x55c190f882f0 2023-10-05T15:47:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.503+0000 7f27a9ffb700 10 client.26846 handle_command_reply: tid=0 2023-10-05T15:47:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.503+0000 7f27dbeb3b80 1 client.26846 shutdown 2023-10-05T15:47:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 msgr2=0x55c190f19d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f19d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55c190f16080 tx=0x7f27bc0cbce0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 shutdown_connections 2023-10-05T15:47:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55c190f882f0 0x55c190f8a6e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c190f0e990 0x55c190f1d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c190f0cec0 0x55c190f19d70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 --2- 172.21.15.17:0/2146559772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c190f0dfd0 0x55c190f1a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 >> 172.21.15.17:0/2146559772 conn(0x55c190e81200 msgr2=0x55c190f1e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.504+0000 7f27a9ffb700 0 client.26846 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.505+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 shutdown_connections 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.505+0000 7f27dbeb3b80 1 -- 172.21.15.17:0/2146559772 wait complete. 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.505+0000 7f27dbeb3b80 20 client.26846 trim_cache size 0 max 16384 2023-10-05T15:47:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f27ac0a1680 msgr2=0x7f27ac0a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f27ac0a1680 0x7f27ac0a3b40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f27b80060b0 tx=0x7f27b800b040 comp rx=0 tx=0).stop 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 msgr2=0x7f27c019d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 0x7f27c019d210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27bc000c00 tx=0x7f27bc004730 comp rx=0 tx=0).stop 2023-10-05T15:47:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 shutdown_connections 2023-10-05T15:47:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f27ac0a1680 0x7f27ac0a3b40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0104aa0 0x7f27c019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27c00ff760 0x7f27c019d210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 --2- 172.21.15.17:0/2752089487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27c01020d0 0x7f27c019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.507+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 >> 172.21.15.17:0/2752089487 conn(0x7f27c00fb340 msgr2=0x7f27c0102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.508+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 shutdown_connections 2023-10-05T15:47:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:38.508+0000 7f27c85ff700 1 -- 172.21.15.17:0/2752089487 wait complete. 2023-10-05T15:47:40.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:39 smithi017 ceph-mon[129107]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.2 MiB/s wr, 613 op/s 2023-10-05T15:47:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:39 smithi167 ceph-mon[133366]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.2 MiB/s wr, 613 op/s 2023-10-05T15:47:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:39 smithi079 ceph-mon[132936]: pgmap v701: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.2 MiB/s wr, 613 op/s 2023-10-05T15:47:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:41 smithi167 ceph-mon[133366]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.6 MiB/s wr, 650 op/s 2023-10-05T15:47:42.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:41 smithi079 ceph-mon[132936]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.6 MiB/s wr, 650 op/s 2023-10-05T15:47:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:41 smithi017 ceph-mon[129107]: pgmap v702: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.6 MiB/s wr, 650 op/s 2023-10-05T15:47:42.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:47:43.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.002+0000 7f2661fff700 1 -- 172.21.15.17:0/401869789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c074ef0 msgr2=0x7f265c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.002+0000 7f2661fff700 1 --2- 172.21.15.17:0/401869789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c074ef0 0x7f265c073340 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f265400b0a0 tx=0x7f265400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.003+0000 7f2661fff700 1 -- 172.21.15.17:0/401869789 shutdown_connections 2023-10-05T15:47:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.003+0000 7f2661fff700 1 --2- 172.21.15.17:0/401869789 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f265c10d510 0x7f265c10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.003+0000 7f2661fff700 1 --2- 172.21.15.17:0/401869789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c074ef0 0x7f265c073340 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.003+0000 7f2661fff700 1 --2- 172.21.15.17:0/401869789 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f265c073910 0x7f265c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.003+0000 7f2661fff700 1 -- 172.21.15.17:0/401869789 >> 172.21.15.17:0/401869789 conn(0x7f265c0fc4d0 msgr2=0x7f265c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.005+0000 7f2661fff700 1 -- 172.21.15.17:0/401869789 shutdown_connections 2023-10-05T15:47:43.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.006+0000 7f2661fff700 1 -- 172.21.15.17:0/401869789 wait complete. 2023-10-05T15:47:43.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.007+0000 7f2661fff700 1 Processor -- start 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 -- start start 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f265c073910 0x7f265c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f265c074ef0 0x7f265c06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 0x7f265c1ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c072de0 con 0x7f265c10d510 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c072f50 con 0x7f265c074ef0 2023-10-05T15:47:43.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.008+0000 7f2661fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c1ad780 con 0x7f265c073910 2023-10-05T15:47:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.009+0000 7f265bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 0x7f265c1ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.009+0000 7f265affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f265c074ef0 0x7f265c06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.009+0000 7f265bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 0x7f265c1ad240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44090/0 (socket says 172.21.15.17:44090) 2023-10-05T15:47:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.009+0000 7f265bfff700 1 -- 172.21.15.17:0/1379091888 learned_addr learned my addr 172.21.15.17:0/1379091888 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f265bfff700 1 -- 172.21.15.17:0/1379091888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f265c073910 msgr2=0x7f265c06f7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:47:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f265bfff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f265c073910 0x7f265c06f7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f265bfff700 1 -- 172.21.15.17:0/1379091888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f265c074ef0 msgr2=0x7f265c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f265bfff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f265c074ef0 0x7f265c06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f265bfff700 1 -- 172.21.15.17:0/1379091888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654009d00 con 0x7f265c10d510 2023-10-05T15:47:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f265bfff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 0x7f265c1ad240 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f265000d980 tx=0x7f265000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.010+0000 7f2658ff9700 1 -- 172.21.15.17:0/1379091888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650004a30 con 0x7f265c10d510 2023-10-05T15:47:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.011+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c1ada30 con 0x7f265c10d510 2023-10-05T15:47:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.011+0000 7f2658ff9700 1 -- 172.21.15.17:0/1379091888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f265000b5c0 con 0x7f265c10d510 2023-10-05T15:47:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.011+0000 7f2658ff9700 1 -- 172.21.15.17:0/1379091888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650009a40 con 0x7f265c10d510 2023-10-05T15:47:43.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.011+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c1adf40 con 0x7f265c10d510 2023-10-05T15:47:43.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.016+0000 7f2658ff9700 1 -- 172.21.15.17:0/1379091888 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f2650009c60 con 0x7f265c10d510 2023-10-05T15:47:43.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.018+0000 7f26759f2b80 1 Processor -- start 2023-10-05T15:47:43.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 -- start start 2023-10-05T15:47:43.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214d8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214d9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562321440460 con 0x5623214d8bc0 2023-10-05T15:47:43.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x562321431c20 con 0x5623214d9a60 2023-10-05T15:47:43.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.019+0000 7f26759f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56232142f540 con 0x5623214d8260 2023-10-05T15:47:43.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214d8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214d8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44396/0 (socket says 172.21.15.17:44396) 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 -- 172.21.15.17:0/998098397 learned_addr learned my addr 172.21.15.17:0/998098397 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214d9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 -- 172.21.15.17:0/998098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 msgr2=0x5623214d9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214d9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 -- 172.21.15.17:0/998098397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 msgr2=0x5623214d9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.020+0000 7f265affd700 1 -- 172.21.15.17:0/998098397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562321255de0 con 0x5623214d8260 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f265affd700 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214d8680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f264c005c50 tx=0x7f264c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a19c023f0c41962c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f2658ff9700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26440a1550 0x7f26440a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f2641ffb700 1 -- 172.21.15.17:0/998098397 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c004030 con 0x5623214d8260 2023-10-05T15:47:43.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f2641ffb700 1 -- 172.21.15.17:0/998098397 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f264c011e90 con 0x5623214d8260 2023-10-05T15:47:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f2641ffb700 1 -- 172.21.15.17:0/998098397 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c003e70 con 0x5623214d8260 2023-10-05T15:47:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f2658ff9700 1 -- 172.21.15.17:0/1379091888 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f26500ccf50 con 0x7f265c10d510 2023-10-05T15:47:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.021+0000 7f265b7fe700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26440a1550 0x7f26440a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 -- 172.21.15.17:0/998098397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 msgr2=0x5623214d8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214d8680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f264c005c50 tx=0x7f264c0047c0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 -- 172.21.15.17:0/998098397 shutdown_connections 2023-10-05T15:47:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214d9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214d8680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 --2- 172.21.15.17:0/998098397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214d9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.022+0000 7f26759f2b80 1 -- 172.21.15.17:0/998098397 >> 172.21.15.17:0/998098397 conn(0x56232144c260 msgr2=0x5623214d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:43.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.023+0000 7f265b7fe700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26440a1550 0x7f26440a3a10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2654009610 tx=0x7f265400b740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:43.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.023+0000 7f26759f2b80 1 -- 172.21.15.17:0/998098397 shutdown_connections 2023-10-05T15:47:43.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.023+0000 7f26759f2b80 1 -- 172.21.15.17:0/998098397 wait complete. 2023-10-05T15:47:43.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.024+0000 7f26759f2b80 1 -- start start 2023-10-05T15:47:43.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.024+0000 7f26759f2b80 1 Processor -- start 2023-10-05T15:47:43.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8bc0 0x5623214f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x5623214fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56232142ae30 con 0x5623214d9a60 2023-10-05T15:47:43.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623213c7710 con 0x5623214d8bc0 2023-10-05T15:47:43.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623213c73b0 con 0x5623214d8260 2023-10-05T15:47:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.025+0000 7f26759f2b80 10 client.0 _ll_register_callbacks cb 0x562321224800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.026+0000 7f265bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x5623214fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.026+0000 7f265bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x5623214fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44110/0 (socket says 172.21.15.17:44110) 2023-10-05T15:47:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.026+0000 7f265bfff700 1 -- 172.21.15.17:0/3298261396 learned_addr learned my addr 172.21.15.17:0/3298261396 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:43.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.026+0000 7f265affd700 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8bc0 0x5623214f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f265bfff700 1 -- 172.21.15.17:0/3298261396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 msgr2=0x5623214f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f265bfff700 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f265bfff700 1 -- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8bc0 msgr2=0x5623214f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f265bfff700 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8bc0 0x5623214f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f265bfff700 1 -- 172.21.15.17:0/3298261396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c019040 con 0x5623214d9a60 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f265bfff700 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x5623214fa5b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2650099e60 tx=0x7f2650099830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85989f7db7bda75b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:43.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.027+0000 7f263affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:47:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.028+0000 7f263affd700 1 -- 172.21.15.17:0/3298261396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500995c0 con 0x5623214d9a60 2023-10-05T15:47:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.028+0000 7f263affd700 1 -- 172.21.15.17:0/3298261396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f265009e020 con 0x5623214d9a60 2023-10-05T15:47:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.028+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623214caf10 con 0x5623214d9a60 2023-10-05T15:47:43.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.029+0000 7f263affd700 1 -- 172.21.15.17:0/3298261396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26500b8170 con 0x5623214d9a60 2023-10-05T15:47:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.029+0000 7f26759f2b80 10 client.16896 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.029+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56232123ec60 con 0x5623214d9a60 2023-10-05T15:47:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.029+0000 7f263affd700 1 -- 172.21.15.17:0/3298261396 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f265007c080 con 0x5623214d9a60 2023-10-05T15:47:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.029+0000 7f263affd700 1 -- 172.21.15.17:0/3298261396 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f265000e9d0 con 0x5623214d9a60 2023-10-05T15:47:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f26759f2b80 10 client.16896 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:43.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f26759f2b80 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f26759f2b80 20 client.16896 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f26759f2b80 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5623214fee40 0x562321501260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f26759f2b80 4 client.16896 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562321423e10 con 0x5623214fee40 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.030+0000 7f265b7fe700 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5623214fee40 0x562321501260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.031+0000 7f265b7fe700 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5623214fee40 0x562321501260 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d382341ec46bfc4 server_cookie=a36d13048e4581a0 in_seq=0 out_seq=0 2023-10-05T15:47:43.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.031+0000 7f263affd700 10 client.16896 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:43.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.031+0000 7f263affd700 1 -- 172.21.15.17:0/3298261396 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562321423e10 con 0x5623214fee40 2023-10-05T15:47:43.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f263affd700 10 client.16896 handle_command_reply: tid=0 2023-10-05T15:47:43.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 client.16896 shutdown 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 msgr2=0x5623214fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x5623214fa5b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2650099e60 tx=0x7f2650099830 comp rx=0 tx=0).stop 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 shutdown_connections 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5623214fee40 0x562321501260 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x5623214fa5b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 --2- 172.21.15.17:0/3298261396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8bc0 0x5623214f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 >> 172.21.15.17:0/3298261396 conn(0x56232144c260 msgr2=0x5623214d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:43.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f263affd700 0 client.16896 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 shutdown_connections 2023-10-05T15:47:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.032+0000 7f26759f2b80 1 -- 172.21.15.17:0/3298261396 wait complete. 2023-10-05T15:47:43.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.033+0000 7f26759f2b80 20 client.16896 trim_cache size 0 max 16384 2023-10-05T15:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.067+0000 7f26759f2b80 1 Processor -- start 2023-10-05T15:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 -- start start 2023-10-05T15:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 0x5623214dfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 0x5623214fa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x562321500e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623214f2c00 con 0x5623214d9a60 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623212ab920 con 0x5623214d8260 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f26759f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623214d9310 con 0x5623214d8bc0 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f265affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 0x5623214fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.068+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 0x5623214dfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 0x5623214dfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:36840/0 (socket says 172.21.15.17:36840) 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 -- 172.21.15.17:0/1017778925 learned_addr learned my addr 172.21.15.17:0/1017778925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265bfff700 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x562321500e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 -- 172.21.15.17:0/1017778925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 msgr2=0x5623214fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 0x5623214fa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44418/0 (socket says 172.21.15.17:44418) 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 0x5623214fa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 -- 172.21.15.17:0/1017778925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 msgr2=0x562321500e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x562321500e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.069+0000 7f265b7fe700 1 -- 172.21.15.17:0/1017778925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56232127c250 con 0x5623214d8260 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.070+0000 7f265affd700 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 0x5623214fa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.070+0000 7f265b7fe700 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 0x5623214dfe70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f265400b0a0 tx=0x7f2654005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee9dedd7ca92942 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:43.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.071+0000 7f26427fc700 1 -- 172.21.15.17:0/1017778925 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400bcb0 con 0x5623214d8260 2023-10-05T15:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.071+0000 7f26427fc700 1 -- 172.21.15.17:0/1017778925 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f265402e070 con 0x5623214d8260 2023-10-05T15:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.071+0000 7f26427fc700 1 -- 172.21.15.17:0/1017778925 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265402a2b0 con 0x5623214d8260 2023-10-05T15:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.072+0000 7f26759f2b80 1 -- 172.21.15.17:0/1017778925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 msgr2=0x5623214dfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.072+0000 7f26759f2b80 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 0x5623214dfe70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f265400b0a0 tx=0x7f2654005040 comp rx=0 tx=0).stop 2023-10-05T15:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.073+0000 7f26759f2b80 1 -- 172.21.15.17:0/1017778925 shutdown_connections 2023-10-05T15:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.073+0000 7f26759f2b80 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d9a60 0x562321500e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.073+0000 7f26759f2b80 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d8260 0x5623214dfe70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.073+0000 7f26759f2b80 1 --2- 172.21.15.17:0/1017778925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8bc0 0x5623214fa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.074+0000 7f26759f2b80 1 -- 172.21.15.17:0/1017778925 >> 172.21.15.17:0/1017778925 conn(0x56232144c260 msgr2=0x5623214f1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.074+0000 7f26759f2b80 1 -- 172.21.15.17:0/1017778925 shutdown_connections 2023-10-05T15:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.074+0000 7f26759f2b80 1 -- 172.21.15.17:0/1017778925 wait complete. 2023-10-05T15:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.074+0000 7f26759f2b80 1 -- start start 2023-10-05T15:47:43.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 Processor -- start 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214f8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623214f8c30 con 0x5623214d8bc0 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623214f8da0 con 0x5623214d9a60 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623214f8f60 con 0x5623214d8260 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.075+0000 7f26759f2b80 10 client.0 _ll_register_callbacks cb 0x7f2650099d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.076+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.076+0000 7f265b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44426/0 (socket says 172.21.15.17:44426) 2023-10-05T15:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.076+0000 7f265b7fe700 1 -- 172.21.15.17:0/603708325 learned_addr learned my addr 172.21.15.17:0/603708325 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:43.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.076+0000 7f265bfff700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.076+0000 7f265affd700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.077+0000 7f265b7fe700 1 -- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 msgr2=0x5623214f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.077+0000 7f265b7fe700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.077+0000 7f265b7fe700 1 -- 172.21.15.17:0/603708325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 msgr2=0x5623214fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.077+0000 7f265b7fe700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214fa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.077+0000 7f265b7fe700 1 -- 172.21.15.17:0/603708325 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c1102b0 con 0x5623214d8260 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.077+0000 7f265b7fe700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f9f10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2654007a00 tx=0x7f2654003ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b203f5417bb4be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f263affd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f263affd700 1 -- 172.21.15.17:0/603708325 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265402aa30 con 0x5623214d8260 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f263affd700 1 -- 172.21.15.17:0/603708325 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f265402ab90 con 0x5623214d8260 2023-10-05T15:47:43.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f264c011e90 con 0x5623214d8260 2023-10-05T15:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f263affd700 1 -- 172.21.15.17:0/603708325 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f265402ad50 con 0x5623214d8260 2023-10-05T15:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f26759f2b80 10 client.26818 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:43.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.078+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5623212542b0 con 0x5623214d8260 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f263affd700 1 -- 172.21.15.17:0/603708325 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f264c011e90 con 0x5623214d8260 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f263affd700 1 -- 172.21.15.17:0/603708325 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2654005420 con 0x5623214d8260 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f26759f2b80 10 client.26818 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f26759f2b80 10 client.26818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f26759f2b80 20 client.26818 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f26759f2b80 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562321553b50 0x562321555f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f26759f2b80 4 client.26818 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:47:43.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.079+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562321423b30 con 0x562321553b50 2023-10-05T15:47:43.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.082+0000 7f265affd700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562321553b50 0x562321555f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.082+0000 7f265affd700 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562321553b50 0x562321555f70 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0c39a5a108a64b4 server_cookie=56cea919d8468f28 in_seq=0 out_seq=0 2023-10-05T15:47:43.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.083+0000 7f263affd700 10 client.26818 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.084+0000 7f263affd700 1 -- 172.21.15.17:0/603708325 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562321423b30 con 0x562321553b50 2023-10-05T15:47:43.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.084+0000 7f263affd700 10 client.26818 handle_command_reply: tid=0 2023-10-05T15:47:43.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.084+0000 7f26759f2b80 1 client.26818 shutdown 2023-10-05T15:47:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 msgr2=0x5623214f9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f9f10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2654007a00 tx=0x7f2654003ab0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 shutdown_connections 2023-10-05T15:47:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x562321553b50 0x562321555f70 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5623214d9a60 0x5623214f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5623214d8260 0x5623214f9f10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 --2- 172.21.15.17:0/603708325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5623214d8bc0 0x5623214fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.085+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 >> 172.21.15.17:0/603708325 conn(0x56232144c260 msgr2=0x562321500e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.086+0000 7f263affd700 0 client.26818 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.086+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 shutdown_connections 2023-10-05T15:47:43.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.086+0000 7f26759f2b80 1 -- 172.21.15.17:0/603708325 wait complete. 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:47:43.090 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.086+0000 7f26759f2b80 20 client.26818 trim_cache size 0 max 16384 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26440a1550 msgr2=0x7f26440a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26440a1550 0x7f26440a3a10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2654009610 tx=0x7f265400b740 comp rx=0 tx=0).stop 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 msgr2=0x7f265c1ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 0x7f265c1ad240 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f265000d980 tx=0x7f265000dc90 comp rx=0 tx=0).stop 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 shutdown_connections 2023-10-05T15:47:43.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f26440a1550 0x7f26440a3a10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f265c10d510 0x7f265c1ad240 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f265c073910 0x7f265c06f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 --2- 172.21.15.17:0/1379091888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f265c074ef0 0x7f265c06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:43.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.088+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 >> 172.21.15.17:0/1379091888 conn(0x7f265c0fc4d0 msgr2=0x7f265c0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:43.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.089+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 shutdown_connections 2023-10-05T15:47:43.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:47:43.089+0000 7f2661fff700 1 -- 172.21.15.17:0/1379091888 wait complete. 2023-10-05T15:47:43.127 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:47:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 545.0 s, 646.6 tps, lat 154.502 ms stddev 50.361 2023-10-05T15:47:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:43 smithi167 ceph-mon[133366]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 539 op/s 2023-10-05T15:47:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:43 smithi079 ceph-mon[132936]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 539 op/s 2023-10-05T15:47:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:43 smithi017 ceph-mon[129107]: pgmap v703: 129 pgs: 129 active+clean; 1.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.5 MiB/s wr, 539 op/s 2023-10-05T15:47:45.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:45 smithi167 ceph-mon[133366]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.5 MiB/s wr, 729 op/s 2023-10-05T15:47:45.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:45 smithi079 ceph-mon[132936]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.5 MiB/s wr, 729 op/s 2023-10-05T15:47:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:45 smithi017 ceph-mon[129107]: pgmap v704: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.5 MiB/s wr, 729 op/s 2023-10-05T15:47:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 550.0 s, 530.2 tps, lat 188.185 ms stddev 57.013 2023-10-05T15:47:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:47 smithi167 ceph-mon[133366]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 536 op/s 2023-10-05T15:47:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:47 smithi079 ceph-mon[132936]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 536 op/s 2023-10-05T15:47:48.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:47 smithi017 ceph-mon[129107]: pgmap v705: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 536 op/s 2023-10-05T15:47:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:49 smithi079 ceph-mon[132936]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 615 op/s 2023-10-05T15:47:50.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:49 smithi017 ceph-mon[129107]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 615 op/s 2023-10-05T15:47:51.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:51 smithi079 ceph-mon[132936]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 619 op/s 2023-10-05T15:47:51.446 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:49 smithi167 ceph-mon[133366]: pgmap v706: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 615 op/s 2023-10-05T15:47:51.446 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:51 smithi167 ceph-mon[133366]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 619 op/s 2023-10-05T15:47:51.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:51 smithi017 ceph-mon[129107]: pgmap v707: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 619 op/s 2023-10-05T15:47:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.174+0000 7fbabbdff700 1 -- 172.21.15.17:0/2465984132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4073910 msgr2=0x7fbab4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.174+0000 7fbabbdff700 1 --2- 172.21.15.17:0/2465984132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4073910 0x7fbab4073d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40098f0 tx=0x7fbaa4009c00 comp rx=0 tx=0).stop 2023-10-05T15:47:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 -- 172.21.15.17:0/2465984132 shutdown_connections 2023-10-05T15:47:52.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 --2- 172.21.15.17:0/2465984132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4108dd0 0x7fbab410b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 --2- 172.21.15.17:0/2465984132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4074ef0 0x7fbab4073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 --2- 172.21.15.17:0/2465984132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4073910 0x7fbab4073d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 -- 172.21.15.17:0/2465984132 >> 172.21.15.17:0/2465984132 conn(0x7fbab40fc460 msgr2=0x7fbab40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:52.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 -- 172.21.15.17:0/2465984132 shutdown_connections 2023-10-05T15:47:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.176+0000 7fbabbdff700 1 -- 172.21.15.17:0/2465984132 wait complete. 2023-10-05T15:47:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.178+0000 7fbabbdff700 1 Processor -- start 2023-10-05T15:47:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.178+0000 7fbabbdff700 1 -- start start 2023-10-05T15:47:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.178+0000 7fbabbdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4073910 0x7fbab419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbabbdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 0x7fbab419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbabbdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4108dd0 0x7fbab419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbabbdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419ec60 con 0x7fbab4074ef0 2023-10-05T15:47:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbabbdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419edd0 con 0x7fbab4073910 2023-10-05T15:47:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbabbdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419ef90 con 0x7fbab4108dd0 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbab939a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 0x7fbab419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbab939a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 0x7fbab419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33464/0 (socket says 172.21.15.17:33464) 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.179+0000 7fbab939a700 1 -- 172.21.15.17:0/246271697 learned_addr learned my addr 172.21.15.17:0/246271697 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.180+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4073910 0x7fbab419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.180+0000 7fbab939a700 1 -- 172.21.15.17:0/246271697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4108dd0 msgr2=0x7fbab419e600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.180+0000 7fbab939a700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4108dd0 0x7fbab419e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.180+0000 7fbab939a700 1 -- 172.21.15.17:0/246271697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4073910 msgr2=0x7fbab419d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.180+0000 7fbab939a700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4073910 0x7fbab419d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.180+0000 7fbab939a700 1 -- 172.21.15.17:0/246271697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab00095f0 con 0x7fbab4074ef0 2023-10-05T15:47:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.181+0000 7fbab939a700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 0x7fbab419d780 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009fd0 tx=0x7fbaa400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.181+0000 7fbaaaffd700 1 -- 172.21.15.17:0/246271697 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa401c070 con 0x7fbab4074ef0 2023-10-05T15:47:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.181+0000 7fbaaaffd700 1 -- 172.21.15.17:0/246271697 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaa400f7d0 con 0x7fbab4074ef0 2023-10-05T15:47:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.181+0000 7fbaaaffd700 1 -- 172.21.15.17:0/246271697 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4003b10 con 0x7fbab4074ef0 2023-10-05T15:47:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.181+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4009520 con 0x7fbab4074ef0 2023-10-05T15:47:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.182+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab419f450 con 0x7fbab4074ef0 2023-10-05T15:47:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.188+0000 7fbaaaffd700 1 -- 172.21.15.17:0/246271697 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fbaa4020030 con 0x7fbab4074ef0 2023-10-05T15:47:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.189+0000 7fbacf7e3b80 1 Processor -- start 2023-10-05T15:47:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.189+0000 7fbacf7e3b80 1 -- start start 2023-10-05T15:47:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 0x561d28cb72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cb8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb8990 0x561d28cbf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28c1f400 con 0x561d28cb7fd0 2023-10-05T15:47:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28c10bc0 con 0x561d28cb8990 2023-10-05T15:47:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28c0e4e0 con 0x561d28cb6ec0 2023-10-05T15:47:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbaba39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 0x561d28cb72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbaba39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 0x561d28cb72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60576/0 (socket says 172.21.15.17:60576) 2023-10-05T15:47:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.190+0000 7fbaba39c700 1 -- 172.21.15.17:0/82142691 learned_addr learned my addr 172.21.15.17:0/82142691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaba39c700 1 -- 172.21.15.17:0/82142691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb8990 msgr2=0x561d28cbf220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:47:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaba39c700 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb8990 0x561d28cbf220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaba39c700 1 -- 172.21.15.17:0/82142691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 msgr2=0x561d28cb8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaba39c700 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cb8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaba39c700 1 -- 172.21.15.17:0/82142691 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d28a34d80 con 0x561d28cb6ec0 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaba39c700 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 0x561d28cb72e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00c110 tx=0x7fbaac00c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80bdb6e74b71635f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.191+0000 7fbaaaffd700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbaa00a1650 0x7fbaa00a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.192+0000 7fba9ffff700 1 -- 172.21.15.17:0/82142691 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac012420 con 0x561d28cb6ec0 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.192+0000 7fbaaaffd700 1 -- 172.21.15.17:0/246271697 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbaa40ce180 con 0x7fbab4074ef0 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.192+0000 7fba9ffff700 1 -- 172.21.15.17:0/82142691 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaac007ac0 con 0x561d28cb6ec0 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.192+0000 7fba9ffff700 1 -- 172.21.15.17:0/82142691 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac011890 con 0x561d28cb6ec0 2023-10-05T15:47:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.192+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbaa00a1650 0x7fbaa00a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.193+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/82142691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 msgr2=0x561d28cb72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.193+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 0x561d28cb72e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00c110 tx=0x7fbaac00c420 comp rx=0 tx=0).stop 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.194+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/82142691 shutdown_connections 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.194+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb8990 0x561d28cbf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.194+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb6ec0 0x561d28cb72e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.194+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/82142691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cb8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.194+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/82142691 >> 172.21.15.17:0/82142691 conn(0x561d28c2b200 msgr2=0x561d28cb1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.194+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbaa00a1650 0x7fbaa00a3b10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbab00095c0 tx=0x7fbab0009510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.195+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/82142691 shutdown_connections 2023-10-05T15:47:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.195+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/82142691 wait complete. 2023-10-05T15:47:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.196+0000 7fbacf7e3b80 1 -- start start 2023-10-05T15:47:52.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.196+0000 7fbacf7e3b80 1 Processor -- start 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 0x561d28cc0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cc11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28c09dd0 con 0x561d28cb7fd0 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28ba66b0 con 0x561d28cb6ec0 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28ba6350 con 0x561d28cb8990 2023-10-05T15:47:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.197+0000 7fbacf7e3b80 10 client.0 _ll_register_callbacks cb 0x561d28a037a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.198+0000 7fbab9b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 0x561d28cc0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.198+0000 7fbab9b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 0x561d28cc0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34826/0 (socket says 172.21.15.17:34826) 2023-10-05T15:47:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.198+0000 7fbab9b9b700 1 -- 172.21.15.17:0/3647660235 learned_addr learned my addr 172.21.15.17:0/3647660235 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.198+0000 7fbab939a700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cc11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.198+0000 7fbaba39c700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab939a700 1 -- 172.21.15.17:0/3647660235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 msgr2=0x561d28cc8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab939a700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab939a700 1 -- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 msgr2=0x561d28cc0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab939a700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 0x561d28cc0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab939a700 1 -- 172.21.15.17:0/3647660235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac007c40 con 0x561d28cb7fd0 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 0x561d28cc0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbaba39c700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:47:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fbab939a700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cc11d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40cb880 tx=0x7fbaa4021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338437780c9b28d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.199+0000 7fba9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:47:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.200+0000 7fba9d7fa700 1 -- 172.21.15.17:0/3647660235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa409f280 con 0x561d28cb7fd0 2023-10-05T15:47:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.200+0000 7fba9d7fa700 1 -- 172.21.15.17:0/3647660235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbaa40a3430 con 0x561d28cb7fd0 2023-10-05T15:47:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.200+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d28c02db0 con 0x561d28cb7fd0 2023-10-05T15:47:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.201+0000 7fba9d7fa700 1 -- 172.21.15.17:0/3647660235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaa4097840 con 0x561d28cb7fd0 2023-10-05T15:47:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.201+0000 7fbacf7e3b80 10 client.16908 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.201+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x561d28a1dc00 con 0x561d28cb7fd0 2023-10-05T15:47:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fba9d7fa700 1 -- 172.21.15.17:0/3647660235 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561d28c02db0 con 0x561d28cb7fd0 2023-10-05T15:47:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fba9d7fa700 1 -- 172.21.15.17:0/3647660235 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbaa409b390 con 0x561d28cb7fd0 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbacf7e3b80 10 client.16908 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbacf7e3b80 10 client.16908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbacf7e3b80 20 client.16908 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28ccc790 0x561d28cceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbacf7e3b80 4 client.16908 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d28c02ad0 con 0x561d28ccc790 2023-10-05T15:47:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.202+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28ccc790 0x561d28cceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.203+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28ccc790 0x561d28cceb80 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c014ff2e44a9a2d0 server_cookie=d9cdac78b4b935e1 in_seq=0 out_seq=0 2023-10-05T15:47:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.203+0000 7fba9d7fa700 10 client.16908 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.204+0000 7fba9d7fa700 1 -- 172.21.15.17:0/3647660235 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561d28c02ad0 con 0x561d28ccc790 2023-10-05T15:47:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.204+0000 7fba9d7fa700 10 client.16908 handle_command_reply: tid=0 2023-10-05T15:47:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.204+0000 7fbacf7e3b80 1 client.16908 shutdown 2023-10-05T15:47:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.205+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 msgr2=0x561d28cc11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.205+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cc11d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40cb880 tx=0x7fbaa4021400 comp rx=0 tx=0).stop 2023-10-05T15:47:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 shutdown_connections 2023-10-05T15:47:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28ccc790 0x561d28cceb80 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb6ec0 0x561d28cc0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3647660235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb7fd0 0x561d28cc11d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 >> 172.21.15.17:0/3647660235 conn(0x561d28c2b200 msgr2=0x561d28cb1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fba9d7fa700 0 client.16908 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 shutdown_connections 2023-10-05T15:47:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.206+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3647660235 wait complete. 2023-10-05T15:47:52.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.207+0000 7fbacf7e3b80 20 client.16908 trim_cache size 0 max 16384 2023-10-05T15:47:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 Processor -- start 2023-10-05T15:47:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 -- start start 2023-10-05T15:47:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 0x561d28cbf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cbeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28a8a8c0 con 0x561d28cb6ec0 2023-10-05T15:47:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28cc1b90 con 0x561d28cb7fd0 2023-10-05T15:47:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.233+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28cc0140 con 0x561d28cb8990 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.234+0000 7fbaba39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cbeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.234+0000 7fbaba39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cbeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60594/0 (socket says 172.21.15.17:60594) 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.234+0000 7fbaba39c700 1 -- 172.21.15.17:0/3894519745 learned_addr learned my addr 172.21.15.17:0/3894519745 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.235+0000 7fbab939a700 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.235+0000 7fbaba39c700 1 -- 172.21.15.17:0/3894519745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 msgr2=0x561d28cc81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.235+0000 7fbaba39c700 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.235+0000 7fbaba39c700 1 -- 172.21.15.17:0/3894519745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 msgr2=0x561d28cbf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.235+0000 7fbaba39c700 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 0x561d28cbf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.235+0000 7fbaba39c700 1 -- 172.21.15.17:0/3894519745 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d28a5b1f0 con 0x561d28cb8990 2023-10-05T15:47:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.236+0000 7fbaba39c700 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cbeed0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00c110 tx=0x7fbaac007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da9fd252faed46d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.236+0000 7fbaa8bff700 1 -- 172.21.15.17:0/3894519745 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac003a00 con 0x561d28cb8990 2023-10-05T15:47:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.236+0000 7fbaa8bff700 1 -- 172.21.15.17:0/3894519745 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaac012420 con 0x561d28cb8990 2023-10-05T15:47:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.236+0000 7fbaa8bff700 1 -- 172.21.15.17:0/3894519745 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac005310 con 0x561d28cb8990 2023-10-05T15:47:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3894519745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 msgr2=0x561d28cbeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cbeed0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00c110 tx=0x7fbaac007a00 comp rx=0 tx=0).stop 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3894519745 shutdown_connections 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cbeed0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 0x561d28cbf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/3894519745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.237+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3894519745 >> 172.21.15.17:0/3894519745 conn(0x561d28c2b200 msgr2=0x561d28cb1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.238+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3894519745 shutdown_connections 2023-10-05T15:47:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.238+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/3894519745 wait complete. 2023-10-05T15:47:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.238+0000 7fbacf7e3b80 1 -- start start 2023-10-05T15:47:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.239+0000 7fbacf7e3b80 1 Processor -- start 2023-10-05T15:47:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.239+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 0x561d28cc5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.239+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.239+0000 7fbacf7e3b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.239+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28cc7570 con 0x561d28cb6ec0 2023-10-05T15:47:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.239+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28cc76e0 con 0x561d28cb7fd0 2023-10-05T15:47:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.240+0000 7fbacf7e3b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d28cc78a0 con 0x561d28cb8990 2023-10-05T15:47:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.240+0000 7fbacf7e3b80 10 client.0 _ll_register_callbacks cb 0x561d28a037a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:47:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.240+0000 7fbab939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.240+0000 7fbab939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34844/0 (socket says 172.21.15.17:34844) 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.240+0000 7fbab939a700 1 -- 172.21.15.17:0/1392384972 learned_addr learned my addr 172.21.15.17:0/1392384972 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.240+0000 7fbaba39c700 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fbab939a700 1 -- 172.21.15.17:0/1392384972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 msgr2=0x561d28cc7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fbab939a700 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fbab939a700 1 -- 172.21.15.17:0/1392384972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 msgr2=0x561d28cc5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fbab939a700 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 0x561d28cc5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fbab939a700 1 -- 172.21.15.17:0/1392384972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d28a34d80 con 0x561d28cb7fd0 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fbab939a700 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc6020 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbaa409b710 tx=0x7fbaa4097470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aa60ee9cda27b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:47:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fba9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:47:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fba9d7fa700 1 -- 172.21.15.17:0/1392384972 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40a7070 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.241+0000 7fba9d7fa700 1 -- 172.21.15.17:0/1392384972 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fbaa40a3430 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.242+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d28ca9d50 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.242+0000 7fba9d7fa700 1 -- 172.21.15.17:0/1392384972 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaa409a8a0 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.242+0000 7fbacf7e3b80 10 client.26876 fetch_fsmap learned FSMap version 41 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.242+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x561d28a33250 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.242+0000 7fba9d7fa700 1 -- 172.21.15.17:0/1392384972 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaa407f080 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.242+0000 7fba9d7fa700 1 -- 172.21.15.17:0/1392384972 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbaa40aa020 con 0x561d28cb7fd0 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbacf7e3b80 10 client.26876 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbacf7e3b80 10 client.26876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbacf7e3b80 20 client.26876 populate_metadata read hostname 'smithi017' 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28d20980 0x561d28d22d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:47:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbacf7e3b80 4 client.26876 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:47:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d28a55f10 con 0x561d28d20980 2023-10-05T15:47:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.243+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28d20980 0x561d28d22d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:47:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.244+0000 7fbab9b9b700 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28d20980 0x561d28d22d70 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=582fcfe1f5341e62 server_cookie=41e0aa55821c4763 in_seq=0 out_seq=0 2023-10-05T15:47:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.244+0000 7fba9d7fa700 10 client.26876 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.260+0000 7fba9d7fa700 1 -- 172.21.15.17:0/1392384972 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561d28a55f10 con 0x561d28d20980 2023-10-05T15:47:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.260+0000 7fba9d7fa700 10 client.26876 handle_command_reply: tid=0 2023-10-05T15:47:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.260+0000 7fbacf7e3b80 1 client.26876 shutdown 2023-10-05T15:47:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 msgr2=0x561d28cc6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc6020 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbaa409b710 tx=0x7fbaa4097470 comp rx=0 tx=0).stop 2023-10-05T15:47:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 shutdown_connections 2023-10-05T15:47:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561d28d20980 0x561d28d22d70 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d28cb8990 0x561d28cc7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561d28cb6ec0 0x561d28cc5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 --2- 172.21.15.17:0/1392384972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561d28cb7fd0 0x561d28cc6020 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.261+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 >> 172.21.15.17:0/1392384972 conn(0x561d28c2b200 msgr2=0x561d28cbf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.262+0000 7fba9d7fa700 0 client.26876 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:47:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.262+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 shutdown_connections 2023-10-05T15:47:52.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.263+0000 7fbacf7e3b80 1 -- 172.21.15.17:0/1392384972 wait complete. 2023-10-05T15:47:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.263+0000 7fbacf7e3b80 20 client.26876 trim_cache size 0 max 16384 2023-10-05T15:47:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:47:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:47:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:47:52.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbaa00a1650 msgr2=0x7fbaa00a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbaa00a1650 0x7fbaa00a3b10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbab00095c0 tx=0x7fbab0009510 comp rx=0 tx=0).stop 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 msgr2=0x7fbab419d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 0x7fbab419d780 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009fd0 tx=0x7fbaa400b840 comp rx=0 tx=0).stop 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 shutdown_connections 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fbaa00a1650 0x7fbaa00a3b10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab4108dd0 0x7fbab419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbab4073910 0x7fbab419d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 --2- 172.21.15.17:0/246271697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbab4074ef0 0x7fbab419d780 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:47:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.264+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 >> 172.21.15.17:0/246271697 conn(0x7fbab40fc460 msgr2=0x7fbab40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:47:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.266+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 shutdown_connections 2023-10-05T15:47:52.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:47:52.266+0000 7fbabbdff700 1 -- 172.21.15.17:0/246271697 wait complete. 2023-10-05T15:47:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 555.0 s, 542.0 tps, lat 185.937 ms stddev 85.720 2023-10-05T15:47:54.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:53 smithi017 ceph-mon[129107]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.6 MiB/s wr, 507 op/s 2023-10-05T15:47:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:53 smithi167 ceph-mon[133366]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.6 MiB/s wr, 507 op/s 2023-10-05T15:47:54.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:53 smithi079 ceph-mon[132936]: pgmap v708: 129 pgs: 129 active+clean; 1.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.6 MiB/s wr, 507 op/s 2023-10-05T15:47:56.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:55 smithi017 ceph-mon[129107]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.4 MiB/s wr, 688 op/s 2023-10-05T15:47:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:55 smithi167 ceph-mon[133366]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.4 MiB/s wr, 688 op/s 2023-10-05T15:47:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:55 smithi079 ceph-mon[132936]: pgmap v709: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.4 MiB/s wr, 688 op/s 2023-10-05T15:47:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 560.0 s, 574.0 tps, lat 173.140 ms stddev 55.351 2023-10-05T15:47:58.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:57 smithi017 ceph-mon[129107]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 494 op/s 2023-10-05T15:47:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:57 smithi167 ceph-mon[133366]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 494 op/s 2023-10-05T15:47:58.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:57 smithi079 ceph-mon[132936]: pgmap v710: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 494 op/s 2023-10-05T15:48:00.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:47:59 smithi017 ceph-mon[129107]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 572 op/s 2023-10-05T15:48:00.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:47:59 smithi167 ceph-mon[133366]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 572 op/s 2023-10-05T15:48:00.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:47:59 smithi079 ceph-mon[132936]: pgmap v711: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 572 op/s 2023-10-05T15:48:02.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:01 smithi017 ceph-mon[129107]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 614 op/s 2023-10-05T15:48:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:01 smithi167 ceph-mon[133366]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 614 op/s 2023-10-05T15:48:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:01 smithi079 ceph-mon[132936]: pgmap v712: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.5 MiB/s wr, 614 op/s 2023-10-05T15:48:03.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 565.0 s, 685.4 tps, lat 146.358 ms stddev 48.361 2023-10-05T15:48:04.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:03 smithi017 ceph-mon[129107]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.4 MiB/s wr, 515 op/s 2023-10-05T15:48:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:03 smithi167 ceph-mon[133366]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.4 MiB/s wr, 515 op/s 2023-10-05T15:48:04.440 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:03 smithi079 ceph-mon[132936]: pgmap v713: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.4 MiB/s wr, 515 op/s 2023-10-05T15:48:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 -- 172.21.15.17:0/205269814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 msgr2=0x7ff6a0101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/205269814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0101440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0099c0 tx=0x7ff68c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 -- 172.21.15.17:0/205269814 shutdown_connections 2023-10-05T15:48:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/205269814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0101980 0x7ff6a0108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/205269814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a00ffdf0 0x7ff6a0100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/205269814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0101440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.539+0000 7ff6a79ff700 1 -- 172.21.15.17:0/205269814 >> 172.21.15.17:0/205269814 conn(0x7ff6a00fb340 msgr2=0x7ff6a00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.540+0000 7ff6a79ff700 1 -- 172.21.15.17:0/205269814 shutdown_connections 2023-10-05T15:48:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.540+0000 7ff6a79ff700 1 -- 172.21.15.17:0/205269814 wait complete. 2023-10-05T15:48:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.541+0000 7ff6a79ff700 1 Processor -- start 2023-10-05T15:48:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.541+0000 7ff6a79ff700 1 -- start start 2023-10-05T15:48:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a79ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a00ffdf0 0x7ff6a0198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a79ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a79ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a0101980 0x7ff6a019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a79ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019a8e0 con 0x7ff6a00ffdf0 2023-10-05T15:48:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a79ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019aa50 con 0x7ff6a0100fe0 2023-10-05T15:48:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a79ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019ac10 con 0x7ff6a0101980 2023-10-05T15:48:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a4f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a00ffdf0 0x7ff6a0198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a4f9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52534/0 (socket says 172.21.15.17:52534) 2023-10-05T15:48:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.542+0000 7ff6a4f9a700 1 -- 172.21.15.17:0/930233863 learned_addr learned my addr 172.21.15.17:0/930233863 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a0101980 0x7ff6a019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a4f9a700 1 -- 172.21.15.17:0/930233863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a0101980 msgr2=0x7ff6a019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a0101980 0x7ff6a019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a4f9a700 1 -- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a00ffdf0 msgr2=0x7ff6a0198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a00ffdf0 0x7ff6a0198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a4f9a700 1 -- 172.21.15.17:0/930233863 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0095f0 con 0x7ff6a0100fe0 2023-10-05T15:48:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a579b700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a00ffdf0 0x7ff6a0198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:48:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.543+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0199430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff68c000c00 tx=0x7ff68c003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.544+0000 7ff69e7fc700 1 -- 172.21.15.17:0/930233863 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c009e60 con 0x7ff6a0100fe0 2023-10-05T15:48:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.544+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a019ae90 con 0x7ff6a0100fe0 2023-10-05T15:48:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.544+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a01a1600 con 0x7ff6a0100fe0 2023-10-05T15:48:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.544+0000 7ff69e7fc700 1 -- 172.21.15.17:0/930233863 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff68c003a60 con 0x7ff6a0100fe0 2023-10-05T15:48:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.544+0000 7ff69e7fc700 1 -- 172.21.15.17:0/930233863 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c015450 con 0x7ff6a0100fe0 2023-10-05T15:48:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.550+0000 7ff69e7fc700 1 -- 172.21.15.17:0/930233863 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff68c020460 con 0x7ff6a0100fe0 2023-10-05T15:48:05.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.551+0000 7ff6bb31bb80 1 Processor -- start 2023-10-05T15:48:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.551+0000 7ff6bb31bb80 1 -- start start 2023-10-05T15:48:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.551+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ad3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.551+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ad4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.551+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060adba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060a33400 con 0x556060ad51a0 2023-10-05T15:48:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060a24bc0 con 0x556060ad47e0 2023-10-05T15:48:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060a224e0 con 0x556060ad36d0 2023-10-05T15:48:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6a4f9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060adba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ad4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ad4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52548/0 (socket says 172.21.15.17:52548) 2023-10-05T15:48:05.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6a579b700 1 -- 172.21.15.17:0/315767933 learned_addr learned my addr 172.21.15.17:0/315767933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.552+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ad3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.553+0000 7ff6a579b700 1 -- 172.21.15.17:0/315767933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 msgr2=0x556060ad3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.553+0000 7ff6a579b700 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ad3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.553+0000 7ff6a579b700 1 -- 172.21.15.17:0/315767933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 msgr2=0x556060adba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.553+0000 7ff6a579b700 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060adba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.553+0000 7ff6a579b700 1 -- 172.21.15.17:0/315767933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556060848d80 con 0x556060ad47e0 2023-10-05T15:48:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.553+0000 7ff6a579b700 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ad4c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff694007740 tx=0x7ff694007a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dafcd85cafdbd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.554+0000 7ff68b7fe700 1 -- 172.21.15.17:0/315767933 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694015850 con 0x556060ad47e0 2023-10-05T15:48:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.554+0000 7ff68b7fe700 1 -- 172.21.15.17:0/315767933 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69400f040 con 0x556060ad47e0 2023-10-05T15:48:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.554+0000 7ff68b7fe700 1 -- 172.21.15.17:0/315767933 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694016d50 con 0x556060ad47e0 2023-10-05T15:48:05.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.554+0000 7ff69e7fc700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff6900a15d0 0x7ff6900a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.554+0000 7ff69e7fc700 1 -- 172.21.15.17:0/930233863 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff68c0cdfd0 con 0x7ff6a0100fe0 2023-10-05T15:48:05.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.555+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff6900a15d0 0x7ff6900a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/315767933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 msgr2=0x556060ad4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ad4c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff694007740 tx=0x7ff694007a50 comp rx=0 tx=0).stop 2023-10-05T15:48:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff6900a15d0 0x7ff6900a3a90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x556060ad3470 tx=0x7ff698009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/315767933 shutdown_connections 2023-10-05T15:48:05.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060adba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ad3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/315767933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ad4c60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/315767933 >> 172.21.15.17:0/315767933 conn(0x556060a3f200 msgr2=0x556060ac5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/315767933 shutdown_connections 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.556+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/315767933 wait complete. 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 -- start start 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 Processor -- start 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060add330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad47e0 0x556060add870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad51a0 0x556060ae48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060a1ddd0 con 0x556060ad47e0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560609ba6b0 con 0x556060ad51a0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560609ba350 con 0x556060ad36d0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.557+0000 7ff6bb31bb80 10 client.0 _ll_register_callbacks cb 0x5560608177a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060add330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060add330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60544/0 (socket says 172.21.15.17:60544) 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 -- 172.21.15.17:0/2522971508 learned_addr learned my addr 172.21.15.17:0/2522971508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad51a0 0x556060ae48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad47e0 0x556060add870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 -- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad51a0 msgr2=0x556060ae48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad51a0 0x556060ae48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 -- 172.21.15.17:0/2522971508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad47e0 msgr2=0x556060add870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad47e0 0x556060add870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.558+0000 7ff6a579b700 1 -- 172.21.15.17:0/2522971508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694009e70 con 0x556060ad36d0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.559+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad47e0 0x556060add870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.559+0000 7ff6a579b700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060add330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff694004e40 tx=0x7ff694004e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49094a185d9b4619 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.559+0000 7ff688ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.559+0000 7ff688ff9700 1 -- 172.21.15.17:0/2522971508 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694003c00 con 0x556060ad36d0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.559+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556060abdd50 con 0x556060ad36d0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.559+0000 7ff688ff9700 1 -- 172.21.15.17:0/2522971508 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff694026070 con 0x556060ad36d0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.560+0000 7ff688ff9700 1 -- 172.21.15.17:0/2522971508 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff694017e70 con 0x556060ad36d0 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.560+0000 7ff6bb31bb80 10 client.26845 fetch_fsmap learned FSMap version 41 2023-10-05T15:48:05.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.560+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x556060831c00 con 0x556060ad36d0 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff688ff9700 1 -- 172.21.15.17:0/2522971508 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556060abdd50 con 0x556060ad36d0 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff688ff9700 1 -- 172.21.15.17:0/2522971508 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff6940053c0 con 0x556060ad36d0 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6bb31bb80 10 client.26845 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6bb31bb80 10 client.26845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6bb31bb80 20 client.26845 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060ae90b0 0x556060aeb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6bb31bb80 4 client.26845 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556060a16db0 con 0x556060ae90b0 2023-10-05T15:48:05.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.561+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060ae90b0 0x556060aeb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.564+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060ae90b0 0x556060aeb4d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e80744daca5f9e6 server_cookie=5036b6142efe36a8 in_seq=0 out_seq=0 2023-10-05T15:48:05.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.564+0000 7ff688ff9700 10 client.26845 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.565+0000 7ff688ff9700 1 -- 172.21.15.17:0/2522971508 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556060a16db0 con 0x556060ae90b0 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.565+0000 7ff688ff9700 10 client.26845 handle_command_reply: tid=0 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.565+0000 7ff6bb31bb80 1 client.26845 shutdown 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 msgr2=0x556060add330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060add330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff694004e40 tx=0x7ff694004e70 comp rx=0 tx=0).stop 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 shutdown_connections 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060ae90b0 0x556060aeb4d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad51a0 0x556060ae48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060add330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/2522971508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad47e0 0x556060add870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 >> 172.21.15.17:0/2522971508 conn(0x556060a3f200 msgr2=0x556060ac5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff688ff9700 0 client.26845 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 shutdown_connections 2023-10-05T15:48:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.566+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/2522971508 wait complete. 2023-10-05T15:48:05.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.568+0000 7ff6bb31bb80 20 client.26845 trim_cache size 0 max 16384 2023-10-05T15:48:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.592+0000 7ff6bb31bb80 1 Processor -- start 2023-10-05T15:48:05.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.592+0000 7ff6bb31bb80 1 -- start start 2023-10-05T15:48:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 0x556060adc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad51a0 0x556060ad8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606089e8c0 con 0x556060ad36d0 2023-10-05T15:48:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060ac6f80 con 0x556060ad47e0 2023-10-05T15:48:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060ac2860 con 0x556060ad51a0 2023-10-05T15:48:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 0x556060adc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 0x556060adc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36982/0 (socket says 172.21.15.17:36982) 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.593+0000 7ff6a579b700 1 -- 172.21.15.17:0/3463363588 learned_addr learned my addr 172.21.15.17:0/3463363588 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad51a0 0x556060ad8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a579b700 1 -- 172.21.15.17:0/3463363588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad51a0 msgr2=0x556060ad8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a579b700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad51a0 0x556060ad8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a579b700 1 -- 172.21.15.17:0/3463363588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 msgr2=0x556060ae4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a579b700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a579b700 1 -- 172.21.15.17:0/3463363588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606086f1f0 con 0x556060ad36d0 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad51a0 0x556060ad8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.594+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.595+0000 7ff6a579b700 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 0x556060adc9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff694007e50 tx=0x7ff694007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf9672a0be50cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.595+0000 7ff68bfff700 1 -- 172.21.15.17:0/3463363588 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694006000 con 0x556060ad36d0 2023-10-05T15:48:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.595+0000 7ff68bfff700 1 -- 172.21.15.17:0/3463363588 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff694024070 con 0x556060ad36d0 2023-10-05T15:48:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.595+0000 7ff68bfff700 1 -- 172.21.15.17:0/3463363588 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694003d30 con 0x556060ad36d0 2023-10-05T15:48:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/3463363588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 msgr2=0x556060adc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 0x556060adc9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff694007e50 tx=0x7ff694007a50 comp rx=0 tx=0).stop 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/3463363588 shutdown_connections 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad51a0 0x556060ad8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad36d0 0x556060adc9e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/3463363588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/3463363588 >> 172.21.15.17:0/3463363588 conn(0x556060a3f200 msgr2=0x556060adb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/3463363588 shutdown_connections 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.596+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/3463363588 wait complete. 2023-10-05T15:48:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.597+0000 7ff6bb31bb80 1 -- start start 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.597+0000 7ff6bb31bb80 1 Processor -- start 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ae25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060ae3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060ae4050 con 0x556060ad51a0 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060ae41c0 con 0x556060ad47e0 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556060ae4380 con 0x556060ad36d0 2023-10-05T15:48:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6bb31bb80 10 client.0 _ll_register_callbacks cb 0x7ff694007590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ae25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6a579b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ae25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60556/0 (socket says 172.21.15.17:60556) 2023-10-05T15:48:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.598+0000 7ff6a579b700 1 -- 172.21.15.17:0/977548487 learned_addr learned my addr 172.21.15.17:0/977548487 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a5f9c700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060ae3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a579b700 1 -- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 msgr2=0x556060ae2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a579b700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a579b700 1 -- 172.21.15.17:0/977548487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 msgr2=0x556060ae3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:05.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a579b700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060ae3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.599+0000 7ff6a579b700 1 -- 172.21.15.17:0/977548487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a01a1600 con 0x556060ad36d0 2023-10-05T15:48:05.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.600+0000 7ff6a579b700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ae25c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff694009d20 tx=0x7ff694016cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd397e68be5166b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.600+0000 7ff688ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.601+0000 7ff688ff9700 1 -- 172.21.15.17:0/977548487 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694006000 con 0x556060ad36d0 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.601+0000 7ff688ff9700 1 -- 172.21.15.17:0/977548487 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff694026070 con 0x556060ad36d0 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.601+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff69400f040 con 0x556060ad36d0 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.602+0000 7ff688ff9700 1 -- 172.21.15.17:0/977548487 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff694005250 con 0x556060ad36d0 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.602+0000 7ff6bb31bb80 10 client.26851 fetch_fsmap learned FSMap version 41 2023-10-05T15:48:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.602+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x556060831c00 con 0x556060ad36d0 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.602+0000 7ff688ff9700 1 -- 172.21.15.17:0/977548487 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff694045030 con 0x556060ad36d0 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff688ff9700 1 -- 172.21.15.17:0/977548487 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 41) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff694015c00 con 0x556060ad36d0 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6bb31bb80 10 client.26851 fetch_fsmap finished waiting for FSMap version 41 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6bb31bb80 10 client.26851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6bb31bb80 20 client.26851 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060b3d8e0 0x556060b3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:05.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6bb31bb80 4 client.26851 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:48:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556060a16ad0 con 0x556060b3d8e0 2023-10-05T15:48:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.603+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060b3d8e0 0x556060b3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.604+0000 7ff6a4f9a700 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060b3d8e0 0x556060b3fd00 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6130131bb1e6af1 server_cookie=270d43bf93813f36 in_seq=0 out_seq=0 2023-10-05T15:48:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.604+0000 7ff688ff9700 10 client.26851 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.630+0000 7ff688ff9700 1 -- 172.21.15.17:0/977548487 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556060a16ad0 con 0x556060b3d8e0 2023-10-05T15:48:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff688ff9700 10 client.26851 handle_command_reply: tid=0 2023-10-05T15:48:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 client.26851 shutdown 2023-10-05T15:48:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 msgr2=0x556060ae25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ae25c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff694009d20 tx=0x7ff694016cd0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 shutdown_connections 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x556060b3d8e0 0x556060b3fd00 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556060ad51a0 0x556060ae3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556060ad36d0 0x556060ae25c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 --2- 172.21.15.17:0/977548487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556060ad47e0 0x556060ae2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 >> 172.21.15.17:0/977548487 conn(0x556060a3f200 msgr2=0x556060ad8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.631+0000 7ff688ff9700 0 client.26851 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.632+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 shutdown_connections 2023-10-05T15:48:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.632+0000 7ff6bb31bb80 1 -- 172.21.15.17:0/977548487 wait complete. 2023-10-05T15:48:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.632+0000 7ff6bb31bb80 20 client.26851 trim_cache size 0 max 16384 2023-10-05T15:48:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:48:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:48:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:48:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:48:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff6900a15d0 msgr2=0x7ff6900a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff6900a15d0 0x7ff6900a3a90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x556060ad3470 tx=0x7ff698009260 comp rx=0 tx=0).stop 2023-10-05T15:48:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 msgr2=0x7ff6a0199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0199430 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff68c000c00 tx=0x7ff68c003f10 comp rx=0 tx=0).stop 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 shutdown_connections 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff6900a15d0 0x7ff6900a3a90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a0101980 0x7ff6a019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a00ffdf0 0x7ff6a0198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 --2- 172.21.15.17:0/930233863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6a0100fe0 0x7ff6a0199430 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.633+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 >> 172.21.15.17:0/930233863 conn(0x7ff6a00fb340 msgr2=0x7ff6a0106980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.634+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 shutdown_connections 2023-10-05T15:48:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:05.634+0000 7ff6a79ff700 1 -- 172.21.15.17:0/930233863 wait complete. 2023-10-05T15:48:06.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:05 smithi017 ceph-mon[129107]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 735 op/s 2023-10-05T15:48:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:05 smithi167 ceph-mon[133366]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 735 op/s 2023-10-05T15:48:06.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:05 smithi079 ceph-mon[132936]: pgmap v714: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.0 MiB/s wr, 735 op/s 2023-10-05T15:48:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 570.0 s, 654.8 tps, lat 152.593 ms stddev 46.708 2023-10-05T15:48:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:07 smithi167 ceph-mon[133366]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 546 op/s 2023-10-05T15:48:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:07 smithi079 ceph-mon[132936]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 546 op/s 2023-10-05T15:48:08.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:07 smithi017 ceph-mon[129107]: pgmap v715: 129 pgs: 129 active+clean; 1.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 546 op/s 2023-10-05T15:48:09.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:08 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:48:09.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:08 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:48:09.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:08 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:48:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:09 smithi167 ceph-mon[133366]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2023-10-05T15:48:10.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:09 smithi079 ceph-mon[132936]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2023-10-05T15:48:10.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:09 smithi017 ceph-mon[129107]: pgmap v716: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 627 op/s 2023-10-05T15:48:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:11 smithi167 ceph-mon[133366]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.5 MiB/s wr, 695 op/s 2023-10-05T15:48:11.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:11 smithi079 ceph-mon[132936]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.5 MiB/s wr, 695 op/s 2023-10-05T15:48:11.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:11 smithi017 ceph-mon[129107]: pgmap v717: 129 pgs: 129 active+clean; 1.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.5 MiB/s wr, 695 op/s 2023-10-05T15:48:13.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:48:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 575.0 s, 567.0 tps, lat 176.250 ms stddev 54.487 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 -- 172.21.15.17:0/1467751588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 msgr2=0x7f3c4010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 --2- 172.21.15.17:0/1467751588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4010f950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3c3801a9a0 tx=0x7f3c3801acb0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 -- 172.21.15.17:0/1467751588 shutdown_connections 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 --2- 172.21.15.17:0/1467751588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4010f950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 --2- 172.21.15.17:0/1467751588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c40107510 0x7f3c40107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 --2- 172.21.15.17:0/1467751588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 -- 172.21.15.17:0/1467751588 >> 172.21.15.17:0/1467751588 conn(0x7f3c40076480 msgr2=0x7f3c400788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:13.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 -- 172.21.15.17:0/1467751588 shutdown_connections 2023-10-05T15:48:13.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.508+0000 7f3c481ff700 1 -- 172.21.15.17:0/1467751588 wait complete. 2023-10-05T15:48:13.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 Processor -- start 2023-10-05T15:48:13.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 -- start start 2023-10-05T15:48:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c40107510 0x7f3c40197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4019c430 con 0x7f3c40108700 2023-10-05T15:48:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4019c5a0 con 0x7f3c40107510 2023-10-05T15:48:13.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.510+0000 7f3c481ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4019c760 con 0x7f3c401090a0 2023-10-05T15:48:13.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.511+0000 7f3c4579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.511+0000 7f3c4679c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.511+0000 7f3c4679c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60570/0 (socket says 172.21.15.17:60570) 2023-10-05T15:48:13.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.511+0000 7f3c4679c700 1 -- 172.21.15.17:0/518301881 learned_addr learned my addr 172.21.15.17:0/518301881 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:13.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.511+0000 7f3c4579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37010/0 (socket says 172.21.15.17:37010) 2023-10-05T15:48:13.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.511+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c40107510 0x7f3c40197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.512+0000 7f3c4579a700 1 -- 172.21.15.17:0/518301881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 msgr2=0x7f3c4019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.512+0000 7f3c4579a700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.512+0000 7f3c4579a700 1 -- 172.21.15.17:0/518301881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c40107510 msgr2=0x7f3c40197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.512+0000 7f3c4579a700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c40107510 0x7f3c40197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.512+0000 7f3c4579a700 1 -- 172.21.15.17:0/518301881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3801a600 con 0x7f3c40108700 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.512+0000 7f3c4579a700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40199760 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00bd70 tx=0x7f3c3c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:13.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.513+0000 7f3c36ffd700 1 -- 172.21.15.17:0/518301881 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00cb90 con 0x7f3c40108700 2023-10-05T15:48:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.513+0000 7f3c36ffd700 1 -- 172.21.15.17:0/518301881 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c3c00ccf0 con 0x7f3c40108700 2023-10-05T15:48:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.513+0000 7f3c36ffd700 1 -- 172.21.15.17:0/518301881 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0125a0 con 0x7f3c40108700 2023-10-05T15:48:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.513+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4019ca40 con 0x7f3c40108700 2023-10-05T15:48:13.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.513+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4019cf80 con 0x7f3c40108700 2023-10-05T15:48:13.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.519+0000 7f3c36ffd700 1 -- 172.21.15.17:0/518301881 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3c3c014440 con 0x7f3c40108700 2023-10-05T15:48:13.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.520+0000 7f3c5bbf8b80 1 Processor -- start 2023-10-05T15:48:13.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.520+0000 7f3c5bbf8b80 1 -- start start 2023-10-05T15:48:13.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13240680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da13241480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da13241ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da131a8460 con 0x55da13240260 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13199c20 con 0x55da13241a60 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13197540 con 0x55da13240bc0 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c45f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da13241480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c4679c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13240680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.521+0000 7f3c45f9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da13241480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60572/0 (socket says 172.21.15.17:60572) 2023-10-05T15:48:13.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c45f9b700 1 -- 172.21.15.17:0/3725439418 learned_addr learned my addr 172.21.15.17:0/3725439418 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:13.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c45f9b700 1 -- 172.21.15.17:0/3725439418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 msgr2=0x55da13241ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c4579a700 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da13241ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da13241ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c45f9b700 1 -- 172.21.15.17:0/3725439418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 msgr2=0x55da13240680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13240680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.522+0000 7f3c45f9b700 1 -- 172.21.15.17:0/3725439418 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da12fbdde0 con 0x55da13240bc0 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.523+0000 7f3c4679c700 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13240680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.523+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da13241480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009aa0 tx=0x7f3c30009db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d5c3c2c2f769752 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.523+0000 7f3c4579a700 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da13241ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.523+0000 7f3c36ffd700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c280a15c0 0x7f3c280a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.524+0000 7f3c36ffd700 1 -- 172.21.15.17:0/518301881 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3c3c006e40 con 0x7f3c40108700 2023-10-05T15:48:13.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.524+0000 7f3c4679c700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c280a15c0 0x7f3c280a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.524+0000 7f3c27fff700 1 -- 172.21.15.17:0/3725439418 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000e8d0 con 0x55da13240bc0 2023-10-05T15:48:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.524+0000 7f3c27fff700 1 -- 172.21.15.17:0/3725439418 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c3000eec0 con 0x55da13240bc0 2023-10-05T15:48:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.524+0000 7f3c27fff700 1 -- 172.21.15.17:0/3725439418 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300123d0 con 0x55da13240bc0 2023-10-05T15:48:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.525+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/3725439418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 msgr2=0x55da13241480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.525+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da13241480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009aa0 tx=0x7f3c30009db0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.525+0000 7f3c4679c700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c280a15c0 0x7f3c280a3a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3c38006010 tx=0x7f3c3802a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/3725439418 shutdown_connections 2023-10-05T15:48:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da13241ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13240680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/3725439418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da13241480 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/3725439418 >> 172.21.15.17:0/3725439418 conn(0x55da131b4260 msgr2=0x55da1323b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:13.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/3725439418 shutdown_connections 2023-10-05T15:48:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.526+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/3725439418 wait complete. 2023-10-05T15:48:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.527+0000 7f3c5bbf8b80 1 -- start start 2023-10-05T15:48:13.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.527+0000 7f3c5bbf8b80 1 Processor -- start 2023-10-05T15:48:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.528+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240260 0x55da1324a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.528+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.528+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13241a60 0x55da132515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.528+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13192e30 con 0x55da13241a60 2023-10-05T15:48:13.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.528+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1312f710 con 0x55da13240260 2023-10-05T15:48:13.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.528+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1312f3b0 con 0x55da13240bc0 2023-10-05T15:48:13.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.529+0000 7f3c5bbf8b80 10 client.0 _ll_register_callbacks cb 0x55da12f8c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:13.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.529+0000 7f3c45f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240260 0x55da1324a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c45f9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240260 0x55da1324a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52604/0 (socket says 172.21.15.17:52604) 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c45f9b700 1 -- 172.21.15.17:0/1527128217 learned_addr learned my addr 172.21.15.17:0/1527128217 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4579a700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4679c700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13241a60 0x55da132515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4579a700 1 -- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240260 msgr2=0x55da1324a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4579a700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240260 0x55da1324a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4579a700 1 -- 172.21.15.17:0/1527128217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13241a60 msgr2=0x55da132515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4579a700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13241a60 0x55da132515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.530+0000 7f3c4579a700 1 -- 172.21.15.17:0/1527128217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c401102a0 con 0x55da13240bc0 2023-10-05T15:48:13.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.531+0000 7f3c4579a700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324a580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55da13241240 tx=0x7f3c3c0994a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ee67190dabdbdc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:13.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c257fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:13.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c257fa700 1 -- 172.21.15.17:0/1527128217 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b92b0 con 0x55da13240bc0 2023-10-05T15:48:13.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c257fa700 1 -- 172.21.15.17:0/1527128217 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3c3c099fe0 con 0x55da13240bc0 2023-10-05T15:48:13.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da1318be10 con 0x55da13240bc0 2023-10-05T15:48:13.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c257fa700 1 -- 172.21.15.17:0/1527128217 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3c0998e0 con 0x55da13240bc0 2023-10-05T15:48:13.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c5bbf8b80 10 client.26863 fetch_fsmap learned FSMap version 42 2023-10-05T15:48:13.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.532+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x7f3c300096d0 con 0x55da13240bc0 2023-10-05T15:48:13.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.533+0000 7f3c257fa700 1 -- 172.21.15.17:0/1527128217 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c3c0b1070 con 0x55da13240bc0 2023-10-05T15:48:13.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.533+0000 7f3c257fa700 1 -- 172.21.15.17:0/1527128217 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 42) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3c3c099bd0 con 0x55da13240bc0 2023-10-05T15:48:13.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.533+0000 7f3c5bbf8b80 10 client.26863 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:48:13.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.533+0000 7f3c5bbf8b80 10 client.26863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:13.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.534+0000 7f3c5bbf8b80 20 client.26863 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:13.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.534+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da13266d70 0x55da13269190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.534+0000 7f3c5bbf8b80 4 client.26863 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:13.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.534+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da1318bb30 con 0x55da13266d70 2023-10-05T15:48:13.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.534+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da13266d70 0x55da13269190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.535+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da13266d70 0x55da13269190 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6e47fedeb87214d server_cookie=bed1ba4a7af6c9f5 in_seq=0 out_seq=0 2023-10-05T15:48:13.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.535+0000 7f3c257fa700 10 client.26863 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:13.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.536+0000 7f3c257fa700 1 -- 172.21.15.17:0/1527128217 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55da1318bb30 con 0x55da13266d70 2023-10-05T15:48:13.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.536+0000 7f3c257fa700 10 client.26863 handle_command_reply: tid=0 2023-10-05T15:48:13.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.536+0000 7f3c5bbf8b80 1 client.26863 shutdown 2023-10-05T15:48:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 msgr2=0x55da1324a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324a580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55da13241240 tx=0x7f3c3c0994a0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 shutdown_connections 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da13266d70 0x55da13269190 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13241a60 0x55da132515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240260 0x55da1324a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/1527128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324a580 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 >> 172.21.15.17:0/1527128217 conn(0x55da131b4260 msgr2=0x55da1323af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:13.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.538+0000 7f3c257fa700 0 client.26863 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:13.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.539+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 shutdown_connections 2023-10-05T15:48:13.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.539+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/1527128217 wait complete. 2023-10-05T15:48:13.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.539+0000 7f3c5bbf8b80 20 client.26863 trim_cache size 0 max 16384 2023-10-05T15:48:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.573+0000 7f3c5bbf8b80 1 Processor -- start 2023-10-05T15:48:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.573+0000 7f3c5bbf8b80 1 -- start start 2023-10-05T15:48:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.573+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13268d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.573+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 0x55da13251580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.573+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13241a60 0x55da1323af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.573+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13249c10 con 0x55da13240260 2023-10-05T15:48:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.574+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13013920 con 0x55da13240bc0 2023-10-05T15:48:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.574+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13235520 con 0x55da13241a60 2023-10-05T15:48:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.575+0000 7f3c4579a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 0x55da13251580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 0x55da13251580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52616/0 (socket says 172.21.15.17:52616) 2023-10-05T15:48:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 -- 172.21.15.17:0/4140780064 learned_addr learned my addr 172.21.15.17:0/4140780064 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4679c700 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13241a60 0x55da1323af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13268d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 -- 172.21.15.17:0/4140780064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13241a60 msgr2=0x55da1323af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13241a60 0x55da1323af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 -- 172.21.15.17:0/4140780064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 msgr2=0x55da13268d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13268d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.576+0000 7f3c4579a700 1 -- 172.21.15.17:0/4140780064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da12fa6c60 con 0x55da13240bc0 2023-10-05T15:48:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.578+0000 7f3c4579a700 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 0x55da13251580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00be10 tx=0x7f3c3c097e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb1183ec0995b9e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.580+0000 7f3c34ff9700 1 -- 172.21.15.17:0/4140780064 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c099fe0 con 0x55da13240bc0 2023-10-05T15:48:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.580+0000 7f3c34ff9700 1 -- 172.21.15.17:0/4140780064 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c3c0b1070 con 0x55da13240bc0 2023-10-05T15:48:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.580+0000 7f3c34ff9700 1 -- 172.21.15.17:0/4140780064 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0a1830 con 0x55da13240bc0 2023-10-05T15:48:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/4140780064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 msgr2=0x55da13251580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 0x55da13251580 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00be10 tx=0x7f3c3c097e90 comp rx=0 tx=0).stop 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/4140780064 shutdown_connections 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13241a60 0x55da1323af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da13268d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/4140780064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13240bc0 0x55da13251580 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/4140780064 >> 172.21.15.17:0/4140780064 conn(0x55da131b4260 msgr2=0x55da13248d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/4140780064 shutdown_connections 2023-10-05T15:48:13.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.581+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/4140780064 wait complete. 2023-10-05T15:48:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.582+0000 7f3c5bbf8b80 1 -- start start 2023-10-05T15:48:13.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.582+0000 7f3c5bbf8b80 1 Processor -- start 2023-10-05T15:48:13.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da1324f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da132505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13250b10 con 0x55da13240260 2023-10-05T15:48:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13250c80 con 0x55da13241a60 2023-10-05T15:48:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da13250e40 con 0x55da13240bc0 2023-10-05T15:48:13.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c5bbf8b80 10 client.0 _ll_register_callbacks cb 0x7f3c3c0996b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c4579a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c4579a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:60610/0 (socket says 172.21.15.17:60610) 2023-10-05T15:48:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.584+0000 7f3c4579a700 1 -- 172.21.15.17:0/2952938245 learned_addr learned my addr 172.21.15.17:0/2952938245 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.585+0000 7f3c4679c700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da132505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.585+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da1324f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c4579a700 1 -- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 msgr2=0x55da132505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c4579a700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da132505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c4579a700 1 -- 172.21.15.17:0/2952938245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 msgr2=0x55da1324f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c4579a700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da1324f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c4579a700 1 -- 172.21.15.17:0/2952938245 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c300096d0 con 0x55da13240bc0 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da1324f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c4579a700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324f5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c014be0 tx=0x7f3c3c098fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ad02770a48f9bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:13.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.586+0000 7f3c257fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.587+0000 7f3c257fa700 1 -- 172.21.15.17:0/2952938245 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c099d50 con 0x55da13240bc0 2023-10-05T15:48:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.587+0000 7f3c257fa700 1 -- 172.21.15.17:0/2952938245 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3c3c099fe0 con 0x55da13240bc0 2023-10-05T15:48:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.587+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da13232f10 con 0x55da13240bc0 2023-10-05T15:48:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.588+0000 7f3c257fa700 1 -- 172.21.15.17:0/2952938245 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3c0998e0 con 0x55da13240bc0 2023-10-05T15:48:13.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.588+0000 7f3c5bbf8b80 10 client.26869 fetch_fsmap learned FSMap version 42 2023-10-05T15:48:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.588+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55da12fe4250 con 0x55da13240bc0 2023-10-05T15:48:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.588+0000 7f3c257fa700 1 -- 172.21.15.17:0/2952938245 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c3c07c070 con 0x55da13240bc0 2023-10-05T15:48:13.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.588+0000 7f3c257fa700 1 -- 172.21.15.17:0/2952938245 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 42) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3c3c098910 con 0x55da13240bc0 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.588+0000 7f3c5bbf8b80 10 client.26869 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.589+0000 7f3c5bbf8b80 10 client.26869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.589+0000 7f3c5bbf8b80 20 client.26869 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.589+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da132bb2b0 0x55da132bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.589+0000 7f3c5bbf8b80 4 client.26869 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.589+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55da12fdef70 con 0x55da132bb2b0 2023-10-05T15:48:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.589+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da132bb2b0 0x55da132bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.590+0000 7f3c45f9b700 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da132bb2b0 0x55da132bd6a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5803544727ae4 server_cookie=974047c79d523cdb in_seq=0 out_seq=0 2023-10-05T15:48:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.590+0000 7f3c257fa700 10 client.26869 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.590+0000 7f3c257fa700 1 -- 172.21.15.17:0/2952938245 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55da12fdef70 con 0x55da132bb2b0 2023-10-05T15:48:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.590+0000 7f3c257fa700 10 client.26869 handle_command_reply: tid=0 2023-10-05T15:48:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.591+0000 7f3c5bbf8b80 1 client.26869 shutdown 2023-10-05T15:48:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.591+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 msgr2=0x55da1324f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.591+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324f5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c014be0 tx=0x7f3c3c098fb0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 shutdown_connections 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55da132bb2b0 0x55da132bd6a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55da13241a60 0x55da132505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da13240260 0x55da1324f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c257fa700 0 client.26869 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c5bbf8b80 1 --2- 172.21.15.17:0/2952938245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55da13240bc0 0x55da1324f5c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.592+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 >> 172.21.15.17:0/2952938245 conn(0x55da131b4260 msgr2=0x55da13247ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.593+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 shutdown_connections 2023-10-05T15:48:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.593+0000 7f3c5bbf8b80 1 -- 172.21.15.17:0/2952938245 wait complete. 2023-10-05T15:48:13.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.593+0000 7f3c5bbf8b80 20 client.26869 trim_cache size 0 max 16384 2023-10-05T15:48:13.595 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:48:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:48:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:48:13.595 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:48:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:48:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:48:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:48:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:48:13.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:48:13.596 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.594+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c280a15c0 msgr2=0x7f3c280a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.594+0000 7f3c481ff700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c280a15c0 0x7f3c280a3a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3c38006010 tx=0x7f3c3802a040 comp rx=0 tx=0).stop 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.594+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 msgr2=0x7f3c40199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.594+0000 7f3c481ff700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40199760 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00bd70 tx=0x7f3c3c00bda0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 shutdown_connections 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3c280a15c0 0x7f3c280a3a80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c401090a0 0x7f3c4019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c40107510 0x7f3c40197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 --2- 172.21.15.17:0/518301881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c40108700 0x7f3c40199760 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:13.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 >> 172.21.15.17:0/518301881 conn(0x7f3c40076480 msgr2=0x7f3c40078600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:13.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 shutdown_connections 2023-10-05T15:48:13.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:13.595+0000 7f3c481ff700 1 -- 172.21.15.17:0/518301881 wait complete. 2023-10-05T15:48:13.630 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:48:14.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:13 smithi017 ceph-mon[129107]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 605 op/s 2023-10-05T15:48:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:13 smithi167 ceph-mon[133366]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 605 op/s 2023-10-05T15:48:14.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:13 smithi079 ceph-mon[132936]: pgmap v718: 129 pgs: 129 active+clean; 1.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 605 op/s 2023-10-05T15:48:16.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:15 smithi017 ceph-mon[129107]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.8 MiB/s wr, 755 op/s 2023-10-05T15:48:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:15 smithi167 ceph-mon[133366]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.8 MiB/s wr, 755 op/s 2023-10-05T15:48:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:15 smithi079 ceph-mon[132936]: pgmap v719: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.8 MiB/s wr, 755 op/s 2023-10-05T15:48:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 580.0 s, 544.2 tps, lat 183.672 ms stddev 57.787 2023-10-05T15:48:18.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:17 smithi017 ceph-mon[129107]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 565 op/s 2023-10-05T15:48:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:17 smithi167 ceph-mon[133366]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 565 op/s 2023-10-05T15:48:18.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:17 smithi079 ceph-mon[132936]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 565 op/s 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 -- 172.21.15.17:0/128379473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc076ab0 msgr2=0x7f00dc076f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 --2- 172.21.15.17:0/128379473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc076ab0 0x7f00dc076f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009990 tx=0x7f00d0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 -- 172.21.15.17:0/128379473 shutdown_connections 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 --2- 172.21.15.17:0/128379473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 0x7f00dc077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 --2- 172.21.15.17:0/128379473 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00dc075870 0x7f00dc075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 --2- 172.21.15.17:0/128379473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc076ab0 0x7f00dc076f30 secure :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009990 tx=0x7f00d0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.909+0000 7f00e45ff700 1 -- 172.21.15.17:0/128379473 >> 172.21.15.17:0/128379473 conn(0x7f00dc0fe6a0 msgr2=0x7f00dc100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.910+0000 7f00e45ff700 1 -- 172.21.15.17:0/128379473 shutdown_connections 2023-10-05T15:48:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.910+0000 7f00e45ff700 1 -- 172.21.15.17:0/128379473 wait complete. 2023-10-05T15:48:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.912+0000 7f00e45ff700 1 Processor -- start 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.913+0000 7f00e45ff700 1 -- start start 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.913+0000 7f00e45ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00dc075870 0x7f00dc19d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.913+0000 7f00e45ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 0x7f00dc19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.913+0000 7f00e45ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc19e870 0x7f00dc19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.913+0000 7f00e45ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc19f2c0 con 0x7f00dc19e870 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.913+0000 7f00e45ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc19f430 con 0x7f00dc075870 2023-10-05T15:48:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.914+0000 7f00e45ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc19f5f0 con 0x7f00dc077470 2023-10-05T15:48:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.914+0000 7f00e1b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 0x7f00dc19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.914+0000 7f00e2b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc19e870 0x7f00dc19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.914+0000 7f00e1b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 0x7f00dc19d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57638/0 (socket says 172.21.15.17:57638) 2023-10-05T15:48:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.914+0000 7f00e1b9a700 1 -- 172.21.15.17:0/525416412 learned_addr learned my addr 172.21.15.17:0/525416412 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.915+0000 7f00e239b700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00dc075870 0x7f00dc19d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.915+0000 7f00e2b9c700 1 -- 172.21.15.17:0/525416412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 msgr2=0x7f00dc19d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.915+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 0x7f00dc19d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.915+0000 7f00e2b9c700 1 -- 172.21.15.17:0/525416412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00dc075870 msgr2=0x7f00dc19d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.915+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00dc075870 0x7f00dc19d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.915+0000 7f00e2b9c700 1 -- 172.21.15.17:0/525416412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00095f0 con 0x7f00dc19e870 2023-10-05T15:48:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.916+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc19e870 0x7f00dc19ecf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e970 tx=0x7f00cc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.916+0000 7f00db7fe700 1 -- 172.21.15.17:0/525416412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc004220 con 0x7f00dc19e870 2023-10-05T15:48:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.916+0000 7f00db7fe700 1 -- 172.21.15.17:0/525416412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00cc004cc0 con 0x7f00dc19e870 2023-10-05T15:48:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.916+0000 7f00db7fe700 1 -- 172.21.15.17:0/525416412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc005590 con 0x7f00dc19e870 2023-10-05T15:48:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.917+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc1a5b20 con 0x7f00dc19e870 2023-10-05T15:48:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.917+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc1a5fe0 con 0x7f00dc19e870 2023-10-05T15:48:18.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.925+0000 7f00f7f07b80 1 Processor -- start 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.925+0000 7f00f7f07b80 1 -- start start 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.925+0000 7f00db7fe700 1 -- 172.21.15.17:0/525416412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f00cc004750 con 0x7f00dc19e870 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.926+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3892e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.926+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 0x5573da38a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.926+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da391220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.926+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da2f1400 con 0x5573da389fd0 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.926+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da2e2bc0 con 0x5573da388ec0 2023-10-05T15:48:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.926+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da2e04e0 con 0x5573da38a990 2023-10-05T15:48:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da391220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3892e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60462/0 (socket says 172.21.15.17:60462) 2023-10-05T15:48:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 -- 172.21.15.17:0/4013662235 learned_addr learned my addr 172.21.15.17:0/4013662235 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 -- 172.21.15.17:0/4013662235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 msgr2=0x5573da391220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da391220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.927+0000 7f00e1b9a700 1 -- 172.21.15.17:0/4013662235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 msgr2=0x5573da38a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:48:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.928+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 0x5573da38a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.928+0000 7f00e1b9a700 1 -- 172.21.15.17:0/4013662235 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573da106d80 con 0x5573da388ec0 2023-10-05T15:48:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.928+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3892e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00d0015000 tx=0x7f00d0005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8360d19b85417bc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.928+0000 7f00d8bfe700 1 -- 172.21.15.17:0/4013662235 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0004110 con 0x5573da388ec0 2023-10-05T15:48:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.929+0000 7f00d8bfe700 1 -- 172.21.15.17:0/4013662235 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00d001e070 con 0x5573da388ec0 2023-10-05T15:48:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.929+0000 7f00db7fe700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00c40a1680 0x7f00c40a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.929+0000 7f00d8bfe700 1 -- 172.21.15.17:0/4013662235 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d000b970 con 0x5573da388ec0 2023-10-05T15:48:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.929+0000 7f00db7fe700 1 -- 172.21.15.17:0/525416412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f00cc014070 con 0x7f00dc19e870 2023-10-05T15:48:18.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.929+0000 7f00e239b700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00c40a1680 0x7f00c40a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.930+0000 7f00f7f07b80 1 -- 172.21.15.17:0/4013662235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 msgr2=0x5573da3892e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:18.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.930+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3892e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00d0015000 tx=0x7f00d0005fb0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.932+0000 7f00e239b700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00c40a1680 0x7f00c40a3b40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f00d400f520 tx=0x7f00d4009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.932+0000 7f00f7f07b80 1 -- 172.21.15.17:0/4013662235 shutdown_connections 2023-10-05T15:48:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.932+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da391220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.932+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3892e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.932+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/4013662235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 0x5573da38a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.932+0000 7f00f7f07b80 1 -- 172.21.15.17:0/4013662235 >> 172.21.15.17:0/4013662235 conn(0x5573da2fd200 msgr2=0x5573da383bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.933+0000 7f00f7f07b80 1 -- 172.21.15.17:0/4013662235 shutdown_connections 2023-10-05T15:48:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.933+0000 7f00f7f07b80 1 -- 172.21.15.17:0/4013662235 wait complete. 2023-10-05T15:48:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.933+0000 7f00f7f07b80 1 -- start start 2023-10-05T15:48:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.934+0000 7f00f7f07b80 1 Processor -- start 2023-10-05T15:48:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 0x5573da3a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da38a990 0x5573da3ab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da2dbdd0 con 0x5573da38a990 2023-10-05T15:48:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da2786b0 con 0x5573da389fd0 2023-10-05T15:48:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da278350 con 0x5573da388ec0 2023-10-05T15:48:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00f7f07b80 10 client.0 _ll_register_callbacks cb 0x5573da0d57a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00e239b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 0x5573da3a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00e239b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 0x5573da3a3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57650/0 (socket says 172.21.15.17:57650) 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.935+0000 7f00e239b700 1 -- 172.21.15.17:0/460355193 learned_addr learned my addr 172.21.15.17:0/460355193 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da38a990 0x5573da3ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e239b700 1 -- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 msgr2=0x5573da3a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e239b700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e239b700 1 -- 172.21.15.17:0/460355193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da38a990 msgr2=0x5573da3ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e239b700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da38a990 0x5573da3ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e239b700 1 -- 172.21.15.17:0/460355193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d0020040 con 0x5573da388ec0 2023-10-05T15:48:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00e239b700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 0x5573da3a3a80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f00d4008a40 tx=0x7f00d4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20404ba7394cf7a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.936+0000 7f00c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.937+0000 7f00c1ffb700 1 -- 172.21.15.17:0/460355193 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4026070 con 0x5573da388ec0 2023-10-05T15:48:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.937+0000 7f00c1ffb700 1 -- 172.21.15.17:0/460355193 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f00d4004bb0 con 0x5573da388ec0 2023-10-05T15:48:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.937+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573da37bd50 con 0x5573da388ec0 2023-10-05T15:48:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.938+0000 7f00c1ffb700 1 -- 172.21.15.17:0/460355193 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00d400e040 con 0x5573da388ec0 2023-10-05T15:48:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.938+0000 7f00f7f07b80 10 client.26881 fetch_fsmap learned FSMap version 42 2023-10-05T15:48:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.938+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5573da0efc00 con 0x5573da388ec0 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00c1ffb700 1 -- 172.21.15.17:0/460355193 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5573da37bd50 con 0x5573da388ec0 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00c1ffb700 1 -- 172.21.15.17:0/460355193 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 42) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f00d4029020 con 0x5573da388ec0 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00f7f07b80 10 client.26881 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00f7f07b80 10 client.26881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00f7f07b80 20 client.26881 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da3af900 0x5573da3b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00f7f07b80 4 client.26881 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.939+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573da2d4db0 con 0x5573da3af900 2023-10-05T15:48:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.940+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da3af900 0x5573da3b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.941+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da3af900 0x5573da3b1d20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85d6a6cf076a79aa server_cookie=bc6677a7e4dc5d01 in_seq=0 out_seq=0 2023-10-05T15:48:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.941+0000 7f00c1ffb700 10 client.26881 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.942+0000 7f00c1ffb700 1 -- 172.21.15.17:0/460355193 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5573da2d4db0 con 0x5573da3af900 2023-10-05T15:48:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.942+0000 7f00c1ffb700 10 client.26881 handle_command_reply: tid=0 2023-10-05T15:48:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.943+0000 7f00f7f07b80 1 client.26881 shutdown 2023-10-05T15:48:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.944+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 msgr2=0x5573da3a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.944+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 0x5573da3a3a80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f00d4008a40 tx=0x7f00d4004b40 comp rx=0 tx=0).stop 2023-10-05T15:48:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.945+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 shutdown_connections 2023-10-05T15:48:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.945+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da3af900 0x5573da3b1d20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.945+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da38a990 0x5573da3ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.945+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da388ec0 0x5573da3a3a80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.945+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/460355193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.945+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 >> 172.21.15.17:0/460355193 conn(0x5573da2fd200 msgr2=0x5573da383250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.946+0000 7f00c1ffb700 0 client.26881 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.947+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 shutdown_connections 2023-10-05T15:48:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.947+0000 7f00f7f07b80 1 -- 172.21.15.17:0/460355193 wait complete. 2023-10-05T15:48:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.948+0000 7f00f7f07b80 20 client.26881 trim_cache size 0 max 16384 2023-10-05T15:48:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.979+0000 7f00f7f07b80 1 Processor -- start 2023-10-05T15:48:18.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 -- start start 2023-10-05T15:48:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 0x5573da3aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da390d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da15c8c0 con 0x5573da389fd0 2023-10-05T15:48:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da384f10 con 0x5573da388ec0 2023-10-05T15:48:18.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.980+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da3a4c00 con 0x5573da38a990 2023-10-05T15:48:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da390d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da390d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:57666/0 (socket says 172.21.15.17:57666) 2023-10-05T15:48:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 -- 172.21.15.17:0/901322654 learned_addr learned my addr 172.21.15.17:0/901322654 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e239b700 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 -- 172.21.15.17:0/901322654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 msgr2=0x5573da3b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 -- 172.21.15.17:0/901322654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 msgr2=0x5573da3aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 0x5573da3aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.981+0000 7f00e2b9c700 1 -- 172.21.15.17:0/901322654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573da12d1f0 con 0x5573da38a990 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.982+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da390d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f00cc09a250 tx=0x7f00cc099ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6306b9ef9118fb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.982+0000 7f00d93ff700 1 -- 172.21.15.17:0/901322654 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc09a2c0 con 0x5573da38a990 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.982+0000 7f00d93ff700 1 -- 172.21.15.17:0/901322654 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00cc09e410 con 0x5573da38a990 2023-10-05T15:48:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.982+0000 7f00d93ff700 1 -- 172.21.15.17:0/901322654 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0cabb0 con 0x5573da38a990 2023-10-05T15:48:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.983+0000 7f00f7f07b80 1 -- 172.21.15.17:0/901322654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 msgr2=0x5573da390d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.983+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da390d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f00cc09a250 tx=0x7f00cc099ca0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 -- 172.21.15.17:0/901322654 shutdown_connections 2023-10-05T15:48:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da390d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da388ec0 0x5573da3b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/901322654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da389fd0 0x5573da3aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 -- 172.21.15.17:0/901322654 >> 172.21.15.17:0/901322654 conn(0x5573da2fd200 msgr2=0x5573da3b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 -- 172.21.15.17:0/901322654 shutdown_connections 2023-10-05T15:48:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.984+0000 7f00f7f07b80 1 -- 172.21.15.17:0/901322654 wait complete. 2023-10-05T15:48:18.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.985+0000 7f00f7f07b80 1 -- start start 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.985+0000 7f00f7f07b80 1 Processor -- start 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da388ec0 0x5573da3a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da3a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da3aa3a0 con 0x5573da388ec0 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da3aa510 con 0x5573da389fd0 2023-10-05T15:48:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573da3aa6d0 con 0x5573da38a990 2023-10-05T15:48:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00f7f07b80 10 client.0 _ll_register_callbacks cb 0x7f00d40093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00e239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da388ec0 0x5573da3a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00e239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da388ec0 0x5573da3a8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59498/0 (socket says 172.21.15.17:59498) 2023-10-05T15:48:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00e239b700 1 -- 172.21.15.17:0/2240410896 learned_addr learned my addr 172.21.15.17:0/2240410896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da3a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.986+0000 7f00e1b9a700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00e2b9c700 1 -- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 msgr2=0x5573da3a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00e2b9c700 1 -- 172.21.15.17:0/2240410896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da388ec0 msgr2=0x5573da3a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da388ec0 0x5573da3a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00e2b9c700 1 -- 172.21.15.17:0/2240410896 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc1a5fe0 con 0x5573da38a990 2023-10-05T15:48:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00e2b9c700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da3a9e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00efd0 tx=0x7f00cc09a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f41f49b296fe28 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.987+0000 7f00c1ffb700 1 -- 172.21.15.17:0/2240410896 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0a2650 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00c1ffb700 1 -- 172.21.15.17:0/2240410896 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f00cc09a2c0 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00d001e070 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00c1ffb700 1 -- 172.21.15.17:0/2240410896 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00cc004410 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00f7f07b80 10 client.26887 fetch_fsmap learned FSMap version 42 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5573da105250 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00c1ffb700 1 -- 172.21.15.17:0/2240410896 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00cc081080 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.988+0000 7f00c1ffb700 1 -- 172.21.15.17:0/2240410896 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 42) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f00cc0a21c0 con 0x5573da38a990 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00f7f07b80 10 client.26887 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00f7f07b80 10 client.26887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00f7f07b80 20 client.26887 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da403e30 0x5573da406250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:18.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00f7f07b80 4 client.26887 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:48:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5573da2d4ad0 con 0x5573da403e30 2023-10-05T15:48:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.989+0000 7f00e239b700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da403e30 0x5573da406250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.991+0000 7f00e239b700 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da403e30 0x5573da406250 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e6fa317acdfdc1 server_cookie=a7e0563ad2fb95cc in_seq=0 out_seq=0 2023-10-05T15:48:18.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:18.991+0000 7f00c1ffb700 10 client.26887 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.004+0000 7f00c1ffb700 1 -- 172.21.15.17:0/2240410896 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5573da2d4ad0 con 0x5573da403e30 2023-10-05T15:48:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.004+0000 7f00c1ffb700 10 client.26887 handle_command_reply: tid=0 2023-10-05T15:48:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.004+0000 7f00f7f07b80 1 client.26887 shutdown 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 msgr2=0x5573da3a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da3a9e60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00efd0 tx=0x7f00cc09a180 comp rx=0 tx=0).stop 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 shutdown_connections 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5573da403e30 0x5573da406250 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5573da38a990 0x5573da3a9e60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573da388ec0 0x5573da3a8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 --2- 172.21.15.17:0/2240410896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5573da389fd0 0x5573da3a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00c1ffb700 0 client.26887 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.005+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 >> 172.21.15.17:0/2240410896 conn(0x5573da2fd200 msgr2=0x5573da3b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.006+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 shutdown_connections 2023-10-05T15:48:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.006+0000 7f00f7f07b80 1 -- 172.21.15.17:0/2240410896 wait complete. 2023-10-05T15:48:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.006+0000 7f00f7f07b80 20 client.26887 trim_cache size 0 max 16384 2023-10-05T15:48:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:48:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:48:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:48:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:48:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.007+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00c40a1680 msgr2=0x7f00c40a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.007+0000 7f00e45ff700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00c40a1680 0x7f00c40a3b40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f00d400f520 tx=0x7f00d4009920 comp rx=0 tx=0).stop 2023-10-05T15:48:19.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.007+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc19e870 msgr2=0x7f00dc19ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.007+0000 7f00e45ff700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc19e870 0x7f00dc19ecf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e970 tx=0x7f00cc00ec80 comp rx=0 tx=0).stop 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 shutdown_connections 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00c40a1680 0x7f00c40a3b40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00dc19e870 0x7f00dc19ecf0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00dc075870 0x7f00dc19d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 --2- 172.21.15.17:0/525416412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00dc077470 0x7f00dc19d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 >> 172.21.15.17:0/525416412 conn(0x7f00dc0fe6a0 msgr2=0x7f00dc100430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:19.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 shutdown_connections 2023-10-05T15:48:19.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:19.008+0000 7f00e45ff700 1 -- 172.21.15.17:0/525416412 wait complete. 2023-10-05T15:48:20.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:19 smithi017 ceph-mon[129107]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.2 MiB/s wr, 621 op/s 2023-10-05T15:48:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:19 smithi167 ceph-mon[133366]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.2 MiB/s wr, 621 op/s 2023-10-05T15:48:20.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:19 smithi079 ceph-mon[132936]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.2 MiB/s wr, 621 op/s 2023-10-05T15:48:22.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:21 smithi017 ceph-mon[129107]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 650 op/s 2023-10-05T15:48:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:21 smithi167 ceph-mon[133366]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 650 op/s 2023-10-05T15:48:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:21 smithi079 ceph-mon[132936]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 650 op/s 2023-10-05T15:48:23.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 585.0 s, 562.2 tps, lat 176.467 ms stddev 62.276 2023-10-05T15:48:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:23 smithi167 ceph-mon[133366]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 516 op/s 2023-10-05T15:48:24.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:23 smithi079 ceph-mon[132936]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 516 op/s 2023-10-05T15:48:24.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:23 smithi017 ceph-mon[129107]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 516 op/s 2023-10-05T15:48:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:25 smithi167 ceph-mon[133366]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 693 op/s 2023-10-05T15:48:26.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:25 smithi079 ceph-mon[132936]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 693 op/s 2023-10-05T15:48:26.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:25 smithi017 ceph-mon[129107]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 693 op/s 2023-10-05T15:48:28.195 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 590.0 s, 471.0 tps, lat 209.326 ms stddev 82.900 2023-10-05T15:48:28.341 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:27 smithi167 ceph-mon[133366]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 535 op/s 2023-10-05T15:48:28.341 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:27 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:48:28.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:27 smithi079 ceph-mon[132936]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 535 op/s 2023-10-05T15:48:28.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:27 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:48:28.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:27 smithi017 ceph-mon[129107]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.4 MiB/s wr, 535 op/s 2023-10-05T15:48:28.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:27 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:48:29.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:29 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:29 smithi017 ceph-mon[129107]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 555 op/s 2023-10-05T15:48:29.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:29 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:29 smithi167 ceph-mon[133366]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 555 op/s 2023-10-05T15:48:29.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.856 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:29 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:29.857 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:29 smithi079 ceph-mon[132936]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 555 op/s 2023-10-05T15:48:30.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:30.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:30 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:30.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:30.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:30 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:30.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:30.949 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:30 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:48:31.854 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:48:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:31 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:31.855 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:31 smithi079 ceph-mon[132936]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 603 op/s 2023-10-05T15:48:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:48:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:48:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:31 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:31.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:31 smithi017 ceph-mon[129107]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 603 op/s 2023-10-05T15:48:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:48:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:48:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:31 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:48:32.083 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:31 smithi167 ceph-mon[133366]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 603 op/s 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.266+0000 7fc17a1ff700 1 -- 172.21.15.17:0/233690993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc17410d5c0 msgr2=0x7fc17410fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.266+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/233690993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc17410d5c0 0x7fc17410fa80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc16c008030 tx=0x7fc16c008340 comp rx=0 tx=0).stop 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 -- 172.21.15.17:0/233690993 shutdown_connections 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/233690993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc17410d5c0 0x7fc17410fa80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/233690993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc174108120 0x7fc17410a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/233690993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 0x7fc17410cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 -- 172.21.15.17:0/233690993 >> 172.21.15.17:0/233690993 conn(0x7fc17406e0b0 msgr2=0x7fc174070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 -- 172.21.15.17:0/233690993 shutdown_connections 2023-10-05T15:48:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.267+0000 7fc17a1ff700 1 -- 172.21.15.17:0/233690993 wait complete. 2023-10-05T15:48:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.268+0000 7fc17a1ff700 1 Processor -- start 2023-10-05T15:48:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 -- start start 2023-10-05T15:48:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc174108120 0x7fc1741a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 0x7fc1741a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17410d5c0 0x7fc1741a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1741a75c0 con 0x7fc174108120 2023-10-05T15:48:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1741a7730 con 0x7fc17410aae0 2023-10-05T15:48:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.269+0000 7fc17a1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1741a78f0 con 0x7fc17410d5c0 2023-10-05T15:48:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.270+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 0x7fc1741a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.270+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 0x7fc1741a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53910/0 (socket says 172.21.15.17:53910) 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.270+0000 7fc16bfff700 1 -- 172.21.15.17:0/1654861637 learned_addr learned my addr 172.21.15.17:0/1654861637 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.270+0000 7fc173fff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17410d5c0 0x7fc1741a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.270+0000 7fc1737fe700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc174108120 0x7fc1741a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc173fff700 1 -- 172.21.15.17:0/1654861637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 msgr2=0x7fc1741a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc173fff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 0x7fc1741a60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc173fff700 1 -- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc174108120 msgr2=0x7fc1741a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc173fff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc174108120 0x7fc1741a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc173fff700 1 -- 172.21.15.17:0/1654861637 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c007ce0 con 0x7fc17410d5c0 2023-10-05T15:48:32.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc173fff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17410d5c0 0x7fc1741a6f60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc16c008710 tx=0x7fc16c004d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:32.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.271+0000 7fc1717fa700 1 -- 172.21.15.17:0/1654861637 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01aab0 con 0x7fc17410d5c0 2023-10-05T15:48:32.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.272+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1741a7b70 con 0x7fc17410d5c0 2023-10-05T15:48:32.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.272+0000 7fc1717fa700 1 -- 172.21.15.17:0/1654861637 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc16c010070 con 0x7fc17410d5c0 2023-10-05T15:48:32.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.272+0000 7fc1717fa700 1 -- 172.21.15.17:0/1654861637 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c005a60 con 0x7fc17410d5c0 2023-10-05T15:48:32.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.272+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1741ae390 con 0x7fc17410d5c0 2023-10-05T15:48:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.277+0000 7fc1717fa700 1 -- 172.21.15.17:0/1654861637 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc16c017070 con 0x7fc17410d5c0 2023-10-05T15:48:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.279+0000 7fc18db61b80 1 Processor -- start 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 -- start start 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc1717fa700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1600a1550 0x7fc1600a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc1717fa700 1 -- 172.21.15.17:0/1654861637 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc16c0cda20 con 0x7fc17410d5c0 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecb62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 0x55945ecb7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb7990 0x55945ecbe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ec1e400 con 0x55945ecb7990 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ec0fbc0 con 0x55945ecb6fd0 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.280+0000 7fc18db61b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ec0d4e0 con 0x55945ecb5ec0 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 0x55945ecb7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 0x55945ecb7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53918/0 (socket says 172.21.15.17:53918) 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 -- 172.21.15.17:0/1100125686 learned_addr learned my addr 172.21.15.17:0/1100125686 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1600a1550 0x7fc1600a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc1737fe700 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecb62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 -- 172.21.15.17:0/1100125686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 msgr2=0x55945ecb62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecb62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 -- 172.21.15.17:0/1100125686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb7990 msgr2=0x55945ecbe220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb7990 0x55945ecbe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.281+0000 7fc16bfff700 1 -- 172.21.15.17:0/1100125686 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945ea33d80 con 0x55945ecb6fd0 2023-10-05T15:48:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.282+0000 7fc16bfff700 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 0x55945ecb7450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ae0 tx=0x7fc15c009df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f28002fb9b320a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.283+0000 7fc169ffb700 1 -- 172.21.15.17:0/1100125686 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004030 con 0x55945ecb6fd0 2023-10-05T15:48:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.283+0000 7fc169ffb700 1 -- 172.21.15.17:0/1100125686 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc15c00dad0 con 0x55945ecb6fd0 2023-10-05T15:48:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.283+0000 7fc169ffb700 1 -- 172.21.15.17:0/1100125686 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c003d80 con 0x55945ecb6fd0 2023-10-05T15:48:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 -- 172.21.15.17:0/1100125686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 msgr2=0x55945ecb7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 0x55945ecb7450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ae0 tx=0x7fc15c009df0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc16bfff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1600a1550 0x7fc1600a3a10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00f000 tx=0x7fc15c012000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 -- 172.21.15.17:0/1100125686 shutdown_connections 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb7990 0x55945ecbe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecb62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1100125686 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb6fd0 0x55945ecb7450 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.284+0000 7fc18db61b80 1 -- 172.21.15.17:0/1100125686 >> 172.21.15.17:0/1100125686 conn(0x55945ec2a200 msgr2=0x55945ecb0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.285+0000 7fc18db61b80 1 -- 172.21.15.17:0/1100125686 shutdown_connections 2023-10-05T15:48:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.285+0000 7fc18db61b80 1 -- 172.21.15.17:0/1100125686 wait complete. 2023-10-05T15:48:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.286+0000 7fc18db61b80 1 -- start start 2023-10-05T15:48:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.286+0000 7fc18db61b80 1 Processor -- start 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ec08dd0 con 0x55945ecb6fd0 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945eba56b0 con 0x55945ecb7990 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945eba5350 con 0x55945ecb5ec0 2023-10-05T15:48:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.287+0000 7fc18db61b80 10 client.0 _ll_register_callbacks cb 0x55945ea027a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.288+0000 7fc173fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.288+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.288+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59116/0 (socket says 172.21.15.17:59116) 2023-10-05T15:48:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.288+0000 7fc1737fe700 1 -- 172.21.15.17:0/1873789748 learned_addr learned my addr 172.21.15.17:0/1873789748 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.289+0000 7fc173fff700 1 -- 172.21.15.17:0/1873789748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 msgr2=0x55945ecd0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.289+0000 7fc173fff700 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.289+0000 7fc173fff700 1 -- 172.21.15.17:0/1873789748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 msgr2=0x55945ecd1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.289+0000 7fc173fff700 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.289+0000 7fc173fff700 1 -- 172.21.15.17:0/1873789748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15c015040 con 0x55945ecb7990 2023-10-05T15:48:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.289+0000 7fc173fff700 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc16c011ed0 tx=0x7fc16c0196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52efe064392ba639 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc152ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:48:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc152ffd700 1 -- 172.21.15.17:0/1873789748 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0b8ea0 con 0x55945ecb7990 2023-10-05T15:48:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc152ffd700 1 -- 172.21.15.17:0/1873789748 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc16c09aa30 con 0x55945ecb7990 2023-10-05T15:48:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55945eca8d50 con 0x55945ecb7990 2023-10-05T15:48:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc152ffd700 1 -- 172.21.15.17:0/1873789748 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc16c09eb80 con 0x55945ecb7990 2023-10-05T15:48:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc18db61b80 10 client.26936 fetch_fsmap learned FSMap version 42 2023-10-05T15:48:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.291+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55945ea1cc00 con 0x55945ecb7990 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc152ffd700 1 -- 172.21.15.17:0/1873789748 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55945eca8d50 con 0x55945ecb7990 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc152ffd700 1 -- 172.21.15.17:0/1873789748 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc16c099f20 con 0x55945ecb7990 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc18db61b80 10 client.26936 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc18db61b80 10 client.26936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc18db61b80 20 client.26936 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ecdc840 0x55945ecdec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc18db61b80 4 client.26936 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.292+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55945ec01db0 con 0x55945ecdc840 2023-10-05T15:48:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.293+0000 7fc1737fe700 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ecdc840 0x55945ecdec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.293+0000 7fc1737fe700 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ecdc840 0x55945ecdec60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a26bd332232f31 server_cookie=c33dbddc0803ce5a in_seq=0 out_seq=0 2023-10-05T15:48:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.293+0000 7fc152ffd700 10 client.26936 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.294+0000 7fc152ffd700 1 -- 172.21.15.17:0/1873789748 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55945ec01db0 con 0x55945ecdc840 2023-10-05T15:48:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.294+0000 7fc152ffd700 10 client.26936 handle_command_reply: tid=0 2023-10-05T15:48:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.294+0000 7fc18db61b80 1 client.26936 shutdown 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 msgr2=0x55945ecd8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc16c011ed0 tx=0x7fc16c0196b0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 shutdown_connections 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ecdc840 0x55945ecdec60 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 --2- 172.21.15.17:0/1873789748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 >> 172.21.15.17:0/1873789748 conn(0x55945ec2a200 msgr2=0x55945ecb0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc152ffd700 0 client.26936 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 shutdown_connections 2023-10-05T15:48:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.295+0000 7fc18db61b80 1 -- 172.21.15.17:0/1873789748 wait complete. 2023-10-05T15:48:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.296+0000 7fc18db61b80 20 client.26936 trim_cache size 0 max 16384 2023-10-05T15:48:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.325+0000 7fc18db61b80 1 Processor -- start 2023-10-05T15:48:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.325+0000 7fc18db61b80 1 -- start start 2023-10-05T15:48:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.325+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb5ec0 0x55945ecde850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.325+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 0x55945ecd8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.325+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc18db61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ea898c0 con 0x55945ecb5ec0 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc18db61b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ecb7850 con 0x55945ecb7990 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc18db61b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ecd0780 con 0x55945ecb6fd0 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 0x55945ecd8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 0x55945ecd8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:59130/0 (socket says 172.21.15.17:59130) 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc16bfff700 1 -- 172.21.15.17:0/3592235762 learned_addr learned my addr 172.21.15.17:0/3592235762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc173fff700 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.326+0000 7fc1737fe700 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb5ec0 0x55945ecde850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.327+0000 7fc16bfff700 1 -- 172.21.15.17:0/3592235762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 msgr2=0x55945ecd8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.327+0000 7fc16bfff700 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.327+0000 7fc16bfff700 1 -- 172.21.15.17:0/3592235762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb5ec0 msgr2=0x55945ecde850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.327+0000 7fc16bfff700 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb5ec0 0x55945ecde850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.327+0000 7fc16bfff700 1 -- 172.21.15.17:0/3592235762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945ea5a1f0 con 0x55945ecb6fd0 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.327+0000 7fc16bfff700 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 0x55945ecd8150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005950 tx=0x7fc15c025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e516689b30054aed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.328+0000 7fc16a7fc700 1 -- 172.21.15.17:0/3592235762 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004030 con 0x55945ecb6fd0 2023-10-05T15:48:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.328+0000 7fc16a7fc700 1 -- 172.21.15.17:0/3592235762 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc15c005050 con 0x55945ecb6fd0 2023-10-05T15:48:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.328+0000 7fc16a7fc700 1 -- 172.21.15.17:0/3592235762 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004970 con 0x55945ecb6fd0 2023-10-05T15:48:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 -- 172.21.15.17:0/3592235762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 msgr2=0x55945ecd8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 0x55945ecd8150 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005950 tx=0x7fc15c025000 comp rx=0 tx=0).stop 2023-10-05T15:48:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 -- 172.21.15.17:0/3592235762 shutdown_connections 2023-10-05T15:48:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb5ec0 0x55945ecde850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 --2- 172.21.15.17:0/3592235762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb6fd0 0x55945ecd8150 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 -- 172.21.15.17:0/3592235762 >> 172.21.15.17:0/3592235762 conn(0x55945ec2a200 msgr2=0x55945ecb0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.329+0000 7fc18db61b80 1 -- 172.21.15.17:0/3592235762 shutdown_connections 2023-10-05T15:48:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.330+0000 7fc18db61b80 1 -- 172.21.15.17:0/3592235762 wait complete. 2023-10-05T15:48:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.330+0000 7fc18db61b80 1 -- start start 2023-10-05T15:48:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.331+0000 7fc18db61b80 1 Processor -- start 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ecd79e0 con 0x55945ecb6fd0 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ecd7b50 con 0x55945ecb7990 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ecd7d10 con 0x55945ecb5ec0 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.333+0000 7fc18db61b80 10 client.0 _ll_register_callbacks cb 0x7fc16c096dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.334+0000 7fc173fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.334+0000 7fc1737fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.334+0000 7fc173fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53938/0 (socket says 172.21.15.17:53938) 2023-10-05T15:48:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.334+0000 7fc173fff700 1 -- 172.21.15.17:0/599720964 learned_addr learned my addr 172.21.15.17:0/599720964 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc16bfff700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc173fff700 1 -- 172.21.15.17:0/599720964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 msgr2=0x55945ecd5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc173fff700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc173fff700 1 -- 172.21.15.17:0/599720964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 msgr2=0x55945ecd6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc173fff700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc173fff700 1 -- 172.21.15.17:0/599720964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55945ea33d80 con 0x55945ecb7990 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc16bfff700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc173fff700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd74a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc16c09a9c0 tx=0x7fc16c0088c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be252965fb047da server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.335+0000 7fc152ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.336+0000 7fc152ffd700 1 -- 172.21.15.17:0/599720964 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0b8ea0 con 0x55945ecb7990 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.336+0000 7fc152ffd700 1 -- 172.21.15.17:0/599720964 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc16c09aa30 con 0x55945ecb7990 2023-10-05T15:48:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.336+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc15c00dad0 con 0x55945ecb7990 2023-10-05T15:48:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.337+0000 7fc152ffd700 1 -- 172.21.15.17:0/599720964 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc16c007940 con 0x55945ecb7990 2023-10-05T15:48:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.337+0000 7fc18db61b80 10 client.26942 fetch_fsmap learned FSMap version 42 2023-10-05T15:48:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.337+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55945ea32250 con 0x55945ecb7990 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc152ffd700 1 -- 172.21.15.17:0/599720964 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc15c00dad0 con 0x55945ecb7990 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc152ffd700 1 -- 172.21.15.17:0/599720964 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 42) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc16c099990 con 0x55945ecb7990 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc18db61b80 10 client.26942 fetch_fsmap finished waiting for FSMap version 42 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc18db61b80 10 client.26942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc18db61b80 20 client.26942 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc18db61b80 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ed31020 0x55945ed33440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc18db61b80 4 client.26942 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:48:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.338+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55945ec01ad0 con 0x55945ed31020 2023-10-05T15:48:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.339+0000 7fc1737fe700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ed31020 0x55945ed33440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.341+0000 7fc1737fe700 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ed31020 0x55945ed33440 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf006b85cd527c6 server_cookie=ea469806d8374978 in_seq=0 out_seq=0 2023-10-05T15:48:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.341+0000 7fc152ffd700 10 client.26942 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.362+0000 7fc152ffd700 1 -- 172.21.15.17:0/599720964 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55945ec01ad0 con 0x55945ed31020 2023-10-05T15:48:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.362+0000 7fc152ffd700 10 client.26942 handle_command_reply: tid=0 2023-10-05T15:48:32.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.362+0000 7fc18db61b80 1 client.26942 shutdown 2023-10-05T15:48:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 msgr2=0x55945ecd74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd74a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc16c09a9c0 tx=0x7fc16c0088c0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 shutdown_connections 2023-10-05T15:48:32.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55945ed31020 0x55945ed33440 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55945ecb7990 0x55945ecd74a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55945ecb5ec0 0x55945ecd5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 --2- 172.21.15.17:0/599720964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55945ecb6fd0 0x55945ecd6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.363+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 >> 172.21.15.17:0/599720964 conn(0x55945ec2a200 msgr2=0x55945ecde850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:32.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.365+0000 7fc152ffd700 0 client.26942 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.365+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 shutdown_connections 2023-10-05T15:48:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.365+0000 7fc18db61b80 1 -- 172.21.15.17:0/599720964 wait complete. 2023-10-05T15:48:32.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.366+0000 7fc18db61b80 20 client.26942 trim_cache size 0 max 16384 2023-10-05T15:48:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:48:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:48:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:48:32.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:48:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1600a1550 msgr2=0x7fc1600a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1600a1550 0x7fc1600a3a10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00f000 tx=0x7fc15c012000 comp rx=0 tx=0).stop 2023-10-05T15:48:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17410d5c0 msgr2=0x7fc1741a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17410d5c0 0x7fc1741a6f60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc16c008710 tx=0x7fc16c004d80 comp rx=0 tx=0).stop 2023-10-05T15:48:32.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 shutdown_connections 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc1600a1550 0x7fc1600a3a10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17410d5c0 0x7fc1741a6f60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc174108120 0x7fc1741a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 --2- 172.21.15.17:0/1654861637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc17410aae0 0x7fc1741a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.367+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 >> 172.21.15.17:0/1654861637 conn(0x7fc17406e0b0 msgr2=0x7fc174108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.368+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 shutdown_connections 2023-10-05T15:48:32.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:32.368+0000 7fc17a1ff700 1 -- 172.21.15.17:0/1654861637 wait complete. 2023-10-05T15:48:33.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 595.0 s, 562.2 tps, lat 178.676 ms stddev 80.105 2023-10-05T15:48:34.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:33 smithi017 ceph-mon[129107]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.8 MiB/s wr, 497 op/s 2023-10-05T15:48:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:33 smithi167 ceph-mon[133366]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.8 MiB/s wr, 497 op/s 2023-10-05T15:48:34.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:33 smithi079 ceph-mon[132936]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.8 MiB/s wr, 497 op/s 2023-10-05T15:48:36.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:35 smithi017 ceph-mon[129107]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.7 MiB/s wr, 681 op/s 2023-10-05T15:48:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:35 smithi167 ceph-mon[133366]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.7 MiB/s wr, 681 op/s 2023-10-05T15:48:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:35 smithi079 ceph-mon[132936]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.7 MiB/s wr, 681 op/s 2023-10-05T15:48:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 600.0 s, 548.5 tps, lat 184.556 ms stddev 70.009 2023-10-05T15:48:38.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:37 smithi017 ceph-mon[129107]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.6 MiB/s wr, 475 op/s 2023-10-05T15:48:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:37 smithi167 ceph-mon[133366]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.6 MiB/s wr, 475 op/s 2023-10-05T15:48:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:37 smithi079 ceph-mon[132936]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.6 MiB/s wr, 475 op/s 2023-10-05T15:48:39.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:38 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:48:39.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:38 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:48:39.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:38 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:48:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:39 smithi167 ceph-mon[133366]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2023-10-05T15:48:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:39 smithi079 ceph-mon[132936]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2023-10-05T15:48:40.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:39 smithi017 ceph-mon[129107]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2023-10-05T15:48:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:41 smithi167 ceph-mon[133366]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.5 MiB/s wr, 622 op/s 2023-10-05T15:48:42.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:41 smithi079 ceph-mon[132936]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.5 MiB/s wr, 622 op/s 2023-10-05T15:48:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:41 smithi017 ceph-mon[129107]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.5 MiB/s wr, 622 op/s 2023-10-05T15:48:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 605.0 s, 570.5 tps, lat 176.194 ms stddev 57.943 2023-10-05T15:48:43.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:48:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 -- 172.21.15.17:0/3854364983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c104a70 msgr2=0x7fdd8c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3854364983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c104a70 0x7fdd8c104ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b0a0 tx=0x7fdd8400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 -- 172.21.15.17:0/3854364983 shutdown_connections 2023-10-05T15:48:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3854364983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c104a70 0x7fdd8c104ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3854364983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c0ff730 0x7fdd8c101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3854364983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd8c1020a0 0x7fdd8c104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 -- 172.21.15.17:0/3854364983 >> 172.21.15.17:0/3854364983 conn(0x7fdd8c0fb330 msgr2=0x7fdd8c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.005+0000 7fdd93dff700 1 -- 172.21.15.17:0/3854364983 shutdown_connections 2023-10-05T15:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.006+0000 7fdd93dff700 1 -- 172.21.15.17:0/3854364983 wait complete. 2023-10-05T15:48:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.007+0000 7fdd93dff700 1 Processor -- start 2023-10-05T15:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.007+0000 7fdd93dff700 1 -- start start 2023-10-05T15:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd93dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c0ff730 0x7fdd8c19d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd93dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd8c1020a0 0x7fdd8c19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd93dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 0x7fdd8c1a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd93dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1a4c40 con 0x7fdd8c1020a0 2023-10-05T15:48:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd93dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1a4d80 con 0x7fdd8c0ff730 2023-10-05T15:48:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd93dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1a4f10 con 0x7fdd8c104a70 2023-10-05T15:48:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.008+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd8c1020a0 0x7fdd8c19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 0x7fdd8c1a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 0x7fdd8c1a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33570/0 (socket says 172.21.15.17:33570) 2023-10-05T15:48:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 -- 172.21.15.17:0/3275578771 learned_addr learned my addr 172.21.15.17:0/3275578771 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c0ff730 0x7fdd8c19d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 -- 172.21.15.17:0/3275578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c0ff730 msgr2=0x7fdd8c19d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c0ff730 0x7fdd8c19d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 -- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd8c1020a0 msgr2=0x7fdd8c19d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd8c1020a0 0x7fdd8c19d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 -- 172.21.15.17:0/3275578771 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84009d00 con 0x7fdd8c104a70 2023-10-05T15:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c0ff730 0x7fdd8c19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:48:44.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.009+0000 7fdd9239c700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 0x7fdd8c1a4670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b070 tx=0x7fdd8400bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.010+0000 7fdd82ffd700 1 -- 172.21.15.17:0/3275578771 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400e040 con 0x7fdd8c104a70 2023-10-05T15:48:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.010+0000 7fdd82ffd700 1 -- 172.21.15.17:0/3275578771 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd84004e60 con 0x7fdd8c104a70 2023-10-05T15:48:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.010+0000 7fdd82ffd700 1 -- 172.21.15.17:0/3275578771 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8401b790 con 0x7fdd8c104a70 2023-10-05T15:48:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.010+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1a5190 con 0x7fdd8c104a70 2023-10-05T15:48:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.010+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c1a5560 con 0x7fdd8c104a70 2023-10-05T15:48:44.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.016+0000 7fdd82ffd700 1 -- 172.21.15.17:0/3275578771 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fdd8401d470 con 0x7fdd8c104a70 2023-10-05T15:48:44.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.017+0000 7fdda76e2b80 1 Processor -- start 2023-10-05T15:48:44.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.018+0000 7fdda76e2b80 1 -- start start 2023-10-05T15:48:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.019+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c20680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.019+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20bc0 0x5613b2c21480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.019+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c21ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.019+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b88460 con 0x5613b2c20260 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.019+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b79c20 con 0x5613b2c21a60 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.019+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b77540 con 0x5613b2c20bc0 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c21ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c21ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57064/0 (socket says 172.21.15.17:57064) 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 -- 172.21.15.17:0/78974865 learned_addr learned my addr 172.21.15.17:0/78974865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:44.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20bc0 0x5613b2c21480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c20680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 -- 172.21.15.17:0/78974865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20bc0 msgr2=0x5613b2c21480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20bc0 0x5613b2c21480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 -- 172.21.15.17:0/78974865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 msgr2=0x5613b2c20680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c20680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.020+0000 7fdd9139a700 1 -- 172.21.15.17:0/78974865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b299dde0 con 0x5613b2c21a60 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.021+0000 7fdd9139a700 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c21ee0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012680 tx=0x7fdd7c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839c5ace0dabfc17 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.021+0000 7fdd82ffd700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd780a1680 0x7fdd780a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.021+0000 7fdd82ffd700 1 -- 172.21.15.17:0/3275578771 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdd840ce280 con 0x7fdd8c104a70 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.021+0000 7fdd77fff700 1 -- 172.21.15.17:0/78974865 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c004230 con 0x5613b2c21a60 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.022+0000 7fdd77fff700 1 -- 172.21.15.17:0/78974865 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7c004390 con 0x5613b2c21a60 2023-10-05T15:48:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.022+0000 7fdd77fff700 1 -- 172.21.15.17:0/78974865 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00f7c0 con 0x5613b2c21a60 2023-10-05T15:48:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.022+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd780a1680 0x7fdd780a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.022+0000 7fdda76e2b80 1 -- 172.21.15.17:0/78974865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 msgr2=0x5613b2c21ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.022+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c21ee0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012680 tx=0x7fdd7c00b900 comp rx=0 tx=0).stop 2023-10-05T15:48:44.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 -- 172.21.15.17:0/78974865 shutdown_connections 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c21ee0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c20680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/78974865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20bc0 0x5613b2c21480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 -- 172.21.15.17:0/78974865 >> 172.21.15.17:0/78974865 conn(0x5613b2b94260 msgr2=0x5613b2c1b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 -- 172.21.15.17:0/78974865 shutdown_connections 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.023+0000 7fdda76e2b80 1 -- 172.21.15.17:0/78974865 wait complete. 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.024+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd780a1680 0x7fdd780a3b40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009e40 tx=0x7fdd88009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:44.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.024+0000 7fdda76e2b80 1 -- start start 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 Processor -- start 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c2a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20bc0 0x5613b2c2a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c31640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b72e30 con 0x5613b2c20bc0 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b0f710 con 0x5613b2c21a60 2023-10-05T15:48:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b0f3b0 con 0x5613b2c20260 2023-10-05T15:48:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.025+0000 7fdda76e2b80 10 client.0 _ll_register_callbacks cb 0x5613b296c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.026+0000 7fdd9239c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c31640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.026+0000 7fdd9239c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c31640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57078/0 (socket says 172.21.15.17:57078) 2023-10-05T15:48:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.026+0000 7fdd9239c700 1 -- 172.21.15.17:0/1257382904 learned_addr learned my addr 172.21.15.17:0/1257382904 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.027+0000 7fdd9239c700 1 -- 172.21.15.17:0/1257382904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 msgr2=0x5613b2c2a0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:48:44.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.027+0000 7fdd9239c700 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c2a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.027+0000 7fdd9239c700 1 -- 172.21.15.17:0/1257382904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20bc0 msgr2=0x5613b2c2a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.027+0000 7fdd9239c700 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20bc0 0x5613b2c2a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.027+0000 7fdd9239c700 1 -- 172.21.15.17:0/1257382904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c00be20 con 0x5613b2c21a60 2023-10-05T15:48:44.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.028+0000 7fdd9239c700 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c31640 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdd840090a0 tx=0x7fdd8409acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ae7308414daf78 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.028+0000 7fdd757fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:48:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.028+0000 7fdd757fa700 1 -- 172.21.15.17:0/1257382904 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8409b230 con 0x5613b2c21a60 2023-10-05T15:48:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.028+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613b2c12f10 con 0x5613b2c21a60 2023-10-05T15:48:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.028+0000 7fdd757fa700 1 -- 172.21.15.17:0/1257382904 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdd840cbe40 con 0x5613b2c21a60 2023-10-05T15:48:44.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.028+0000 7fdd757fa700 1 -- 172.21.15.17:0/1257382904 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd8409f380 con 0x5613b2c21a60 2023-10-05T15:48:44.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.029+0000 7fdda76e2b80 10 client.26954 fetch_fsmap learned FSMap version 43 2023-10-05T15:48:44.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.029+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5613b2986c60 con 0x5613b2c21a60 2023-10-05T15:48:44.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdd757fa700 1 -- 172.21.15.17:0/1257382904 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5613b2c12f10 con 0x5613b2c21a60 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdd757fa700 1 -- 172.21.15.17:0/1257382904 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd8409a720 con 0x5613b2c21a60 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdda76e2b80 10 client.26954 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdda76e2b80 10 client.26954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdda76e2b80 20 client.26954 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2c46cb0 0x5613b2c490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdda76e2b80 4 client.26954 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.030+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613b2b6be10 con 0x5613b2c46cb0 2023-10-05T15:48:44.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.031+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2c46cb0 0x5613b2c490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.032+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2c46cb0 0x5613b2c490a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1da202aa7a777d server_cookie=15f3e7ec282f2663 in_seq=0 out_seq=0 2023-10-05T15:48:44.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.033+0000 7fdd757fa700 10 client.26954 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.033+0000 7fdd757fa700 1 -- 172.21.15.17:0/1257382904 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5613b2b6be10 con 0x5613b2c46cb0 2023-10-05T15:48:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.033+0000 7fdd757fa700 10 client.26954 handle_command_reply: tid=0 2023-10-05T15:48:44.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.033+0000 7fdda76e2b80 1 client.26954 shutdown 2023-10-05T15:48:44.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.036+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 msgr2=0x5613b2c31640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.036+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c31640 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdd840090a0 tx=0x7fdd8409acc0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 shutdown_connections 2023-10-05T15:48:44.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2c46cb0 0x5613b2c490a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c21a60 0x5613b2c31640 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c2a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/1257382904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20bc0 0x5613b2c2a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdd757fa700 0 client.26954 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 >> 172.21.15.17:0/1257382904 conn(0x5613b2b94260 msgr2=0x5613b2c1af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.037+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 shutdown_connections 2023-10-05T15:48:44.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.038+0000 7fdda76e2b80 1 -- 172.21.15.17:0/1257382904 wait complete. 2023-10-05T15:48:44.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.038+0000 7fdda76e2b80 20 client.26954 trim_cache size 0 max 16384 2023-10-05T15:48:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.071+0000 7fdda76e2b80 1 Processor -- start 2023-10-05T15:48:44.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.071+0000 7fdda76e2b80 1 -- start start 2023-10-05T15:48:44.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c1af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c21a60 0x5613b2c27e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b29f3920 con 0x5613b2c20260 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2b6be40 con 0x5613b2c20bc0 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2c15570 con 0x5613b2c21a60 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57094/0 (socket says 172.21.15.17:57094) 2023-10-05T15:48:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdd9139a700 1 -- 172.21.15.17:0/21924271 learned_addr learned my addr 172.21.15.17:0/21924271 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c1af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.072+0000 7fdd9239c700 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c21a60 0x5613b2c27e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.073+0000 7fdd9139a700 1 -- 172.21.15.17:0/21924271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c21a60 msgr2=0x5613b2c27e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.073+0000 7fdd9139a700 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c21a60 0x5613b2c27e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.073+0000 7fdd9139a700 1 -- 172.21.15.17:0/21924271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 msgr2=0x5613b2c1af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.073+0000 7fdd9139a700 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c1af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.073+0000 7fdd9139a700 1 -- 172.21.15.17:0/21924271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613b29c4250 con 0x5613b2c20bc0 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.073+0000 7fdd9139a700 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012c70 tx=0x7fdd7c00b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df379acb7a4c56c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.074+0000 7fdd80bff700 1 -- 172.21.15.17:0/21924271 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c023070 con 0x5613b2c20bc0 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.074+0000 7fdd80bff700 1 -- 172.21.15.17:0/21924271 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7c0054d0 con 0x5613b2c20bc0 2023-10-05T15:48:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.074+0000 7fdd80bff700 1 -- 172.21.15.17:0/21924271 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c004c00 con 0x5613b2c20bc0 2023-10-05T15:48:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 -- 172.21.15.17:0/21924271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 msgr2=0x5613b2c31600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31600 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012c70 tx=0x7fdd7c00b7c0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 -- 172.21.15.17:0/21924271 shutdown_connections 2023-10-05T15:48:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c21a60 0x5613b2c27e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c20260 0x5613b2c1af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/21924271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31600 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 -- 172.21.15.17:0/21924271 >> 172.21.15.17:0/21924271 conn(0x5613b2b94260 msgr2=0x5613b2c28d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:44.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 -- 172.21.15.17:0/21924271 shutdown_connections 2023-10-05T15:48:44.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.075+0000 7fdda76e2b80 1 -- 172.21.15.17:0/21924271 wait complete. 2023-10-05T15:48:44.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.076+0000 7fdda76e2b80 1 -- start start 2023-10-05T15:48:44.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.076+0000 7fdda76e2b80 1 Processor -- start 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.077+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c31020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.077+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.077+0000 7fdda76e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c21a60 0x5613b2c2f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.077+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2c2fdc0 con 0x5613b2c21a60 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.077+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2c2ff30 con 0x5613b2c20bc0 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.077+0000 7fdda76e2b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613b2c300f0 con 0x5613b2c20260 2023-10-05T15:48:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.078+0000 7fdda76e2b80 10 client.0 _ll_register_callbacks cb 0x7fdd8409b000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.078+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.078+0000 7fdd91b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c31020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.078+0000 7fdd9139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57110/0 (socket says 172.21.15.17:57110) 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.078+0000 7fdd9139a700 1 -- 172.21.15.17:0/64375197 learned_addr learned my addr 172.21.15.17:0/64375197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.079+0000 7fdd9139a700 1 -- 172.21.15.17:0/64375197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 msgr2=0x5613b2c31020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.079+0000 7fdd9139a700 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c31020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.079+0000 7fdd9139a700 1 -- 172.21.15.17:0/64375197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c21a60 msgr2=0x5613b2c2f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.079+0000 7fdd9139a700 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c21a60 0x5613b2c2f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.079+0000 7fdd9139a700 1 -- 172.21.15.17:0/64375197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613b299dde0 con 0x5613b2c20bc0 2023-10-05T15:48:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.079+0000 7fdd9139a700 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31560 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012680 tx=0x7fdd7c004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d099de1d093af5c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.080+0000 7fdd757fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.080+0000 7fdd757fa700 1 -- 172.21.15.17:0/64375197 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c023050 con 0x5613b2c20bc0 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.080+0000 7fdd757fa700 1 -- 172.21.15.17:0/64375197 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fdd7c000e40 con 0x5613b2c20bc0 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.080+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd7c004390 con 0x5613b2c20bc0 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.081+0000 7fdd757fa700 1 -- 172.21.15.17:0/64375197 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd7c005640 con 0x5613b2c20bc0 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.081+0000 7fdda76e2b80 10 client.26960 fetch_fsmap learned FSMap version 43 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.081+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5613b299c2b0 con 0x5613b2c20bc0 2023-10-05T15:48:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.081+0000 7fdd757fa700 1 -- 172.21.15.17:0/64375197 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7c004390 con 0x5613b2c20bc0 2023-10-05T15:48:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.081+0000 7fdd757fa700 1 -- 172.21.15.17:0/64375197 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd7c031c00 con 0x5613b2c20bc0 2023-10-05T15:48:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdda76e2b80 10 client.26960 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:48:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdda76e2b80 10 client.26960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdda76e2b80 20 client.26960 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2cacaf0 0x5613b2caeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdda76e2b80 4 client.26960 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:48:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5613b2b6bb30 con 0x5613b2cacaf0 2023-10-05T15:48:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.082+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2cacaf0 0x5613b2caeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.083+0000 7fdd91b9b700 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2cacaf0 0x5613b2caeee0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=235734a7d72b6f4 server_cookie=46386bc22b74bab4 in_seq=0 out_seq=0 2023-10-05T15:48:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.083+0000 7fdd757fa700 10 client.26960 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdd757fa700 1 -- 172.21.15.17:0/64375197 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5613b2b6bb30 con 0x5613b2cacaf0 2023-10-05T15:48:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdd757fa700 10 client.26960 handle_command_reply: tid=0 2023-10-05T15:48:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdda76e2b80 1 client.26960 shutdown 2023-10-05T15:48:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 msgr2=0x5613b2c31560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31560 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012680 tx=0x7fdd7c004b50 comp rx=0 tx=0).stop 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 shutdown_connections 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.084+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5613b2cacaf0 0x5613b2caeee0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.085+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5613b2c21a60 0x5613b2c2f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.085+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613b2c20260 0x5613b2c31020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.085+0000 7fdda76e2b80 1 --2- 172.21.15.17:0/64375197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5613b2c20bc0 0x5613b2c31560 secure :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c012680 tx=0x7fdd7c004b50 comp rx=0 tx=0).stop 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.085+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 >> 172.21.15.17:0/64375197 conn(0x5613b2b94260 msgr2=0x5613b2c249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:44.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.085+0000 7fdd757fa700 0 client.26960 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.086+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 shutdown_connections 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.086+0000 7fdda76e2b80 1 -- 172.21.15.17:0/64375197 wait complete. 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.086+0000 7fdda76e2b80 20 client.26960 trim_cache size 0 max 16384 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:48:44.088 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:48:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:48:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:48:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:48:44.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:48:44.089 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd780a1680 msgr2=0x7fdd780a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd780a1680 0x7fdd780a3b40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009e40 tx=0x7fdd88009260 comp rx=0 tx=0).stop 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 msgr2=0x7fdd8c1a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 0x7fdd8c1a4670 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b070 tx=0x7fdd8400bce0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 shutdown_connections 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fdd780a1680 0x7fdd780a3b40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd8c104a70 0x7fdd8c1a4670 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd8c0ff730 0x7fdd8c19d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 --2- 172.21.15.17:0/3275578771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd8c1020a0 0x7fdd8c19d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.087+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 >> 172.21.15.17:0/3275578771 conn(0x7fdd8c0fb330 msgr2=0x7fdd8c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:44.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.088+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 shutdown_connections 2023-10-05T15:48:44.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:48:44.088+0000 7fdd93dff700 1 -- 172.21.15.17:0/3275578771 wait complete. 2023-10-05T15:48:44.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:43 smithi017 ceph-mon[129107]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 516 op/s 2023-10-05T15:48:44.120 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:48:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:43 smithi167 ceph-mon[133366]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 516 op/s 2023-10-05T15:48:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:43 smithi079 ceph-mon[132936]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 516 op/s 2023-10-05T15:48:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.635+0000 7f90af5ff700 1 -- 172.21.15.17:0/913675146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 msgr2=0x7f90a810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.635+0000 7f90af5ff700 1 --2- 172.21.15.17:0/913675146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a810d670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009990 tx=0x7f90a0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.636+0000 7f90af5ff700 1 -- 172.21.15.17:0/913675146 shutdown_connections 2023-10-05T15:48:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.636+0000 7f90af5ff700 1 --2- 172.21.15.17:0/913675146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a810d670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.636+0000 7f90af5ff700 1 --2- 172.21.15.17:0/913675146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a8107eb0 0x7f90a810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.636+0000 7f90af5ff700 1 --2- 172.21.15.17:0/913675146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 0x7f90a810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.636+0000 7f90af5ff700 1 -- 172.21.15.17:0/913675146 >> 172.21.15.17:0/913675146 conn(0x7f90a806dd10 msgr2=0x7f90a8070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.636+0000 7f90af5ff700 1 -- 172.21.15.17:0/913675146 shutdown_connections 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.637+0000 7f90af5ff700 1 -- 172.21.15.17:0/913675146 wait complete. 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.638+0000 7f90af5ff700 1 Processor -- start 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.638+0000 7f90af5ff700 1 -- start start 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90af5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a8107eb0 0x7f90a81a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90af5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 0x7f90a81a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90af5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a81a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90af5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a73b0 con 0x7f90a8107eb0 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90af5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a7520 con 0x7f90a810a820 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90af5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a76e0 con 0x7f90a810d1f0 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.639+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 0x7f90a81a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 0x7f90a81a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57132/0 (socket says 172.21.15.17:57132) 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90acb9a700 1 -- 172.21.15.17:0/1210565268 learned_addr learned my addr 172.21.15.17:0/1210565268 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a81a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90ad39b700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a8107eb0 0x7f90a81a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 -- 172.21.15.17:0/1210565268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 msgr2=0x7f90a81a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 0x7f90a81a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 -- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a8107eb0 msgr2=0x7f90a81a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a8107eb0 0x7f90a81a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 -- 172.21.15.17:0/1210565268 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00095f0 con 0x7f90a810d1f0 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.640+0000 7f90adb9c700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a81a6d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f90a00098e0 tx=0x7f90a0003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.641+0000 7f90a67fc700 1 -- 172.21.15.17:0/1210565268 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a001d070 con 0x7f90a810d1f0 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.641+0000 7f90a67fc700 1 -- 172.21.15.17:0/1210565268 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90a000bde0 con 0x7f90a810d1f0 2023-10-05T15:48:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.641+0000 7f90a67fc700 1 -- 172.21.15.17:0/1210565268 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000fbe0 con 0x7f90a810d1f0 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.641+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a81a7960 con 0x7f90a810d1f0 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.641+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a81ae180 con 0x7f90a810d1f0 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.648+0000 7f90a67fc700 1 -- 172.21.15.17:0/1210565268 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f90a000fd40 con 0x7f90a810d1f0 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.648+0000 7f90c2e21b80 1 Processor -- start 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.648+0000 7f90c2e21b80 1 -- start start 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 0x559b52f922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f93450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f93990 0x559b52f9a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52efa400 con 0x559b52f92fd0 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52eebbc0 con 0x559b52f91ec0 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52ee94e0 con 0x559b52f93990 2023-10-05T15:48:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 0x559b52f922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 0x559b52f922e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57140/0 (socket says 172.21.15.17:57140) 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90acb9a700 1 -- 172.21.15.17:0/3602081039 learned_addr learned my addr 172.21.15.17:0/3602081039 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.649+0000 7f90acb9a700 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f93990 0x559b52f9a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90ad39b700 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f93450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90acb9a700 1 -- 172.21.15.17:0/3602081039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f93990 msgr2=0x559b52f9a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90acb9a700 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f93990 0x559b52f9a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90acb9a700 1 -- 172.21.15.17:0/3602081039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 msgr2=0x559b52f93450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90acb9a700 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f93450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90acb9a700 1 -- 172.21.15.17:0/3602081039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b52d0fd80 con 0x559b52f91ec0 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.650+0000 7f90ad39b700 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f93450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:48:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.651+0000 7f90a67fc700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90980a1550 0x7f90980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.651+0000 7f90a67fc700 1 -- 172.21.15.17:0/1210565268 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f90a00cdf90 con 0x7f90a810d1f0 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.651+0000 7f90acb9a700 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 0x559b52f922e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9094012970 tx=0x7f90940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5695c7f5acdc939 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.652+0000 7f90ad39b700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90980a1550 0x7f90980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.653+0000 7f90937fe700 1 -- 172.21.15.17:0/3602081039 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094004030 con 0x559b52f91ec0 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.653+0000 7f90937fe700 1 -- 172.21.15.17:0/3602081039 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9094003680 con 0x559b52f91ec0 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.653+0000 7f90937fe700 1 -- 172.21.15.17:0/3602081039 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400f710 con 0x559b52f91ec0 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.654+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3602081039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 msgr2=0x559b52f922e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.654+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 0x559b52f922e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9094012970 tx=0x7f90940047c0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.655+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3602081039 shutdown_connections 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.655+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f93990 0x559b52f9a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.655+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f91ec0 0x559b52f922e0 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9094012970 tx=0x7f90940047c0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.655+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3602081039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f93450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.655+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3602081039 >> 172.21.15.17:0/3602081039 conn(0x559b52f06200 msgr2=0x559b52f8cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.656+0000 7f90ad39b700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90980a1550 0x7f90980a3a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f909c009db0 tx=0x7f909c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.658+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3602081039 shutdown_connections 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.658+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3602081039 wait complete. 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.659+0000 7f90c2e21b80 1 -- start start 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.659+0000 7f90c2e21b80 1 Processor -- start 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 0x559b52f9bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f93990 0x559b52f9c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52fa3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52ee4dd0 con 0x559b52f93990 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52e816b0 con 0x559b52f92fd0 2023-10-05T15:48:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52e81350 con 0x559b52fa1330 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90c2e21b80 10 client.0 _ll_register_callbacks cb 0x559b52cde7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f93990 0x559b52f9c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90ad39b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 0x559b52f9bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90ad39b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 0x559b52f9bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:57150/0 (socket says 172.21.15.17:57150) 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.660+0000 7f90ad39b700 1 -- 172.21.15.17:0/4249765308 learned_addr learned my addr 172.21.15.17:0/4249765308 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.661+0000 7f90acb9a700 1 -- 172.21.15.17:0/4249765308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 msgr2=0x559b52fa3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.661+0000 7f90acb9a700 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52fa3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.661+0000 7f90acb9a700 1 -- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 msgr2=0x559b52f9bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.661+0000 7f90acb9a700 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 0x559b52f9bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.661+0000 7f90acb9a700 1 -- 172.21.15.17:0/4249765308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909401a040 con 0x559b52f93990 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.661+0000 7f90ad39b700 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 0x559b52f9bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:48:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.662+0000 7f90acb9a700 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f93990 0x559b52f9c300 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x559b52f8df30 tx=0x7f909400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f699c127fa480 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.662+0000 7f9090ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.662+0000 7f9090ff9700 1 -- 172.21.15.17:0/4249765308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90940041f0 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.662+0000 7f9090ff9700 1 -- 172.21.15.17:0/4249765308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9094004350 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.662+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b52f84d50 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.663+0000 7f9090ff9700 1 -- 172.21.15.17:0/4249765308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9094004510 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.664+0000 7f90c2e21b80 10 client.16986 fetch_fsmap learned FSMap version 43 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.664+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x559b52cf8c00 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.664+0000 7f9090ff9700 1 -- 172.21.15.17:0/4249765308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559b52f84d50 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.664+0000 7f9090ff9700 1 -- 172.21.15.17:0/4249765308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f909401f400 con 0x559b52f93990 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.664+0000 7f90c2e21b80 10 client.16986 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.664+0000 7f90c2e21b80 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.665+0000 7f90c2e21b80 20 client.16986 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.665+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52fa7e00 0x559b52faa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.665+0000 7f90c2e21b80 4 client.16986 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.665+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b52edddb0 con 0x559b52fa7e00 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.665+0000 7f90ad39b700 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52fa7e00 0x559b52faa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.666+0000 7f90ad39b700 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52fa7e00 0x559b52faa220 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228d96a2f1035936 server_cookie=2c661d7316970d15 in_seq=0 out_seq=0 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.666+0000 7f9090ff9700 10 client.16986 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.667+0000 7f9090ff9700 1 -- 172.21.15.17:0/4249765308 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559b52edddb0 con 0x559b52fa7e00 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.667+0000 7f9090ff9700 10 client.16986 handle_command_reply: tid=0 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.667+0000 7f90c2e21b80 1 client.16986 shutdown 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f93990 msgr2=0x559b52f9c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f93990 0x559b52f9c300 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x559b52f8df30 tx=0x7f909400b7b0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 shutdown_connections 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52fa7e00 0x559b52faa220 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52fa3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f92fd0 0x559b52f9bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/4249765308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f93990 0x559b52f9c300 secure :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0x559b52f8df30 tx=0x7f909400b7b0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.668+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 >> 172.21.15.17:0/4249765308 conn(0x559b52f06200 msgr2=0x559b52f8c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.669+0000 7f9090ff9700 0 client.16986 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.669+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 shutdown_connections 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.670+0000 7f90c2e21b80 1 -- 172.21.15.17:0/4249765308 wait complete. 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.673+0000 7f90c2e21b80 20 client.16986 trim_cache size 0 max 16384 2023-10-05T15:48:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.704+0000 7f90c2e21b80 1 Processor -- start 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 -- start start 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f96200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52f9a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f8c250 0x559b52fb7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52d658c0 con 0x559b52f92fd0 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52fa7a10 con 0x559b52f8c250 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.705+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52f89860 con 0x559b52fa1330 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.706+0000 7f90ad39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f96200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.706+0000 7f90ad39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f96200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59242/0 (socket says 172.21.15.17:59242) 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.706+0000 7f90ad39b700 1 -- 172.21.15.17:0/3307426536 learned_addr learned my addr 172.21.15.17:0/3307426536 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90adb9c700 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f8c250 0x559b52fb7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90acb9a700 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52f9a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90adb9c700 1 -- 172.21.15.17:0/3307426536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 msgr2=0x559b52f9a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90adb9c700 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52f9a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90adb9c700 1 -- 172.21.15.17:0/3307426536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 msgr2=0x559b52f96200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90adb9c700 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f96200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90adb9c700 1 -- 172.21.15.17:0/3307426536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b52d361f0 con 0x559b52f8c250 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.707+0000 7f90acb9a700 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52f9a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.708+0000 7f90adb9c700 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f8c250 0x559b52fb7a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x559b52f9ce70 tx=0x7f90a009ab00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da3ab38f9ede07f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.708+0000 7f9093fff700 1 -- 172.21.15.17:0/3307426536 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a009af40 con 0x559b52f8c250 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.709+0000 7f9093fff700 1 -- 172.21.15.17:0/3307426536 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90a009f090 con 0x559b52f8c250 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.709+0000 7f9093fff700 1 -- 172.21.15.17:0/3307426536 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0004020 con 0x559b52f8c250 2023-10-05T15:48:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3307426536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f8c250 msgr2=0x559b52fb7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f8c250 0x559b52fb7a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x559b52f9ce70 tx=0x7f90a009ab00 comp rx=0 tx=0).stop 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3307426536 shutdown_connections 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52f8c250 0x559b52fb7a00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f92fd0 0x559b52f96200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/3307426536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52fa1330 0x559b52f9a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3307426536 >> 172.21.15.17:0/3307426536 conn(0x559b52f06200 msgr2=0x559b52faeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3307426536 shutdown_connections 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.710+0000 7f90c2e21b80 1 -- 172.21.15.17:0/3307426536 wait complete. 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.711+0000 7f90c2e21b80 1 -- start start 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.711+0000 7f90c2e21b80 1 Processor -- start 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f8c250 0x559b52fb7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 0x559b52fb76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52fa1330 0x559b52ffa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52ffae30 con 0x559b52f8c250 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52ffaf70 con 0x559b52fa1330 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b52ffb100 con 0x559b52f92fd0 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.712+0000 7f90c2e21b80 10 client.0 _ll_register_callbacks cb 0x7f9094012430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 0x559b52fb76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 0x559b52fb76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33682/0 (socket says 172.21.15.17:33682) 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 -- 172.21.15.17:0/2719321085 learned_addr learned my addr 172.21.15.17:0/2719321085 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 -- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52fa1330 msgr2=0x559b52ffa8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52fa1330 0x559b52ffa8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 -- 172.21.15.17:0/2719321085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f8c250 msgr2=0x559b52fb7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f8c250 0x559b52fb7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.713+0000 7f90acb9a700 1 -- 172.21.15.17:0/2719321085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b52cf8c00 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.714+0000 7f90acb9a700 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 0x559b52fb76d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9094001eb0 tx=0x7f909401fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a69c9772cac616b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.714+0000 7f9090ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.714+0000 7f9090ff9700 1 -- 172.21.15.17:0/2719321085 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400b5b0 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.714+0000 7f9090ff9700 1 -- 172.21.15.17:0/2719321085 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9094003ce0 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.714+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9094003680 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.715+0000 7f9090ff9700 1 -- 172.21.15.17:0/2719321085 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9094005250 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.715+0000 7f90c2e21b80 10 client.26935 fetch_fsmap learned FSMap version 43 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.715+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f90a81ae180 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.716+0000 7f9090ff9700 1 -- 172.21.15.17:0/2719321085 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9094003680 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.716+0000 7f9090ff9700 1 -- 172.21.15.17:0/2719321085 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f909400fa10 con 0x559b52f92fd0 2023-10-05T15:48:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90c2e21b80 10 client.26935 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:48:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90c2e21b80 10 client.26935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90c2e21b80 20 client.26935 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52ffc810 0x559b52ffec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90c2e21b80 4 client.26935 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559b52eddad0 con 0x559b52ffc810 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.717+0000 7f90ad39b700 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52ffc810 0x559b52ffec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.718+0000 7f90ad39b700 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52ffc810 0x559b52ffec30 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424abd5fe883e6b3 server_cookie=6dd1335a4bc1e08d in_seq=0 out_seq=0 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.718+0000 7f9090ff9700 10 client.26935 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.737+0000 7f9090ff9700 1 -- 172.21.15.17:0/2719321085 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559b52eddad0 con 0x559b52ffc810 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.737+0000 7f9090ff9700 10 client.26935 handle_command_reply: tid=0 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.737+0000 7f90c2e21b80 1 client.26935 shutdown 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.737+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 msgr2=0x559b52fb76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.737+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 0x559b52fb76d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9094001eb0 tx=0x7f909401fa30 comp rx=0 tx=0).stop 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 shutdown_connections 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559b52ffc810 0x559b52ffec30 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b52fa1330 0x559b52ffa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b52f8c250 0x559b52fb7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f90c2e21b80 1 --2- 172.21.15.17:0/2719321085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559b52f92fd0 0x559b52fb76d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 >> 172.21.15.17:0/2719321085 conn(0x559b52f06200 msgr2=0x559b52f8ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.738+0000 7f9090ff9700 0 client.26935 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.739+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 shutdown_connections 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.739+0000 7f90c2e21b80 1 -- 172.21.15.17:0/2719321085 wait complete. 2023-10-05T15:48:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.740+0000 7f90c2e21b80 20 client.26935 trim_cache size 0 max 16384 2023-10-05T15:48:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:48:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:48:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:48:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90980a1550 msgr2=0x7f90980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90980a1550 0x7f90980a3a10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f909c009db0 tx=0x7f909c00b040 comp rx=0 tx=0).stop 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 msgr2=0x7f90a81a6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a81a6d50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f90a00098e0 tx=0x7f90a0003a50 comp rx=0 tx=0).stop 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 shutdown_connections 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f90980a1550 0x7f90980a3a10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90a810d1f0 0x7f90a81a6d50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a8107eb0 0x7f90a81a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 --2- 172.21.15.17:0/1210565268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a810a820 0x7f90a81a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.741+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 >> 172.21.15.17:0/1210565268 conn(0x7f90a806dd10 msgr2=0x7f90a8109770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.742+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 shutdown_connections 2023-10-05T15:48:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:45.742+0000 7f90af5ff700 1 -- 172.21.15.17:0/1210565268 wait complete. 2023-10-05T15:48:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:45 smithi167 ceph-mon[133366]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 707 op/s 2023-10-05T15:48:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:45 smithi079 ceph-mon[132936]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 707 op/s 2023-10-05T15:48:46.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:45 smithi017 ceph-mon[129107]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.4 MiB/s wr, 707 op/s 2023-10-05T15:48:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 610.0 s, 527.6 tps, lat 188.631 ms stddev 58.306 2023-10-05T15:48:48.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:47 smithi017 ceph-mon[129107]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.9 MiB/s wr, 535 op/s 2023-10-05T15:48:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:47 smithi167 ceph-mon[133366]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.9 MiB/s wr, 535 op/s 2023-10-05T15:48:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:47 smithi079 ceph-mon[132936]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.9 MiB/s wr, 535 op/s 2023-10-05T15:48:50.197 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:49 smithi017 ceph-mon[129107]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.4 MiB/s wr, 594 op/s 2023-10-05T15:48:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:49 smithi167 ceph-mon[133366]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.4 MiB/s wr, 594 op/s 2023-10-05T15:48:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:49 smithi079 ceph-mon[132936]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.4 MiB/s wr, 594 op/s 2023-10-05T15:48:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:51 smithi167 ceph-mon[133366]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 607 op/s 2023-10-05T15:48:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:51 smithi079 ceph-mon[132936]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 607 op/s 2023-10-05T15:48:52.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:51 smithi017 ceph-mon[129107]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 607 op/s 2023-10-05T15:48:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 615.0 s, 432.8 tps, lat 232.682 ms stddev 306.035 2023-10-05T15:48:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:53 smithi167 ceph-mon[133366]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 506 op/s 2023-10-05T15:48:54.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:53 smithi079 ceph-mon[132936]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 506 op/s 2023-10-05T15:48:54.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:53 smithi017 ceph-mon[129107]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.6 MiB/s wr, 506 op/s 2023-10-05T15:48:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:55 smithi167 ceph-mon[133366]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 707 op/s 2023-10-05T15:48:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:55 smithi079 ceph-mon[132936]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 707 op/s 2023-10-05T15:48:56.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:55 smithi017 ceph-mon[129107]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 707 op/s 2023-10-05T15:48:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 620.0 s, 545.6 tps, lat 184.044 ms stddev 69.036 2023-10-05T15:48:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:57 smithi167 ceph-mon[133366]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.6 MiB/s wr, 511 op/s 2023-10-05T15:48:58.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:57 smithi079 ceph-mon[132936]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.6 MiB/s wr, 511 op/s 2023-10-05T15:48:58.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:57 smithi017 ceph-mon[129107]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.6 MiB/s wr, 511 op/s 2023-10-05T15:48:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:48:59 smithi167 ceph-mon[133366]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.6 MiB/s wr, 588 op/s 2023-10-05T15:48:59.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:48:59 smithi079 ceph-mon[132936]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.6 MiB/s wr, 588 op/s 2023-10-05T15:48:59.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:48:59 smithi017 ceph-mon[129107]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.6 MiB/s wr, 588 op/s 2023-10-05T15:48:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.647+0000 7fe7be7ff700 1 -- 172.21.15.17:0/3406903793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 msgr2=0x7fe7b8100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.647+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/3406903793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b8100390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009990 tx=0x7fe7ac009ca0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 -- 172.21.15.17:0/3406903793 shutdown_connections 2023-10-05T15:48:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/3406903793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b81008d0 0x7fe7b8105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/3406903793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b80ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/3406903793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b8100390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 -- 172.21.15.17:0/3406903793 >> 172.21.15.17:0/3406903793 conn(0x7fe7b80faac0 msgr2=0x7fe7b80fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 -- 172.21.15.17:0/3406903793 shutdown_connections 2023-10-05T15:48:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.648+0000 7fe7be7ff700 1 -- 172.21.15.17:0/3406903793 wait complete. 2023-10-05T15:48:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.650+0000 7fe7be7ff700 1 Processor -- start 2023-10-05T15:48:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.650+0000 7fe7be7ff700 1 -- start start 2023-10-05T15:48:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.650+0000 7fe7be7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.650+0000 7fe7be7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7be7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7b81008d0 0x7fe7b819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7be7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b819ec40 con 0x7fe7b81008d0 2023-10-05T15:48:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7be7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b819edb0 con 0x7fe7b80fff10 2023-10-05T15:48:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7be7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b819ef70 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b819d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39556/0 (socket says 172.21.15.17:39556) 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1473249260 learned_addr learned my addr 172.21.15.17:0/1473249260 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.651+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1473249260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 msgr2=0x7fe7b819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7b81008d0 msgr2=0x7fe7b819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7b81008d0 0x7fe7b819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1473249260 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0095f0 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:48:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b819d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800d980 tx=0x7fe7a800dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b57fa700 1 -- 172.21.15.17:0/1473249260 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800bb60 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b57fa700 1 -- 172.21.15.17:0/1473249260 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a8007640 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.652+0000 7fe7b57fa700 1 -- 172.21.15.17:0/1473249260 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8004d60 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.653+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b819f250 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.653+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b81a5a10 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.659+0000 7fe7b57fa700 1 -- 172.21.15.17:0/1473249260 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe7a8004020 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.660+0000 7fe7d207ab80 1 Processor -- start 2023-10-05T15:48:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.661+0000 7fe7b57fa700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe7a00a1500 0x7fe7a00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.662+0000 7fe7b57fa700 1 -- 172.21.15.17:0/1473249260 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe7a80cce80 con 0x7fe7b80ff1b0 2023-10-05T15:48:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.662+0000 7fe7d207ab80 1 -- start start 2023-10-05T15:48:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 0x55dd5754c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5754d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754d990 0x55dd57554220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd574b4400 con 0x55dd5754bec0 2023-10-05T15:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd574a5bc0 con 0x55dd5754cfd0 2023-10-05T15:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd574a34e0 con 0x55dd5754d990 2023-10-05T15:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 0x55dd5754c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 0x55dd5754c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48580/0 (socket says 172.21.15.17:48580) 2023-10-05T15:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.663+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2797085351 learned_addr learned my addr 172.21.15.17:0/2797085351 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5754d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754d990 0x55dd57554220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2797085351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754d990 msgr2=0x55dd57554220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754d990 0x55dd57554220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2797085351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 msgr2=0x55dd5754d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5754d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2797085351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd572c9d80 con 0x55dd5754bec0 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.664+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754d990 0x55dd57554220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.665+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 0x55dd5754c2e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8099d30 tx=0x7fe7a8099700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddddd79ca78259d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.665+0000 7fe79e7fc700 1 -- 172.21.15.17:0/2797085351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80b1070 con 0x55dd5754bec0 2023-10-05T15:48:59.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.665+0000 7fe79e7fc700 1 -- 172.21.15.17:0/2797085351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a800de60 con 0x55dd5754bec0 2023-10-05T15:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.665+0000 7fe79e7fc700 1 -- 172.21.15.17:0/2797085351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80a21c0 con 0x55dd5754bec0 2023-10-05T15:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.665+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe7a00a1500 0x7fe7a00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2797085351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 msgr2=0x55dd5754c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 0x55dd5754c2e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8099d30 tx=0x7fe7a8099700 comp rx=0 tx=0).stop 2023-10-05T15:48:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe7a00a1500 0x7fe7a00a39c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009c50 tx=0x7fe7b0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2797085351 shutdown_connections 2023-10-05T15:48:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754d990 0x55dd57554220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754bec0 0x55dd5754c2e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2797085351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5754d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.667+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2797085351 >> 172.21.15.17:0/2797085351 conn(0x55dd574c0200 msgr2=0x55dd57546bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.669+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2797085351 shutdown_connections 2023-10-05T15:48:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.669+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2797085351 wait complete. 2023-10-05T15:48:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.670+0000 7fe7d207ab80 1 -- start start 2023-10-05T15:48:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.670+0000 7fe7d207ab80 1 Processor -- start 2023-10-05T15:48:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd57555c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd57556140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5749edd0 con 0x55dd5754d990 2023-10-05T15:48:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5743b6b0 con 0x55dd5754bec0 2023-10-05T15:48:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5743b350 con 0x55dd5754cfd0 2023-10-05T15:48:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7d207ab80 10 client.0 _ll_register_callbacks cb 0x55dd572987a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd57555c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd57555c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:33234/0 (socket says 172.21.15.17:33234) 2023-10-05T15:48:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.671+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1417373491 learned_addr learned my addr 172.21.15.17:0/1417373491 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd57556140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1417373491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 msgr2=0x55dd57556140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd57556140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1417373491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 msgr2=0x55dd5755d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b7fff700 1 -- 172.21.15.17:0/1417373491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b81a5a10 con 0x55dd5754bec0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd57555c00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80a1c00 tx=0x7fe7a80a2250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72dcc353abc5eeb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7977fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7977fe700 1 -- 172.21.15.17:0/1417373491 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80b1070 con 0x55dd5754bec0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.672+0000 7fe7977fe700 1 -- 172.21.15.17:0/1417373491 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe7a809a4a0 con 0x55dd5754bec0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.673+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd5753ed50 con 0x55dd5754bec0 2023-10-05T15:48:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.673+0000 7fe7977fe700 1 -- 172.21.15.17:0/1417373491 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a8099290 con 0x55dd5754bec0 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.673+0000 7fe7d207ab80 10 client.26987 fetch_fsmap learned FSMap version 43 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.673+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dd572b2c00 con 0x55dd5754bec0 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.673+0000 7fe7977fe700 1 -- 172.21.15.17:0/1417373491 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a807c080 con 0x55dd5754bec0 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7977fe700 1 -- 172.21.15.17:0/1417373491 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7a80a1dc0 con 0x55dd5754bec0 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7d207ab80 10 client.26987 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7d207ab80 10 client.26987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7d207ab80 20 client.26987 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd57561590 0x55dd575639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7d207ab80 4 client.26987 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd57497db0 con 0x55dd57561590 2023-10-05T15:48:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.674+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd57561590 0x55dd575639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.675+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd57561590 0x55dd575639b0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c7106e5ef360c16 server_cookie=4f4c81bb9281caa3 in_seq=0 out_seq=0 2023-10-05T15:48:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.675+0000 7fe7977fe700 10 client.26987 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.676+0000 7fe7977fe700 1 -- 172.21.15.17:0/1417373491 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dd57497db0 con 0x55dd57561590 2023-10-05T15:48:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.676+0000 7fe7977fe700 10 client.26987 handle_command_reply: tid=0 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.676+0000 7fe7d207ab80 1 client.26987 shutdown 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.676+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 msgr2=0x55dd57555c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.676+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd57555c00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80a1c00 tx=0x7fe7a80a2250 comp rx=0 tx=0).stop 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 shutdown_connections 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd57561590 0x55dd575639b0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd57555c00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/1417373491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd57556140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 >> 172.21.15.17:0/1417373491 conn(0x55dd574c0200 msgr2=0x55dd57546250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7977fe700 0 client.26987 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 shutdown_connections 2023-10-05T15:48:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.677+0000 7fe7d207ab80 1 -- 172.21.15.17:0/1417373491 wait complete. 2023-10-05T15:48:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.678+0000 7fe7d207ab80 20 client.26987 trim_cache size 0 max 16384 2023-10-05T15:48:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.706+0000 7fe7d207ab80 1 Processor -- start 2023-10-05T15:48:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.706+0000 7fe7d207ab80 1 -- start start 2023-10-05T15:48:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754bec0 0x55dd57553dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5755d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd57550920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd575557d0 con 0x55dd5754d990 2023-10-05T15:48:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5731f8c0 con 0x55dd5754cfd0 2023-10-05T15:48:59.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd57543890 con 0x55dd5754bec0 2023-10-05T15:48:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd57550920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd57550920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48592/0 (socket says 172.21.15.17:48592) 2023-10-05T15:48:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7bcd9c700 1 -- 172.21.15.17:0/2396114197 learned_addr learned my addr 172.21.15.17:0/2396114197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.707+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754bec0 0x55dd57553dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.708+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2396114197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 msgr2=0x55dd5755d140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:48:59.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.708+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5755d140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.708+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2396114197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 msgr2=0x55dd57550920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.708+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd57550920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.708+0000 7fe7b7fff700 1 -- 172.21.15.17:0/2396114197 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd572f01f0 con 0x55dd5754bec0 2023-10-05T15:48:59.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.709+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754bec0 0x55dd57553dd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80962a0 tx=0x7fe7a8099700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ffa4893317e92b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.709+0000 7fe79effd700 1 -- 172.21.15.17:0/2396114197 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a809df60 con 0x55dd5754bec0 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.709+0000 7fe79effd700 1 -- 172.21.15.17:0/2396114197 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dd5753ed50 con 0x55dd5754bec0 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.709+0000 7fe79effd700 1 -- 172.21.15.17:0/2396114197 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8095f10 con 0x55dd5754bec0 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2396114197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754bec0 msgr2=0x55dd57553dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754bec0 0x55dd57553dd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80962a0 tx=0x7fe7a8099700 comp rx=0 tx=0).stop 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2396114197 shutdown_connections 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd57550920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754bec0 0x55dd57553dd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/2396114197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754cfd0 0x55dd5755d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2396114197 >> 172.21.15.17:0/2396114197 conn(0x55dd574c0200 msgr2=0x55dd575548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2396114197 shutdown_connections 2023-10-05T15:48:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.710+0000 7fe7d207ab80 1 -- 172.21.15.17:0/2396114197 wait complete. 2023-10-05T15:48:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.711+0000 7fe7d207ab80 1 -- start start 2023-10-05T15:48:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.711+0000 7fe7d207ab80 1 Processor -- start 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd5755adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd5755b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5755c850 con 0x55dd5754d990 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5755c9c0 con 0x55dd5754bec0 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5755cb80 con 0x55dd5754cfd0 2023-10-05T15:48:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7d207ab80 10 client.0 _ll_register_callbacks cb 0x7fe7a80998e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd5755adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd5755adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:33256/0 (socket says 172.21.15.17:33256) 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7b7fff700 1 -- 172.21.15.17:0/135645350 learned_addr learned my addr 172.21.15.17:0/135645350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.712+0000 7fe7bcd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48598/0 (socket says 172.21.15.17:48598) 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7b77fe700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd5755b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7bcd9c700 1 -- 172.21.15.17:0/135645350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 msgr2=0x55dd5755b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd5755b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7bcd9c700 1 -- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 msgr2=0x55dd5755adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:48:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd5755adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7bcd9c700 1 -- 172.21.15.17:0/135645350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd572b2c00 con 0x55dd5754d990 2023-10-05T15:48:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd5755adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:48:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7bcd9c700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755c310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009300 tx=0x7fe7b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371a70acf54dd4d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:48:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.713+0000 7fe7977fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.714+0000 7fe7977fe700 1 -- 172.21.15.17:0/135645350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0015e20 con 0x55dd5754d990 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.714+0000 7fe7977fe700 1 -- 172.21.15.17:0/135645350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe7b0004bb0 con 0x55dd5754d990 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.714+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7a800de60 con 0x55dd5754d990 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7977fe700 1 -- 172.21.15.17:0/135645350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b0004d70 con 0x55dd5754d990 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 10 client.17004 fetch_fsmap learned FSMap version 43 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dd572c8250 con 0x55dd5754d990 2023-10-05T15:48:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7977fe700 1 -- 172.21.15.17:0/135645350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a800de60 con 0x55dd5754d990 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7977fe700 1 -- 172.21.15.17:0/135645350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7b0005640 con 0x55dd5754d990 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 10 client.17004 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 10 client.17004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 20 client.17004 populate_metadata read hostname 'smithi017' 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd575b6350 0x55dd575b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 4 client.17004 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.715+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dd57497ad0 con 0x55dd575b6350 2023-10-05T15:48:59.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.716+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd575b6350 0x55dd575b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:48:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.717+0000 7fe7b7fff700 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd575b6350 0x55dd575b8770 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e666544076b51a9d server_cookie=6966f763a85d219f in_seq=0 out_seq=0 2023-10-05T15:48:59.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.717+0000 7fe7977fe700 10 client.17004 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.734+0000 7fe7977fe700 1 -- 172.21.15.17:0/135645350 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dd57497ad0 con 0x55dd575b6350 2023-10-05T15:48:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.734+0000 7fe7977fe700 10 client.17004 handle_command_reply: tid=0 2023-10-05T15:48:59.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 client.17004 shutdown 2023-10-05T15:48:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 msgr2=0x55dd5755c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755c310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009300 tx=0x7fe7b0004ad0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 shutdown_connections 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55dd575b6350 0x55dd575b8770 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dd5754d990 0x55dd5755c310 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dd5754bec0 0x55dd5755adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 --2- 172.21.15.17:0/135645350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd5754cfd0 0x55dd5755b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 >> 172.21.15.17:0/135645350 conn(0x55dd574c0200 msgr2=0x55dd57553dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.735+0000 7fe7977fe700 0 client.17004 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:48:59.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.736+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 shutdown_connections 2023-10-05T15:48:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.736+0000 7fe7d207ab80 1 -- 172.21.15.17:0/135645350 wait complete. 2023-10-05T15:48:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.737+0000 7fe7d207ab80 20 client.17004 trim_cache size 0 max 16384 2023-10-05T15:48:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:48:59.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:48:59.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:48:59.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe7a00a1500 msgr2=0x7fe7a00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe7a00a1500 0x7fe7a00a39c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009c50 tx=0x7fe7b0009600 comp rx=0 tx=0).stop 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 msgr2=0x7fe7b819d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b819d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800d980 tx=0x7fe7a800dd40 comp rx=0 tx=0).stop 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 shutdown_connections 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe7a00a1500 0x7fe7a00a39c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7b81008d0 0x7fe7b819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7b80ff1b0 0x7fe7b819d220 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 --2- 172.21.15.17:0/1473249260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7b80fff10 0x7fe7b819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:48:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 >> 172.21.15.17:0/1473249260 conn(0x7fe7b80faac0 msgr2=0x7fe7b80fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:48:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 shutdown_connections 2023-10-05T15:48:59.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:48:59.738+0000 7fe7be7ff700 1 -- 172.21.15.17:0/1473249260 wait complete. 2023-10-05T15:49:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:01 smithi167 ceph-mon[133366]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 635 op/s 2023-10-05T15:49:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:01 smithi079 ceph-mon[132936]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 635 op/s 2023-10-05T15:49:02.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:01 smithi017 ceph-mon[129107]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 635 op/s 2023-10-05T15:49:03.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 625.0 s, 636.4 tps, lat 156.489 ms stddev 55.113 2023-10-05T15:49:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:03 smithi167 ceph-mon[133366]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.3 MiB/s wr, 545 op/s 2023-10-05T15:49:04.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:03 smithi079 ceph-mon[132936]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.3 MiB/s wr, 545 op/s 2023-10-05T15:49:04.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:03 smithi017 ceph-mon[129107]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.3 MiB/s wr, 545 op/s 2023-10-05T15:49:05.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:05 smithi167 ceph-mon[133366]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 729 op/s 2023-10-05T15:49:05.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:05 smithi079 ceph-mon[132936]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 729 op/s 2023-10-05T15:49:05.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:05 smithi017 ceph-mon[129107]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 729 op/s 2023-10-05T15:49:08.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 630.0 s, 672.0 tps, lat 148.398 ms stddev 62.807 2023-10-05T15:49:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:07 smithi167 ceph-mon[133366]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 525 op/s 2023-10-05T15:49:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:07 smithi079 ceph-mon[132936]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 525 op/s 2023-10-05T15:49:08.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:07 smithi017 ceph-mon[129107]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 525 op/s 2023-10-05T15:49:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:09 smithi167 ceph-mon[133366]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 645 op/s 2023-10-05T15:49:10.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:09 smithi079 ceph-mon[132936]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 645 op/s 2023-10-05T15:49:10.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:09 smithi017 ceph-mon[129107]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 645 op/s 2023-10-05T15:49:11.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:11 smithi167 ceph-mon[133366]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 665 op/s 2023-10-05T15:49:11.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:11 smithi079 ceph-mon[132936]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 665 op/s 2023-10-05T15:49:11.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:11 smithi017 ceph-mon[129107]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 665 op/s 2023-10-05T15:49:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.002+0000 7f13a3bff700 1 -- 172.21.15.17:0/1308932309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c107530 msgr2=0x7f139c107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.002+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1308932309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c107530 0x7f139c107950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1398009990 tx=0x7f1398009ca0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.005+0000 7f13a3bff700 1 -- 172.21.15.17:0/1308932309 shutdown_connections 2023-10-05T15:49:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.005+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1308932309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139c1090c0 0x7f139c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.005+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1308932309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c107530 0x7f139c107950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.005+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1308932309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c108720 0x7f139c108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.005+0000 7f13a3bff700 1 -- 172.21.15.17:0/1308932309 >> 172.21.15.17:0/1308932309 conn(0x7f139c0764b0 msgr2=0x7f139c078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:13.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.006+0000 7f13a3bff700 1 -- 172.21.15.17:0/1308932309 shutdown_connections 2023-10-05T15:49:13.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.007+0000 7f13a3bff700 1 -- 172.21.15.17:0/1308932309 wait complete. 2023-10-05T15:49:13.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.008+0000 7f13a3bff700 1 Processor -- start 2023-10-05T15:49:13.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.008+0000 7f13a3bff700 1 -- start start 2023-10-05T15:49:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a3bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c107530 0x7f139c07e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a3bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139c108720 0x7f139c07ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a3bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 0x7f139c07faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a3bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c080100 con 0x7f139c107530 2023-10-05T15:49:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a3bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c080270 con 0x7f139c108720 2023-10-05T15:49:13.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a3bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c080430 con 0x7f139c1090c0 2023-10-05T15:49:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a219c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 0x7f139c07faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a219c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 0x7f139c07faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39502/0 (socket says 172.21.15.17:39502) 2023-10-05T15:49:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.010+0000 7f13a219c700 1 -- 172.21.15.17:0/1007216083 learned_addr learned my addr 172.21.15.17:0/1007216083 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.011+0000 7f13a219c700 1 -- 172.21.15.17:0/1007216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139c108720 msgr2=0x7f139c07ebd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:49:13.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.011+0000 7f13a219c700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139c108720 0x7f139c07ebd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.011+0000 7f13a219c700 1 -- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c107530 msgr2=0x7f139c07e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.011+0000 7f13a219c700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c107530 0x7f139c07e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.011+0000 7f13a219c700 1 -- 172.21.15.17:0/1007216083 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980095f0 con 0x7f139c1090c0 2023-10-05T15:49:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.012+0000 7f13a219c700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 0x7f139c07faa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f139400b970 tx=0x7f139400bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.012+0000 7f1392ffd700 1 -- 172.21.15.17:0/1007216083 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400c9b0 con 0x7f139c1090c0 2023-10-05T15:49:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.012+0000 7f1392ffd700 1 -- 172.21.15.17:0/1007216083 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1394014440 con 0x7f139c1090c0 2023-10-05T15:49:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.012+0000 7f1392ffd700 1 -- 172.21.15.17:0/1007216083 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940075b0 con 0x7f139c1090c0 2023-10-05T15:49:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.012+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c080710 con 0x7f139c1090c0 2023-10-05T15:49:13.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.013+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c080f40 con 0x7f139c1090c0 2023-10-05T15:49:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.021+0000 7f1392ffd700 1 -- 172.21.15.17:0/1007216083 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f13940145b0 con 0x7f139c1090c0 2023-10-05T15:49:13.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.021+0000 7f13b749eb80 1 Processor -- start 2023-10-05T15:49:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.021+0000 7f13b749eb80 1 -- start start 2023-10-05T15:49:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.022+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.022+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb68fd0 0x55904bb69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.022+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 0x55904bb70220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.022+0000 7f13b749eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bad0400 con 0x55904bb68fd0 2023-10-05T15:49:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.022+0000 7f13b749eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bac1bc0 con 0x55904bb67ec0 2023-10-05T15:49:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.022+0000 7f13b749eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904babf4e0 con 0x55904bb69990 2023-10-05T15:49:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.023+0000 7f13a119a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 0x55904bb70220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.023+0000 7f13a119a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 0x55904bb70220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39514/0 (socket says 172.21.15.17:39514) 2023-10-05T15:49:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.023+0000 7f13a119a700 1 -- 172.21.15.17:0/1919467781 learned_addr learned my addr 172.21.15.17:0/1919467781 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.023+0000 7f13a199b700 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb68fd0 0x55904bb69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.023+0000 7f13a119a700 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f13a119a700 1 -- 172.21.15.17:0/1919467781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 msgr2=0x55904bb682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f13a119a700 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f13a119a700 1 -- 172.21.15.17:0/1919467781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb68fd0 msgr2=0x55904bb69450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f13a119a700 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb68fd0 0x55904bb69450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f13a119a700 1 -- 172.21.15.17:0/1919467781 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904b8e5d80 con 0x55904bb69990 2023-10-05T15:49:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f13a119a700 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 0x55904bb70220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c009ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11f73d16b5bb037 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f1387fff700 1 -- 172.21.15.17:0/1919467781 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c008c10 con 0x55904bb69990 2023-10-05T15:49:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f1387fff700 1 -- 172.21.15.17:0/1919467781 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f138c015e80 con 0x55904bb69990 2023-10-05T15:49:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.024+0000 7f1387fff700 1 -- 172.21.15.17:0/1919467781 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c004860 con 0x55904bb69990 2023-10-05T15:49:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.025+0000 7f13b749eb80 1 -- 172.21.15.17:0/1919467781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 msgr2=0x55904bb70220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.025+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 0x55904bb70220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c009ec0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f13b749eb80 1 -- 172.21.15.17:0/1919467781 shutdown_connections 2023-10-05T15:49:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb69990 0x55904bb70220 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1919467781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb68fd0 0x55904bb69450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f13b749eb80 1 -- 172.21.15.17:0/1919467781 >> 172.21.15.17:0/1919467781 conn(0x55904badc200 msgr2=0x55904bb62bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f1392ffd700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f13880a1680 0x7f13880a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.026+0000 7f1392ffd700 1 -- 172.21.15.17:0/1007216083 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f13940cc880 con 0x7f139c1090c0 2023-10-05T15:49:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.027+0000 7f13a119a700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f13880a1680 0x7f13880a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.027+0000 7f13b749eb80 1 -- 172.21.15.17:0/1919467781 shutdown_connections 2023-10-05T15:49:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.028+0000 7f13b749eb80 1 -- 172.21.15.17:0/1919467781 wait complete. 2023-10-05T15:49:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.029+0000 7f13b749eb80 1 -- start start 2023-10-05T15:49:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.029+0000 7f13a119a700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f13880a1680 0x7f13880a3b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f138c004790 tx=0x7f138c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.029+0000 7f13b749eb80 1 Processor -- start 2023-10-05T15:49:13.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bb71d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb69990 0x55904bb72280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb772b0 0x55904bb796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904babadd0 con 0x55904bb772b0 2023-10-05T15:49:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904ba576b0 con 0x55904bb69990 2023-10-05T15:49:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904ba57350 con 0x55904bb67ec0 2023-10-05T15:49:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.030+0000 7f13b749eb80 10 client.0 _ll_register_callbacks cb 0x55904b8b47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.031+0000 7f13a199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bb71d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.031+0000 7f13a119a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb69990 0x55904bb72280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.031+0000 7f13a199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bb71d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39528/0 (socket says 172.21.15.17:39528) 2023-10-05T15:49:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.031+0000 7f13a199b700 1 -- 172.21.15.17:0/1411679005 learned_addr learned my addr 172.21.15.17:0/1411679005 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.032+0000 7f13a119a700 1 -- 172.21.15.17:0/1411679005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 msgr2=0x55904bb71d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.032+0000 7f13a119a700 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bb71d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.032+0000 7f13a119a700 1 -- 172.21.15.17:0/1411679005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb772b0 msgr2=0x55904bb796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.032+0000 7f13a119a700 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb772b0 0x55904bb796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.032+0000 7f13a119a700 1 -- 172.21.15.17:0/1411679005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c001d50 con 0x55904bb69990 2023-10-05T15:49:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.033+0000 7f13a119a700 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb69990 0x55904bb72280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5ad361f86e99ca server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.033+0000 7f13857fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:49:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.033+0000 7f13857fa700 1 -- 172.21.15.17:0/1411679005 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c004860 con 0x55904bb69990 2023-10-05T15:49:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.033+0000 7f13857fa700 1 -- 172.21.15.17:0/1411679005 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f138c0049c0 con 0x55904bb69990 2023-10-05T15:49:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.033+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55904bab3db0 con 0x55904bb69990 2023-10-05T15:49:13.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.034+0000 7f13857fa700 1 -- 172.21.15.17:0/1411679005 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f138c004b80 con 0x55904bb69990 2023-10-05T15:49:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.034+0000 7f13b749eb80 10 client.26996 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.034+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55904b8cec00 con 0x55904bb69990 2023-10-05T15:49:13.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13857fa700 1 -- 172.21.15.17:0/1411679005 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55904bab3db0 con 0x55904bb69990 2023-10-05T15:49:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13857fa700 1 -- 172.21.15.17:0/1411679005 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f138c01a480 con 0x55904bb69990 2023-10-05T15:49:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13b749eb80 10 client.26996 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13b749eb80 10 client.26996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13b749eb80 20 client.26996 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bb7de50 0x55904bb80270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13b749eb80 4 client.26996 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:49:13.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.035+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55904bab3ad0 con 0x55904bb7de50 2023-10-05T15:49:13.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.036+0000 7f13a199b700 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bb7de50 0x55904bb80270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.037+0000 7f13a199b700 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bb7de50 0x55904bb80270 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61be728235a74c15 server_cookie=300eb68c6bab5eb5 in_seq=0 out_seq=0 2023-10-05T15:49:13.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.037+0000 7f13857fa700 10 client.26996 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:13.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.038+0000 7f13857fa700 1 -- 172.21.15.17:0/1411679005 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55904bab3ad0 con 0x55904bb7de50 2023-10-05T15:49:13.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.038+0000 7f13857fa700 10 client.26996 handle_command_reply: tid=0 2023-10-05T15:49:13.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.038+0000 7f13b749eb80 1 client.26996 shutdown 2023-10-05T15:49:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb69990 msgr2=0x55904bb72280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb69990 0x55904bb72280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c009ec0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 shutdown_connections 2023-10-05T15:49:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bb7de50 0x55904bb80270 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb772b0 0x55904bb796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bb71d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 --2- 172.21.15.17:0/1411679005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb69990 0x55904bb72280 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 >> 172.21.15.17:0/1411679005 conn(0x55904badc200 msgr2=0x55904bb62ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:13.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.039+0000 7f13857fa700 0 client.26996 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.040+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 shutdown_connections 2023-10-05T15:49:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.040+0000 7f13b749eb80 1 -- 172.21.15.17:0/1411679005 wait complete. 2023-10-05T15:49:13.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.041+0000 7f13b749eb80 20 client.26996 trim_cache size 0 max 16384 2023-10-05T15:49:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.070+0000 7f13b749eb80 1 Processor -- start 2023-10-05T15:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 -- start start 2023-10-05T15:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb8da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb7fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb772b0 0x55904bb6c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904b93b8c0 con 0x55904bb69990 2023-10-05T15:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bb718b0 con 0x55904bb67ec0 2023-10-05T15:49:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.071+0000 7f13b749eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bb7d9f0 con 0x55904bb772b0 2023-10-05T15:49:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.072+0000 7f13a219c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb772b0 0x55904bb6c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.072+0000 7f13a119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb7fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.072+0000 7f13a119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb7fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56368/0 (socket says 172.21.15.17:56368) 2023-10-05T15:49:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.072+0000 7f13a119a700 1 -- 172.21.15.17:0/3309434117 learned_addr learned my addr 172.21.15.17:0/3309434117 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.072+0000 7f13a199b700 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb8da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.073+0000 7f13a219c700 1 -- 172.21.15.17:0/3309434117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 msgr2=0x55904bb8da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.073+0000 7f13a219c700 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb8da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.073+0000 7f13a219c700 1 -- 172.21.15.17:0/3309434117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 msgr2=0x55904bb7fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.073+0000 7f13a219c700 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb7fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.073+0000 7f13a219c700 1 -- 172.21.15.17:0/3309434117 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904b90c1f0 con 0x55904bb772b0 2023-10-05T15:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.074+0000 7f13a219c700 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb772b0 0x55904bb6c9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55904bb72df0 tx=0x7f13940993b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff6b9563e28f330a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.074+0000 7f1390bff700 1 -- 172.21.15.17:0/3309434117 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394099ea0 con 0x55904bb772b0 2023-10-05T15:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.074+0000 7f1390bff700 1 -- 172.21.15.17:0/3309434117 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13940997a0 con 0x55904bb772b0 2023-10-05T15:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.074+0000 7f1390bff700 1 -- 172.21.15.17:0/3309434117 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394098c90 con 0x55904bb772b0 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 -- 172.21.15.17:0/3309434117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb772b0 msgr2=0x55904bb6c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb772b0 0x55904bb6c9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55904bb72df0 tx=0x7f13940993b0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 -- 172.21.15.17:0/3309434117 shutdown_connections 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb772b0 0x55904bb6c9c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb67ec0 0x55904bb8da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3309434117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb7fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.075+0000 7f13b749eb80 1 -- 172.21.15.17:0/3309434117 >> 172.21.15.17:0/3309434117 conn(0x55904badc200 msgr2=0x55904bb6ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.076+0000 7f13b749eb80 1 -- 172.21.15.17:0/3309434117 shutdown_connections 2023-10-05T15:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.076+0000 7f13b749eb80 1 -- 172.21.15.17:0/3309434117 wait complete. 2023-10-05T15:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.076+0000 7f13b749eb80 1 -- start start 2023-10-05T15:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 Processor -- start 2023-10-05T15:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bbcde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb8da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb772b0 0x55904bbe1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bbe1bf0 con 0x55904bb69990 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bbe1d60 con 0x55904bb772b0 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904bbe1f20 con 0x55904bb67ec0 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.077+0000 7f13b749eb80 10 client.0 _ll_register_callbacks cb 0x7f138c007130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.078+0000 7f13a199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bbcde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.078+0000 7f13a199b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bbcde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39536/0 (socket says 172.21.15.17:39536) 2023-10-05T15:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.078+0000 7f13a199b700 1 -- 172.21.15.17:0/3120144044 learned_addr learned my addr 172.21.15.17:0/3120144044 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.078+0000 7f13a219c700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb772b0 0x55904bbe1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.079+0000 7f13a119a700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb8da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.079+0000 7f13a119a700 1 -- 172.21.15.17:0/3120144044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 msgr2=0x55904bbcde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.079+0000 7f13a119a700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bbcde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.079+0000 7f13a119a700 1 -- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb772b0 msgr2=0x55904bbe1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.079+0000 7f13a119a700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb772b0 0x55904bbe1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.079+0000 7f13a119a700 1 -- 172.21.15.17:0/3120144044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c080f40 con 0x55904bb69990 2023-10-05T15:49:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.080+0000 7f13a219c700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb772b0 0x55904bbe1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:49:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.080+0000 7f13a119a700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb8da90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b9f9b8a08e4ae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.080+0000 7f13857fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.081+0000 7f13857fa700 1 -- 172.21.15.17:0/3120144044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c01ae60 con 0x55904bb69990 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.081+0000 7f13857fa700 1 -- 172.21.15.17:0/3120144044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f138c004860 con 0x55904bb69990 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.081+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55904bb5ad50 con 0x55904bb69990 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.081+0000 7f13857fa700 1 -- 172.21.15.17:0/3120144044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f138c004a20 con 0x55904bb69990 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.081+0000 7f13b749eb80 10 client.17013 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.081+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55904b8e4250 con 0x55904bb69990 2023-10-05T15:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.082+0000 7f13857fa700 1 -- 172.21.15.17:0/3120144044 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55904bb5ad50 con 0x55904bb69990 2023-10-05T15:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13857fa700 1 -- 172.21.15.17:0/3120144044 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f138c009770 con 0x55904bb69990 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13b749eb80 10 client.17013 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13b749eb80 10 client.17013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13b749eb80 20 client.17013 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bbe3580 0x55904bbe59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13b749eb80 4 client.17013 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55904b906f10 con 0x55904bbe3580 2023-10-05T15:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.083+0000 7f13a199b700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bbe3580 0x55904bbe59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.084+0000 7f13857fa700 10 client.17013 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.084+0000 7f13a199b700 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bbe3580 0x55904bbe59a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e08f3ace34822206 server_cookie=12964ec949c43777 in_seq=0 out_seq=0 2023-10-05T15:49:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 635.0 s, 587.2 tps, lat 169.832 ms stddev 54.258 2023-10-05T15:49:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.361+0000 7f13857fa700 1 -- 172.21.15.17:0/3120144044 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55904b906f10 con 0x55904bbe3580 2023-10-05T15:49:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.361+0000 7f13857fa700 10 client.17013 handle_command_reply: tid=0 2023-10-05T15:49:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 client.17013 shutdown 2023-10-05T15:49:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 msgr2=0x55904bb8da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb8da90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c001860 comp rx=0 tx=0).stop 2023-10-05T15:49:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 shutdown_connections 2023-10-05T15:49:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55904bbe3580 0x55904bbe59a0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55904bb772b0 0x55904bbe1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55904bb67ec0 0x55904bbcde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 --2- 172.21.15.17:0/3120144044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55904bb69990 0x55904bb8da90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 >> 172.21.15.17:0/3120144044 conn(0x55904badc200 msgr2=0x55904bb7fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.363+0000 7f13857fa700 0 client.17013 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.364+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 shutdown_connections 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.364+0000 7f13b749eb80 1 -- 172.21.15.17:0/3120144044 wait complete. 2023-10-05T15:49:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.364+0000 7f13b749eb80 20 client.17013 trim_cache size 0 max 16384 2023-10-05T15:49:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:49:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:49:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:49:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:49:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.369+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f13880a1680 msgr2=0x7f13880a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.369+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f13880a1680 0x7f13880a3b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f138c004790 tx=0x7f138c00b040 comp rx=0 tx=0).stop 2023-10-05T15:49:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.369+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 msgr2=0x7f139c07faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.369+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 0x7f139c07faa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f139400b970 tx=0x7f139400bd30 comp rx=0 tx=0).stop 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 shutdown_connections 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f13880a1680 0x7f13880a3b40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f139c1090c0 0x7f139c07faa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c107530 0x7f139c07e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 --2- 172.21.15.17:0/1007216083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139c108720 0x7f139c07ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 >> 172.21.15.17:0/1007216083 conn(0x7f139c0764b0 msgr2=0x7f139c10bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.370+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 shutdown_connections 2023-10-05T15:49:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:13.371+0000 7f13a3bff700 1 -- 172.21.15.17:0/1007216083 wait complete. 2023-10-05T15:49:14.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:49:14.238 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:13 smithi017 ceph-mon[129107]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 584 op/s 2023-10-05T15:49:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:13 smithi167 ceph-mon[133366]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 584 op/s 2023-10-05T15:49:14.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:13 smithi079 ceph-mon[132936]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 584 op/s 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 -- 172.21.15.17:0/1913640776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d81020d0 msgr2=0x7f87d8104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1913640776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d81020d0 0x7f87d8104560 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009990 tx=0x7f87cc009ca0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 -- 172.21.15.17:0/1913640776 shutdown_connections 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1913640776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d8104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1913640776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d80ff760 0x7f87d8101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1913640776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d81020d0 0x7f87d8104560 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.489+0000 7f87de1ff700 1 -- 172.21.15.17:0/1913640776 >> 172.21.15.17:0/1913640776 conn(0x7f87d80fb380 msgr2=0x7f87d80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.490+0000 7f87de1ff700 1 -- 172.21.15.17:0/1913640776 shutdown_connections 2023-10-05T15:49:14.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.490+0000 7f87de1ff700 1 -- 172.21.15.17:0/1913640776 wait complete. 2023-10-05T15:49:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.491+0000 7f87de1ff700 1 Processor -- start 2023-10-05T15:49:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.491+0000 7f87de1ff700 1 -- start start 2023-10-05T15:49:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87de1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d80ff760 0x7f87d806f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87de1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d81020d0 0x7f87d806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87de1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d81ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87de1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8072de0 con 0x7f87d8104aa0 2023-10-05T15:49:14.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87de1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8072f50 con 0x7f87d80ff760 2023-10-05T15:49:14.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87de1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81ad800 con 0x7f87d81020d0 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d81ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d81ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45536/0 (socket says 172.21.15.17:45536) 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87d7fff700 1 -- 172.21.15.17:0/1368572393 learned_addr learned my addr 172.21.15.17:0/1368572393 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.492+0000 7f87d77fe700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d80ff760 0x7f87d806f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d81020d0 0x7f87d806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d7fff700 1 -- 172.21.15.17:0/1368572393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d81020d0 msgr2=0x7f87d806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d7fff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d81020d0 0x7f87d806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d7fff700 1 -- 172.21.15.17:0/1368572393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d80ff760 msgr2=0x7f87d806f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d7fff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d80ff760 0x7f87d806f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d7fff700 1 -- 172.21.15.17:0/1368572393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0095f0 con 0x7f87d8104aa0 2023-10-05T15:49:14.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.493+0000 7f87d7fff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d81ad2c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f87d000ef30 tx=0x7f87d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:14.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.498+0000 7f87d4ff9700 1 -- 172.21.15.17:0/1368572393 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0018070 con 0x7f87d8104aa0 2023-10-05T15:49:14.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.498+0000 7f87d4ff9700 1 -- 172.21.15.17:0/1368572393 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87d000f040 con 0x7f87d8104aa0 2023-10-05T15:49:14.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.498+0000 7f87d4ff9700 1 -- 172.21.15.17:0/1368572393 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d000cbc0 con 0x7f87d8104aa0 2023-10-05T15:49:14.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.498+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d81ada50 con 0x7f87d8104aa0 2023-10-05T15:49:14.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.498+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d81adf10 con 0x7f87d8104aa0 2023-10-05T15:49:14.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.504+0000 7f87f1bd7b80 1 Processor -- start 2023-10-05T15:49:14.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.506+0000 7f87d4ff9700 1 -- 172.21.15.17:0/1368572393 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f87d000cd20 con 0x7f87d8104aa0 2023-10-05T15:49:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.506+0000 7f87f1bd7b80 1 -- start start 2023-10-05T15:49:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944874680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944875480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944875ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559447dc460 con 0x555944874bc0 2023-10-05T15:49:14.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559447cdc20 con 0x555944875a60 2023-10-05T15:49:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559447cb540 con 0x555944874260 2023-10-05T15:49:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944874680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944874680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33270/0 (socket says 172.21.15.17:33270) 2023-10-05T15:49:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87d6ffd700 1 -- 172.21.15.17:0/1293062616 learned_addr learned my addr 172.21.15.17:0/1293062616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.507+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944875ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d77fe700 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944875480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d6ffd700 1 -- 172.21.15.17:0/1293062616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 msgr2=0x555944875ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944875ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d6ffd700 1 -- 172.21.15.17:0/1293062616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 msgr2=0x555944875480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944875480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d6ffd700 1 -- 172.21.15.17:0/1293062616 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559445f1de0 con 0x555944874260 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.508+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944874680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x555944875240 tx=0x7f87cc01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a4b6634cf30f0b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.509+0000 7f87bdffb700 1 -- 172.21.15.17:0/1293062616 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc005040 con 0x555944874260 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.509+0000 7f87bdffb700 1 -- 172.21.15.17:0/1293062616 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87cc0051a0 con 0x555944874260 2023-10-05T15:49:14.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.509+0000 7f87bdffb700 1 -- 172.21.15.17:0/1293062616 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00bba0 con 0x555944874260 2023-10-05T15:49:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.510+0000 7f87d4ff9700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87c00a1600 0x7f87c00a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.510+0000 7f87d4ff9700 1 -- 172.21.15.17:0/1368572393 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f87d00cc2a0 con 0x7f87d8104aa0 2023-10-05T15:49:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/1293062616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 msgr2=0x555944874680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944874680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x555944875240 tx=0x7f87cc01a040 comp rx=0 tx=0).stop 2023-10-05T15:49:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87d77fe700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87c00a1600 0x7f87c00a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/1293062616 shutdown_connections 2023-10-05T15:49:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944875ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944874680 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/1293062616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944875480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.511+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/1293062616 >> 172.21.15.17:0/1293062616 conn(0x5559447e8260 msgr2=0x55594486f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.512+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/1293062616 shutdown_connections 2023-10-05T15:49:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.512+0000 7f87d77fe700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87c00a1600 0x7f87c00a3ac0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f87c8005950 tx=0x7f87c800a300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:14.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.512+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/1293062616 wait complete. 2023-10-05T15:49:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.513+0000 7f87f1bd7b80 1 -- start start 2023-10-05T15:49:14.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.513+0000 7f87f1bd7b80 1 Processor -- start 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x55594488f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 0x55594488f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x555944896580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559447c6e30 con 0x555944875a60 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555944763710 con 0x555944874bc0 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559447633b0 con 0x555944874260 2023-10-05T15:49:14.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.514+0000 7f87f1bd7b80 10 client.0 _ll_register_callbacks cb 0x5559445c0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.515+0000 7f87d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x555944896580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.515+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 0x55594488f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.515+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 0x55594488f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:43116/0 (socket says 172.21.15.17:43116) 2023-10-05T15:49:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.515+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3287087043 learned_addr learned my addr 172.21.15.17:0/3287087043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.516+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3287087043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 msgr2=0x55594488f000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:49:14.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.516+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x55594488f000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.516+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3287087043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 msgr2=0x555944896580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.516+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x555944896580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.516+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3287087043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc020040 con 0x555944874bc0 2023-10-05T15:49:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.517+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 0x55594488f540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f87cc003f60 tx=0x7f87cc005540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9fb3e7ef39e6d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:14.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.517+0000 7f87b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:49:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.517+0000 7f87b6ffd700 1 -- 172.21.15.17:0/3287087043 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc030070 con 0x555944874bc0 2023-10-05T15:49:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.517+0000 7f87b6ffd700 1 -- 172.21.15.17:0/3287087043 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f87cc00b900 con 0x555944874bc0 2023-10-05T15:49:14.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.518+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555944866f10 con 0x555944874bc0 2023-10-05T15:49:14.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.519+0000 7f87b6ffd700 1 -- 172.21.15.17:0/3287087043 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87cc003d60 con 0x555944874bc0 2023-10-05T15:49:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.519+0000 7f87f1bd7b80 10 client.27014 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.519+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5559445dac60 con 0x555944874bc0 2023-10-05T15:49:14.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.520+0000 7f87b6ffd700 1 -- 172.21.15.17:0/3287087043 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555944866f10 con 0x555944874bc0 2023-10-05T15:49:14.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87b6ffd700 1 -- 172.21.15.17:0/3287087043 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f87cc00fc00 con 0x555944874bc0 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87f1bd7b80 10 client.27014 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87f1bd7b80 10 client.27014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87f1bd7b80 20 client.27014 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55594489a900 0x55594489cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87f1bd7b80 4 client.27014 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.521+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559447bfe10 con 0x55594489a900 2023-10-05T15:49:14.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.522+0000 7f87d77fe700 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55594489a900 0x55594489cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.523+0000 7f87d77fe700 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55594489a900 0x55594489cd20 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83781b57f6b841d6 server_cookie=1ec9e84eb83df512 in_seq=0 out_seq=0 2023-10-05T15:49:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.523+0000 7f87b6ffd700 10 client.27014 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:14.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.525+0000 7f87b6ffd700 1 -- 172.21.15.17:0/3287087043 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5559447bfe10 con 0x55594489a900 2023-10-05T15:49:14.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.525+0000 7f87b6ffd700 10 client.27014 handle_command_reply: tid=0 2023-10-05T15:49:14.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.527+0000 7f87f1bd7b80 1 client.27014 shutdown 2023-10-05T15:49:14.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.528+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 msgr2=0x55594488f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.528+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 0x55594488f540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f87cc003f60 tx=0x7f87cc005540 comp rx=0 tx=0).stop 2023-10-05T15:49:14.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 shutdown_connections 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55594489a900 0x55594489cd20 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x555944896580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x55594488f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3287087043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874bc0 0x55594488f540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 >> 172.21.15.17:0/3287087043 conn(0x5559447e8260 msgr2=0x55594486ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87b6ffd700 0 client.27014 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 shutdown_connections 2023-10-05T15:49:14.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.529+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3287087043 wait complete. 2023-10-05T15:49:14.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.530+0000 7f87f1bd7b80 20 client.27014 trim_cache size 0 max 16384 2023-10-05T15:49:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.562+0000 7f87f1bd7b80 1 Processor -- start 2023-10-05T15:49:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.562+0000 7f87f1bd7b80 1 -- start start 2023-10-05T15:49:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.562+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 0x55594488dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.562+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874bc0 0x555944896540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x55594487be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555944647920 con 0x555944875a60 2023-10-05T15:49:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594486ba20 con 0x555944874260 2023-10-05T15:49:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55594488e4b0 con 0x555944874bc0 2023-10-05T15:49:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87d77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 0x55594488dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874bc0 0x555944896540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87d77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 0x55594488dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:43132/0 (socket says 172.21.15.17:43132) 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87d77fe700 1 -- 172.21.15.17:0/3379505708 learned_addr learned my addr 172.21.15.17:0/3379505708 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.563+0000 7f87d7fff700 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x55594487be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3379505708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 msgr2=0x55594488dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 0x55594488dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3379505708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 msgr2=0x55594487be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x55594487be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d6ffd700 1 -- 172.21.15.17:0/3379505708 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555944618250 con 0x555944874bc0 2023-10-05T15:49:14.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d77fe700 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 0x55594488dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:49:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.564+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874bc0 0x555944896540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0295f0 tx=0x7f87cc00b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92d705cafa20efd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.565+0000 7f87be7fc700 1 -- 172.21.15.17:0/3379505708 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc030040 con 0x555944874bc0 2023-10-05T15:49:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.565+0000 7f87be7fc700 1 -- 172.21.15.17:0/3379505708 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87cc003d60 con 0x555944874bc0 2023-10-05T15:49:14.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.566+0000 7f87be7fc700 1 -- 172.21.15.17:0/3379505708 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc029860 con 0x555944874bc0 2023-10-05T15:49:14.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3379505708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874bc0 msgr2=0x555944896540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874bc0 0x555944896540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0295f0 tx=0x7f87cc00b740 comp rx=0 tx=0).stop 2023-10-05T15:49:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3379505708 shutdown_connections 2023-10-05T15:49:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944875a60 0x55594487be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944874260 0x55594488dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/3379505708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874bc0 0x555944896540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.567+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3379505708 >> 172.21.15.17:0/3379505708 conn(0x5559447e8260 msgr2=0x55594486dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:14.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.568+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3379505708 shutdown_connections 2023-10-05T15:49:14.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.568+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/3379505708 wait complete. 2023-10-05T15:49:14.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.569+0000 7f87f1bd7b80 1 -- start start 2023-10-05T15:49:14.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.569+0000 7f87f1bd7b80 1 Processor -- start 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944892030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944892570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944895590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555944895ad0 con 0x555944874bc0 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555944895c40 con 0x555944875a60 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x555944895e00 con 0x555944874260 2023-10-05T15:49:14.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.570+0000 7f87f1bd7b80 10 client.0 _ll_register_callbacks cb 0x7f87cc005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944892570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944892570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45568/0 (socket says 172.21.15.17:45568) 2023-10-05T15:49:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 -- 172.21.15.17:0/566095433 learned_addr learned my addr 172.21.15.17:0/566095433 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d7fff700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944895590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d77fe700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944892030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 -- 172.21.15.17:0/566095433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 msgr2=0x555944892030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944892030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 -- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 msgr2=0x555944895590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944895590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.571+0000 7f87d6ffd700 1 -- 172.21.15.17:0/566095433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c800ade0 con 0x555944874bc0 2023-10-05T15:49:14.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.573+0000 7f87d6ffd700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944892570 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87cc005850 tx=0x7f87cc0165d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bec48a81b7ba8ea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:14.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.573+0000 7f87b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:49:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.575+0000 7f87b6ffd700 1 -- 172.21.15.17:0/566095433 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc016740 con 0x555944874bc0 2023-10-05T15:49:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.575+0000 7f87b6ffd700 1 -- 172.21.15.17:0/566095433 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f87cc000e40 con 0x555944874bc0 2023-10-05T15:49:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.575+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87cc0051a0 con 0x555944874bc0 2023-10-05T15:49:14.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.575+0000 7f87b6ffd700 1 -- 172.21.15.17:0/566095433 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87cc029a70 con 0x555944874bc0 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.575+0000 7f87f1bd7b80 10 client.17031 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5559445dac60 con 0x555944874bc0 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87b6ffd700 1 -- 172.21.15.17:0/566095433 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87cc0051a0 con 0x555944874bc0 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87b6ffd700 1 -- 172.21.15.17:0/566095433 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f87cc051070 con 0x555944874bc0 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 10 client.17031 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 20 client.17031 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:14.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5559448eef50 0x5559448f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 4 client.17031 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:49:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.576+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5559447bfb30 con 0x5559448eef50 2023-10-05T15:49:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.577+0000 7f87d77fe700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5559448eef50 0x5559448f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:14.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.578+0000 7f87d77fe700 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5559448eef50 0x5559448f1340 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00f9ac900baee99 server_cookie=f95371d54562fa19 in_seq=0 out_seq=0 2023-10-05T15:49:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.578+0000 7f87b6ffd700 10 client.17031 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.578+0000 7f87b6ffd700 1 -- 172.21.15.17:0/566095433 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5559447bfb30 con 0x5559448eef50 2023-10-05T15:49:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.578+0000 7f87b6ffd700 10 client.17031 handle_command_reply: tid=0 2023-10-05T15:49:14.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.578+0000 7f87f1bd7b80 1 client.17031 shutdown 2023-10-05T15:49:14.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 msgr2=0x555944892570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944892570 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f87cc005850 tx=0x7f87cc0165d0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 shutdown_connections 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5559448eef50 0x5559448f1340 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555944875a60 0x555944895590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555944874260 0x555944892030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 --2- 172.21.15.17:0/566095433 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555944874bc0 0x555944892570 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.579+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 >> 172.21.15.17:0/566095433 conn(0x5559447e8260 msgr2=0x55594488fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.580+0000 7f87b6ffd700 0 client.17031 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:14.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.580+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 shutdown_connections 2023-10-05T15:49:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.580+0000 7f87f1bd7b80 1 -- 172.21.15.17:0/566095433 wait complete. 2023-10-05T15:49:14.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.581+0000 7f87f1bd7b80 20 client.17031 trim_cache size 0 max 16384 2023-10-05T15:49:14.583 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:49:14.583 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:49:14.583 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:49:14.583 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:49:14.584 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:49:14.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:49:14.584 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:49:14.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:49:14.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:49:14.584 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:49:14.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87c00a1600 msgr2=0x7f87c00a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87c00a1600 0x7f87c00a3ac0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f87c8005950 tx=0x7f87c800a300 comp rx=0 tx=0).stop 2023-10-05T15:49:14.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 msgr2=0x7f87d81ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:14.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d81ad2c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f87d000ef30 tx=0x7f87d000c3a0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 shutdown_connections 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f87c00a1600 0x7f87c00a3ac0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87d8104aa0 0x7f87d81ad2c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d80ff760 0x7f87d806f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 --2- 172.21.15.17:0/1368572393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87d81020d0 0x7f87d806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 >> 172.21.15.17:0/1368572393 conn(0x7f87d80fb380 msgr2=0x7f87d8100410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 shutdown_connections 2023-10-05T15:49:14.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:14.583+0000 7f87de1ff700 1 -- 172.21.15.17:0/1368572393 wait complete. 2023-10-05T15:49:14.616 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:49:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:15 smithi167 ceph-mon[133366]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 769 op/s 2023-10-05T15:49:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:15 smithi079 ceph-mon[132936]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 769 op/s 2023-10-05T15:49:16.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:15 smithi017 ceph-mon[129107]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 769 op/s 2023-10-05T15:49:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 640.0 s, 577.6 tps, lat 172.525 ms stddev 53.821 2023-10-05T15:49:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:17 smithi167 ceph-mon[133366]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.8 MiB/s wr, 579 op/s 2023-10-05T15:49:18.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:17 smithi079 ceph-mon[132936]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.8 MiB/s wr, 579 op/s 2023-10-05T15:49:18.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:17 smithi017 ceph-mon[129107]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.8 MiB/s wr, 579 op/s 2023-10-05T15:49:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:19 smithi167 ceph-mon[133366]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 688 op/s 2023-10-05T15:49:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:19 smithi079 ceph-mon[132936]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 688 op/s 2023-10-05T15:49:20.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:19 smithi017 ceph-mon[129107]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 688 op/s 2023-10-05T15:49:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:21 smithi167 ceph-mon[133366]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 687 op/s 2023-10-05T15:49:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:21 smithi079 ceph-mon[132936]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 687 op/s 2023-10-05T15:49:22.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:21 smithi017 ceph-mon[129107]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 687 op/s 2023-10-05T15:49:23.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 645.0 s, 594.5 tps, lat 168.903 ms stddev 59.471 2023-10-05T15:49:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:23 smithi167 ceph-mon[133366]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.8 MiB/s wr, 585 op/s 2023-10-05T15:49:24.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:23 smithi079 ceph-mon[132936]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.8 MiB/s wr, 585 op/s 2023-10-05T15:49:24.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:23 smithi017 ceph-mon[129107]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.8 MiB/s wr, 585 op/s 2023-10-05T15:49:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:26 smithi167 ceph-mon[133366]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 766 op/s 2023-10-05T15:49:26.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:26 smithi079 ceph-mon[132936]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 766 op/s 2023-10-05T15:49:26.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:25 smithi017 ceph-mon[129107]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 766 op/s 2023-10-05T15:49:26.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 -- 172.21.15.17:0/1228025134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c107eb0 msgr2=0x7f7f7c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1228025134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c10a2e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009990 tx=0x7f7f6c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 -- 172.21.15.17:0/1228025134 shutdown_connections 2023-10-05T15:49:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1228025134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c10d1f0 0x7f7f7c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1228025134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c10a2e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1228025134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c10a820 0x7f7f7c10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 -- 172.21.15.17:0/1228025134 >> 172.21.15.17:0/1228025134 conn(0x7f7f7c06dd10 msgr2=0x7f7f7c070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.638+0000 7f7f837ff700 1 -- 172.21.15.17:0/1228025134 shutdown_connections 2023-10-05T15:49:26.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.639+0000 7f7f837ff700 1 -- 172.21.15.17:0/1228025134 wait complete. 2023-10-05T15:49:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.640+0000 7f7f837ff700 1 Processor -- start 2023-10-05T15:49:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.640+0000 7f7f837ff700 1 -- start start 2023-10-05T15:49:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.641+0000 7f7f837ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c1a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.641+0000 7f7f837ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10a820 0x7f7f7c1a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.641+0000 7f7f837ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c10d1f0 0x7f7f7c1a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.641+0000 7f7f837ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1a7430 con 0x7f7f7c107eb0 2023-10-05T15:49:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.641+0000 7f7f837ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1a75a0 con 0x7f7f7c10d1f0 2023-10-05T15:49:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.641+0000 7f7f837ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c1a7760 con 0x7f7f7c10a820 2023-10-05T15:49:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.642+0000 7f7f8159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c1a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.642+0000 7f7f8159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c1a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46840/0 (socket says 172.21.15.17:46840) 2023-10-05T15:49:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.642+0000 7f7f8159b700 1 -- 172.21.15.17:0/1969855609 learned_addr learned my addr 172.21.15.17:0/1969855609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.642+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c10d1f0 0x7f7f7c1a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.642+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10a820 0x7f7f7c1a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.643+0000 7f7f80d9a700 1 -- 172.21.15.17:0/1969855609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c10d1f0 msgr2=0x7f7f7c1a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.643+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c10d1f0 0x7f7f7c1a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.643+0000 7f7f80d9a700 1 -- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c107eb0 msgr2=0x7f7f7c1a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.643+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c1a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.643+0000 7f7f80d9a700 1 -- 172.21.15.17:0/1969855609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0095f0 con 0x7f7f7c10a820 2023-10-05T15:49:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.647+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10a820 0x7f7f7c1a5f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ada0 tx=0x7f7f7400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.647+0000 7f7f727fc700 1 -- 172.21.15.17:0/1969855609 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400f070 con 0x7f7f7c10a820 2023-10-05T15:49:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.647+0000 7f7f727fc700 1 -- 172.21.15.17:0/1969855609 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f74007b30 con 0x7f7f7c10a820 2023-10-05T15:49:26.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.647+0000 7f7f727fc700 1 -- 172.21.15.17:0/1969855609 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74005280 con 0x7f7f7c10a820 2023-10-05T15:49:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.650+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c1a7a40 con 0x7f7f7c10a820 2023-10-05T15:49:26.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.651+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c1ae200 con 0x7f7f7c10a820 2023-10-05T15:49:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.658+0000 7f7f971d1b80 1 Processor -- start 2023-10-05T15:49:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.658+0000 7f7f971d1b80 1 -- start start 2023-10-05T15:49:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f831fd0 0x56422f832450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f839220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f799400 con 0x56422f832990 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f78abc0 con 0x56422f831fd0 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f7884e0 con 0x56422f830ec0 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.661+0000 7f7f81d9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8312e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54596/0 (socket says 172.21.15.17:54596) 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 -- 172.21.15.17:0/3449028771 learned_addr learned my addr 172.21.15.17:0/3449028771 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f8159b700 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f831fd0 0x56422f832450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 -- 172.21.15.17:0/3449028771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f831fd0 msgr2=0x56422f832450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f831fd0 0x56422f832450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 -- 172.21.15.17:0/3449028771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 msgr2=0x56422f839220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f839220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.662+0000 7f7f81d9c700 1 -- 172.21.15.17:0/3449028771 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56422f5aed80 con 0x56422f830ec0 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.663+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8312e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009ca0 tx=0x7f7f780113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb2dcbae6a9ed62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.663+0000 7f7f677fe700 1 -- 172.21.15.17:0/3449028771 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78011c00 con 0x56422f830ec0 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.663+0000 7f7f677fe700 1 -- 172.21.15.17:0/3449028771 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f78011d60 con 0x56422f830ec0 2023-10-05T15:49:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.663+0000 7f7f677fe700 1 -- 172.21.15.17:0/3449028771 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800f6a0 con 0x56422f830ec0 2023-10-05T15:49:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.664+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3449028771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 msgr2=0x56422f8312e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.664+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8312e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009ca0 tx=0x7f7f780113e0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3449028771 shutdown_connections 2023-10-05T15:49:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f839220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8312e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3449028771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f831fd0 0x56422f832450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3449028771 >> 172.21.15.17:0/3449028771 conn(0x56422f7a5200 msgr2=0x56422f82bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3449028771 shutdown_connections 2023-10-05T15:49:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3449028771 wait complete. 2023-10-05T15:49:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.665+0000 7f7f727fc700 1 -- 172.21.15.17:0/1969855609 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7f7400c980 con 0x7f7f7c10a820 2023-10-05T15:49:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.666+0000 7f7f971d1b80 1 -- start start 2023-10-05T15:49:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.667+0000 7f7f971d1b80 1 Processor -- start 2023-10-05T15:49:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.670+0000 7f7f727fc700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7f680a1590 0x7f7f680a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.670+0000 7f7f727fc700 1 -- 172.21.15.17:0/1969855609 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7f740cc370 con 0x7f7f7c10a820 2023-10-05T15:49:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f83ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f831fd0 0x56422f83b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f842200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f783dd0 con 0x56422f832990 2023-10-05T15:49:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f7206b0 con 0x56422f830ec0 2023-10-05T15:49:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f720350 con 0x56422f831fd0 2023-10-05T15:49:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.671+0000 7f7f971d1b80 10 client.0 _ll_register_callbacks cb 0x56422f57d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.673+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7f680a1590 0x7f7f680a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.674+0000 7f7f81d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f842200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.674+0000 7f7f81d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f842200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46856/0 (socket says 172.21.15.17:46856) 2023-10-05T15:49:26.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.674+0000 7f7f81d9c700 1 -- 172.21.15.17:0/3707741965 learned_addr learned my addr 172.21.15.17:0/3707741965 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.677+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f831fd0 0x56422f83b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.677+0000 7f7f8159b700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f83ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.679+0000 7f7f80d9a700 1 -- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 msgr2=0x56422f83ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.679+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f83ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.679+0000 7f7f80d9a700 1 -- 172.21.15.17:0/3707741965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 msgr2=0x56422f842200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.679+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f842200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.679+0000 7f7f80d9a700 1 -- 172.21.15.17:0/3707741965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f78009950 con 0x56422f831fd0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.679+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f831fd0 0x56422f83b1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f74099220 tx=0x7f7f740997d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=947cf07a5b2e96c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.680+0000 7f7f64ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.680+0000 7f7f64ff9700 1 -- 172.21.15.17:0/3707741965 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74093ea0 con 0x56422f831fd0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.680+0000 7f7f64ff9700 1 -- 172.21.15.17:0/3707741965 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7f74099990 con 0x56422f831fd0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.680+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56422f823d50 con 0x56422f831fd0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.681+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7f680a1590 0x7f7f680a3a50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009ca0 tx=0x7f7f78004830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.681+0000 7f7f64ff9700 1 -- 172.21.15.17:0/3707741965 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f740cc160 con 0x56422f831fd0 2023-10-05T15:49:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.681+0000 7f7f971d1b80 10 client.26992 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.681+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56422f597c00 con 0x56422f831fd0 2023-10-05T15:49:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.682+0000 7f7f64ff9700 1 -- 172.21.15.17:0/3707741965 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56422f823d50 con 0x56422f831fd0 2023-10-05T15:49:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.682+0000 7f7f64ff9700 1 -- 172.21.15.17:0/3707741965 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f740a1190 con 0x56422f831fd0 2023-10-05T15:49:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.683+0000 7f7f971d1b80 10 client.26992 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.683+0000 7f7f971d1b80 10 client.26992 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.683+0000 7f7f971d1b80 20 client.26992 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.683+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f857ac0 0x56422f859ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.683+0000 7f7f971d1b80 4 client.26992 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:49:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.683+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56422f77cdb0 con 0x56422f857ac0 2023-10-05T15:49:26.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.684+0000 7f7f8159b700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f857ac0 0x56422f859ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.685+0000 7f7f8159b700 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f857ac0 0x56422f859ee0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd8b3fc78c1a22d server_cookie=a82c01ff21c0ca67 in_seq=0 out_seq=0 2023-10-05T15:49:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.685+0000 7f7f64ff9700 10 client.26992 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:26.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.686+0000 7f7f64ff9700 1 -- 172.21.15.17:0/3707741965 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56422f77cdb0 con 0x56422f857ac0 2023-10-05T15:49:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.686+0000 7f7f64ff9700 10 client.26992 handle_command_reply: tid=0 2023-10-05T15:49:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.686+0000 7f7f971d1b80 1 client.26992 shutdown 2023-10-05T15:49:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f831fd0 msgr2=0x56422f83b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f831fd0 0x56422f83b1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7f74099220 tx=0x7f7f740997d0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 shutdown_connections 2023-10-05T15:49:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f857ac0 0x56422f859ee0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f832990 0x56422f842200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f83ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/3707741965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f831fd0 0x56422f83b1c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 >> 172.21.15.17:0/3707741965 conn(0x56422f7a5200 msgr2=0x56422f82b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.687+0000 7f7f64ff9700 0 client.26992 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.688+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 shutdown_connections 2023-10-05T15:49:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.688+0000 7f7f971d1b80 1 -- 172.21.15.17:0/3707741965 wait complete. 2023-10-05T15:49:26.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.689+0000 7f7f971d1b80 20 client.26992 trim_cache size 0 max 16384 2023-10-05T15:49:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.716+0000 7f7f971d1b80 1 Processor -- start 2023-10-05T15:49:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.716+0000 7f7f971d1b80 1 -- start start 2023-10-05T15:49:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f839910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f8421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f832990 0x56422f853a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f6048c0 con 0x56422f831fd0 2023-10-05T15:49:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f83a130 con 0x56422f830ec0 2023-10-05T15:49:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f831740 con 0x56422f832990 2023-10-05T15:49:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.717+0000 7f7f8159b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f839910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.718+0000 7f7f8159b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f839910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39370/0 (socket says 172.21.15.17:39370) 2023-10-05T15:49:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.718+0000 7f7f8159b700 1 -- 172.21.15.17:0/1221187982 learned_addr learned my addr 172.21.15.17:0/1221187982 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.719+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f832990 0x56422f853a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.720+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f8421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.721+0000 7f7f8159b700 1 -- 172.21.15.17:0/1221187982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f832990 msgr2=0x56422f853a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.721+0000 7f7f8159b700 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f832990 0x56422f853a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.721+0000 7f7f8159b700 1 -- 172.21.15.17:0/1221187982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 msgr2=0x56422f8421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.721+0000 7f7f8159b700 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f8421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.721+0000 7f7f8159b700 1 -- 172.21.15.17:0/1221187982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56422f5d51f0 con 0x56422f830ec0 2023-10-05T15:49:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.723+0000 7f7f8159b700 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f839910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x56422f85a7b0 tx=0x7f7f6c00b280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac7a9d389a21499 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:26.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.723+0000 7f7f67fff700 1 -- 172.21.15.17:0/1221187982 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c01d040 con 0x56422f830ec0 2023-10-05T15:49:26.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.723+0000 7f7f67fff700 1 -- 172.21.15.17:0/1221187982 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f6c01e040 con 0x56422f830ec0 2023-10-05T15:49:26.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.723+0000 7f7f67fff700 1 -- 172.21.15.17:0/1221187982 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00b790 con 0x56422f830ec0 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.724+0000 7f7f971d1b80 1 -- 172.21.15.17:0/1221187982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 msgr2=0x56422f839910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.724+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f839910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x56422f85a7b0 tx=0x7f7f6c00b280 comp rx=0 tx=0).stop 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.725+0000 7f7f971d1b80 1 -- 172.21.15.17:0/1221187982 shutdown_connections 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.725+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f832990 0x56422f853a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.725+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f830ec0 0x56422f839910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.725+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/1221187982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f8421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.725+0000 7f7f971d1b80 1 -- 172.21.15.17:0/1221187982 >> 172.21.15.17:0/1221187982 conn(0x56422f7a5200 msgr2=0x56422f82bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.726+0000 7f7f971d1b80 1 -- 172.21.15.17:0/1221187982 shutdown_connections 2023-10-05T15:49:26.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.726+0000 7f7f971d1b80 1 -- 172.21.15.17:0/1221187982 wait complete. 2023-10-05T15:49:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.727+0000 7f7f971d1b80 1 -- start start 2023-10-05T15:49:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.727+0000 7f7f971d1b80 1 Processor -- start 2023-10-05T15:49:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f840630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f832990 0x56422f841640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f841b80 con 0x56422f831fd0 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f841cf0 con 0x56422f832990 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422f841eb0 con 0x56422f830ec0 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.728+0000 7f7f971d1b80 10 client.0 _ll_register_callbacks cb 0x7f7f74098dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.729+0000 7f7f8159b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.729+0000 7f7f8159b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:54624/0 (socket says 172.21.15.17:54624) 2023-10-05T15:49:26.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.729+0000 7f7f8159b700 1 -- 172.21.15.17:0/715104486 learned_addr learned my addr 172.21.15.17:0/715104486 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.729+0000 7f7f81d9c700 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f832990 0x56422f841640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.730+0000 7f7f8159b700 1 -- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f832990 msgr2=0x56422f841640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.730+0000 7f7f8159b700 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f832990 0x56422f841640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.730+0000 7f7f8159b700 1 -- 172.21.15.17:0/715104486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 msgr2=0x56422f840630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.730+0000 7f7f8159b700 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f840630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.730+0000 7f7f8159b700 1 -- 172.21.15.17:0/715104486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c10e290 con 0x56422f830ec0 2023-10-05T15:49:26.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.731+0000 7f7f8159b700 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8400f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c005b40 tx=0x7f7f6c0261a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1dbb53a1758865 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.732+0000 7f7f64ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:49:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.732+0000 7f7f64ff9700 1 -- 172.21.15.17:0/715104486 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c01d070 con 0x56422f830ec0 2023-10-05T15:49:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.732+0000 7f7f64ff9700 1 -- 172.21.15.17:0/715104486 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7f6c048c10 con 0x56422f830ec0 2023-10-05T15:49:26.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.732+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f78011d60 con 0x56422f830ec0 2023-10-05T15:49:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.733+0000 7f7f64ff9700 1 -- 172.21.15.17:0/715104486 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f6c005300 con 0x56422f830ec0 2023-10-05T15:49:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.733+0000 7f7f971d1b80 10 client.26995 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.733+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56422f5ad250 con 0x56422f830ec0 2023-10-05T15:49:26.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.734+0000 7f7f64ff9700 1 -- 172.21.15.17:0/715104486 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f78011d60 con 0x56422f830ec0 2023-10-05T15:49:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.734+0000 7f7f64ff9700 1 -- 172.21.15.17:0/715104486 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f6c023040 con 0x56422f830ec0 2023-10-05T15:49:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.734+0000 7f7f971d1b80 10 client.26995 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.734+0000 7f7f971d1b80 10 client.26995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.734+0000 7f7f971d1b80 20 client.26995 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:26.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.734+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f849420 0x56422f84b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.735+0000 7f7f971d1b80 4 client.26995 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:49:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.735+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56422f77cad0 con 0x56422f849420 2023-10-05T15:49:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.735+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f849420 0x56422f84b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.736+0000 7f7f64ff9700 10 client.26995 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:26.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.736+0000 7f7f80d9a700 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f849420 0x56422f84b840 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69c14a4d7ae6d7a0 server_cookie=63f4dd87b2260e71 in_seq=0 out_seq=0 2023-10-05T15:49:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.765+0000 7f7f64ff9700 1 -- 172.21.15.17:0/715104486 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56422f77cad0 con 0x56422f849420 2023-10-05T15:49:26.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.765+0000 7f7f64ff9700 10 client.26995 handle_command_reply: tid=0 2023-10-05T15:49:26.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.765+0000 7f7f971d1b80 1 client.26995 shutdown 2023-10-05T15:49:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.767+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 msgr2=0x56422f8400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.767+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8400f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c005b40 tx=0x7f7f6c0261a0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 shutdown_connections 2023-10-05T15:49:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56422f849420 0x56422f84b840 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56422f832990 0x56422f841640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56422f830ec0 0x56422f8400f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 --2- 172.21.15.17:0/715104486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56422f831fd0 0x56422f840630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 >> 172.21.15.17:0/715104486 conn(0x56422f7a5200 msgr2=0x56422f839910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:26.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f64ff9700 0 client.26995 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:26.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 shutdown_connections 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.771+0000 7f7f971d1b80 1 -- 172.21.15.17:0/715104486 wait complete. 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.772+0000 7f7f971d1b80 20 client.26995 trim_cache size 0 max 16384 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:49:26.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7f680a1590 msgr2=0x7f7f680a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7f680a1590 0x7f7f680a3a50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009ca0 tx=0x7f7f78004830 comp rx=0 tx=0).stop 2023-10-05T15:49:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10a820 msgr2=0x7f7f7c1a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10a820 0x7f7f7c1a5f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ada0 tx=0x7f7f7400c330 comp rx=0 tx=0).stop 2023-10-05T15:49:26.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 shutdown_connections 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7f680a1590 0x7f7f680a3a50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7c10d1f0 0x7f7f7c1a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f7c107eb0 0x7f7f7c1a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.773+0000 7f7f837ff700 1 --2- 172.21.15.17:0/1969855609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7c10a820 0x7f7f7c1a5f50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.774+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 >> 172.21.15.17:0/1969855609 conn(0x7f7f7c06dd10 msgr2=0x7f7f7c10c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.774+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 shutdown_connections 2023-10-05T15:49:26.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:26.774+0000 7f7f837ff700 1 -- 172.21.15.17:0/1969855609 wait complete. 2023-10-05T15:49:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 650.0 s, 537.4 tps, lat 188.376 ms stddev 67.658 2023-10-05T15:49:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:28 smithi167 ceph-mon[133366]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.5 MiB/s wr, 580 op/s 2023-10-05T15:49:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:28 smithi079 ceph-mon[132936]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.5 MiB/s wr, 580 op/s 2023-10-05T15:49:28.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:28 smithi017 ceph-mon[129107]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.5 MiB/s wr, 580 op/s 2023-10-05T15:49:29.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:29 smithi167 ceph-mon[133366]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.7 MiB/s wr, 661 op/s 2023-10-05T15:49:29.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:29 smithi079 ceph-mon[132936]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.7 MiB/s wr, 661 op/s 2023-10-05T15:49:29.451 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:29 smithi017 ceph-mon[129107]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.7 MiB/s wr, 661 op/s 2023-10-05T15:49:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:32 smithi167 ceph-mon[133366]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.5 MiB/s wr, 674 op/s 2023-10-05T15:49:32.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:32 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:49:32.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:32 smithi017 ceph-mon[129107]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.5 MiB/s wr, 674 op/s 2023-10-05T15:49:32.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:32 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:49:32.543 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:32 smithi079 ceph-mon[132936]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.5 MiB/s wr, 674 op/s 2023-10-05T15:49:32.543 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:32 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:49:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 655.0 s, 436.0 tps, lat 221.350 ms stddev 108.273 2023-10-05T15:49:33.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:33 smithi167 ceph-mon[133366]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.2 MiB/s wr, 593 op/s 2023-10-05T15:49:33.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:33 smithi079 ceph-mon[132936]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.2 MiB/s wr, 593 op/s 2023-10-05T15:49:33.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:33 smithi017 ceph-mon[129107]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.2 MiB/s wr, 593 op/s 2023-10-05T15:49:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:36 smithi167 ceph-mon[133366]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 756 op/s 2023-10-05T15:49:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:36 smithi079 ceph-mon[132936]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 756 op/s 2023-10-05T15:49:36.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:36 smithi017 ceph-mon[129107]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 756 op/s 2023-10-05T15:49:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 660.0 s, 401.2 tps, lat 255.628 ms stddev 385.183 2023-10-05T15:49:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:37 smithi167 ceph-mon[133366]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.2 MiB/s wr, 558 op/s 2023-10-05T15:49:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:49:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:49:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:49:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:37 smithi079 ceph-mon[132936]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.2 MiB/s wr, 558 op/s 2023-10-05T15:49:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:49:38.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:49:38.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:49:38.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:37 smithi017 ceph-mon[129107]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.2 MiB/s wr, 558 op/s 2023-10-05T15:49:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:49:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:49:38.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:49:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.034+0000 7fa3917ff700 1 -- 172.21.15.17:0/223028384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 msgr2=0x7fa38c105170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.034+0000 7fa3917ff700 1 --2- 172.21.15.17:0/223028384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c105170 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa38400b0a0 tx=0x7fa38400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 -- 172.21.15.17:0/223028384 shutdown_connections 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 --2- 172.21.15.17:0/223028384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c105170 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 --2- 172.21.15.17:0/223028384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0ff1b0 0x7fa38c0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 --2- 172.21.15.17:0/223028384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38c0fff10 0x7fa38c100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 -- 172.21.15.17:0/223028384 >> 172.21.15.17:0/223028384 conn(0x7fa38c0faac0 msgr2=0x7fa38c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 -- 172.21.15.17:0/223028384 shutdown_connections 2023-10-05T15:49:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.035+0000 7fa3917ff700 1 -- 172.21.15.17:0/223028384 wait complete. 2023-10-05T15:49:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.036+0000 7fa3917ff700 1 Processor -- start 2023-10-05T15:49:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 -- start start 2023-10-05T15:49:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38c0ff1b0 0x7fa38c06f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0fff10 0x7fa38c06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c071320 con 0x7fa38c0ff1b0 2023-10-05T15:49:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c071490 con 0x7fa38c1008d0 2023-10-05T15:49:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.038+0000 7fa3917ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c071650 con 0x7fa38c0fff10 2023-10-05T15:49:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.039+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.039+0000 7fa38affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38c0ff1b0 0x7fa38c06f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.039+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45590/0 (socket says 172.21.15.17:45590) 2023-10-05T15:49:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.039+0000 7fa38b7fe700 1 -- 172.21.15.17:0/1372884263 learned_addr learned my addr 172.21.15.17:0/1372884263 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.039+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0fff10 0x7fa38c06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38a7fc700 1 -- 172.21.15.17:0/1372884263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 msgr2=0x7fa38c070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38a7fc700 1 -- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38c0ff1b0 msgr2=0x7fa38c06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38c0ff1b0 0x7fa38c06f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38a7fc700 1 -- 172.21.15.17:0/1372884263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384009d00 con 0x7fa38c0fff10 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:49:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0fff10 0x7fa38c06fdf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b450 tx=0x7fa38000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa373fff700 1 -- 172.21.15.17:0/1372884263 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380011830 con 0x7fa38c0fff10 2023-10-05T15:49:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.040+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c071930 con 0x7fa38c0fff10 2023-10-05T15:49:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.041+0000 7fa373fff700 1 -- 172.21.15.17:0/1372884263 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa380011e20 con 0x7fa38c0fff10 2023-10-05T15:49:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.041+0000 7fa373fff700 1 -- 172.21.15.17:0/1372884263 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380010d50 con 0x7fa38c0fff10 2023-10-05T15:49:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.041+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c072160 con 0x7fa38c0fff10 2023-10-05T15:49:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.047+0000 7fa373fff700 1 -- 172.21.15.17:0/1372884263 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa380011990 con 0x7fa38c0fff10 2023-10-05T15:49:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.047+0000 7fa3a505eb80 1 Processor -- start 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.048+0000 7fa3a505eb80 1 -- start start 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.048+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c4990 0x56112b0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b02b400 con 0x56112b0c4990 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b01cbc0 con 0x56112b0c2ec0 2023-10-05T15:49:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b01a4e0 con 0x56112b0c3fd0 2023-10-05T15:49:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa38affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa38affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58036/0 (socket says 172.21.15.17:58036) 2023-10-05T15:49:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.049+0000 7fa38affd700 1 -- 172.21.15.17:0/382416918 learned_addr learned my addr 172.21.15.17:0/382416918 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.050+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.050+0000 7fa38affd700 1 -- 172.21.15.17:0/382416918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 msgr2=0x56112b0c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.050+0000 7fa38affd700 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0c32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.050+0000 7fa38affd700 1 -- 172.21.15.17:0/382416918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c4990 msgr2=0x56112b0cb220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:49:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.051+0000 7fa38affd700 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c4990 0x56112b0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.051+0000 7fa38affd700 1 -- 172.21.15.17:0/382416918 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56112ae40d80 con 0x56112b0c3fd0 2023-10-05T15:49:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.051+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:49:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.051+0000 7fa373fff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3740a15d0 0x7fa3740a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.052+0000 7fa373fff700 1 -- 172.21.15.17:0/1372884263 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa3800cca20 con 0x7fa38c0fff10 2023-10-05T15:49:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.052+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3740a15d0 0x7fa3740a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.052+0000 7fa38affd700 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0c4450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009ac0 tx=0x7fa37c009dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16eab18a38b18ab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.053+0000 7fa3717fa700 1 -- 172.21.15.17:0/382416918 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c009590 con 0x56112b0c3fd0 2023-10-05T15:49:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.053+0000 7fa3717fa700 1 -- 172.21.15.17:0/382416918 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa37c00edc0 con 0x56112b0c3fd0 2023-10-05T15:49:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.053+0000 7fa3717fa700 1 -- 172.21.15.17:0/382416918 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0123d0 con 0x56112b0c3fd0 2023-10-05T15:49:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 -- 172.21.15.17:0/382416918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 msgr2=0x56112b0c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0c4450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009ac0 tx=0x7fa37c009dd0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3740a15d0 0x7fa3740a3a90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x56112b0c2c60 tx=0x7fa3840076a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 -- 172.21.15.17:0/382416918 shutdown_connections 2023-10-05T15:49:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c4990 0x56112b0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/382416918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0c4450 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.054+0000 7fa3a505eb80 1 -- 172.21.15.17:0/382416918 >> 172.21.15.17:0/382416918 conn(0x56112b037200 msgr2=0x56112b0bdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.055+0000 7fa3a505eb80 1 -- 172.21.15.17:0/382416918 shutdown_connections 2023-10-05T15:49:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.055+0000 7fa3a505eb80 1 -- 172.21.15.17:0/382416918 wait complete. 2023-10-05T15:49:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.055+0000 7fa3a505eb80 1 -- start start 2023-10-05T15:49:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.056+0000 7fa3a505eb80 1 Processor -- start 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.056+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c3fd0 0x56112b0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b015dd0 con 0x56112b0c3fd0 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112afb26b0 con 0x56112b0c2ec0 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112afb2350 con 0x56112b0c4990 2023-10-05T15:49:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa3a505eb80 10 client.0 _ll_register_callbacks cb 0x56112ae0f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa38affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa38affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45616/0 (socket says 172.21.15.17:45616) 2023-10-05T15:49:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.057+0000 7fa38affd700 1 -- 172.21.15.17:0/1883346546 learned_addr learned my addr 172.21.15.17:0/1883346546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c3fd0 0x56112b0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38affd700 1 -- 172.21.15.17:0/1883346546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 msgr2=0x56112b0d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38affd700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38affd700 1 -- 172.21.15.17:0/1883346546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c3fd0 msgr2=0x56112b0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38affd700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c3fd0 0x56112b0cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.058+0000 7fa38affd700 1 -- 172.21.15.17:0/1883346546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c0096f0 con 0x56112b0c2ec0 2023-10-05T15:49:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.059+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c3fd0 0x56112b0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:49:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.059+0000 7fa38affd700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0ccbf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0138a0 tx=0x7fa37c014e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d1a3956b513e52 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.059+0000 7fa36eff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.060+0000 7fa36eff5700 1 -- 172.21.15.17:0/1883346546 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00eb40 con 0x56112b0c2ec0 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.060+0000 7fa36eff5700 1 -- 172.21.15.17:0/1883346546 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa37c01c450 con 0x56112b0c2ec0 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.060+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56112b0b5d50 con 0x56112b0c2ec0 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.060+0000 7fa36eff5700 1 -- 172.21.15.17:0/1883346546 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa37c01c610 con 0x56112b0c2ec0 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.060+0000 7fa3a505eb80 10 client.27047 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.060+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56112ae29c00 con 0x56112b0c2ec0 2023-10-05T15:49:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa36eff5700 1 -- 172.21.15.17:0/1883346546 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56112b0b5d50 con 0x56112b0c2ec0 2023-10-05T15:49:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa36eff5700 1 -- 172.21.15.17:0/1883346546 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa37c011070 con 0x56112b0c2ec0 2023-10-05T15:49:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa3a505eb80 10 client.27047 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:40.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa3a505eb80 10 client.27047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa3a505eb80 20 client.27047 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b0e9990 0x56112b0ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa3a505eb80 4 client.27047 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.061+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56112b00edb0 con 0x56112b0e9990 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.062+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b0e9990 0x56112b0ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.063+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b0e9990 0x56112b0ebdb0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3ff99ee53b38ba server_cookie=e895972a479bf0d9 in_seq=0 out_seq=0 2023-10-05T15:49:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.063+0000 7fa36eff5700 10 client.27047 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.064+0000 7fa36eff5700 1 -- 172.21.15.17:0/1883346546 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56112b00edb0 con 0x56112b0e9990 2023-10-05T15:49:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.064+0000 7fa36eff5700 10 client.27047 handle_command_reply: tid=0 2023-10-05T15:49:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.064+0000 7fa3a505eb80 1 client.27047 shutdown 2023-10-05T15:49:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.064+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 msgr2=0x56112b0ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.064+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0ccbf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0138a0 tx=0x7fa37c014e60 comp rx=0 tx=0).stop 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 shutdown_connections 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b0e9990 0x56112b0ebdb0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c2ec0 0x56112b0ccbf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa36eff5700 0 client.27047 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/1883346546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c3fd0 0x56112b0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.065+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 >> 172.21.15.17:0/1883346546 conn(0x56112b037200 msgr2=0x56112b0bd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.066+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 shutdown_connections 2023-10-05T15:49:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.067+0000 7fa3a505eb80 1 -- 172.21.15.17:0/1883346546 wait complete. 2023-10-05T15:49:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.068+0000 7fa3a505eb80 20 client.27047 trim_cache size 0 max 16384 2023-10-05T15:49:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.096+0000 7fa3a505eb80 1 Processor -- start 2023-10-05T15:49:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.096+0000 7fa3a505eb80 1 -- start start 2023-10-05T15:49:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c3fd0 0x56112b0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112ae968c0 con 0x56112b0c2ec0 2023-10-05T15:49:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b0c3770 con 0x56112b0c3fd0 2023-10-05T15:49:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b0c7450 con 0x56112b0c4990 2023-10-05T15:49:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:58046/0 (socket says 172.21.15.17:58046) 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa38b7fe700 1 -- 172.21.15.17:0/3019352801 learned_addr learned my addr 172.21.15.17:0/3019352801 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.097+0000 7fa38affd700 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.098+0000 7fa38a7fc700 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c3fd0 0x56112b0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.098+0000 7fa38b7fe700 1 -- 172.21.15.17:0/3019352801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c3fd0 msgr2=0x56112b0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.098+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c3fd0 0x56112b0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.098+0000 7fa38b7fe700 1 -- 172.21.15.17:0/3019352801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 msgr2=0x56112b0cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.098+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.098+0000 7fa38b7fe700 1 -- 172.21.15.17:0/3019352801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56112ae671f0 con 0x56112b0c4990 2023-10-05T15:49:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.099+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa384007a10 tx=0x7fa38401d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628b4a41c344a8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.100+0000 7fa371ffb700 1 -- 172.21.15.17:0/3019352801 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400e040 con 0x56112b0c4990 2023-10-05T15:49:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.100+0000 7fa371ffb700 1 -- 172.21.15.17:0/3019352801 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa38402d070 con 0x56112b0c4990 2023-10-05T15:49:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.100+0000 7fa371ffb700 1 -- 172.21.15.17:0/3019352801 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840052a0 con 0x56112b0c4990 2023-10-05T15:49:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 -- 172.21.15.17:0/3019352801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 msgr2=0x56112b0d4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa384007a10 tx=0x7fa38401d000 comp rx=0 tx=0).stop 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 -- 172.21.15.17:0/3019352801 shutdown_connections 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c4990 0x56112b0d4090 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/3019352801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c3fd0 0x56112b0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.101+0000 7fa3a505eb80 1 -- 172.21.15.17:0/3019352801 >> 172.21.15.17:0/3019352801 conn(0x56112b037200 msgr2=0x56112b0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.102+0000 7fa3a505eb80 1 -- 172.21.15.17:0/3019352801 shutdown_connections 2023-10-05T15:49:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.102+0000 7fa3a505eb80 1 -- 172.21.15.17:0/3019352801 wait complete. 2023-10-05T15:49:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.103+0000 7fa3a505eb80 1 -- start start 2023-10-05T15:49:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.103+0000 7fa3a505eb80 1 Processor -- start 2023-10-05T15:49:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 0x56112b0d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b0d3820 con 0x56112b0c2ec0 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b0d3990 con 0x56112b0c4990 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56112b0d3b50 con 0x56112b0c3fd0 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.104+0000 7fa3a505eb80 10 client.0 _ll_register_callbacks cb 0x7fa37c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.105+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 0x56112b0d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.105+0000 7fa38b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 0x56112b0d32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45626/0 (socket says 172.21.15.17:45626) 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.105+0000 7fa38b7fe700 1 -- 172.21.15.17:0/4215861347 learned_addr learned my addr 172.21.15.17:0/4215861347 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.106+0000 7fa38b7fe700 1 -- 172.21.15.17:0/4215861347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 msgr2=0x56112b0d22d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.106+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0d22d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.106+0000 7fa38b7fe700 1 -- 172.21.15.17:0/4215861347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 msgr2=0x56112b0d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.106+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.106+0000 7fa38b7fe700 1 -- 172.21.15.17:0/4215861347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c105ba0 con 0x56112b0c4990 2023-10-05T15:49:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.106+0000 7fa38b7fe700 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 0x56112b0d32e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa384007590 tx=0x7fa384006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c7104180dc8b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.107+0000 7fa36eff5700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:49:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.107+0000 7fa36eff5700 1 -- 172.21.15.17:0/4215861347 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400e040 con 0x56112b0c4990 2023-10-05T15:49:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.107+0000 7fa36eff5700 1 -- 172.21.15.17:0/4215861347 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa384029430 con 0x56112b0c4990 2023-10-05T15:49:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.107+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa37c00edc0 con 0x56112b0c4990 2023-10-05T15:49:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.108+0000 7fa36eff5700 1 -- 172.21.15.17:0/4215861347 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3840295f0 con 0x56112b0c4990 2023-10-05T15:49:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.108+0000 7fa3a505eb80 10 client.27053 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.108+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56112ae3f250 con 0x56112b0c4990 2023-10-05T15:49:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.109+0000 7fa36eff5700 1 -- 172.21.15.17:0/4215861347 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa37c00edc0 con 0x56112b0c4990 2023-10-05T15:49:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa36eff5700 1 -- 172.21.15.17:0/4215861347 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa38403d810 con 0x56112b0c4990 2023-10-05T15:49:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa3a505eb80 10 client.27053 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa3a505eb80 10 client.27053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa3a505eb80 20 client.27053 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b13e2b0 0x56112b1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa3a505eb80 4 client.27053 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:49:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56112b00ead0 con 0x56112b13e2b0 2023-10-05T15:49:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.110+0000 7fa38affd700 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b13e2b0 0x56112b1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.111+0000 7fa38affd700 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b13e2b0 0x56112b1406d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec4c8d657aaa260 server_cookie=7b1382968f78897e in_seq=0 out_seq=0 2023-10-05T15:49:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.111+0000 7fa36eff5700 10 client.27053 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.140+0000 7fa36eff5700 1 -- 172.21.15.17:0/4215861347 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56112b00ead0 con 0x56112b13e2b0 2023-10-05T15:49:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.140+0000 7fa36eff5700 10 client.27053 handle_command_reply: tid=0 2023-10-05T15:49:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.140+0000 7fa3a505eb80 1 client.27053 shutdown 2023-10-05T15:49:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.140+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 msgr2=0x56112b0d32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.140+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 0x56112b0d32e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa384007590 tx=0x7fa384006000 comp rx=0 tx=0).stop 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 shutdown_connections 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56112b13e2b0 0x56112b1406d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56112b0c4990 0x56112b0d32e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56112b0c2ec0 0x56112b0d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 --2- 172.21.15.17:0/4215861347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56112b0c3fd0 0x56112b0d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 >> 172.21.15.17:0/4215861347 conn(0x56112b037200 msgr2=0x56112b0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa36eff5700 0 client.27053 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 shutdown_connections 2023-10-05T15:49:40.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.141+0000 7fa3a505eb80 1 -- 172.21.15.17:0/4215861347 wait complete. 2023-10-05T15:49:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.142+0000 7fa3a505eb80 20 client.27053 trim_cache size 0 max 16384 2023-10-05T15:49:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:49:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:49:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:49:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3740a15d0 msgr2=0x7fa3740a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3740a15d0 0x7fa3740a3a90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x56112b0c2c60 tx=0x7fa3840076a0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0fff10 msgr2=0x7fa38c06fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0fff10 0x7fa38c06fdf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b450 tx=0x7fa38000b760 comp rx=0 tx=0).stop 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 shutdown_connections 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3740a15d0 0x7fa3740a3a90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa38c1008d0 0x7fa38c070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38c0ff1b0 0x7fa38c06f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 --2- 172.21.15.17:0/1372884263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0fff10 0x7fa38c06fdf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 >> 172.21.15.17:0/1372884263 conn(0x7fa38c0faac0 msgr2=0x7fa38c0fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.143+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 shutdown_connections 2023-10-05T15:49:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:40.144+0000 7fa3917ff700 1 -- 172.21.15.17:0/1372884263 wait complete. 2023-10-05T15:49:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:39 smithi167 ceph-mon[133366]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.0 MiB/s wr, 636 op/s 2023-10-05T15:49:40.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:39 smithi017 ceph-mon[129107]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.0 MiB/s wr, 636 op/s 2023-10-05T15:49:40.719 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:39 smithi079 ceph-mon[132936]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.0 MiB/s wr, 636 op/s 2023-10-05T15:49:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:41 smithi167 ceph-mon[133366]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 702 op/s 2023-10-05T15:49:42.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:41 smithi079 ceph-mon[132936]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 702 op/s 2023-10-05T15:49:42.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:41 smithi017 ceph-mon[129107]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 702 op/s 2023-10-05T15:49:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 665.0 s, 441.0 tps, lat 226.322 ms stddev 274.432 2023-10-05T15:49:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:44 smithi167 ceph-mon[133366]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.9 MiB/s wr, 613 op/s 2023-10-05T15:49:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:44 smithi079 ceph-mon[132936]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.9 MiB/s wr, 613 op/s 2023-10-05T15:49:44.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:44 smithi017 ceph-mon[129107]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.9 MiB/s wr, 613 op/s 2023-10-05T15:49:44.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:49:44.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.976+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/2469306271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 msgr2=0x7f0eb8101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:44.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.976+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/2469306271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb8101b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b0a0 tx=0x7f0eb400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/2469306271 shutdown_connections 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/2469306271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eb8104a70 0x7f0eb8104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/2469306271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb8101b60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/2469306271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb81020a0 0x7f0eb8104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/2469306271 >> 172.21.15.17:0/2469306271 conn(0x7f0eb80fb330 msgr2=0x7f0eb80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/2469306271 shutdown_connections 2023-10-05T15:49:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.977+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/2469306271 wait complete. 2023-10-05T15:49:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.979+0000 7f0ebf3ff700 1 Processor -- start 2023-10-05T15:49:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.979+0000 7f0ebf3ff700 1 -- start start 2023-10-05T15:49:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebf3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebf3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eb81020a0 0x7f0eb819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebf3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb8104a70 0x7f0eb81a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebf3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81a4d70 con 0x7f0eb81020a0 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebf3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81a4eb0 con 0x7f0eb8104a70 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebf3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81a5040 con 0x7f0eb80ff730 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb8104a70 0x7f0eb81a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb8104a70 0x7f0eb81a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56270/0 (socket says 172.21.15.17:56270) 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebd99c700 1 -- 172.21.15.17:0/398385046 learned_addr learned my addr 172.21.15.17:0/398385046 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.980+0000 7f0ebd19b700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.981+0000 7f0ebd19b700 1 -- 172.21.15.17:0/398385046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb8104a70 msgr2=0x7f0eb81a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.981+0000 7f0ebd19b700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb8104a70 0x7f0eb81a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.981+0000 7f0ebd19b700 1 -- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eb81020a0 msgr2=0x7f0eb819d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.981+0000 7f0ebd19b700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eb81020a0 0x7f0eb819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.981+0000 7f0ebd19b700 1 -- 172.21.15.17:0/398385046 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009d00 con 0x7f0eb80ff730 2023-10-05T15:49:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.981+0000 7f0ebd19b700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb819d1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b070 tx=0x7f0eb40126a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.982+0000 7f0eae7fc700 1 -- 172.21.15.17:0/398385046 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400e040 con 0x7f0eb80ff730 2023-10-05T15:49:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.982+0000 7f0eae7fc700 1 -- 172.21.15.17:0/398385046 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb4012e10 con 0x7f0eb80ff730 2023-10-05T15:49:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.982+0000 7f0eae7fc700 1 -- 172.21.15.17:0/398385046 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb401bb50 con 0x7f0eb80ff730 2023-10-05T15:49:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.982+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb81a52c0 con 0x7f0eb80ff730 2023-10-05T15:49:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.982+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb81a5770 con 0x7f0eb80ff730 2023-10-05T15:49:44.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.989+0000 7f0ed2dccb80 1 Processor -- start 2023-10-05T15:49:44.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.989+0000 7f0eae7fc700 1 -- 172.21.15.17:0/398385046 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0eb401bcb0 con 0x7f0eb80ff730 2023-10-05T15:49:44.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 -- start start 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd934680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934bc0 0x5585cd935480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd935ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd89c460 con 0x5585cd934bc0 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd88dc20 con 0x5585cd935a60 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.990+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd88b540 con 0x5585cd934260 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.991+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd934680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.991+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd934680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:41558/0 (socket says 172.21.15.17:41558) 2023-10-05T15:49:44.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.991+0000 7f0ebd99c700 1 -- 172.21.15.17:0/2580114173 learned_addr learned my addr 172.21.15.17:0/2580114173 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:44.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0ebd99c700 1 -- 172.21.15.17:0/2580114173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 msgr2=0x5585cd935ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:49:44.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd935ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0ebd99c700 1 -- 172.21.15.17:0/2580114173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934bc0 msgr2=0x5585cd935480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:44.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934bc0 0x5585cd935480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0ebd99c700 1 -- 172.21.15.17:0/2580114173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585cd6b1de0 con 0x5585cd934260 2023-10-05T15:49:44.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd934680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000bde0 tx=0x7f0eb00106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b632ff20c370c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:44.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.992+0000 7f0eae7fc700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ea40a1650 0x7f0ea40a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:44.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.993+0000 7f0eae7fc700 1 -- 172.21.15.17:0/398385046 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0eb40ce6a0 con 0x7f0eb80ff730 2023-10-05T15:49:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.993+0000 7f0ea37fe700 1 -- 172.21.15.17:0/2580114173 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0010ec0 con 0x5585cd934260 2023-10-05T15:49:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.993+0000 7f0ea37fe700 1 -- 172.21.15.17:0/2580114173 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb0015070 con 0x5585cd934260 2023-10-05T15:49:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.993+0000 7f0ea37fe700 1 -- 172.21.15.17:0/2580114173 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0011440 con 0x5585cd934260 2023-10-05T15:49:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.994+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/2580114173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 msgr2=0x5585cd934680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:44.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.994+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd934680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000bde0 tx=0x7f0eb00106b0 comp rx=0 tx=0).stop 2023-10-05T15:49:44.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.996+0000 7f0ebd19b700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ea40a1650 0x7f0ea40a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/2580114173 shutdown_connections 2023-10-05T15:49:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd935ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd934680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/2580114173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934bc0 0x5585cd935480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/2580114173 >> 172.21.15.17:0/2580114173 conn(0x5585cd8a8260 msgr2=0x5585cd92f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/2580114173 shutdown_connections 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:44.999+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/2580114173 wait complete. 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.000+0000 7f0ed2dccb80 1 -- start start 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.000+0000 7f0ed2dccb80 1 Processor -- start 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd93e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934bc0 0x5585cd93e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd945610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd886e30 con 0x5585cd934260 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd823710 con 0x5585cd935a60 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd8233b0 con 0x5585cd934bc0 2023-10-05T15:49:45.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.001+0000 7f0ed2dccb80 10 client.0 _ll_register_callbacks cb 0x5585cd680800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd945610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd945610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56298/0 (socket says 172.21.15.17:56298) 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 -- 172.21.15.17:0/931113435 learned_addr learned my addr 172.21.15.17:0/931113435 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebc99a700 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934bc0 0x5585cd93e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 -- 172.21.15.17:0/931113435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934bc0 msgr2=0x5585cd93e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934bc0 0x5585cd93e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 -- 172.21.15.17:0/931113435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 msgr2=0x5585cd93e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd93e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.003+0000 7f0ebd99c700 1 -- 172.21.15.17:0/931113435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb000ba10 con 0x5585cd935a60 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.004+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd945610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005710 tx=0x7f0eb00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49ab0295cdeeef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:45.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.004+0000 7f0ea0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:49:45.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.004+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/931113435 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0004ca0 con 0x5585cd935a60 2023-10-05T15:49:45.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.004+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/931113435 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0eb0017070 con 0x5585cd935a60 2023-10-05T15:49:45.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.004+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585cd926f10 con 0x5585cd935a60 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.005+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/931113435 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eb0004e00 con 0x5585cd935a60 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.005+0000 7f0ebd19b700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ea40a1650 0x7f0ea40a3b10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4097b50 tx=0x7f0eb409b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.005+0000 7f0ed2dccb80 10 client.27059 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.005+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5585cd69ac60 con 0x5585cd935a60 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/931113435 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5585cd926f10 con 0x5585cd935a60 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/931113435 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0eb0011440 con 0x5585cd935a60 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ed2dccb80 10 client.27059 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ed2dccb80 10 client.27059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ed2dccb80 20 client.27059 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:45.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd95ad80 0x5585cd95d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ed2dccb80 4 client.27059 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:49:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585cd87fe10 con 0x5585cd95ad80 2023-10-05T15:49:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.006+0000 7f0ebc99a700 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd95ad80 0x5585cd95d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.008+0000 7f0ebc99a700 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd95ad80 0x5585cd95d1a0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ebfb0e03b225ea server_cookie=47a6bdb9894a1437 in_seq=0 out_seq=0 2023-10-05T15:49:45.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.008+0000 7f0ea0ff9700 10 client.27059 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:45.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.011+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/931113435 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5585cd87fe10 con 0x5585cd95ad80 2023-10-05T15:49:45.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.011+0000 7f0ea0ff9700 10 client.27059 handle_command_reply: tid=0 2023-10-05T15:49:45.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.011+0000 7f0ed2dccb80 1 client.27059 shutdown 2023-10-05T15:49:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.012+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 msgr2=0x5585cd945610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.012+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd945610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005710 tx=0x7f0eb00057f0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 shutdown_connections 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd95ad80 0x5585cd95d1a0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd935a60 0x5585cd945610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd93e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/931113435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934bc0 0x5585cd93e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 >> 172.21.15.17:0/931113435 conn(0x5585cd8a8260 msgr2=0x5585cd92ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ea0ff9700 0 client.27059 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:45.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.013+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 shutdown_connections 2023-10-05T15:49:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.014+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/931113435 wait complete. 2023-10-05T15:49:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.014+0000 7f0ed2dccb80 20 client.27059 trim_cache size 0 max 16384 2023-10-05T15:49:45.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.047+0000 7f0ed2dccb80 1 Processor -- start 2023-10-05T15:49:45.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.047+0000 7f0ed2dccb80 1 -- start start 2023-10-05T15:49:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd938970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd9455d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd935a60 0x5585cd938eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd707920 con 0x5585cd934260 2023-10-05T15:49:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd92e240 con 0x5585cd934bc0 2023-10-05T15:49:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd933e90 con 0x5585cd935a60 2023-10-05T15:49:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.048+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd938970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd938970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59912/0 (socket says 172.21.15.17:59912) 2023-10-05T15:49:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1640810391 learned_addr learned my addr 172.21.15.17:0/1640810391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd935a60 0x5585cd938eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebc99a700 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd9455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1640810391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 msgr2=0x5585cd9455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:45.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd9455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.049+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1640810391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 msgr2=0x5585cd938970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:45.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.050+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd938970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.050+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1640810391 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585cd6d8250 con 0x5585cd935a60 2023-10-05T15:49:45.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.050+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd935a60 0x5585cd938eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005a80 tx=0x7f0eb00058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d29678515f13e48f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.051+0000 7f0ea3fff700 1 -- 172.21.15.17:0/1640810391 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0011640 con 0x5585cd935a60 2023-10-05T15:49:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.051+0000 7f0ea3fff700 1 -- 172.21.15.17:0/1640810391 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb001f070 con 0x5585cd935a60 2023-10-05T15:49:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.051+0000 7f0ea3fff700 1 -- 172.21.15.17:0/1640810391 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0031890 con 0x5585cd935a60 2023-10-05T15:49:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1640810391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd935a60 msgr2=0x5585cd938eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd935a60 0x5585cd938eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005a80 tx=0x7f0eb00058e0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1640810391 shutdown_connections 2023-10-05T15:49:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd935a60 0x5585cd938eb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd934260 0x5585cd938970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1640810391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd9455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.052+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1640810391 >> 172.21.15.17:0/1640810391 conn(0x5585cd8a8260 msgr2=0x5585cd956f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.053+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1640810391 shutdown_connections 2023-10-05T15:49:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.053+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1640810391 wait complete. 2023-10-05T15:49:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.054+0000 7f0ed2dccb80 1 -- start start 2023-10-05T15:49:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.054+0000 7f0ed2dccb80 1 Processor -- start 2023-10-05T15:49:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd944f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd945440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd935a60 0x5585cd9419a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd942030 con 0x5585cd935a60 2023-10-05T15:49:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd9421a0 con 0x5585cd934bc0 2023-10-05T15:49:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585cd942360 con 0x5585cd934260 2023-10-05T15:49:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.055+0000 7f0ed2dccb80 10 client.0 _ll_register_callbacks cb 0x7f0eb000bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd944f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd944f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:41582/0 (socket says 172.21.15.17:41582) 2023-10-05T15:49:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1232739241 learned_addr learned my addr 172.21.15.17:0/1232739241 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 msgr2=0x5585cd945440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd945440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1232739241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd935a60 msgr2=0x5585cd9419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd935a60 0x5585cd9419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.056+0000 7f0ebd99c700 1 -- 172.21.15.17:0/1232739241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585cd69ac60 con 0x5585cd934260 2023-10-05T15:49:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.057+0000 7f0ebd99c700 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd944f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0010e40 tx=0x7f0eb0011b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2adddf27f0f57c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.057+0000 7f0ea0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:49:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.058+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/1232739241 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0043070 con 0x5585cd934260 2023-10-05T15:49:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.058+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/1232739241 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0eb0000e40 con 0x5585cd934260 2023-10-05T15:49:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.058+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0eb0015070 con 0x5585cd934260 2023-10-05T15:49:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.059+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/1232739241 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eb0011440 con 0x5585cd934260 2023-10-05T15:49:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.059+0000 7f0ed2dccb80 10 client.27025 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.059+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5585cd6b02b0 con 0x5585cd934260 2023-10-05T15:49:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/1232739241 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eb0015070 con 0x5585cd934260 2023-10-05T15:49:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/1232739241 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0eb0031a60 con 0x5585cd934260 2023-10-05T15:49:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ed2dccb80 10 client.27025 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ed2dccb80 10 client.27025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ed2dccb80 20 client.27025 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd9c0d50 0x5585cd9c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ed2dccb80 4 client.27025 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:49:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5585cd87fb30 con 0x5585cd9c0d50 2023-10-05T15:49:45.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.061+0000 7f0ebc99a700 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd9c0d50 0x5585cd9c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.062+0000 7f0ebc99a700 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd9c0d50 0x5585cd9c3170 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9034d080b6216de server_cookie=6afd2d5dfb67ed29 in_seq=0 out_seq=0 2023-10-05T15:49:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.062+0000 7f0ea0ff9700 10 client.27025 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.063+0000 7f0ea0ff9700 1 -- 172.21.15.17:0/1232739241 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5585cd87fb30 con 0x5585cd9c0d50 2023-10-05T15:49:45.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.063+0000 7f0ea0ff9700 10 client.27025 handle_command_reply: tid=0 2023-10-05T15:49:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.063+0000 7f0ed2dccb80 1 client.27025 shutdown 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 msgr2=0x5585cd944f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd944f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0010e40 tx=0x7f0eb0011b10 comp rx=0 tx=0).stop 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 shutdown_connections 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5585cd9c0d50 0x5585cd9c3170 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5585cd935a60 0x5585cd9419a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585cd934260 0x5585cd944f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 --2- 172.21.15.17:0/1232739241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5585cd934bc0 0x5585cd945440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 >> 172.21.15.17:0/1232739241 conn(0x5585cd8a8260 msgr2=0x5585cd938970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:45.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ea0ff9700 0 client.27025 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.064+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 shutdown_connections 2023-10-05T15:49:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.065+0000 7f0ed2dccb80 1 -- 172.21.15.17:0/1232739241 wait complete. 2023-10-05T15:49:45.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.065+0000 7f0ed2dccb80 20 client.27025 trim_cache size 0 max 16384 2023-10-05T15:49:45.068 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:49:45.068 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:49:45.068 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:49:45.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ea40a1650 msgr2=0x7f0ea40a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ea40a1650 0x7f0ea40a3b10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4097b50 tx=0x7f0eb409b4d0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 msgr2=0x7f0eb819d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb819d1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400b070 tx=0x7f0eb40126a0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 shutdown_connections 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0ea40a1650 0x7f0ea40a3b10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0eb8104a70 0x7f0eb81a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0eb80ff730 0x7f0eb819d1f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 --2- 172.21.15.17:0/398385046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eb81020a0 0x7f0eb819d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.067+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 >> 172.21.15.17:0/398385046 conn(0x7f0eb80fb330 msgr2=0x7f0eb8102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.068+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 shutdown_connections 2023-10-05T15:49:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:49:45.069+0000 7f0ebf3ff700 1 -- 172.21.15.17:0/398385046 wait complete. 2023-10-05T15:49:45.104 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:49:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:46 smithi167 ceph-mon[133366]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 10 MiB/s wr, 772 op/s 2023-10-05T15:49:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:46 smithi079 ceph-mon[132936]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 10 MiB/s wr, 772 op/s 2023-10-05T15:49:46.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:46 smithi017 ceph-mon[129107]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 10 MiB/s wr, 772 op/s 2023-10-05T15:49:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 670.0 s, 486.2 tps, lat 203.668 ms stddev 80.706 2023-10-05T15:49:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:47 smithi167 ceph-mon[133366]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 7.7 MiB/s wr, 593 op/s 2023-10-05T15:49:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:47 smithi079 ceph-mon[132936]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 7.7 MiB/s wr, 593 op/s 2023-10-05T15:49:48.452 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:47 smithi017 ceph-mon[129107]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 7.7 MiB/s wr, 593 op/s 2023-10-05T15:49:50.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:49 smithi167 ceph-mon[133366]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.0 MiB/s wr, 659 op/s 2023-10-05T15:49:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:49 smithi079 ceph-mon[132936]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.0 MiB/s wr, 659 op/s 2023-10-05T15:49:50.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:49 smithi017 ceph-mon[129107]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 9.0 MiB/s wr, 659 op/s 2023-10-05T15:49:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:51 smithi167 ceph-mon[133366]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.8 MiB/s wr, 681 op/s 2023-10-05T15:49:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:51 smithi079 ceph-mon[132936]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.8 MiB/s wr, 681 op/s 2023-10-05T15:49:52.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:51 smithi017 ceph-mon[129107]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.8 MiB/s wr, 681 op/s 2023-10-05T15:49:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 675.0 s, 566.6 tps, lat 178.119 ms stddev 65.548 2023-10-05T15:49:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.411+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2823186163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444104cc0 msgr2=0x7fb44410b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.411+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2823186163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444104cc0 0x7fb44410b570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0099c0 tx=0x7fb43c009cd0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.412+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2823186163 shutdown_connections 2023-10-05T15:49:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.412+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2823186163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444104cc0 0x7fb44410b570 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.412+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2823186163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb444103130 0x7fb444103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.412+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2823186163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 0x7fb444104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.412+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2823186163 >> 172.21.15.17:0/2823186163 conn(0x7fb4440fe6a0 msgr2=0x7fb444100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.413+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2823186163 shutdown_connections 2023-10-05T15:49:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.413+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2823186163 wait complete. 2023-10-05T15:49:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.414+0000 7fb44b3ff700 1 Processor -- start 2023-10-05T15:49:53.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.415+0000 7fb44b3ff700 1 -- start start 2023-10-05T15:49:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44b3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444103130 0x7fb44419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 0x7fb44419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44b3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb444104cc0 0x7fb44419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44419ee20 con 0x7fb444104320 2023-10-05T15:49:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44b3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44419ef90 con 0x7fb444103130 2023-10-05T15:49:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44b3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44419f150 con 0x7fb444104cc0 2023-10-05T15:49:53.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444103130 0x7fb44419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.416+0000 7fb44919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444103130 0x7fb44419d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56332/0 (socket says 172.21.15.17:56332) 2023-10-05T15:49:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.417+0000 7fb44919b700 1 -- 172.21.15.17:0/2717279824 learned_addr learned my addr 172.21.15.17:0/2717279824 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.417+0000 7fb44899a700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 0x7fb44419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.418+0000 7fb44999c700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb444104cc0 0x7fb44419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.418+0000 7fb44899a700 1 -- 172.21.15.17:0/2717279824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb444104cc0 msgr2=0x7fb44419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.418+0000 7fb44899a700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb444104cc0 0x7fb44419e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.418+0000 7fb44899a700 1 -- 172.21.15.17:0/2717279824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444103130 msgr2=0x7fb44419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.418+0000 7fb44899a700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444103130 0x7fb44419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.418+0000 7fb44899a700 1 -- 172.21.15.17:0/2717279824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0095f0 con 0x7fb444104320 2023-10-05T15:49:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.419+0000 7fb44899a700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 0x7fb44419d940 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb43800b450 tx=0x7fb43800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.419+0000 7fb4367fc700 1 -- 172.21.15.17:0/2717279824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438011830 con 0x7fb444104320 2023-10-05T15:49:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.419+0000 7fb4367fc700 1 -- 172.21.15.17:0/2717279824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb438011e20 con 0x7fb444104320 2023-10-05T15:49:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.419+0000 7fb4367fc700 1 -- 172.21.15.17:0/2717279824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438010e60 con 0x7fb444104320 2023-10-05T15:49:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.419+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44419f430 con 0x7fb444104320 2023-10-05T15:49:53.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.420+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4441a5bf0 con 0x7fb444104320 2023-10-05T15:49:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.427+0000 7fb45ec53b80 1 Processor -- start 2023-10-05T15:49:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.428+0000 7fb4367fc700 1 -- 172.21.15.17:0/2717279824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb438011990 con 0x7fb444104320 2023-10-05T15:49:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.430+0000 7fb45ec53b80 1 -- start start 2023-10-05T15:49:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.432+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40000ec0 0x55cc400012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.432+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 0x55cc40002450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.432+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40002990 0x55cc40009220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.432+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3ff69400 con 0x55cc40001fd0 2023-10-05T15:49:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.432+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3ff5abc0 con 0x55cc40002990 2023-10-05T15:49:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.432+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3ff584e0 con 0x55cc40000ec0 2023-10-05T15:49:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.433+0000 7fb44919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 0x55cc40002450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.433+0000 7fb44919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 0x55cc40002450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59964/0 (socket says 172.21.15.17:59964) 2023-10-05T15:49:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.433+0000 7fb44919b700 1 -- 172.21.15.17:0/2743568940 learned_addr learned my addr 172.21.15.17:0/2743568940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.434+0000 7fb4367fc700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb4300a15d0 0x7fb4300a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb4367fc700 1 -- 172.21.15.17:0/2717279824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb4380ccb10 con 0x7fb444104320 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb44899a700 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40002990 0x55cc40009220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb44919b700 1 -- 172.21.15.17:0/2743568940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40000ec0 msgr2=0x55cc400012e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb44919b700 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40000ec0 0x55cc400012e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb44919b700 1 -- 172.21.15.17:0/2743568940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40002990 msgr2=0x55cc40009220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb44919b700 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40002990 0x55cc40009220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.435+0000 7fb44919b700 1 -- 172.21.15.17:0/2743568940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc3fd7ed80 con 0x55cc40001fd0 2023-10-05T15:49:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.436+0000 7fb44999c700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb4300a15d0 0x7fb4300a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.436+0000 7fb44919b700 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 0x55cc40002450 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb4400073f0 tx=0x7fb440007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b15c83679f2223 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:53.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.437+0000 7fb44999c700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb4300a15d0 0x7fb4300a3a90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009990 tx=0x7fb43c00b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:53.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.438+0000 7fb42f7fe700 1 -- 172.21.15.17:0/2743568940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440014600 con 0x55cc40001fd0 2023-10-05T15:49:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.438+0000 7fb42f7fe700 1 -- 172.21.15.17:0/2743568940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb440014bf0 con 0x55cc40001fd0 2023-10-05T15:49:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.438+0000 7fb42f7fe700 1 -- 172.21.15.17:0/2743568940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440013c50 con 0x55cc40001fd0 2023-10-05T15:49:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.439+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2743568940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 msgr2=0x55cc40002450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.439+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 0x55cc40002450 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb4400073f0 tx=0x7fb440007700 comp rx=0 tx=0).stop 2023-10-05T15:49:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2743568940 shutdown_connections 2023-10-05T15:49:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40002990 0x55cc40009220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40000ec0 0x55cc400012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2743568940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40001fd0 0x55cc40002450 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2743568940 >> 172.21.15.17:0/2743568940 conn(0x55cc3ff75200 msgr2=0x55cc3fffbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2743568940 shutdown_connections 2023-10-05T15:49:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.440+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2743568940 wait complete. 2023-10-05T15:49:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.441+0000 7fb45ec53b80 1 -- start start 2023-10-05T15:49:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.441+0000 7fb45ec53b80 1 Processor -- start 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40000ec0 0x55cc4000ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 0x55cc4000b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40002990 0x55cc400121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3ff53dd0 con 0x55cc40000ec0 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3fef06b0 con 0x55cc40001fd0 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3fef0350 con 0x55cc40002990 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.442+0000 7fb45ec53b80 10 client.0 _ll_register_callbacks cb 0x55cc3fd4d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.443+0000 7fb44899a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 0x55cc4000b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.443+0000 7fb44899a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 0x55cc4000b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56346/0 (socket says 172.21.15.17:56346) 2023-10-05T15:49:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.443+0000 7fb44899a700 1 -- 172.21.15.17:0/728756860 learned_addr learned my addr 172.21.15.17:0/728756860 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.443+0000 7fb44919b700 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40000ec0 0x55cc4000ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb44899a700 1 -- 172.21.15.17:0/728756860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40002990 msgr2=0x55cc400121d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb44899a700 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40002990 0x55cc400121d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb44899a700 1 -- 172.21.15.17:0/728756860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40000ec0 msgr2=0x55cc4000ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb44899a700 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40000ec0 0x55cc4000ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb44899a700 1 -- 172.21.15.17:0/728756860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb440009cc0 con 0x55cc40001fd0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb44899a700 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 0x55cc4000b190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb438000c00 tx=0x7fb438010650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330564a3820f7965 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb42cff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb42cff9700 1 -- 172.21.15.17:0/728756860 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438099a30 con 0x55cc40001fd0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.444+0000 7fb42cff9700 1 -- 172.21.15.17:0/728756860 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb43809db80 con 0x55cc40001fd0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.445+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc3fff3d50 con 0x55cc40001fd0 2023-10-05T15:49:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.445+0000 7fb42cff9700 1 -- 172.21.15.17:0/728756860 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4380a1dc0 con 0x55cc40001fd0 2023-10-05T15:49:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.445+0000 7fb45ec53b80 10 client.27074 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.445+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55cc3fd67c00 con 0x55cc40001fd0 2023-10-05T15:49:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.445+0000 7fb42cff9700 1 -- 172.21.15.17:0/728756860 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cc3fff3d50 con 0x55cc40001fd0 2023-10-05T15:49:53.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.446+0000 7fb42cff9700 1 -- 172.21.15.17:0/728756860 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb438098f20 con 0x55cc40001fd0 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.446+0000 7fb45ec53b80 10 client.27074 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.446+0000 7fb45ec53b80 10 client.27074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.446+0000 7fb45ec53b80 20 client.27074 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.447+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc400279f0 0x55cc40029e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.447+0000 7fb45ec53b80 4 client.27074 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.447+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc3ff4cdb0 con 0x55cc400279f0 2023-10-05T15:49:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.447+0000 7fb44919b700 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc400279f0 0x55cc40029e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.448+0000 7fb44919b700 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc400279f0 0x55cc40029e10 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c913787b1661b46 server_cookie=7beb35422e403414 in_seq=0 out_seq=0 2023-10-05T15:49:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.449+0000 7fb42cff9700 10 client.27074 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.449+0000 7fb42cff9700 1 -- 172.21.15.17:0/728756860 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc3ff4cdb0 con 0x55cc400279f0 2023-10-05T15:49:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.449+0000 7fb42cff9700 10 client.27074 handle_command_reply: tid=0 2023-10-05T15:49:53.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.450+0000 7fb45ec53b80 1 client.27074 shutdown 2023-10-05T15:49:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.450+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 msgr2=0x55cc4000b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.450+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 0x55cc4000b190 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb438000c00 tx=0x7fb438010650 comp rx=0 tx=0).stop 2023-10-05T15:49:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 shutdown_connections 2023-10-05T15:49:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc400279f0 0x55cc40029e10 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40002990 0x55cc400121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40000ec0 0x55cc4000ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/728756860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40001fd0 0x55cc4000b190 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 >> 172.21.15.17:0/728756860 conn(0x55cc3ff75200 msgr2=0x55cc3fffb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb42cff9700 0 client.27074 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 shutdown_connections 2023-10-05T15:49:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.451+0000 7fb45ec53b80 1 -- 172.21.15.17:0/728756860 wait complete. 2023-10-05T15:49:53.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.452+0000 7fb45ec53b80 20 client.27074 trim_cache size 0 max 16384 2023-10-05T15:49:53.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.481+0000 7fb45ec53b80 1 Processor -- start 2023-10-05T15:49:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.481+0000 7fb45ec53b80 1 -- start start 2023-10-05T15:49:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc3fffb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc40012190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40029a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3fdd48c0 con 0x55cc40002990 2023-10-05T15:49:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4000bb50 con 0x55cc40000ec0 2023-10-05T15:49:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc4000a100 con 0x55cc40001fd0 2023-10-05T15:49:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb44899a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc40012190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb44899a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc40012190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:41634/0 (socket says 172.21.15.17:41634) 2023-10-05T15:49:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.482+0000 7fb44899a700 1 -- 172.21.15.17:0/909816264 learned_addr learned my addr 172.21.15.17:0/909816264 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44919b700 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc3fffb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44899a700 1 -- 172.21.15.17:0/909816264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 msgr2=0x55cc3fffb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44899a700 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc3fffb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44899a700 1 -- 172.21.15.17:0/909816264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 msgr2=0x55cc40029a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44899a700 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40029a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44899a700 1 -- 172.21.15.17:0/909816264 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc3fda51f0 con 0x55cc40001fd0 2023-10-05T15:49:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.483+0000 7fb44919b700 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc3fffb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:49:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.484+0000 7fb44899a700 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc40012190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb4380999c0 tx=0x7fb438097fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f19efada33c763 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.484+0000 7fb42ffff700 1 -- 172.21.15.17:0/909816264 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43809db80 con 0x55cc40001fd0 2023-10-05T15:49:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.484+0000 7fb42ffff700 1 -- 172.21.15.17:0/909816264 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb438099a30 con 0x55cc40001fd0 2023-10-05T15:49:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.484+0000 7fb42ffff700 1 -- 172.21.15.17:0/909816264 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380a19b0 con 0x55cc40001fd0 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.485+0000 7fb45ec53b80 1 -- 172.21.15.17:0/909816264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 msgr2=0x55cc40012190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.485+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc40012190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb4380999c0 tx=0x7fb438097fe0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.486+0000 7fb45ec53b80 1 -- 172.21.15.17:0/909816264 shutdown_connections 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.486+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40029a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.486+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc3fffb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.486+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/909816264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc40012190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.486+0000 7fb45ec53b80 1 -- 172.21.15.17:0/909816264 >> 172.21.15.17:0/909816264 conn(0x55cc3ff75200 msgr2=0x55cc400098d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.487+0000 7fb45ec53b80 1 -- 172.21.15.17:0/909816264 shutdown_connections 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.487+0000 7fb45ec53b80 1 -- 172.21.15.17:0/909816264 wait complete. 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.487+0000 7fb45ec53b80 1 -- start start 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 Processor -- start 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc4000f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc4000fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40010e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc400113b0 con 0x55cc40002990 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc40011520 con 0x55cc40000ec0 2023-10-05T15:49:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc400116e0 con 0x55cc40001fd0 2023-10-05T15:49:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.488+0000 7fb45ec53b80 10 client.0 _ll_register_callbacks cb 0x7fb438099610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:49:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.489+0000 7fb44919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc4000f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.489+0000 7fb44919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc4000f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56372/0 (socket says 172.21.15.17:56372) 2023-10-05T15:49:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.489+0000 7fb44919b700 1 -- 172.21.15.17:0/2214453883 learned_addr learned my addr 172.21.15.17:0/2214453883 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:49:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.489+0000 7fb44999c700 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40010e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb44999c700 1 -- 172.21.15.17:0/2214453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 msgr2=0x55cc4000fe60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:49:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb44999c700 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc4000fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb44999c700 1 -- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 msgr2=0x55cc4000f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb44999c700 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc4000f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb44999c700 1 -- 172.21.15.17:0/2214453883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc3fd7ed80 con 0x55cc40002990 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb44999c700 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40010e70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009fd0 tx=0x7fb43c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf22f43d6354c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.491+0000 7fb42cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.492+0000 7fb42cff9700 1 -- 172.21.15.17:0/2214453883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c01e070 con 0x55cc40002990 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.492+0000 7fb42cff9700 1 -- 172.21.15.17:0/2214453883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb43c003aa0 con 0x55cc40002990 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.493+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb440014bf0 con 0x55cc40002990 2023-10-05T15:49:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.494+0000 7fb42cff9700 1 -- 172.21.15.17:0/2214453883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb43c003ca0 con 0x55cc40002990 2023-10-05T15:49:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.494+0000 7fb45ec53b80 10 client.17067 fetch_fsmap learned FSMap version 43 2023-10-05T15:49:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.494+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55cc3fd67c00 con 0x55cc40002990 2023-10-05T15:49:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb42cff9700 1 -- 172.21.15.17:0/2214453883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb440014bf0 con 0x55cc40002990 2023-10-05T15:49:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb42cff9700 1 -- 172.21.15.17:0/2214453883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb43c004c10 con 0x55cc40002990 2023-10-05T15:49:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb45ec53b80 10 client.17067 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:49:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb45ec53b80 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:49:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb45ec53b80 20 client.17067 populate_metadata read hostname 'smithi017' 2023-10-05T15:49:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc4007c270 0x55cc4007e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:49:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb45ec53b80 4 client.17067 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:49:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.495+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc3ff4cad0 con 0x55cc4007c270 2023-10-05T15:49:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.496+0000 7fb44919b700 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc4007c270 0x55cc4007e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:49:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.499+0000 7fb44919b700 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc4007c270 0x55cc4007e690 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab46b456b0ce5e server_cookie=a41fbd08aeeab37f in_seq=0 out_seq=0 2023-10-05T15:49:53.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.501+0000 7fb42cff9700 10 client.17067 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.527+0000 7fb42cff9700 1 -- 172.21.15.17:0/2214453883 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc3ff4cad0 con 0x55cc4007c270 2023-10-05T15:49:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.527+0000 7fb42cff9700 10 client.17067 handle_command_reply: tid=0 2023-10-05T15:49:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.527+0000 7fb45ec53b80 1 client.17067 shutdown 2023-10-05T15:49:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.529+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 msgr2=0x55cc40010e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.529+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40010e70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009fd0 tx=0x7fb43c005fd0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 shutdown_connections 2023-10-05T15:49:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55cc4007c270 0x55cc4007e690 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cc40002990 0x55cc40010e70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc40000ec0 0x55cc4000f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb45ec53b80 1 --2- 172.21.15.17:0/2214453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cc40001fd0 0x55cc4000fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 >> 172.21.15.17:0/2214453883 conn(0x55cc3ff75200 msgr2=0x55cc3fffb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.530+0000 7fb42cff9700 0 client.17067 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:49:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.534+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 shutdown_connections 2023-10-05T15:49:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.535+0000 7fb45ec53b80 1 -- 172.21.15.17:0/2214453883 wait complete. 2023-10-05T15:49:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.536+0000 7fb45ec53b80 20 client.17067 trim_cache size 0 max 16384 2023-10-05T15:49:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:49:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:49:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:49:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:49:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.537+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb4300a15d0 msgr2=0x7fb4300a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.537+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb4300a15d0 0x7fb4300a3a90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009990 tx=0x7fb43c00b540 comp rx=0 tx=0).stop 2023-10-05T15:49:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.537+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 msgr2=0x7fb44419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:49:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.537+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 0x7fb44419d940 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb43800b450 tx=0x7fb43800b810 comp rx=0 tx=0).stop 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 shutdown_connections 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb4300a15d0 0x7fb4300a3a90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb444104cc0 0x7fb44419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb444103130 0x7fb44419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 --2- 172.21.15.17:0/2717279824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb444104320 0x7fb44419d940 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 >> 172.21.15.17:0/2717279824 conn(0x7fb4440fe6a0 msgr2=0x7fb444078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.538+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 shutdown_connections 2023-10-05T15:49:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:49:53.539+0000 7fb44b3ff700 1 -- 172.21.15.17:0/2717279824 wait complete. 2023-10-05T15:49:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:53 smithi167 ceph-mon[133366]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.8 MiB/s wr, 547 op/s 2023-10-05T15:49:54.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:53 smithi079 ceph-mon[132936]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.8 MiB/s wr, 547 op/s 2023-10-05T15:49:54.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:53 smithi017 ceph-mon[129107]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.8 MiB/s wr, 547 op/s 2023-10-05T15:49:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:55 smithi167 ceph-mon[133366]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 9.3 MiB/s wr, 681 op/s 2023-10-05T15:49:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:55 smithi079 ceph-mon[132936]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 9.3 MiB/s wr, 681 op/s 2023-10-05T15:49:56.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:55 smithi017 ceph-mon[129107]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 9.3 MiB/s wr, 681 op/s 2023-10-05T15:49:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 680.0 s, 489.0 tps, lat 122.154 ms stddev 42.338 2023-10-05T15:49:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:57 smithi167 ceph-mon[133366]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 496 op/s 2023-10-05T15:49:58.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:57 smithi079 ceph-mon[132936]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 496 op/s 2023-10-05T15:49:58.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:57 smithi017 ceph-mon[129107]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 496 op/s 2023-10-05T15:50:00.335 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:49:59 smithi167 ceph-mon[133366]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.8 MiB/s wr, 586 op/s 2023-10-05T15:50:00.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:49:59 smithi079 ceph-mon[132936]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.8 MiB/s wr, 586 op/s 2023-10-05T15:50:00.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:49:59 smithi017 ceph-mon[129107]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.8 MiB/s wr, 586 op/s 2023-10-05T15:50:01.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:00 smithi167 ceph-mon[133366]: overall HEALTH_OK 2023-10-05T15:50:01.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:00 smithi079 ceph-mon[132936]: overall HEALTH_OK 2023-10-05T15:50:01.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:00 smithi017 ceph-mon[129107]: overall HEALTH_OK 2023-10-05T15:50:02.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:01 smithi167 ceph-mon[133366]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.6 MiB/s wr, 606 op/s 2023-10-05T15:50:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:01 smithi079 ceph-mon[132936]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.6 MiB/s wr, 606 op/s 2023-10-05T15:50:02.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:01 smithi017 ceph-mon[129107]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.6 MiB/s wr, 606 op/s 2023-10-05T15:50:03.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 685.0 s, 495.1 tps, lat 121.148 ms stddev 45.996 2023-10-05T15:50:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:04 smithi167 ceph-mon[133366]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.6 MiB/s wr, 505 op/s 2023-10-05T15:50:04.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:04 smithi079 ceph-mon[132936]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.6 MiB/s wr, 505 op/s 2023-10-05T15:50:04.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:04 smithi017 ceph-mon[129107]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.6 MiB/s wr, 505 op/s 2023-10-05T15:50:06.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:06 smithi167 ceph-mon[133366]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.0 MiB/s wr, 687 op/s 2023-10-05T15:50:06.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:06 smithi079 ceph-mon[132936]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.0 MiB/s wr, 687 op/s 2023-10-05T15:50:06.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:06 smithi017 ceph-mon[129107]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.0 MiB/s wr, 687 op/s 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 -- 172.21.15.17:0/933732713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe8069c40 msgr2=0x7f4fe8108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/933732713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe8069c40 0x7f4fe8108120 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009990 tx=0x7f4fe0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 -- 172.21.15.17:0/933732713 shutdown_connections 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/933732713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe8108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/933732713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe8069c40 0x7f4fe8108120 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/933732713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fe810bad0 0x7f4fe810dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.808+0000 7f4fee5ff700 1 -- 172.21.15.17:0/933732713 >> 172.21.15.17:0/933732713 conn(0x7f4fe806e0b0 msgr2=0x7f4fe8070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.810+0000 7f4fee5ff700 1 -- 172.21.15.17:0/933732713 shutdown_connections 2023-10-05T15:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.810+0000 7f4fee5ff700 1 -- 172.21.15.17:0/933732713 wait complete. 2023-10-05T15:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.811+0000 7f4fee5ff700 1 Processor -- start 2023-10-05T15:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.812+0000 7f4fee5ff700 1 -- start start 2023-10-05T15:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.812+0000 7f4fee5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fe8069c40 0x7f4fe81a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.812+0000 7f4fee5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe81a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe81a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe81a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:55194/0 (socket says 172.21.15.17:55194) 2023-10-05T15:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fee5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe810bad0 0x7f4fe81a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fee5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe81a75d0 con 0x7f4fe810bad0 2023-10-05T15:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fee5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe81a7740 con 0x7f4fe8069c40 2023-10-05T15:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fee5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe81a7900 con 0x7f4fe8108840 2023-10-05T15:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.813+0000 7f4fe77fe700 1 -- 172.21.15.17:0/3495111900 learned_addr learned my addr 172.21.15.17:0/3495111900 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.814+0000 7f4fe77fe700 1 -- 172.21.15.17:0/3495111900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fe8069c40 msgr2=0x7f4fe81a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.814+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fe8069c40 0x7f4fe81a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.814+0000 7f4fe77fe700 1 -- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe810bad0 msgr2=0x7f4fe81a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.814+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe810bad0 0x7f4fe81a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.814+0000 7f4fe77fe700 1 -- 172.21.15.17:0/3495111900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe00095f0 con 0x7f4fe8108840 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.814+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe81a60f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000b550 tx=0x7f4fd000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.815+0000 7f4fe57fa700 1 -- 172.21.15.17:0/3495111900 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0011830 con 0x7f4fe8108840 2023-10-05T15:50:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.815+0000 7f4fe57fa700 1 -- 172.21.15.17:0/3495111900 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fd0011e20 con 0x7f4fe8108840 2023-10-05T15:50:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.815+0000 7f4fe57fa700 1 -- 172.21.15.17:0/3495111900 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0010df0 con 0x7f4fe8108840 2023-10-05T15:50:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.815+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe81a7be0 con 0x7f4fe8108840 2023-10-05T15:50:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.815+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe81ae3a0 con 0x7f4fe8108840 2023-10-05T15:50:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.821+0000 7f500201db80 1 Processor -- start 2023-10-05T15:50:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.821+0000 7f500201db80 1 -- start start 2023-10-05T15:50:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.822+0000 7f500201db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 0x5643b8bcc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.822+0000 7f500201db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bcd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.822+0000 7f500201db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bd4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.822+0000 7f500201db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8b34400 con 0x5643b8bcbec0 2023-10-05T15:50:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.822+0000 7f500201db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8b25bc0 con 0x5643b8bccfd0 2023-10-05T15:50:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.822+0000 7f500201db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8b234e0 con 0x5643b8bcd990 2023-10-05T15:50:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.823+0000 7f4fe7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bcd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.823+0000 7f4fecb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 0x5643b8bcc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.823+0000 7f4fecb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 0x5643b8bcc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56700/0 (socket says 172.21.15.17:56700) 2023-10-05T15:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.823+0000 7f4fecb9c700 1 -- 172.21.15.17:0/1211570717 learned_addr learned my addr 172.21.15.17:0/1211570717 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.824+0000 7f4fecb9c700 1 -- 172.21.15.17:0/1211570717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 msgr2=0x5643b8bd4220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.824+0000 7f4fecb9c700 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bd4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.824+0000 7f4fecb9c700 1 -- 172.21.15.17:0/1211570717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 msgr2=0x5643b8bcd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.824+0000 7f4fecb9c700 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bcd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.824+0000 7f4fecb9c700 1 -- 172.21.15.17:0/1211570717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643b8949d80 con 0x5643b8bcbec0 2023-10-05T15:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.825+0000 7f4fe57fa700 1 -- 172.21.15.17:0/3495111900 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4fd0011990 con 0x7f4fe8108840 2023-10-05T15:50:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.827+0000 7f4fe57fa700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4fd40a1680 0x7f4fd40a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.828+0000 7f4fe57fa700 1 -- 172.21.15.17:0/3495111900 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4fd00cc870 con 0x7f4fe8108840 2023-10-05T15:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.832+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4fd40a1680 0x7f4fd40a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.832+0000 7f4fecb9c700 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 0x5643b8bcc2e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009d00 tx=0x7f4fd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bea3d4a4f13e9db server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.833+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4fd40a1680 0x7f4fd40a3b40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000b5c0 tx=0x7f4fe0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.833+0000 7f4fde7fc700 1 -- 172.21.15.17:0/1211570717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800e070 con 0x5643b8bcbec0 2023-10-05T15:50:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.833+0000 7f4fde7fc700 1 -- 172.21.15.17:0/1211570717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fd8009830 con 0x5643b8bcbec0 2023-10-05T15:50:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.833+0000 7f4fde7fc700 1 -- 172.21.15.17:0/1211570717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8012d30 con 0x5643b8bcbec0 2023-10-05T15:50:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.834+0000 7f500201db80 1 -- 172.21.15.17:0/1211570717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 msgr2=0x5643b8bcc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.834+0000 7f500201db80 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 0x5643b8bcc2e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009d00 tx=0x7f4fd800b330 comp rx=0 tx=0).stop 2023-10-05T15:50:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.834+0000 7f500201db80 1 -- 172.21.15.17:0/1211570717 shutdown_connections 2023-10-05T15:50:06.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.835+0000 7f500201db80 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bd4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.835+0000 7f500201db80 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcbec0 0x5643b8bcc2e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.835+0000 7f500201db80 1 --2- 172.21.15.17:0/1211570717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bcd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.835+0000 7f500201db80 1 -- 172.21.15.17:0/1211570717 >> 172.21.15.17:0/1211570717 conn(0x5643b8b40200 msgr2=0x5643b8bc6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.835+0000 7f500201db80 1 -- 172.21.15.17:0/1211570717 shutdown_connections 2023-10-05T15:50:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.835+0000 7f500201db80 1 -- 172.21.15.17:0/1211570717 wait complete. 2023-10-05T15:50:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.836+0000 7f500201db80 1 -- start start 2023-10-05T15:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.836+0000 7f500201db80 1 Processor -- start 2023-10-05T15:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 0x5643b8bd5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bd61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcd990 0x5643b8bdd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8b1edd0 con 0x5643b8bcd990 2023-10-05T15:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8abb6b0 con 0x5643b8bccfd0 2023-10-05T15:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8abb350 con 0x5643b8bcbec0 2023-10-05T15:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.837+0000 7f500201db80 10 client.0 _ll_register_callbacks cb 0x5643b89187a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.838+0000 7f4fe7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 0x5643b8bd5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.838+0000 7f4fe7fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 0x5643b8bd5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:55198/0 (socket says 172.21.15.17:55198) 2023-10-05T15:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.838+0000 7f4fe7fff700 1 -- 172.21.15.17:0/3735226029 learned_addr learned my addr 172.21.15.17:0/3735226029 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.838+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bd61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.839+0000 7f4fe7fff700 1 -- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 msgr2=0x5643b8bd61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.839+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bd61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.839+0000 7f4fe7fff700 1 -- 172.21.15.17:0/3735226029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcd990 msgr2=0x5643b8bdd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.839+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcd990 0x5643b8bdd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.839+0000 7f4fe7fff700 1 -- 172.21.15.17:0/3735226029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80099b0 con 0x5643b8bcbec0 2023-10-05T15:50:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.839+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 0x5643b8bd5c70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0003880 tx=0x7f4fe0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8ec3f3c58e54b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.840+0000 7f4fc77fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.841+0000 7f4fc77fe700 1 -- 172.21.15.17:0/3735226029 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe002a070 con 0x5643b8bcbec0 2023-10-05T15:50:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.841+0000 7f4fc77fe700 1 -- 172.21.15.17:0/3735226029 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4fe002f470 con 0x5643b8bcbec0 2023-10-05T15:50:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.841+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643b8b17db0 con 0x5643b8bcbec0 2023-10-05T15:50:06.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.842+0000 7f4fc77fe700 1 -- 172.21.15.17:0/3735226029 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fe002f630 con 0x5643b8bcbec0 2023-10-05T15:50:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.845+0000 7f500201db80 10 client.27034 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.845+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5643b8932c00 con 0x5643b8bcbec0 2023-10-05T15:50:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.846+0000 7f4fc77fe700 1 -- 172.21.15.17:0/3735226029 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5643b8b17db0 con 0x5643b8bcbec0 2023-10-05T15:50:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.846+0000 7f4fc77fe700 1 -- 172.21.15.17:0/3735226029 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4fe0037070 con 0x5643b8bcbec0 2023-10-05T15:50:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.846+0000 7f500201db80 10 client.27034 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.846+0000 7f500201db80 10 client.27034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.847+0000 7f500201db80 20 client.27034 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.847+0000 7f500201db80 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8bf2a90 0x5643b8bf4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.847+0000 7f500201db80 4 client.27034 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:50:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.847+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643b8b17ad0 con 0x5643b8bf2a90 2023-10-05T15:50:06.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.847+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8bf2a90 0x5643b8bf4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.849+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8bf2a90 0x5643b8bf4eb0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d19bf4b1654ef74e server_cookie=41de7661e0e366d8 in_seq=0 out_seq=0 2023-10-05T15:50:06.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.849+0000 7f4fc77fe700 10 client.27034 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:06.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.851+0000 7f4fc77fe700 1 -- 172.21.15.17:0/3735226029 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5643b8b17ad0 con 0x5643b8bf2a90 2023-10-05T15:50:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.851+0000 7f4fc77fe700 10 client.27034 handle_command_reply: tid=0 2023-10-05T15:50:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.851+0000 7f500201db80 1 client.27034 shutdown 2023-10-05T15:50:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 msgr2=0x5643b8bd5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 0x5643b8bd5c70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0003880 tx=0x7f4fe0009310 comp rx=0 tx=0).stop 2023-10-05T15:50:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 shutdown_connections 2023-10-05T15:50:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8bf2a90 0x5643b8bf4eb0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bcd990 0x5643b8bdd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcbec0 0x5643b8bd5c70 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0003880 tx=0x7f4fe0009310 comp rx=0 tx=0).stop 2023-10-05T15:50:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.856+0000 7f500201db80 1 --2- 172.21.15.17:0/3735226029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bd61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.857+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 >> 172.21.15.17:0/3735226029 conn(0x5643b8b40200 msgr2=0x5643b8bc6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.857+0000 7f4fc77fe700 0 client.27034 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.857+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 shutdown_connections 2023-10-05T15:50:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.857+0000 7f500201db80 1 -- 172.21.15.17:0/3735226029 wait complete. 2023-10-05T15:50:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.862+0000 7f500201db80 20 client.27034 trim_cache size 0 max 16384 2023-10-05T15:50:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.892+0000 7f500201db80 1 Processor -- start 2023-10-05T15:50:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.892+0000 7f500201db80 1 -- start start 2023-10-05T15:50:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f500201db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bccfd0 0x5643b8bd3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f500201db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 0x5643b8bdd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f500201db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bc69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f500201db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b899f8c0 con 0x5643b8bc2f00 2023-10-05T15:50:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f500201db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8bd4f90 con 0x5643b8bcd990 2023-10-05T15:50:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f500201db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8bc82f0 con 0x5643b8bccfd0 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 0x5643b8bdd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 0x5643b8bdd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44322/0 (socket says 172.21.15.17:44322) 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.893+0000 7f4fe77fe700 1 -- 172.21.15.17:0/2199311821 learned_addr learned my addr 172.21.15.17:0/2199311821 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fecb9c700 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bc69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bccfd0 0x5643b8bd3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe77fe700 1 -- 172.21.15.17:0/2199311821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bccfd0 msgr2=0x5643b8bd3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bccfd0 0x5643b8bd3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe77fe700 1 -- 172.21.15.17:0/2199311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 msgr2=0x5643b8bc69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bc69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe77fe700 1 -- 172.21.15.17:0/2199311821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643b89701f0 con 0x5643b8bcd990 2023-10-05T15:50:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.894+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 0x5643b8bdd180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0096200 tx=0x7f4fd00c9e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a11093f40aa946f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.895+0000 7f4fdeffd700 1 -- 172.21.15.17:0/2199311821 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00104f0 con 0x5643b8bcd990 2023-10-05T15:50:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.895+0000 7f4fdeffd700 1 -- 172.21.15.17:0/2199311821 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fd0011c40 con 0x5643b8bcd990 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.895+0000 7f4fdeffd700 1 -- 172.21.15.17:0/2199311821 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a1b20 con 0x5643b8bcd990 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 -- 172.21.15.17:0/2199311821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 msgr2=0x5643b8bdd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 0x5643b8bdd180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0096200 tx=0x7f4fd00c9e40 comp rx=0 tx=0).stop 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 -- 172.21.15.17:0/2199311821 shutdown_connections 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bc69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bccfd0 0x5643b8bd3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 --2- 172.21.15.17:0/2199311821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bcd990 0x5643b8bdd180 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 -- 172.21.15.17:0/2199311821 >> 172.21.15.17:0/2199311821 conn(0x5643b8b40200 msgr2=0x5643b8bc78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 -- 172.21.15.17:0/2199311821 shutdown_connections 2023-10-05T15:50:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.896+0000 7f500201db80 1 -- 172.21.15.17:0/2199311821 wait complete. 2023-10-05T15:50:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.897+0000 7f500201db80 1 -- start start 2023-10-05T15:50:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.897+0000 7f500201db80 1 Processor -- start 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bdcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bdd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bdb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8bdb7c0 con 0x5643b8bc2f00 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8bdb930 con 0x5643b8bccfd0 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643b8bdbaf0 con 0x5643b8bcd990 2023-10-05T15:50:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.898+0000 7f500201db80 10 client.0 _ll_register_callbacks cb 0x5643b89187a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bdd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bdd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44332/0 (socket says 172.21.15.17:44332) 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 -- 172.21.15.17:0/1198289482 learned_addr learned my addr 172.21.15.17:0/1198289482 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fecb9c700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bdb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bdcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 -- 172.21.15.17:0/1198289482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 msgr2=0x5643b8bdb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bdb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 -- 172.21.15.17:0/1198289482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 msgr2=0x5643b8bdcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bdcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.899+0000 7f4fe77fe700 1 -- 172.21.15.17:0/1198289482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe81ae3a0 con 0x5643b8bccfd0 2023-10-05T15:50:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.901+0000 7f4fe77fe700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bdd010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0099490 tx=0x7f4fd00105a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c80447ec021dd22 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.901+0000 7f4fc77fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:50:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.901+0000 7f4fc77fe700 1 -- 172.21.15.17:0/1198289482 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0099e90 con 0x5643b8bccfd0 2023-10-05T15:50:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.901+0000 7f4fc77fe700 1 -- 172.21.15.17:0/1198289482 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4fd00a1b20 con 0x5643b8bccfd0 2023-10-05T15:50:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.902+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643b8bbed50 con 0x5643b8bccfd0 2023-10-05T15:50:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.902+0000 7f4fc77fe700 1 -- 172.21.15.17:0/1198289482 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fd0097b30 con 0x5643b8bccfd0 2023-10-05T15:50:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.902+0000 7f500201db80 10 client.27089 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.902+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5643b8948250 con 0x5643b8bccfd0 2023-10-05T15:50:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.903+0000 7f4fc77fe700 1 -- 172.21.15.17:0/1198289482 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5643b8bbed50 con 0x5643b8bccfd0 2023-10-05T15:50:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.903+0000 7f4fc77fe700 1 -- 172.21.15.17:0/1198289482 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4fd0098cf0 con 0x5643b8bccfd0 2023-10-05T15:50:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f500201db80 10 client.27089 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f500201db80 10 client.27089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f500201db80 20 client.27089 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f500201db80 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8c477a0 0x5643b8c49bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f500201db80 4 client.27089 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:50:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5643b896af10 con 0x5643b8c477a0 2023-10-05T15:50:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.904+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8c477a0 0x5643b8c49bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.905+0000 7f4fe7fff700 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8c477a0 0x5643b8c49bc0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b5dec9c793ad876 server_cookie=b003121cf32ad51e in_seq=0 out_seq=0 2023-10-05T15:50:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.905+0000 7f4fc77fe700 10 client.27089 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.926+0000 7f4fc77fe700 1 -- 172.21.15.17:0/1198289482 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5643b896af10 con 0x5643b8c477a0 2023-10-05T15:50:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.926+0000 7f4fc77fe700 10 client.27089 handle_command_reply: tid=0 2023-10-05T15:50:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.927+0000 7f500201db80 1 client.27089 shutdown 2023-10-05T15:50:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 msgr2=0x5643b8bdd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bdd010 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0099490 tx=0x7f4fd00105a0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 shutdown_connections 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5643b8c477a0 0x5643b8c49bc0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643b8bcd990 0x5643b8bdb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643b8bc2f00 0x5643b8bdcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 --2- 172.21.15.17:0/1198289482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643b8bccfd0 0x5643b8bdd010 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 >> 172.21.15.17:0/1198289482 conn(0x5643b8b40200 msgr2=0x5643b8bc6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f4fc77fe700 0 client.27089 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.928+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 shutdown_connections 2023-10-05T15:50:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.929+0000 7f500201db80 1 -- 172.21.15.17:0/1198289482 wait complete. 2023-10-05T15:50:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.929+0000 7f500201db80 20 client.27089 trim_cache size 0 max 16384 2023-10-05T15:50:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:50:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:50:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:50:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:50:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4fd40a1680 msgr2=0x7f4fd40a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4fd40a1680 0x7f4fd40a3b40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4fe000b5c0 tx=0x7f4fe0000bc0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 msgr2=0x7f4fe81a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe81a60f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000b550 tx=0x7f4fd000b910 comp rx=0 tx=0).stop 2023-10-05T15:50:06.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 shutdown_connections 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4fd40a1680 0x7f4fd40a3b40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fe810bad0 0x7f4fe81a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fe8069c40 0x7f4fe81a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 --2- 172.21.15.17:0/3495111900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fe8108840 0x7f4fe81a60f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.930+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 >> 172.21.15.17:0/3495111900 conn(0x7f4fe806e0b0 msgr2=0x7f4fe8110ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.931+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 shutdown_connections 2023-10-05T15:50:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:06.931+0000 7f4fee5ff700 1 -- 172.21.15.17:0/3495111900 wait complete. 2023-10-05T15:50:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 690.0 s, 399.8 tps, lat 150.499 ms stddev 81.374 2023-10-05T15:50:08.321 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:07 smithi167 ceph-mon[133366]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 517 op/s 2023-10-05T15:50:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:07 smithi079 ceph-mon[132936]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 517 op/s 2023-10-05T15:50:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:07 smithi017 ceph-mon[129107]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 517 op/s 2023-10-05T15:50:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:09 smithi167 ceph-mon[133366]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 575 op/s 2023-10-05T15:50:10.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:09 smithi079 ceph-mon[132936]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 575 op/s 2023-10-05T15:50:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:09 smithi017 ceph-mon[129107]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.4 MiB/s wr, 575 op/s 2023-10-05T15:50:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:11 smithi167 ceph-mon[133366]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 585 op/s 2023-10-05T15:50:12.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:11 smithi079 ceph-mon[132936]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 585 op/s 2023-10-05T15:50:12.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:11 smithi017 ceph-mon[129107]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 585 op/s 2023-10-05T15:50:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 695.0 s, 480.0 tps, lat 124.394 ms stddev 42.623 2023-10-05T15:50:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:14 smithi167 ceph-mon[133366]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 519 op/s 2023-10-05T15:50:14.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:14 smithi079 ceph-mon[132936]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 519 op/s 2023-10-05T15:50:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:14 smithi017 ceph-mon[129107]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 519 op/s 2023-10-05T15:50:15.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:50:15.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.494+0000 7fc81b7ff700 1 -- 172.21.15.17:0/1486597728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8140ff730 msgr2=0x7fc814101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.494+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/1486597728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8140ff730 0x7fc814101b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc8040098f0 tx=0x7fc804009c00 comp rx=0 tx=0).stop 2023-10-05T15:50:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.496+0000 7fc81b7ff700 1 -- 172.21.15.17:0/1486597728 shutdown_connections 2023-10-05T15:50:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.496+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/1486597728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814104a70 0x7fc814104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.496+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/1486597728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8140ff730 0x7fc814101b60 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc8040098f0 tx=0x7fc804009c00 comp rx=0 tx=0).stop 2023-10-05T15:50:15.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.496+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/1486597728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8141020a0 0x7fc814104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.496+0000 7fc81b7ff700 1 -- 172.21.15.17:0/1486597728 >> 172.21.15.17:0/1486597728 conn(0x7fc8140fb330 msgr2=0x7fc8140fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.498+0000 7fc81b7ff700 1 -- 172.21.15.17:0/1486597728 shutdown_connections 2023-10-05T15:50:15.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.498+0000 7fc81b7ff700 1 -- 172.21.15.17:0/1486597728 wait complete. 2023-10-05T15:50:15.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.499+0000 7fc81b7ff700 1 Processor -- start 2023-10-05T15:50:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 -- start start 2023-10-05T15:50:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8141020a0 0x7fc81410de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 0x7fc81410e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81410f380 0x7fc81410f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81410fd40 con 0x7fc8141020a0 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81410feb0 con 0x7fc814104a70 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.500+0000 7fc81b7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814110070 con 0x7fc81410f380 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.501+0000 7fc81959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8141020a0 0x7fc81410de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.501+0000 7fc818d9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 0x7fc81410e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.501+0000 7fc818d9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 0x7fc81410e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34190/0 (socket says 172.21.15.17:34190) 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.501+0000 7fc818d9a700 1 -- 172.21.15.17:0/3091080385 learned_addr learned my addr 172.21.15.17:0/3091080385 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:15.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.501+0000 7fc819d9c700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81410f380 0x7fc81410f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.502+0000 7fc818d9a700 1 -- 172.21.15.17:0/3091080385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81410f380 msgr2=0x7fc81410f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.502+0000 7fc818d9a700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81410f380 0x7fc81410f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.502+0000 7fc818d9a700 1 -- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8141020a0 msgr2=0x7fc81410de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.502+0000 7fc818d9a700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8141020a0 0x7fc81410de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.502+0000 7fc818d9a700 1 -- 172.21.15.17:0/3091080385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc804009520 con 0x7fc814104a70 2023-10-05T15:50:15.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.502+0000 7fc818d9a700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 0x7fc81410e340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc81000e9c0 tx=0x7fc81000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.503+0000 7fc80a7fc700 1 -- 172.21.15.17:0/3091080385 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810004a30 con 0x7fc814104a70 2023-10-05T15:50:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.503+0000 7fc80a7fc700 1 -- 172.21.15.17:0/3091080385 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc81000cc50 con 0x7fc814104a70 2023-10-05T15:50:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.503+0000 7fc80a7fc700 1 -- 172.21.15.17:0/3091080385 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810005410 con 0x7fc814104a70 2023-10-05T15:50:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.503+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc814110350 con 0x7fc814104a70 2023-10-05T15:50:15.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.503+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8141ae5b0 con 0x7fc814104a70 2023-10-05T15:50:15.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.511+0000 7fc82f039b80 1 Processor -- start 2023-10-05T15:50:15.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.513+0000 7fc80a7fc700 1 -- 172.21.15.17:0/3091080385 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc810005570 con 0x7fc814104a70 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.514+0000 7fc82f039b80 1 -- start start 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.514+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 0x564bd0fab680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.514+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.514+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0faca60 0x564bd0facee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.514+0000 7fc82f039b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0f13460 con 0x564bd0fabbc0 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.514+0000 7fc82f039b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0f04c20 con 0x564bd0fab260 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.515+0000 7fc82f039b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0f02540 con 0x564bd0faca60 2023-10-05T15:50:15.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.515+0000 7fc819d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 0x564bd0fab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.515+0000 7fc819d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 0x564bd0fab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34200/0 (socket says 172.21.15.17:34200) 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.515+0000 7fc819d9c700 1 -- 172.21.15.17:0/3599126713 learned_addr learned my addr 172.21.15.17:0/3599126713 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.515+0000 7fc81959b700 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.516+0000 7fc819d9c700 1 -- 172.21.15.17:0/3599126713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0faca60 msgr2=0x564bd0facee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.516+0000 7fc819d9c700 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0faca60 0x564bd0facee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.516+0000 7fc819d9c700 1 -- 172.21.15.17:0/3599126713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 msgr2=0x564bd0fac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.516+0000 7fc819d9c700 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.516+0000 7fc819d9c700 1 -- 172.21.15.17:0/3599126713 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bd0d28de0 con 0x564bd0fab260 2023-10-05T15:50:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.517+0000 7fc819d9c700 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 0x564bd0fab680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0098f0 tx=0x7fc80c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f91d626a8bdec3f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:15.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.518+0000 7fc80a7fc700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc8000a1680 0x7fc8000a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.518+0000 7fc7ff7fe700 1 -- 172.21.15.17:0/3599126713 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c019070 con 0x564bd0fab260 2023-10-05T15:50:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.518+0000 7fc7ff7fe700 1 -- 172.21.15.17:0/3599126713 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc80c00f040 con 0x564bd0fab260 2023-10-05T15:50:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.518+0000 7fc7ff7fe700 1 -- 172.21.15.17:0/3599126713 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c007aa0 con 0x564bd0fab260 2023-10-05T15:50:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.518+0000 7fc80a7fc700 1 -- 172.21.15.17:0/3091080385 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc810014070 con 0x7fc814104a70 2023-10-05T15:50:15.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.519+0000 7fc81959b700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc8000a1680 0x7fc8000a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.519+0000 7fc82f039b80 1 -- 172.21.15.17:0/3599126713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 msgr2=0x564bd0fab680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.519+0000 7fc82f039b80 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 0x564bd0fab680 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0098f0 tx=0x7fc80c009c00 comp rx=0 tx=0).stop 2023-10-05T15:50:15.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.520+0000 7fc82f039b80 1 -- 172.21.15.17:0/3599126713 shutdown_connections 2023-10-05T15:50:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.520+0000 7fc82f039b80 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0faca60 0x564bd0facee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.520+0000 7fc82f039b80 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0fab260 0x564bd0fab680 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.520+0000 7fc82f039b80 1 --2- 172.21.15.17:0/3599126713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.520+0000 7fc82f039b80 1 -- 172.21.15.17:0/3599126713 >> 172.21.15.17:0/3599126713 conn(0x564bd0f1f260 msgr2=0x564bd0fa6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.521+0000 7fc81959b700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc8000a1680 0x7fc8000a3b40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc804000c00 tx=0x7fc804019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:15.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.521+0000 7fc82f039b80 1 -- 172.21.15.17:0/3599126713 shutdown_connections 2023-10-05T15:50:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.521+0000 7fc82f039b80 1 -- 172.21.15.17:0/3599126713 wait complete. 2023-10-05T15:50:15.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.522+0000 7fc82f039b80 1 -- start start 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.522+0000 7fc82f039b80 1 Processor -- start 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fc60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fc6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0efde30 con 0x564bd0fabbc0 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0e9a710 con 0x564bd0faca60 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0e9a3b0 con 0x564bd0fab260 2023-10-05T15:50:15.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.523+0000 7fc82f039b80 10 client.0 _ll_register_callbacks cb 0x564bd0cf7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.524+0000 7fc81959b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fc60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.524+0000 7fc81959b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fc60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44876/0 (socket says 172.21.15.17:44876) 2023-10-05T15:50:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.524+0000 7fc81959b700 1 -- 172.21.15.17:0/709313676 learned_addr learned my addr 172.21.15.17:0/709313676 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.525+0000 7fc819d9c700 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.525+0000 7fc81959b700 1 -- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 msgr2=0x564bd0fcd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.525+0000 7fc81959b700 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.525+0000 7fc81959b700 1 -- 172.21.15.17:0/709313676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 msgr2=0x564bd0fc6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.525+0000 7fc81959b700 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fc6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.525+0000 7fc81959b700 1 -- 172.21.15.17:0/709313676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c003c50 con 0x564bd0fab260 2023-10-05T15:50:15.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.527+0000 7fc81959b700 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fc60d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc804016000 tx=0x7fc804009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa13a8f65928cd68 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:15.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.533+0000 7fc7fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:15.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.533+0000 7fc7fcff9700 1 -- 172.21.15.17:0/709313676 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80402b070 con 0x564bd0fab260 2023-10-05T15:50:15.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.533+0000 7fc7fcff9700 1 -- 172.21.15.17:0/709313676 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc80400bb80 con 0x564bd0fab260 2023-10-05T15:50:15.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.533+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564bd0f9df10 con 0x564bd0fab260 2023-10-05T15:50:15.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.535+0000 7fc7fcff9700 1 -- 172.21.15.17:0/709313676 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc804005040 con 0x564bd0fab260 2023-10-05T15:50:15.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.535+0000 7fc82f039b80 10 client.27046 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:15.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.535+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x564bd0d11c60 con 0x564bd0fab260 2023-10-05T15:50:15.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.535+0000 7fc7fcff9700 1 -- 172.21.15.17:0/709313676 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564bd0f9df10 con 0x564bd0fab260 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc7fcff9700 1 -- 172.21.15.17:0/709313676 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc804003bc0 con 0x564bd0fab260 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc82f039b80 10 client.27046 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc82f039b80 10 client.27046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc82f039b80 20 client.27046 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc82f039b80 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd0fd1f20 0x564bd0fd4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc82f039b80 4 client.27046 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:50:15.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.536+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564bd0ef6e10 con 0x564bd0fd1f20 2023-10-05T15:50:15.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.537+0000 7fc818d9a700 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd0fd1f20 0x564bd0fd4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.537+0000 7fc818d9a700 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd0fd1f20 0x564bd0fd4340 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db614cd43499938 server_cookie=ad9bcae2e7dd8de3 in_seq=0 out_seq=0 2023-10-05T15:50:15.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.537+0000 7fc7fcff9700 10 client.27046 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:15.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.539+0000 7fc7fcff9700 1 -- 172.21.15.17:0/709313676 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564bd0ef6e10 con 0x564bd0fd1f20 2023-10-05T15:50:15.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.539+0000 7fc7fcff9700 10 client.27046 handle_command_reply: tid=0 2023-10-05T15:50:15.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.539+0000 7fc82f039b80 1 client.27046 shutdown 2023-10-05T15:50:15.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 msgr2=0x564bd0fc60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fc60d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc804016000 tx=0x7fc804009c00 comp rx=0 tx=0).stop 2023-10-05T15:50:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 shutdown_connections 2023-10-05T15:50:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd0fd1f20 0x564bd0fd4340 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fc60d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 --2- 172.21.15.17:0/709313676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fc6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 >> 172.21.15.17:0/709313676 conn(0x564bd0f1f260 msgr2=0x564bd0fa5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:15.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc7fcff9700 0 client.27046 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:15.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 shutdown_connections 2023-10-05T15:50:15.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.540+0000 7fc82f039b80 1 -- 172.21.15.17:0/709313676 wait complete. 2023-10-05T15:50:15.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.541+0000 7fc82f039b80 20 client.27046 trim_cache size 0 max 16384 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.576+0000 7fc82f039b80 1 Processor -- start 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.576+0000 7fc82f039b80 1 -- start start 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.577+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fab260 0x564bd0fc4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.577+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fabbc0 0x564bd0fcd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.577+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0faf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.577+0000 7fc82f039b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0d7e920 con 0x564bd0fab260 2023-10-05T15:50:15.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.577+0000 7fc82f039b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0fc4b30 con 0x564bd0faca60 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.577+0000 7fc82f039b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0fc5580 con 0x564bd0fabbc0 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0faf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0faf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34222/0 (socket says 172.21.15.17:34222) 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 -- 172.21.15.17:0/4108773586 learned_addr learned my addr 172.21.15.17:0/4108773586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc818d9a700 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fabbc0 0x564bd0fcd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 -- 172.21.15.17:0/4108773586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fabbc0 msgr2=0x564bd0fcd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fabbc0 0x564bd0fcd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 -- 172.21.15.17:0/4108773586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fab260 msgr2=0x564bd0fc4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fab260 0x564bd0fc4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.578+0000 7fc819d9c700 1 -- 172.21.15.17:0/4108773586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bd0d4f250 con 0x564bd0faca60 2023-10-05T15:50:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.579+0000 7fc819d9c700 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0faf9d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc80c004560 tx=0x7fc80c004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f40c2f82ca8fc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:15.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.579+0000 7fc7fffff700 1 -- 172.21.15.17:0/4108773586 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c019040 con 0x564bd0faca60 2023-10-05T15:50:15.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.579+0000 7fc7fffff700 1 -- 172.21.15.17:0/4108773586 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc80c007500 con 0x564bd0faca60 2023-10-05T15:50:15.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.579+0000 7fc7fffff700 1 -- 172.21.15.17:0/4108773586 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0156e0 con 0x564bd0faca60 2023-10-05T15:50:15.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 -- 172.21.15.17:0/4108773586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 msgr2=0x564bd0faf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0faf9d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc80c004560 tx=0x7fc80c004590 comp rx=0 tx=0).stop 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 -- 172.21.15.17:0/4108773586 shutdown_connections 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0faf9d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fab260 0x564bd0fc4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 --2- 172.21.15.17:0/4108773586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fabbc0 0x564bd0fcd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.581+0000 7fc82f039b80 1 -- 172.21.15.17:0/4108773586 >> 172.21.15.17:0/4108773586 conn(0x564bd0f1f260 msgr2=0x564bd0fd8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.582+0000 7fc82f039b80 1 -- 172.21.15.17:0/4108773586 shutdown_connections 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.582+0000 7fc82f039b80 1 -- 172.21.15.17:0/4108773586 wait complete. 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.582+0000 7fc82f039b80 1 -- start start 2023-10-05T15:50:15.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 Processor -- start 2023-10-05T15:50:15.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fcd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fcb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0fcc370 con 0x564bd0fabbc0 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0fcc4e0 con 0x564bd0faca60 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bd0fcc650 con 0x564bd0fab260 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.583+0000 7fc82f039b80 10 client.0 _ll_register_callbacks cb 0x564bd0cf7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34238/0 (socket says 172.21.15.17:34238) 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 -- 172.21.15.17:0/2691979805 learned_addr learned my addr 172.21.15.17:0/2691979805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:15.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc818d9a700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fcb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 -- 172.21.15.17:0/2691979805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 msgr2=0x564bd0fcd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fcd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 -- 172.21.15.17:0/2691979805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 msgr2=0x564bd0fcb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:15.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fcb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc819d9c700 1 -- 172.21.15.17:0/2691979805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bd0d28de0 con 0x564bd0faca60 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.584+0000 7fc818d9a700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fcb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc819d9c700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcbe30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc80c007d00 tx=0x7fc80c009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a978dfd0577add26 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc7fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc7fcff9700 1 -- 172.21.15.17:0/2691979805 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c019040 con 0x564bd0faca60 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc80c00f040 con 0x564bd0faca60 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc7fcff9700 1 -- 172.21.15.17:0/2691979805 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc80c015480 con 0x564bd0faca60 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc7fcff9700 1 -- 172.21.15.17:0/2691979805 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc80c015640 con 0x564bd0faca60 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc82f039b80 10 client.27107 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:15.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.585+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x564bd0d272b0 con 0x564bd0faca60 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc7fcff9700 1 -- 172.21.15.17:0/2691979805 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc80c00f040 con 0x564bd0faca60 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc7fcff9700 1 -- 172.21.15.17:0/2691979805 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc80c027040 con 0x564bd0faca60 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc82f039b80 10 client.27107 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc82f039b80 10 client.27107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc82f039b80 20 client.27107 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc82f039b80 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd1027100 0x564bd1029520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc82f039b80 4 client.27107 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.586+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564bd0ef6b30 con 0x564bd1027100 2023-10-05T15:50:15.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.587+0000 7fc81959b700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd1027100 0x564bd1029520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc81959b700 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd1027100 0x564bd1029520 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=394d26270ad3ba59 server_cookie=83b12924b945e4ad in_seq=0 out_seq=0 2023-10-05T15:50:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc7fcff9700 10 client.27107 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc7fcff9700 1 -- 172.21.15.17:0/2691979805 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564bd0ef6b30 con 0x564bd1027100 2023-10-05T15:50:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc7fcff9700 10 client.27107 handle_command_reply: tid=0 2023-10-05T15:50:15.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc82f039b80 1 client.27107 shutdown 2023-10-05T15:50:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 msgr2=0x564bd0fcbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.588+0000 7fc82f039b80 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcbe30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc80c007d00 tx=0x7fc80c009340 comp rx=0 tx=0).stop 2023-10-05T15:50:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 shutdown_connections 2023-10-05T15:50:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x564bd1027100 0x564bd1029520 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564bd0faca60 0x564bd0fcbe30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc7fcff9700 0 client.27107 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564bd0fab260 0x564bd0fcd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 --2- 172.21.15.17:0/2691979805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564bd0fabbc0 0x564bd0fcb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 >> 172.21.15.17:0/2691979805 conn(0x564bd0f1f260 msgr2=0x564bd0fc4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.589+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 shutdown_connections 2023-10-05T15:50:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.590+0000 7fc82f039b80 1 -- 172.21.15.17:0/2691979805 wait complete. 2023-10-05T15:50:15.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.590+0000 7fc82f039b80 20 client.27107 trim_cache size 0 max 16384 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:50:15.593 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:50:15.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.591+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc8000a1680 msgr2=0x7fc8000a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.591+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc8000a1680 0x7fc8000a3b40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc804000c00 tx=0x7fc804019040 comp rx=0 tx=0).stop 2023-10-05T15:50:15.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.591+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 msgr2=0x7fc81410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:15.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.591+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 0x7fc81410e340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc81000e9c0 tx=0x7fc81000ecd0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.594+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 shutdown_connections 2023-10-05T15:50:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.594+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc8000a1680 0x7fc8000a3b40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.594+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc81410f380 0x7fc81410f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.594+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8141020a0 0x7fc81410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.594+0000 7fc81b7ff700 1 --2- 172.21.15.17:0/3091080385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc814104a70 0x7fc81410e340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.594+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 >> 172.21.15.17:0/3091080385 conn(0x7fc8140fb330 msgr2=0x7fc8140fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.597+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 shutdown_connections 2023-10-05T15:50:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:15.598+0000 7fc81b7ff700 1 -- 172.21.15.17:0/3091080385 wait complete. 2023-10-05T15:50:15.641 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:50:16.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:16 smithi167 ceph-mon[133366]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 709 op/s 2023-10-05T15:50:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:16 smithi079 ceph-mon[132936]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 709 op/s 2023-10-05T15:50:16.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:16 smithi017 ceph-mon[129107]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.0 MiB/s wr, 709 op/s 2023-10-05T15:50:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 700.0 s, 495.6 tps, lat 121.435 ms stddev 41.267 2023-10-05T15:50:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:17 smithi167 ceph-mon[133366]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-05T15:50:18.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:17 smithi079 ceph-mon[132936]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-05T15:50:18.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:17 smithi017 ceph-mon[129107]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-05T15:50:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 -- 172.21.15.17:0/641332469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 msgr2=0x7f9a28073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 --2- 172.21.15.17:0/641332469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 0x7f9a28073340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009990 tx=0x7f9a24009ca0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 -- 172.21.15.17:0/641332469 shutdown_connections 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 --2- 172.21.15.17:0/641332469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a2810d4d0 0x7f9a2810f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 --2- 172.21.15.17:0/641332469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 0x7f9a28073340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 --2- 172.21.15.17:0/641332469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a28073910 0x7f9a28073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.181+0000 7f9a303ff700 1 -- 172.21.15.17:0/641332469 >> 172.21.15.17:0/641332469 conn(0x7f9a280fc430 msgr2=0x7f9a280fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.182+0000 7f9a303ff700 1 -- 172.21.15.17:0/641332469 shutdown_connections 2023-10-05T15:50:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.182+0000 7f9a303ff700 1 -- 172.21.15.17:0/641332469 wait complete. 2023-10-05T15:50:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.183+0000 7f9a303ff700 1 Processor -- start 2023-10-05T15:50:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 -- start start 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 0x7f9a2806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 0x7f9a2806fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a2810d4d0 0x7f9a28070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28071350 con 0x7f9a2810d4d0 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280714c0 con 0x7f9a28074ef0 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.184+0000 7f9a303ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28071680 con 0x7f9a28073910 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.185+0000 7f9a2e19b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 0x7f9a2806f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.185+0000 7f9a2e19b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 0x7f9a2806f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44914/0 (socket says 172.21.15.17:44914) 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.185+0000 7f9a2e19b700 1 -- 172.21.15.17:0/953876347 learned_addr learned my addr 172.21.15.17:0/953876347 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.185+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a2810d4d0 0x7f9a28070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.185+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 0x7f9a2806fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.186+0000 7f9a2e19b700 1 -- 172.21.15.17:0/953876347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 msgr2=0x7f9a2806fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.186+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 0x7f9a2806fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.186+0000 7f9a2e19b700 1 -- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a2810d4d0 msgr2=0x7f9a28070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.186+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a2810d4d0 0x7f9a28070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.186+0000 7f9a2e19b700 1 -- 172.21.15.17:0/953876347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240095f0 con 0x7f9a28073910 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.186+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 0x7f9a2806f8e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000c00 tx=0x7f9a24003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.187+0000 7f9a1f7fe700 1 -- 172.21.15.17:0/953876347 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2401d070 con 0x7f9a28073910 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.187+0000 7f9a1f7fe700 1 -- 172.21.15.17:0/953876347 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a2400bd70 con 0x7f9a28073910 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.187+0000 7f9a1f7fe700 1 -- 172.21.15.17:0/953876347 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24022d20 con 0x7f9a28073910 2023-10-05T15:50:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.187+0000 7f9a303ff700 1 -- 172.21.15.17:0/953876347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a28071900 con 0x7f9a28073910 2023-10-05T15:50:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.187+0000 7f9a303ff700 1 -- 172.21.15.17:0/953876347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a28072190 con 0x7f9a28073910 2023-10-05T15:50:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.195+0000 7f9a43d10b80 1 Processor -- start 2023-10-05T15:50:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.195+0000 7f9a43d10b80 1 -- start start 2023-10-05T15:50:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.196+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a6ec0 0x55d5d35a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.196+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35a8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.196+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.196+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d350f400 con 0x55d5d35a8990 2023-10-05T15:50:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.196+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d3500bc0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.196+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d34fe4e0 con 0x55d5d35a7fd0 2023-10-05T15:50:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.197+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.197+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59970/0 (socket says 172.21.15.17:59970) 2023-10-05T15:50:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.197+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1008186286 learned_addr learned my addr 172.21.15.17:0/1008186286 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.197+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a6ec0 0x55d5d35a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.198+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1008186286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 msgr2=0x55d5d35a8450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:50:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.198+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35a8450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.198+0000 7f9a1f7fe700 1 -- 172.21.15.17:0/953876347 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9a2400f480 con 0x7f9a28073910 2023-10-05T15:50:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.198+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1008186286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a6ec0 msgr2=0x55d5d35a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.198+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a6ec0 0x55d5d35a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.198+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1008186286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5d3324d80 con 0x55d5d35a8990 2023-10-05T15:50:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.200+0000 7f9a1f7fe700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9a140a1650 0x7f9a140a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.201+0000 7f9a1f7fe700 1 -- 172.21.15.17:0/953876347 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9a240ce610 con 0x7f9a28073910 2023-10-05T15:50:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.201+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35af220 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9a180077f0 tx=0x7f9a18007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb60ac39422dec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.201+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9a140a1650 0x7f9a140a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.201+0000 7f9a1cbfe700 1 -- 172.21.15.17:0/1008186286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180125f0 con 0x55d5d35a8990 2023-10-05T15:50:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.202+0000 7f9a1cbfe700 1 -- 172.21.15.17:0/1008186286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a18012be0 con 0x55d5d35a8990 2023-10-05T15:50:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.202+0000 7f9a1cbfe700 1 -- 172.21.15.17:0/1008186286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18013cc0 con 0x55d5d35a8990 2023-10-05T15:50:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1008186286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 msgr2=0x55d5d35af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35af220 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9a180077f0 tx=0x7f9a18007b00 comp rx=0 tx=0).stop 2023-10-05T15:50:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9a140a1650 0x7f9a140a3b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55d5d35a6c60 tx=0x7f9a2000c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1008186286 shutdown_connections 2023-10-05T15:50:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35af220 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a6ec0 0x55d5d35a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1008186286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.203+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1008186286 >> 172.21.15.17:0/1008186286 conn(0x55d5d351b200 msgr2=0x55d5d35a1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:20.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.206+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1008186286 shutdown_connections 2023-10-05T15:50:20.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.207+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1008186286 wait complete. 2023-10-05T15:50:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.208+0000 7f9a43d10b80 1 -- start start 2023-10-05T15:50:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.208+0000 7f9a43d10b80 1 Processor -- start 2023-10-05T15:50:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 0x55d5d35b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d34f9dd0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d34966b0 con 0x55d5d35a7fd0 2023-10-05T15:50:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d3496350 con 0x55d5d35a8990 2023-10-05T15:50:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.209+0000 7f9a43d10b80 10 client.0 _ll_register_callbacks cb 0x55d5d32f37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.210+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.210+0000 7f9a2e99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 0x55d5d35b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.210+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34284/0 (socket says 172.21.15.17:34284) 2023-10-05T15:50:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.210+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1905181794 learned_addr learned my addr 172.21.15.17:0/1905181794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.210+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.210+0000 7f9a2e99c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 0x55d5d35b81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44926/0 (socket says 172.21.15.17:44926) 2023-10-05T15:50:20.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.211+0000 7f9a2e99c700 1 -- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 msgr2=0x55d5d35b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.211+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.211+0000 7f9a2e99c700 1 -- 172.21.15.17:0/1905181794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 msgr2=0x55d5d35b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.211+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.211+0000 7f9a2e99c700 1 -- 172.21.15.17:0/1905181794 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1800e040 con 0x55d5d35a8990 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.211+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 0x55d5d35b81d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a20008d80 tx=0x7f9a20004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47637af80aafc383 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.212+0000 7f9a11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.212+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1905181794 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000f050 con 0x55d5d35a8990 2023-10-05T15:50:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.212+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1905181794 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9a20017e10 con 0x55d5d35a8990 2023-10-05T15:50:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.213+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5d3599d50 con 0x55d5d35a8990 2023-10-05T15:50:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.213+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1905181794 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a2002c450 con 0x55d5d35a8990 2023-10-05T15:50:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.213+0000 7f9a43d10b80 10 client.27055 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.213+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d5d330dc00 con 0x55d5d35a8990 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1905181794 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d5d3599d50 con 0x55d5d35a8990 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1905181794 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9a20021540 con 0x55d5d35a8990 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a43d10b80 10 client.27055 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a43d10b80 10 client.27055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a43d10b80 20 client.27055 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d35bcb00 0x55d5d35bef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a43d10b80 4 client.27055 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:50:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.214+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5d34f2db0 con 0x55d5d35bcb00 2023-10-05T15:50:20.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.215+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d35bcb00 0x55d5d35bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.216+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d35bcb00 0x55d5d35bef20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abb01497bb723797 server_cookie=77ec9ae13da7ecf1 in_seq=0 out_seq=0 2023-10-05T15:50:20.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.216+0000 7f9a11ffb700 10 client.27055 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.217+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1905181794 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d5d34f2db0 con 0x55d5d35bcb00 2023-10-05T15:50:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.217+0000 7f9a11ffb700 10 client.27055 handle_command_reply: tid=0 2023-10-05T15:50:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.218+0000 7f9a43d10b80 1 client.27055 shutdown 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 msgr2=0x55d5d35b81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 0x55d5d35b81d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a20008d80 tx=0x7f9a20004b40 comp rx=0 tx=0).stop 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 shutdown_connections 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d35bcb00 0x55d5d35bef20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a8990 0x55d5d35b81d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1905181794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.223+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 >> 172.21.15.17:0/1905181794 conn(0x55d5d351b200 msgr2=0x55d5d35a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.224+0000 7f9a11ffb700 0 client.27055 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.224+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 shutdown_connections 2023-10-05T15:50:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.224+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1905181794 wait complete. 2023-10-05T15:50:20.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.225+0000 7f9a43d10b80 20 client.27055 trim_cache size 0 max 16384 2023-10-05T15:50:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.252+0000 7f9a43d10b80 1 Processor -- start 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 -- start start 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a6ec0 0x55d5d35af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d337a8c0 con 0x55d5d35a8990 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d35b07c0 con 0x55d5d35a7fd0 2023-10-05T15:50:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.253+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d35a2a00 con 0x55d5d35a6ec0 2023-10-05T15:50:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.254+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.254+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:34294/0 (socket says 172.21.15.17:34294) 2023-10-05T15:50:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.254+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1684208680 learned_addr learned my addr 172.21.15.17:0/1684208680 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.254+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.255+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1684208680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a6ec0 msgr2=0x55d5d35af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.255+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a6ec0 0x55d5d35af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.255+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1684208680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 msgr2=0x55d5d35aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.255+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.255+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1684208680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5d334b1f0 con 0x55d5d35a7fd0 2023-10-05T15:50:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.255+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b8190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a18004700 tx=0x7f9a18004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ea7bd9ff2a1a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.256+0000 7f9a303ff700 1 -- 172.21.15.17:0/1684208680 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18012d50 con 0x55d5d35a7fd0 2023-10-05T15:50:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.256+0000 7f9a303ff700 1 -- 172.21.15.17:0/1684208680 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a18012eb0 con 0x55d5d35a7fd0 2023-10-05T15:50:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.256+0000 7f9a303ff700 1 -- 172.21.15.17:0/1684208680 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18013bb0 con 0x55d5d35a7fd0 2023-10-05T15:50:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1684208680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 msgr2=0x55d5d35b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b8190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a18004700 tx=0x7f9a18004730 comp rx=0 tx=0).stop 2023-10-05T15:50:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1684208680 shutdown_connections 2023-10-05T15:50:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a8990 0x55d5d35aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a6ec0 0x55d5d35af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1684208680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b8190 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.257+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1684208680 >> 172.21.15.17:0/1684208680 conn(0x55d5d351b200 msgr2=0x55d5d35beb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.259+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1684208680 shutdown_connections 2023-10-05T15:50:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.259+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1684208680 wait complete. 2023-10-05T15:50:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.260+0000 7f9a43d10b80 1 -- start start 2023-10-05T15:50:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.260+0000 7f9a43d10b80 1 Processor -- start 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a8990 0x55d5d35b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d35b7610 con 0x55d5d35a6ec0 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d35b7780 con 0x55d5d35a8990 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5d35b7940 con 0x55d5d35a7fd0 2023-10-05T15:50:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a43d10b80 10 client.0 _ll_register_callbacks cb 0x7f9a200167e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a2d99a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44942/0 (socket says 172.21.15.17:44942) 2023-10-05T15:50:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.261+0000 7f9a2d99a700 1 -- 172.21.15.17:0/1736791419 learned_addr learned my addr 172.21.15.17:0/1736791419 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.262+0000 7f9a2e99c700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a8990 0x55d5d35b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.262+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.263+0000 7f9a2e19b700 1 -- 172.21.15.17:0/1736791419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 msgr2=0x55d5d35b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.263+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.263+0000 7f9a2e19b700 1 -- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a8990 msgr2=0x55d5d35b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.263+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a8990 0x55d5d35b70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.263+0000 7f9a2e19b700 1 -- 172.21.15.17:0/1736791419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5d3324d80 con 0x55d5d35a6ec0 2023-10-05T15:50:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.264+0000 7f9a2e19b700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b5b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9a240cbd10 tx=0x7f9a24009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6593aabded4c88c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.264+0000 7f9a11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:50:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.265+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1736791419 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24022ea0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.265+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1736791419 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9a2409a0f0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.265+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a18012be0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.265+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1736791419 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a240cbe20 con 0x55d5d35a6ec0 2023-10-05T15:50:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.265+0000 7f9a43d10b80 10 client.17106 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.265+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d5d3323250 con 0x55d5d35a6ec0 2023-10-05T15:50:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.266+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1736791419 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a18012be0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.266+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1736791419 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9a2409b2a0 con 0x55d5d35a6ec0 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a43d10b80 10 client.17106 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a43d10b80 10 client.17106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a43d10b80 20 client.17106 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d36110f0 0x55d5d36134e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a43d10b80 4 client.17106 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d5d34f2ad0 con 0x55d5d36110f0 2023-10-05T15:50:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.267+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d36110f0 0x55d5d36134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.268+0000 7f9a2d99a700 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d36110f0 0x55d5d36134e0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b37097a07c288d5 server_cookie=333a05a4ffa9c88a in_seq=0 out_seq=0 2023-10-05T15:50:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.268+0000 7f9a11ffb700 10 client.17106 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.295+0000 7f9a11ffb700 1 -- 172.21.15.17:0/1736791419 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d5d34f2ad0 con 0x55d5d36110f0 2023-10-05T15:50:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.295+0000 7f9a11ffb700 10 client.17106 handle_command_reply: tid=0 2023-10-05T15:50:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.296+0000 7f9a43d10b80 1 client.17106 shutdown 2023-10-05T15:50:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.299+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 msgr2=0x55d5d35b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.299+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b5b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9a240cbd10 tx=0x7f9a24009910 comp rx=0 tx=0).stop 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 shutdown_connections 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d5d36110f0 0x55d5d36134e0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d5d35a8990 0x55d5d35b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d5d35a6ec0 0x55d5d35b5b80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 --2- 172.21.15.17:0/1736791419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d5d35a7fd0 0x55d5d35b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 >> 172.21.15.17:0/1736791419 conn(0x55d5d351b200 msgr2=0x55d5d35aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a11ffb700 0 client.17106 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 shutdown_connections 2023-10-05T15:50:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.300+0000 7f9a43d10b80 1 -- 172.21.15.17:0/1736791419 wait complete. 2023-10-05T15:50:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.301+0000 7f9a43d10b80 20 client.17106 trim_cache size 0 max 16384 2023-10-05T15:50:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:50:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:50:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:50:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:50:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.302+0000 7f9a1d3ff700 1 -- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9a140a1650 msgr2=0x7f9a140a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.302+0000 7f9a1d3ff700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9a140a1650 0x7f9a140a3b10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55d5d35a6c60 tx=0x7f9a2000c040 comp rx=0 tx=0).stop 2023-10-05T15:50:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.302+0000 7f9a1d3ff700 1 -- 172.21.15.17:0/953876347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 msgr2=0x7f9a2806f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.302+0000 7f9a1d3ff700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 0x7f9a2806f8e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000c00 tx=0x7f9a24003a50 comp rx=0 tx=0).stop 2023-10-05T15:50:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 -- 172.21.15.17:0/953876347 shutdown_connections 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f9a140a1650 0x7f9a140a3b10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a2810d4d0 0x7f9a28070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a28073910 0x7f9a2806f8e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 --2- 172.21.15.17:0/953876347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a28074ef0 0x7f9a2806fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 -- 172.21.15.17:0/953876347 >> 172.21.15.17:0/953876347 conn(0x7f9a280fc430 msgr2=0x7f9a280fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 -- 172.21.15.17:0/953876347 shutdown_connections 2023-10-05T15:50:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:20.303+0000 7f9a1d3ff700 1 -- 172.21.15.17:0/953876347 wait complete. 2023-10-05T15:50:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:19 smithi167 ceph-mon[133366]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 580 op/s 2023-10-05T15:50:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:19 smithi079 ceph-mon[132936]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 580 op/s 2023-10-05T15:50:20.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:19 smithi017 ceph-mon[129107]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 580 op/s 2023-10-05T15:50:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:22 smithi167 ceph-mon[133366]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 621 op/s 2023-10-05T15:50:22.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:22 smithi079 ceph-mon[132936]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 621 op/s 2023-10-05T15:50:22.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:22 smithi017 ceph-mon[129107]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 621 op/s 2023-10-05T15:50:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 705.0 s, 540.2 tps, lat 554.828 ms stddev 3075.442 2023-10-05T15:50:24.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:24 smithi167 ceph-mon[133366]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 564 op/s 2023-10-05T15:50:24.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:24 smithi079 ceph-mon[132936]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 564 op/s 2023-10-05T15:50:24.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:24 smithi017 ceph-mon[129107]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 564 op/s 2023-10-05T15:50:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:26 smithi167 ceph-mon[133366]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 726 op/s 2023-10-05T15:50:26.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:26 smithi079 ceph-mon[132936]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 726 op/s 2023-10-05T15:50:26.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:26 smithi017 ceph-mon[129107]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.6 MiB/s wr, 726 op/s 2023-10-05T15:50:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 710.0 s, 481.8 tps, lat 207.689 ms stddev 66.215 2023-10-05T15:50:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:27 smithi167 ceph-mon[133366]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.1 MiB/s wr, 528 op/s 2023-10-05T15:50:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:27 smithi079 ceph-mon[132936]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.1 MiB/s wr, 528 op/s 2023-10-05T15:50:28.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:27 smithi017 ceph-mon[129107]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.1 MiB/s wr, 528 op/s 2023-10-05T15:50:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:29 smithi167 ceph-mon[133366]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.1 MiB/s wr, 609 op/s 2023-10-05T15:50:30.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:29 smithi079 ceph-mon[132936]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.1 MiB/s wr, 609 op/s 2023-10-05T15:50:30.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:29 smithi017 ceph-mon[129107]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.1 MiB/s wr, 609 op/s 2023-10-05T15:50:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:32 smithi167 ceph-mon[133366]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.0 MiB/s wr, 661 op/s 2023-10-05T15:50:32.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:32 smithi079 ceph-mon[132936]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.0 MiB/s wr, 661 op/s 2023-10-05T15:50:32.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:32 smithi017 ceph-mon[129107]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.0 MiB/s wr, 661 op/s 2023-10-05T15:50:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 715.0 s, 434.6 tps, lat 230.019 ms stddev 91.082 2023-10-05T15:50:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.564+0000 7f0394dff700 1 -- 172.21.15.17:0/2838426974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 msgr2=0x7f0390073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.564+0000 7f0394dff700 1 --2- 172.21.15.17:0/2838426974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f0390073d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0384009990 tx=0x7f0384009ca0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 -- 172.21.15.17:0/2838426974 shutdown_connections 2023-10-05T15:50:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 --2- 172.21.15.17:0/2838426974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 0x7f039010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 --2- 172.21.15.17:0/2838426974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 0x7f0390073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 --2- 172.21.15.17:0/2838426974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f0390073d90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 -- 172.21.15.17:0/2838426974 >> 172.21.15.17:0/2838426974 conn(0x7f03900fc460 msgr2=0x7f03900fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 -- 172.21.15.17:0/2838426974 shutdown_connections 2023-10-05T15:50:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.565+0000 7f0394dff700 1 -- 172.21.15.17:0/2838426974 wait complete. 2023-10-05T15:50:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.567+0000 7f0394dff700 1 Processor -- start 2023-10-05T15:50:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.567+0000 7f0394dff700 1 -- start start 2023-10-05T15:50:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.567+0000 7f0394dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f039006f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f0394dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 0x7f039006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f0394dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 0x7f0390070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f0394dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390071340 con 0x7f0390074ef0 2023-10-05T15:50:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f0394dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900714b0 con 0x7f0390073910 2023-10-05T15:50:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f0394dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390071670 con 0x7f039010d4c0 2023-10-05T15:50:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f038e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f039006f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f038e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f039006f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:43836/0 (socket says 172.21.15.17:43836) 2023-10-05T15:50:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.568+0000 7f038e59c700 1 -- 172.21.15.17:0/1942795509 learned_addr learned my addr 172.21.15.17:0/1942795509 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038dd9b700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 0x7f039006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038ed9d700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 0x7f0390070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038e59c700 1 -- 172.21.15.17:0/1942795509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 msgr2=0x7f0390070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038e59c700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 0x7f0390070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038e59c700 1 -- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 msgr2=0x7f039006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038e59c700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 0x7f039006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.569+0000 7f038e59c700 1 -- 172.21.15.17:0/1942795509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840095f0 con 0x7f0390073910 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f038e59c700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f039006f8d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f038000ba50 tx=0x7f038000be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f038ed9d700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 0x7f0390070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f038dd9b700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 0x7f039006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:50:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f037f7fe700 1 -- 172.21.15.17:0/1942795509 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000cab0 con 0x7f0390073910 2023-10-05T15:50:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f037f7fe700 1 -- 172.21.15.17:0/1942795509 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f038000cc10 con 0x7f0390073910 2023-10-05T15:50:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0390071950 con 0x7f0390073910 2023-10-05T15:50:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f037f7fe700 1 -- 172.21.15.17:0/1942795509 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800075d0 con 0x7f0390073910 2023-10-05T15:50:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.570+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0390072180 con 0x7f0390073910 2023-10-05T15:50:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.578+0000 7f037f7fe700 1 -- 172.21.15.17:0/1942795509 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0380014960 con 0x7f0390073910 2023-10-05T15:50:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.579+0000 7f03a879ab80 1 Processor -- start 2023-10-05T15:50:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.579+0000 7f03a879ab80 1 -- start start 2023-10-05T15:50:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf0990 0x55d495cf7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f03a879ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495c57400 con 0x55d495cf0990 2023-10-05T15:50:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f03a879ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495c48bc0 con 0x55d495ceeec0 2023-10-05T15:50:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f03a879ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495c464e0 con 0x55d495ceffd0 2023-10-05T15:50:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f038ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f038ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cef2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:43846/0 (socket says 172.21.15.17:43846) 2023-10-05T15:50:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.580+0000 7f038ed9d700 1 -- 172.21.15.17:0/4021895908 learned_addr learned my addr 172.21.15.17:0/4021895908 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.581+0000 7f038e59c700 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.581+0000 7f038ed9d700 1 -- 172.21.15.17:0/4021895908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 msgr2=0x55d495cf0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.581+0000 7f038ed9d700 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.581+0000 7f038ed9d700 1 -- 172.21.15.17:0/4021895908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf0990 msgr2=0x55d495cf7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.581+0000 7f038ed9d700 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf0990 0x55d495cf7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.581+0000 7f038ed9d700 1 -- 172.21.15.17:0/4021895908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d495a6cd80 con 0x55d495ceeec0 2023-10-05T15:50:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.584+0000 7f038ed9d700 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cef2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f038800acc0 tx=0x7f038800e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ad35d8709f5cd40 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.585+0000 7f037cff9700 1 -- 172.21.15.17:0/4021895908 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038800ee60 con 0x55d495ceeec0 2023-10-05T15:50:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.585+0000 7f037f7fe700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03780a1500 0x7f03780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.585+0000 7f037f7fe700 1 -- 172.21.15.17:0/1942795509 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0380006e40 con 0x7f0390073910 2023-10-05T15:50:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.586+0000 7f038e59c700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03780a1500 0x7f03780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.586+0000 7f037cff9700 1 -- 172.21.15.17:0/4021895908 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0388004cc0 con 0x55d495ceeec0 2023-10-05T15:50:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.586+0000 7f037cff9700 1 -- 172.21.15.17:0/4021895908 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388010430 con 0x55d495ceeec0 2023-10-05T15:50:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.587+0000 7f03a879ab80 1 -- 172.21.15.17:0/4021895908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 msgr2=0x55d495cef2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.587+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cef2e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f038800acc0 tx=0x7f038800e350 comp rx=0 tx=0).stop 2023-10-05T15:50:33.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.588+0000 7f038e59c700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03780a1500 0x7f03780a39c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03800cc880 tx=0x7f0380000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:33.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.590+0000 7f03a879ab80 1 -- 172.21.15.17:0/4021895908 shutdown_connections 2023-10-05T15:50:33.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.590+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf0990 0x55d495cf7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.590+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cef2e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.590+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4021895908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.590+0000 7f03a879ab80 1 -- 172.21.15.17:0/4021895908 >> 172.21.15.17:0/4021895908 conn(0x55d495c63200 msgr2=0x55d495ce9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.590+0000 7f03a879ab80 1 -- 172.21.15.17:0/4021895908 shutdown_connections 2023-10-05T15:50:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.591+0000 7f03a879ab80 1 -- 172.21.15.17:0/4021895908 wait complete. 2023-10-05T15:50:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.591+0000 7f03a879ab80 1 -- start start 2023-10-05T15:50:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.592+0000 7f03a879ab80 1 Processor -- start 2023-10-05T15:50:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.592+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf0990 0x55d495d000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f03a879ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495c41dd0 con 0x55d495ceeec0 2023-10-05T15:50:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f03a879ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495bde6b0 con 0x55d495cf0990 2023-10-05T15:50:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f03a879ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495bde350 con 0x55d495ceffd0 2023-10-05T15:50:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f03a879ab80 10 client.0 _ll_register_callbacks cb 0x55d495a3b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f038dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f038dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38276/0 (socket says 172.21.15.17:38276) 2023-10-05T15:50:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.593+0000 7f038dd9b700 1 -- 172.21.15.17:0/712882642 learned_addr learned my addr 172.21.15.17:0/712882642 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038ed9d700 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf0990 0x55d495d000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038dd9b700 1 -- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf0990 msgr2=0x55d495d000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038dd9b700 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf0990 0x55d495d000d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038dd9b700 1 -- 172.21.15.17:0/712882642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 msgr2=0x55d495cf8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038dd9b700 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038dd9b700 1 -- 172.21.15.17:0/712882642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038800a8f0 con 0x55d495ceffd0 2023-10-05T15:50:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.594+0000 7f038dd9b700 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf9090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0384009990 tx=0x7f0384009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52254e37d5d09f0c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.595+0000 7f0375ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.595+0000 7f0375ffb700 1 -- 172.21.15.17:0/712882642 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384005600 con 0x55d495ceffd0 2023-10-05T15:50:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.595+0000 7f0375ffb700 1 -- 172.21.15.17:0/712882642 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0384004500 con 0x55d495ceffd0 2023-10-05T15:50:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.595+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d495ce1d50 con 0x55d495ceffd0 2023-10-05T15:50:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.596+0000 7f0375ffb700 1 -- 172.21.15.17:0/712882642 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03840046c0 con 0x55d495ceffd0 2023-10-05T15:50:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.596+0000 7f03a879ab80 10 client.27064 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.596+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d495a55c00 con 0x55d495ceffd0 2023-10-05T15:50:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f0375ffb700 1 -- 172.21.15.17:0/712882642 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d495ce1d50 con 0x55d495ceffd0 2023-10-05T15:50:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f0375ffb700 1 -- 172.21.15.17:0/712882642 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0384003c70 con 0x55d495ceffd0 2023-10-05T15:50:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f03a879ab80 10 client.27064 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f03a879ab80 10 client.27064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f03a879ab80 20 client.27064 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f03a879ab80 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d04950 0x55d495d06d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.597+0000 7f03a879ab80 4 client.27064 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:50:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.598+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d495c3adb0 con 0x55d495d04950 2023-10-05T15:50:33.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.598+0000 7f038ed9d700 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d04950 0x55d495d06d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.598+0000 7f0375ffb700 10 client.27064 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.598+0000 7f038ed9d700 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d04950 0x55d495d06d70 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc95a26c3561998f server_cookie=459140f0f039669f in_seq=0 out_seq=0 2023-10-05T15:50:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.599+0000 7f0375ffb700 1 -- 172.21.15.17:0/712882642 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d495c3adb0 con 0x55d495d04950 2023-10-05T15:50:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.599+0000 7f0375ffb700 10 client.27064 handle_command_reply: tid=0 2023-10-05T15:50:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 client.27064 shutdown 2023-10-05T15:50:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 msgr2=0x55d495cf9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf9090 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0384009990 tx=0x7f0384009f90 comp rx=0 tx=0).stop 2023-10-05T15:50:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 shutdown_connections 2023-10-05T15:50:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d04950 0x55d495d06d70 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf0990 0x55d495d000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 --2- 172.21.15.17:0/712882642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495ceffd0 0x55d495cf9090 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.600+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 >> 172.21.15.17:0/712882642 conn(0x55d495c63200 msgr2=0x55d495ce9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.601+0000 7f0375ffb700 0 client.27064 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.605+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 shutdown_connections 2023-10-05T15:50:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.605+0000 7f03a879ab80 1 -- 172.21.15.17:0/712882642 wait complete. 2023-10-05T15:50:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.606+0000 7f03a879ab80 20 client.27064 trim_cache size 0 max 16384 2023-10-05T15:50:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.636+0000 7f03a879ab80 1 Processor -- start 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 -- start start 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cf72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf78d0 0x55d495d00090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495ac28c0 con 0x55d495ceeec0 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495cf8030 con 0x55d495cf78d0 2023-10-05T15:50:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.637+0000 7f03a879ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495cf86c0 con 0x55d495cf0990 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.638+0000 7f038dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cf72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cf72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38278/0 (socket says 172.21.15.17:38278) 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 -- 172.21.15.17:0/4046816731 learned_addr learned my addr 172.21.15.17:0/4046816731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038ed9d700 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf78d0 0x55d495d00090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038ed9d700 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 -- 172.21.15.17:0/4046816731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf78d0 msgr2=0x55d495d00090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf78d0 0x55d495d00090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 -- 172.21.15.17:0/4046816731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 msgr2=0x55d495cf6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.639+0000 7f038dd9b700 1 -- 172.21.15.17:0/4046816731 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d495a931f0 con 0x55d495cf0990 2023-10-05T15:50:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.640+0000 7f038dd9b700 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cf72a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f038400c010 tx=0x7f0384005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f11b108d0b4eb935 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.641+0000 7f037d7fa700 1 -- 172.21.15.17:0/4046816731 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384005bc0 con 0x55d495cf0990 2023-10-05T15:50:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.641+0000 7f037d7fa700 1 -- 172.21.15.17:0/4046816731 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f038401e040 con 0x55d495cf0990 2023-10-05T15:50:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.641+0000 7f037d7fa700 1 -- 172.21.15.17:0/4046816731 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400f850 con 0x55d495cf0990 2023-10-05T15:50:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 -- 172.21.15.17:0/4046816731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 msgr2=0x55d495cf72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cf72a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f038400c010 tx=0x7f0384005fb0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 -- 172.21.15.17:0/4046816731 shutdown_connections 2023-10-05T15:50:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495cf78d0 0x55d495d00090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495ceeec0 0x55d495cf6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 --2- 172.21.15.17:0/4046816731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cf72a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.642+0000 7f03a879ab80 1 -- 172.21.15.17:0/4046816731 >> 172.21.15.17:0/4046816731 conn(0x55d495c63200 msgr2=0x55d495ceffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.643+0000 7f03a879ab80 1 -- 172.21.15.17:0/4046816731 shutdown_connections 2023-10-05T15:50:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.643+0000 7f03a879ab80 1 -- 172.21.15.17:0/4046816731 wait complete. 2023-10-05T15:50:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.644+0000 7f03a879ab80 1 -- start start 2023-10-05T15:50:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.644+0000 7f03a879ab80 1 Processor -- start 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.645+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cfda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.645+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cfdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.645+0000 7f03a879ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf78d0 0x55d495cfefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f03a879ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495cff520 con 0x55d495cf78d0 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f03a879ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495cff690 con 0x55d495ceeec0 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f03a879ab80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d495cff850 con 0x55d495cf0990 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f03a879ab80 10 client.0 _ll_register_callbacks cb 0x7f0384009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f038ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cfda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f038ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cfda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:43872/0 (socket says 172.21.15.17:43872) 2023-10-05T15:50:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f038ed9d700 1 -- 172.21.15.17:0/3869381040 learned_addr learned my addr 172.21.15.17:0/3869381040 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.646+0000 7f038dd9b700 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cfdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f038dd9b700 1 -- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 msgr2=0x55d495cfda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f038dd9b700 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cfda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f038dd9b700 1 -- 172.21.15.17:0/3869381040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf78d0 msgr2=0x55d495cfefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f038dd9b700 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf78d0 0x55d495cfefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f038dd9b700 1 -- 172.21.15.17:0/3869381040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d495a55c00 con 0x55d495cf0990 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f038dd9b700 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cfdfd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0384005710 tx=0x7f0384003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca1c623af27bf5dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f0375ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.647+0000 7f0375ffb700 1 -- 172.21.15.17:0/3869381040 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384005bc0 con 0x55d495cf0990 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.648+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0388004cc0 con 0x55d495cf0990 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.648+0000 7f0375ffb700 1 -- 172.21.15.17:0/3869381040 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0384000e40 con 0x55d495cf0990 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.648+0000 7f0375ffb700 1 -- 172.21.15.17:0/3869381040 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f038400f650 con 0x55d495cf0990 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.648+0000 7f03a879ab80 10 client.27070 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.648+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d495a6b250 con 0x55d495cf0990 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.648+0000 7f0375ffb700 1 -- 172.21.15.17:0/3869381040 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0388004cc0 con 0x55d495cf0990 2023-10-05T15:50:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f0375ffb700 1 -- 172.21.15.17:0/3869381040 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0384004800 con 0x55d495cf0990 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f03a879ab80 10 client.27070 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f03a879ab80 10 client.27070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f03a879ab80 20 client.27070 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f03a879ab80 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d58dd0 0x55d495d5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f03a879ab80 4 client.27070 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.649+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d495c3aad0 con 0x55d495d58dd0 2023-10-05T15:50:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.650+0000 7f038ed9d700 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d58dd0 0x55d495d5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.651+0000 7f038ed9d700 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d58dd0 0x55d495d5b1c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ad9ccad96d49c6 server_cookie=d2091646dd0a2d75 in_seq=0 out_seq=0 2023-10-05T15:50:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.651+0000 7f0375ffb700 10 client.27070 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:33.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.687+0000 7f0375ffb700 1 -- 172.21.15.17:0/3869381040 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d495c3aad0 con 0x55d495d58dd0 2023-10-05T15:50:33.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.687+0000 7f0375ffb700 10 client.27070 handle_command_reply: tid=0 2023-10-05T15:50:33.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.688+0000 7f03a879ab80 1 client.27070 shutdown 2023-10-05T15:50:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 msgr2=0x55d495cfdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cfdfd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0384005710 tx=0x7f0384003f00 comp rx=0 tx=0).stop 2023-10-05T15:50:33.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 shutdown_connections 2023-10-05T15:50:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d495d58dd0 0x55d495d5b1c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d495cf78d0 0x55d495cfefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d495ceeec0 0x55d495cfda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 --2- 172.21.15.17:0/3869381040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d495cf0990 0x55d495cfdfd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f0375ffb700 0 client.27070 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:33.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 >> 172.21.15.17:0/3869381040 conn(0x55d495c63200 msgr2=0x55d495cf6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.689+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 shutdown_connections 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.690+0000 7f03a879ab80 1 -- 172.21.15.17:0/3869381040 wait complete. 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.690+0000 7f03a879ab80 20 client.27070 trim_cache size 0 max 16384 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:50:33.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:50:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.691+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03780a1500 msgr2=0x7f03780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.692+0000 7f0394dff700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03780a1500 0x7f03780a39c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03800cc880 tx=0x7f0380000f40 comp rx=0 tx=0).stop 2023-10-05T15:50:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.692+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 msgr2=0x7f039006f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:33.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.692+0000 7f0394dff700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f039006f8d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f038000ba50 tx=0x7f038000be10 comp rx=0 tx=0).stop 2023-10-05T15:50:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 shutdown_connections 2023-10-05T15:50:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f03780a1500 0x7f03780a39c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f039010d4c0 0x7f0390070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0390073910 0x7f039006f8d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 --2- 172.21.15.17:0/1942795509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0390074ef0 0x7f039006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 >> 172.21.15.17:0/1942795509 conn(0x7f03900fc460 msgr2=0x7f03900fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.694+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 shutdown_connections 2023-10-05T15:50:33.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:33.695+0000 7f0394dff700 1 -- 172.21.15.17:0/1942795509 wait complete. 2023-10-05T15:50:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:34 smithi167 ceph-mon[133366]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 574 op/s 2023-10-05T15:50:34.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:34 smithi079 ceph-mon[132936]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 574 op/s 2023-10-05T15:50:34.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:34 smithi017 ceph-mon[129107]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 574 op/s 2023-10-05T15:50:36.337 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:36 smithi167 ceph-mon[133366]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.2 MiB/s wr, 702 op/s 2023-10-05T15:50:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:36 smithi079 ceph-mon[132936]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.2 MiB/s wr, 702 op/s 2023-10-05T15:50:36.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:36 smithi017 ceph-mon[129107]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.2 MiB/s wr, 702 op/s 2023-10-05T15:50:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 720.0 s, 453.0 tps, lat 219.325 ms stddev 73.250 2023-10-05T15:50:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:37 smithi167 ceph-mon[133366]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 517 op/s 2023-10-05T15:50:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:37 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:50:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:37 smithi079 ceph-mon[132936]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 517 op/s 2023-10-05T15:50:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:37 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:50:38.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:37 smithi017 ceph-mon[129107]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 517 op/s 2023-10-05T15:50:38.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:37 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:50:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:39 smithi167 ceph-mon[133366]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.0 MiB/s wr, 591 op/s 2023-10-05T15:50:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:50:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:50:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:39 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:50:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:39 smithi079 ceph-mon[132936]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.0 MiB/s wr, 591 op/s 2023-10-05T15:50:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:50:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:50:40.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:39 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:50:40.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:39 smithi017 ceph-mon[129107]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.0 MiB/s wr, 591 op/s 2023-10-05T15:50:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:50:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:50:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:39 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:50:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:42 smithi167 ceph-mon[133366]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.3 MiB/s wr, 613 op/s 2023-10-05T15:50:42.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:42 smithi079 ceph-mon[132936]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.3 MiB/s wr, 613 op/s 2023-10-05T15:50:42.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:42 smithi017 ceph-mon[129107]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.3 MiB/s wr, 613 op/s 2023-10-05T15:50:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 725.0 s, 500.8 tps, lat 202.598 ms stddev 87.357 2023-10-05T15:50:44.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:44 smithi167 ceph-mon[133366]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.8 MiB/s wr, 507 op/s 2023-10-05T15:50:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:44 smithi079 ceph-mon[132936]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.8 MiB/s wr, 507 op/s 2023-10-05T15:50:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:44 smithi017 ceph-mon[129107]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.8 MiB/s wr, 507 op/s 2023-10-05T15:50:45.642 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:50:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.011+0000 7f7d1bdff700 1 -- 172.21.15.17:0/2270279152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100a20 msgr2=0x7f7d140fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.011+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/2270279152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100a20 0x7f7d140fef70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009990 tx=0x7f7d0c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.012+0000 7f7d1bdff700 1 -- 172.21.15.17:0/2270279152 shutdown_connections 2023-10-05T15:50:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.012+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/2270279152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100a20 0x7f7d140fef70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.012+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/2270279152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d14101350 0x7f7d14101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.012+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/2270279152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100080 0x7f7d141004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.012+0000 7f7d1bdff700 1 -- 172.21.15.17:0/2270279152 >> 172.21.15.17:0/2270279152 conn(0x7f7d140faab0 msgr2=0x7f7d140fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.012+0000 7f7d1bdff700 1 -- 172.21.15.17:0/2270279152 shutdown_connections 2023-10-05T15:50:46.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.013+0000 7f7d1bdff700 1 -- 172.21.15.17:0/2270279152 wait complete. 2023-10-05T15:50:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 Processor -- start 2023-10-05T15:50:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 -- start start 2023-10-05T15:50:46.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100080 0x7f7d1410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 0x7f7d141100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d14101350 0x7f7d14115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141156f0 con 0x7f7d14101350 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14115860 con 0x7f7d14100a20 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.015+0000 7f7d1bdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d14115a20 con 0x7f7d14100080 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 0x7f7d141100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 0x7f7d141100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41644/0 (socket says 172.21.15.17:41644) 2023-10-05T15:50:46.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 -- 172.21.15.17:0/3930731655 learned_addr learned my addr 172.21.15.17:0/3930731655 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 -- 172.21.15.17:0/3930731655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100080 msgr2=0x7f7d1410fb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:50:46.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100080 0x7f7d1410fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 -- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d14101350 msgr2=0x7f7d14115120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d14101350 0x7f7d14115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.016+0000 7f7d1939a700 1 -- 172.21.15.17:0/3930731655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0095f0 con 0x7f7d14100a20 2023-10-05T15:50:46.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.022+0000 7f7d1939a700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 0x7f7d141100c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e9a0 tx=0x7f7d0000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.024+0000 7f7d12ffd700 1 -- 172.21.15.17:0/3930731655 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00009790 con 0x7f7d14100a20 2023-10-05T15:50:46.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.024+0000 7f7d12ffd700 1 -- 172.21.15.17:0/3930731655 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d0000cbd0 con 0x7f7d14100a20 2023-10-05T15:50:46.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.024+0000 7f7d12ffd700 1 -- 172.21.15.17:0/3930731655 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00018680 con 0x7f7d14100a20 2023-10-05T15:50:46.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.024+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d14115ca0 con 0x7f7d14100a20 2023-10-05T15:50:46.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.024+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d14116160 con 0x7f7d14100a20 2023-10-05T15:50:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.031+0000 7f7d12ffd700 1 -- 172.21.15.17:0/3930731655 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f7d0000cd40 con 0x7f7d14100a20 2023-10-05T15:50:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.032+0000 7f7d2f7a0b80 1 Processor -- start 2023-10-05T15:50:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.034+0000 7f7d12ffd700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7d040a1550 0x7f7d040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.034+0000 7f7d12ffd700 1 -- 172.21.15.17:0/3930731655 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7d00014070 con 0x7f7d14100a20 2023-10-05T15:50:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.035+0000 7f7d2f7a0b80 1 -- start start 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b4d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b4e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b4eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5ab5460 con 0x5622a5b4d260 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5aa6c20 con 0x5622a5b4ea60 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5aa4540 con 0x5622a5b4dbc0 2023-10-05T15:50:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.036+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7d040a1550 0x7f7d040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.037+0000 7f7d19b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b4d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.037+0000 7f7d1a39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b4eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.037+0000 7f7d19b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b4d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33308/0 (socket says 172.21.15.17:33308) 2023-10-05T15:50:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.037+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2683612853 learned_addr learned my addr 172.21.15.17:0/2683612853 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2683612853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 msgr2=0x5622a5b4e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b4e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2683612853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 msgr2=0x5622a5b4eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b4eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2683612853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622a58cade0 con 0x5622a5b4d260 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7d040a1550 0x7f7d040a3a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006010 tx=0x7f7d0c0040e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.038+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b4d680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800e490 tx=0x7f7d08009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc95627174a34b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.040+0000 7f7cfffff700 1 -- 172.21.15.17:0/2683612853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08018070 con 0x5622a5b4d260 2023-10-05T15:50:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.040+0000 7f7cfffff700 1 -- 172.21.15.17:0/2683612853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d0800f040 con 0x5622a5b4d260 2023-10-05T15:50:46.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.040+0000 7f7cfffff700 1 -- 172.21.15.17:0/2683612853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08007a50 con 0x5622a5b4d260 2023-10-05T15:50:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.041+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2683612853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 msgr2=0x5622a5b4d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.041+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b4d680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800e490 tx=0x7f7d08009920 comp rx=0 tx=0).stop 2023-10-05T15:50:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.043+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2683612853 shutdown_connections 2023-10-05T15:50:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.043+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b4eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.043+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b4d680 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.043+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2683612853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b4e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.043+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2683612853 >> 172.21.15.17:0/2683612853 conn(0x5622a5ac1260 msgr2=0x5622a5b48140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.044+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2683612853 shutdown_connections 2023-10-05T15:50:46.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.045+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2683612853 wait complete. 2023-10-05T15:50:46.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.045+0000 7f7d2f7a0b80 1 -- start start 2023-10-05T15:50:46.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 Processor -- start 2023-10-05T15:50:46.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b57090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b5e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5a9fe30 con 0x5622a5b4d260 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5a3c710 con 0x5622a5b4ea60 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5a3c3b0 con 0x5622a5b4dbc0 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.046+0000 7f7d2f7a0b80 10 client.0 _ll_register_callbacks cb 0x5622a5899800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b5e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41666/0 (socket says 172.21.15.17:41666) 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 -- 172.21.15.17:0/1989829782 learned_addr learned my addr 172.21.15.17:0/1989829782 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1939a700 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 -- 172.21.15.17:0/1989829782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 msgr2=0x5622a5b575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 -- 172.21.15.17:0/1989829782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 msgr2=0x5622a5b57090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b57090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.047+0000 7f7d1a39c700 1 -- 172.21.15.17:0/1989829782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0800e140 con 0x5622a5b4ea60 2023-10-05T15:50:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.048+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b5e610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0095c0 tx=0x7f7d0c024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdaca6812d203c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.048+0000 7f7cfd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:50:46.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.049+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/1989829782 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00f730 con 0x5622a5b4ea60 2023-10-05T15:50:46.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.049+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/1989829782 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7d0c00f890 con 0x5622a5b4ea60 2023-10-05T15:50:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.053+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622a5b3ff10 con 0x5622a5b4ea60 2023-10-05T15:50:46.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.053+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/1989829782 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d0c00fa50 con 0x5622a5b4ea60 2023-10-05T15:50:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.053+0000 7f7d2f7a0b80 10 client.27152 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.053+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5622a58b3c60 con 0x5622a5b4ea60 2023-10-05T15:50:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/1989829782 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5622a5b3ff10 con 0x5622a5b4ea60 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/1989829782 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d0c038070 con 0x5622a5b4ea60 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7d2f7a0b80 10 client.27152 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7d2f7a0b80 10 client.27152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7d2f7a0b80 20 client.27152 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5b62e30 0x5622a5b65250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7d2f7a0b80 4 client.27152 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:50:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.054+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622a5a98e10 con 0x5622a5b62e30 2023-10-05T15:50:46.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.056+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5b62e30 0x5622a5b65250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.061+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5b62e30 0x5622a5b65250 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b2612f254b5fc49 server_cookie=33b72bc32e5827b6 in_seq=0 out_seq=0 2023-10-05T15:50:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.061+0000 7f7cfd7fa700 10 client.27152 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.063+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/1989829782 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5622a5a98e10 con 0x5622a5b62e30 2023-10-05T15:50:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.063+0000 7f7cfd7fa700 10 client.27152 handle_command_reply: tid=0 2023-10-05T15:50:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.063+0000 7f7d2f7a0b80 1 client.27152 shutdown 2023-10-05T15:50:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.063+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 msgr2=0x5622a5b5e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.063+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b5e610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0095c0 tx=0x7f7d0c024000 comp rx=0 tx=0).stop 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 shutdown_connections 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5b62e30 0x5622a5b65250 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b5e610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b57090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/1989829782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 >> 172.21.15.17:0/1989829782 conn(0x5622a5ac1260 msgr2=0x5622a5b47f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7cfd7fa700 0 client.27152 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.064+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 shutdown_connections 2023-10-05T15:50:46.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.065+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/1989829782 wait complete. 2023-10-05T15:50:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.069+0000 7f7d2f7a0b80 20 client.27152 trim_cache size 0 max 16384 2023-10-05T15:50:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.102+0000 7f7d2f7a0b80 1 Processor -- start 2023-10-05T15:50:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.102+0000 7f7d2f7a0b80 1 -- start start 2023-10-05T15:50:46.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.103+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b55c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.103+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b5e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.103+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b51ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.103+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5920920 con 0x5622a5b4d260 2023-10-05T15:50:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.103+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5b56540 con 0x5622a5b4ea60 2023-10-05T15:50:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.103+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5b49270 con 0x5622a5b4dbc0 2023-10-05T15:50:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.104+0000 7f7d1a39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b51ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.104+0000 7f7d1a39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b51ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41672/0 (socket says 172.21.15.17:41672) 2023-10-05T15:50:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.104+0000 7f7d1a39c700 1 -- 172.21.15.17:0/589627631 learned_addr learned my addr 172.21.15.17:0/589627631 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.105+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b55c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d1a39c700 1 -- 172.21.15.17:0/589627631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 msgr2=0x5622a5b5e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:50:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b5e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d1a39c700 1 -- 172.21.15.17:0/589627631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 msgr2=0x5622a5b55c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b55c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d1a39c700 1 -- 172.21.15.17:0/589627631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622a58f1250 con 0x5622a5b4ea60 2023-10-05T15:50:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d1a39c700 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b51ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c003ec0 tx=0x7f7d0c00b470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc1fc322e20cc366 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.106+0000 7f7d10bff700 1 -- 172.21.15.17:0/589627631 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c028cd0 con 0x5622a5b4ea60 2023-10-05T15:50:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.107+0000 7f7d10bff700 1 -- 172.21.15.17:0/589627631 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d0c028e30 con 0x5622a5b4ea60 2023-10-05T15:50:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.107+0000 7f7d10bff700 1 -- 172.21.15.17:0/589627631 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c005020 con 0x5622a5b4ea60 2023-10-05T15:50:46.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.107+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/589627631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 msgr2=0x5622a5b51ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.108+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b51ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c003ec0 tx=0x7f7d0c00b470 comp rx=0 tx=0).stop 2023-10-05T15:50:46.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.108+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/589627631 shutdown_connections 2023-10-05T15:50:46.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.108+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4ea60 0x5622a5b51ab0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.108+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4d260 0x5622a5b55c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.108+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/589627631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4dbc0 0x5622a5b5e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.108+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/589627631 >> 172.21.15.17:0/589627631 conn(0x5622a5ac1260 msgr2=0x5622a5b54f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.112+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/589627631 shutdown_connections 2023-10-05T15:50:46.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.112+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/589627631 wait complete. 2023-10-05T15:50:46.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.113+0000 7f7d2f7a0b80 1 -- start start 2023-10-05T15:50:46.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.113+0000 7f7d2f7a0b80 1 Processor -- start 2023-10-05T15:50:46.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 0x5622a5b5c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4dbc0 0x5622a5b5c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4ea60 0x5622a5b5d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5b5dc00 con 0x5622a5b4ea60 2023-10-05T15:50:46.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5b5dd70 con 0x5622a5b4dbc0 2023-10-05T15:50:46.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622a5b5df30 con 0x5622a5b4d260 2023-10-05T15:50:46.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.114+0000 7f7d2f7a0b80 10 client.0 _ll_register_callbacks cb 0x7f7d0c003df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:46.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.115+0000 7f7d19b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 0x5622a5b5c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 0x5622a5b5c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39068/0 (socket says 172.21.15.17:39068) 2023-10-05T15:50:46.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2880299227 learned_addr learned my addr 172.21.15.17:0/2880299227 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4dbc0 msgr2=0x5622a5b5c6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4dbc0 0x5622a5b5c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2880299227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4ea60 msgr2=0x5622a5b5d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4ea60 0x5622a5b5d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.116+0000 7f7d19b9b700 1 -- 172.21.15.17:0/2880299227 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622a58b3c60 con 0x5622a5b4d260 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.117+0000 7f7d19b9b700 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 0x5622a5b5c170 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009c10 tx=0x7f7d08004c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c8148d005a333ab server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.117+0000 7f7cfd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:46.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.117+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/2880299227 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08018040 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.117+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/2880299227 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f7d08021b00 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.118+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d0800f040 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.118+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/2880299227 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d08021cc0 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.118+0000 7f7d2f7a0b80 10 client.27079 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.118+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5622a58c92b0 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.119+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/2880299227 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d0800f040 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.119+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/2880299227 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d08007c40 con 0x5622a5b4d260 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.120+0000 7f7d2f7a0b80 10 client.27079 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.120+0000 7f7d2f7a0b80 10 client.27079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.120+0000 7f7d2f7a0b80 20 client.27079 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:46.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.120+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5bb79f0 0x5622a5bb9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.120+0000 7f7d2f7a0b80 4 client.27079 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:50:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.120+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5622a5a98b30 con 0x5622a5bb79f0 2023-10-05T15:50:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.122+0000 7f7d1939a700 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5bb79f0 0x5622a5bb9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.124+0000 7f7d1939a700 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5bb79f0 0x5622a5bb9e10 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3c20847805f5e9 server_cookie=17db5faca75f8922 in_seq=0 out_seq=0 2023-10-05T15:50:46.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.124+0000 7f7cfd7fa700 10 client.27079 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.124+0000 7f7cfd7fa700 1 -- 172.21.15.17:0/2880299227 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5622a5a98b30 con 0x5622a5bb79f0 2023-10-05T15:50:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.124+0000 7f7cfd7fa700 10 client.27079 handle_command_reply: tid=0 2023-10-05T15:50:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.125+0000 7f7d2f7a0b80 1 client.27079 shutdown 2023-10-05T15:50:46.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 msgr2=0x5622a5b5c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 0x5622a5b5c170 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009c10 tx=0x7f7d08004c40 comp rx=0 tx=0).stop 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 shutdown_connections 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5622a5bb79f0 0x5622a5bb9e10 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5622a5b4ea60 0x5622a5b5d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622a5b4d260 0x5622a5b5c170 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 --2- 172.21.15.17:0/2880299227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5622a5b4dbc0 0x5622a5b5c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 >> 172.21.15.17:0/2880299227 conn(0x5622a5ac1260 msgr2=0x5622a5b55c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.126+0000 7f7cfd7fa700 0 client.27079 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.127+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 shutdown_connections 2023-10-05T15:50:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.127+0000 7f7d2f7a0b80 1 -- 172.21.15.17:0/2880299227 wait complete. 2023-10-05T15:50:46.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.127+0000 7f7d2f7a0b80 20 client.27079 trim_cache size 0 max 16384 2023-10-05T15:50:46.129 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:50:46.130 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:50:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7d040a1550 msgr2=0x7f7d040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7d040a1550 0x7f7d040a3a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c006010 tx=0x7f7d0c0040e0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 msgr2=0x7f7d141100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 0x7f7d141100c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000e9a0 tx=0x7f7d0000ed60 comp rx=0 tx=0).stop 2023-10-05T15:50:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 shutdown_connections 2023-10-05T15:50:46.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f7d040a1550 0x7f7d040a3a10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d14101350 0x7f7d14115120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d14100080 0x7f7d1410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 --2- 172.21.15.17:0/3930731655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d14100a20 0x7f7d141100c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 >> 172.21.15.17:0/3930731655 conn(0x7f7d140faab0 msgr2=0x7f7d14109d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 shutdown_connections 2023-10-05T15:50:46.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:50:46.129+0000 7f7d1bdff700 1 -- 172.21.15.17:0/3930731655 wait complete. 2023-10-05T15:50:46.164 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:50:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:46 smithi167 ceph-mon[133366]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.9 MiB/s wr, 701 op/s 2023-10-05T15:50:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:46 smithi079 ceph-mon[132936]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.9 MiB/s wr, 701 op/s 2023-10-05T15:50:46.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:46 smithi017 ceph-mon[129107]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 7.9 MiB/s wr, 701 op/s 2023-10-05T15:50:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.962+0000 7f0c859ff700 1 -- 172.21.15.17:0/596480464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80075870 msgr2=0x7f0c80075c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.962+0000 7f0c859ff700 1 --2- 172.21.15.17:0/596480464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80075870 0x7f0c80075c90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009990 tx=0x7f0c70009ca0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.963+0000 7f0c859ff700 1 -- 172.21.15.17:0/596480464 shutdown_connections 2023-10-05T15:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.963+0000 7f0c859ff700 1 --2- 172.21.15.17:0/596480464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c80077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.963+0000 7f0c859ff700 1 --2- 172.21.15.17:0/596480464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80075870 0x7f0c80075c90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.963+0000 7f0c859ff700 1 --2- 172.21.15.17:0/596480464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c80076ab0 0x7f0c80076f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.963+0000 7f0c859ff700 1 -- 172.21.15.17:0/596480464 >> 172.21.15.17:0/596480464 conn(0x7f0c800fe660 msgr2=0x7f0c80100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.966+0000 7f0c859ff700 1 -- 172.21.15.17:0/596480464 shutdown_connections 2023-10-05T15:50:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.966+0000 7f0c859ff700 1 -- 172.21.15.17:0/596480464 wait complete. 2023-10-05T15:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 Processor -- start 2023-10-05T15:50:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 -- start start 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c80075870 0x7f0c8010da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80076ab0 0x7f0c8010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c8010ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8010f4f0 con 0x7f0c80075870 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.968+0000 7f0c859ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8010f660 con 0x7f0c80076ab0 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.969+0000 7f0c859ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8010f820 con 0x7f0c80077470 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.969+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c8010ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.969+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c8010ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39078/0 (socket says 172.21.15.17:39078) 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.969+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/3972164185 learned_addr learned my addr 172.21.15.17:0/3972164185 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.970+0000 7f0c7effd700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c80075870 0x7f0c8010da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.970+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/3972164185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80076ab0 msgr2=0x7f0c8010dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.970+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80076ab0 0x7f0c8010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.970+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c80075870 msgr2=0x7f0c8010da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.970+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c80075870 0x7f0c8010da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.970+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/3972164185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700095f0 con 0x7f0c80077470 2023-10-05T15:50:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.971+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c8010ee90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400e940 tx=0x7f0c7400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.971+0000 7f0c849fd700 1 -- 172.21.15.17:0/3972164185 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400cbd0 con 0x7f0c80077470 2023-10-05T15:50:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.971+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8010fb00 con 0x7f0c80077470 2023-10-05T15:50:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.972+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c801102b0 con 0x7f0c80077470 2023-10-05T15:50:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.972+0000 7f0c849fd700 1 -- 172.21.15.17:0/3972164185 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7400cd30 con 0x7f0c80077470 2023-10-05T15:50:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.972+0000 7f0c849fd700 1 -- 172.21.15.17:0/3972164185 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74005570 con 0x7f0c80077470 2023-10-05T15:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.979+0000 7f0c992bdb80 1 Processor -- start 2023-10-05T15:50:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.979+0000 7f0c849fd700 1 -- 172.21.15.17:0/3972164185 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0c74004750 con 0x7f0c80077470 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 -- start start 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceaf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2ceb6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ce16400 con 0x557d2ceadec0 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ce07bc0 con 0x557d2ceaefd0 2023-10-05T15:50:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.980+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ce054e0 con 0x557d2ceaf990 2023-10-05T15:50:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.981+0000 7f0c7e7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2ceb6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.981+0000 7f0c7effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceaf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.981+0000 7f0c7e7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2ceb6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39080/0 (socket says 172.21.15.17:39080) 2023-10-05T15:50:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.981+0000 7f0c7effd700 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceaf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:41704/0 (socket says 172.21.15.17:41704) 2023-10-05T15:50:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.981+0000 7f0c7e7fc700 1 -- 172.21.15.17:0/788131079 learned_addr learned my addr 172.21.15.17:0/788131079 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.981+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.982+0000 7f0c7effd700 1 -- 172.21.15.17:0/788131079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 msgr2=0x557d2ceb6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.982+0000 7f0c7effd700 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2ceb6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.982+0000 7f0c7effd700 1 -- 172.21.15.17:0/788131079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 msgr2=0x557d2ceae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.982+0000 7f0c7effd700 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.982+0000 7f0c7effd700 1 -- 172.21.15.17:0/788131079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2cc2bd80 con 0x557d2ceaefd0 2023-10-05T15:50:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.982+0000 7f0c7effd700 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceaf450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c700098e0 tx=0x7f0c70005af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab52bfd8de21ee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.983+0000 7f0c65ffb700 1 -- 172.21.15.17:0/788131079 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70003880 con 0x557d2ceaefd0 2023-10-05T15:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.983+0000 7f0c65ffb700 1 -- 172.21.15.17:0/788131079 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7001e040 con 0x557d2ceaefd0 2023-10-05T15:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.983+0000 7f0c65ffb700 1 -- 172.21.15.17:0/788131079 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000b970 con 0x557d2ceaefd0 2023-10-05T15:50:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.984+0000 7f0c992bdb80 1 -- 172.21.15.17:0/788131079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 msgr2=0x557d2ceaf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.984+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceaf450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c700098e0 tx=0x7f0c70005af0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c849fd700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0c680a15d0 0x7f0c680a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c849fd700 1 -- 172.21.15.17:0/3972164185 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0c74014070 con 0x7f0c80077470 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c992bdb80 1 -- 172.21.15.17:0/788131079 shutdown_connections 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2ceb6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/788131079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceaf450 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.985+0000 7f0c992bdb80 1 -- 172.21.15.17:0/788131079 >> 172.21.15.17:0/788131079 conn(0x557d2ce22200 msgr2=0x557d2cea8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.986+0000 7f0c992bdb80 1 -- 172.21.15.17:0/788131079 shutdown_connections 2023-10-05T15:50:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.986+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0c680a15d0 0x7f0c680a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.987+0000 7f0c992bdb80 1 -- 172.21.15.17:0/788131079 wait complete. 2023-10-05T15:50:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.987+0000 7f0c992bdb80 1 -- start start 2023-10-05T15:50:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.988+0000 7f0c992bdb80 1 Processor -- start 2023-10-05T15:50:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceb7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceb8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2cebf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ce00dd0 con 0x557d2ceadec0 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cd9d6b0 con 0x557d2ceaefd0 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cd9d350 con 0x557d2ceaf990 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c992bdb80 10 client.0 _ll_register_callbacks cb 0x557d2cbfa7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.989+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0c680a15d0 0x7f0c680a3a90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009c10 tx=0x7f0c7800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.990+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2cebf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.990+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2cebf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39092/0 (socket says 172.21.15.17:39092) 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.990+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/791355332 learned_addr learned my addr 172.21.15.17:0/791355332 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.990+0000 7f0c7effd700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceb7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.990+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceb8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.991+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 msgr2=0x557d2ceb8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.991+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceb8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.991+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/791355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 msgr2=0x557d2ceb7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.991+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceb7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.991+0000 7f0c7f7fe700 1 -- 172.21.15.17:0/791355332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c80078720 con 0x557d2ceaf990 2023-10-05T15:50:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.991+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2cebf090 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c74096700 tx=0x7f0c7409a980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8fc77bd2a6df1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.993+0000 7f0c5effd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.994+0000 7f0c5effd700 1 -- 172.21.15.17:0/791355332 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740caea0 con 0x557d2ceaf990 2023-10-05T15:50:46.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.994+0000 7f0c5effd700 1 -- 172.21.15.17:0/791355332 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0c7409e350 con 0x557d2ceaf990 2023-10-05T15:50:46.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.994+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d2cea0d50 con 0x557d2ceaf990 2023-10-05T15:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.996+0000 7f0c5effd700 1 -- 172.21.15.17:0/791355332 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c7409e170 con 0x557d2ceaf990 2023-10-05T15:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.997+0000 7f0c992bdb80 10 client.27091 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.997+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x557d2cc14c00 con 0x557d2ceaf990 2023-10-05T15:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c5effd700 1 -- 172.21.15.17:0/791355332 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d2cea0d50 con 0x557d2ceaf990 2023-10-05T15:50:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c5effd700 1 -- 172.21.15.17:0/791355332 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0c740a2100 con 0x557d2ceaf990 2023-10-05T15:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c992bdb80 10 client.27091 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c992bdb80 10 client.27091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c992bdb80 20 client.27091 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cec3970 0x557d2cec5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c992bdb80 4 client.27091 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:50:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.998+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d2cdf9db0 con 0x557d2cec3970 2023-10-05T15:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:46.999+0000 7f0c7effd700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cec3970 0x557d2cec5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.000+0000 7f0c7effd700 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cec3970 0x557d2cec5d90 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f43e02ca583cac server_cookie=e1b6eb96d971d6aa in_seq=0 out_seq=0 2023-10-05T15:50:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.000+0000 7f0c5effd700 10 client.27091 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c5effd700 1 -- 172.21.15.17:0/791355332 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557d2cdf9db0 con 0x557d2cec3970 2023-10-05T15:50:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c5effd700 10 client.27091 handle_command_reply: tid=0 2023-10-05T15:50:47.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 client.27091 shutdown 2023-10-05T15:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 msgr2=0x557d2cebf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2cebf090 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c74096700 tx=0x7f0c7409a980 comp rx=0 tx=0).stop 2023-10-05T15:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 shutdown_connections 2023-10-05T15:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cec3970 0x557d2cec5d90 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaf990 0x557d2cebf090 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceadec0 0x557d2ceb7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/791355332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceaefd0 0x557d2ceb8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 >> 172.21.15.17:0/791355332 conn(0x557d2ce22200 msgr2=0x557d2cea8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.001+0000 7f0c5effd700 0 client.27091 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.003+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 shutdown_connections 2023-10-05T15:50:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.003+0000 7f0c992bdb80 1 -- 172.21.15.17:0/791355332 wait complete. 2023-10-05T15:50:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.005+0000 7f0c992bdb80 20 client.27091 trim_cache size 0 max 16384 2023-10-05T15:50:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.031+0000 7f0c992bdb80 1 Processor -- start 2023-10-05T15:50:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.031+0000 7f0c992bdb80 1 -- start start 2023-10-05T15:50:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.032+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cea8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.032+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.032+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2ceb6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.032+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cc818c0 con 0x557d2ceaf990 2023-10-05T15:50:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.032+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cea87f0 con 0x557d2ceadec0 2023-10-05T15:50:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.032+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2ceaa340 con 0x557d2ceaefd0 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.033+0000 7f0c7effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cea8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.033+0000 7f0c7e7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.033+0000 7f0c7e7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39100/0 (socket says 172.21.15.17:39100) 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.033+0000 7f0c7e7fc700 1 -- 172.21.15.17:0/2877201869 learned_addr learned my addr 172.21.15.17:0/2877201869 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.033+0000 7f0c7f7fe700 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2ceb6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.034+0000 7f0c7effd700 1 -- 172.21.15.17:0/2877201869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 msgr2=0x557d2cebefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.034+0000 7f0c7effd700 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.034+0000 7f0c7effd700 1 -- 172.21.15.17:0/2877201869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 msgr2=0x557d2ceb6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.034+0000 7f0c7effd700 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2ceb6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.034+0000 7f0c7effd700 1 -- 172.21.15.17:0/2877201869 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2cc521f0 con 0x557d2ceadec0 2023-10-05T15:50:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.035+0000 7f0c7effd700 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cea8250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x557d2cec66c0 tx=0x7f0c70009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6b89c3b496e580 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.035+0000 7f0c667fc700 1 -- 172.21.15.17:0/2877201869 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700051a0 con 0x557d2ceadec0 2023-10-05T15:50:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.036+0000 7f0c667fc700 1 -- 172.21.15.17:0/2877201869 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c70003b10 con 0x557d2ceadec0 2023-10-05T15:50:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.036+0000 7f0c667fc700 1 -- 172.21.15.17:0/2877201869 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000bea0 con 0x557d2ceadec0 2023-10-05T15:50:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 -- 172.21.15.17:0/2877201869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 msgr2=0x557d2cea8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cea8250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x557d2cec66c0 tx=0x7f0c70009ca0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 -- 172.21.15.17:0/2877201869 shutdown_connections 2023-10-05T15:50:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2ceb6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cea8250 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/2877201869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.037+0000 7f0c992bdb80 1 -- 172.21.15.17:0/2877201869 >> 172.21.15.17:0/2877201869 conn(0x557d2ce22200 msgr2=0x557d2ceca710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.038+0000 7f0c992bdb80 1 -- 172.21.15.17:0/2877201869 shutdown_connections 2023-10-05T15:50:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.038+0000 7f0c992bdb80 1 -- 172.21.15.17:0/2877201869 wait complete. 2023-10-05T15:50:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.039+0000 7f0c992bdb80 1 -- start start 2023-10-05T15:50:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.039+0000 7f0c992bdb80 1 Processor -- start 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cebc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2cebdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cebe430 con 0x557d2ceaf990 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cebe5a0 con 0x557d2ceadec0 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d2cebe710 con 0x557d2ceaefd0 2023-10-05T15:50:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.040+0000 7f0c992bdb80 10 client.0 _ll_register_callbacks cb 0x7f0c7409a010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:50:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cebc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39112/0 (socket says 172.21.15.17:39112) 2023-10-05T15:50:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 -- 172.21.15.17:0/4153744996 learned_addr learned my addr 172.21.15.17:0/4153744996 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:50:47.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 -- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 msgr2=0x557d2cebc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cebc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 -- 172.21.15.17:0/4153744996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 msgr2=0x557d2cebdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:50:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.041+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2cebdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.042+0000 7f0c7e7fc700 1 -- 172.21.15.17:0/4153744996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d2cc2bd80 con 0x557d2ceaefd0 2023-10-05T15:50:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.042+0000 7f0c7e7fc700 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebcee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c7801abe0 tx=0x7f0c78009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a25aaa235347cad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:50:47.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.042+0000 7f0c5effd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:50:47.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.043+0000 7f0c5effd700 1 -- 172.21.15.17:0/4153744996 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c78007ea0 con 0x557d2ceaefd0 2023-10-05T15:50:47.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.043+0000 7f0c5effd700 1 -- 172.21.15.17:0/4153744996 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f0c78018c00 con 0x557d2ceaefd0 2023-10-05T15:50:47.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.043+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c7001e040 con 0x557d2ceaefd0 2023-10-05T15:50:47.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.043+0000 7f0c5effd700 1 -- 172.21.15.17:0/4153744996 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c7800e070 con 0x557d2ceaefd0 2023-10-05T15:50:47.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.044+0000 7f0c992bdb80 10 client.27097 fetch_fsmap learned FSMap version 43 2023-10-05T15:50:47.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.044+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x557d2cc2a250 con 0x557d2ceaefd0 2023-10-05T15:50:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.045+0000 7f0c5effd700 1 -- 172.21.15.17:0/4153744996 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7001e040 con 0x557d2ceaefd0 2023-10-05T15:50:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.045+0000 7f0c5effd700 1 -- 172.21.15.17:0/4153744996 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0c780273e0 con 0x557d2ceaefd0 2023-10-05T15:50:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.045+0000 7f0c992bdb80 10 client.27097 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:50:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.045+0000 7f0c992bdb80 10 client.27097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:50:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.045+0000 7f0c992bdb80 20 client.27097 populate_metadata read hostname 'smithi017' 2023-10-05T15:50:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.046+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cf29480 0x557d2cf2b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:50:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.046+0000 7f0c992bdb80 4 client.27097 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:50:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.046+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557d2cdf9ad0 con 0x557d2cf29480 2023-10-05T15:50:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.047+0000 7f0c7effd700 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cf29480 0x557d2cf2b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:50:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.048+0000 7f0c7effd700 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cf29480 0x557d2cf2b8a0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb03ce2fa19f48f6 server_cookie=116b9c431a11c7e3 in_seq=0 out_seq=0 2023-10-05T15:50:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.048+0000 7f0c5effd700 10 client.27097 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:47.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.067+0000 7f0c5effd700 1 -- 172.21.15.17:0/4153744996 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557d2cdf9ad0 con 0x557d2cf29480 2023-10-05T15:50:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.067+0000 7f0c5effd700 10 client.27097 handle_command_reply: tid=0 2023-10-05T15:50:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.067+0000 7f0c992bdb80 1 client.27097 shutdown 2023-10-05T15:50:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.067+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 msgr2=0x557d2cebcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.067+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebcee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0c7801abe0 tx=0x7f0c78009920 comp rx=0 tx=0).stop 2023-10-05T15:50:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 shutdown_connections 2023-10-05T15:50:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557d2cf29480 0x557d2cf2b8a0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557d2ceaf990 0x557d2cebdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557d2ceadec0 0x557d2cebc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c992bdb80 1 --2- 172.21.15.17:0/4153744996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557d2ceaefd0 0x557d2cebcee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 >> 172.21.15.17:0/4153744996 conn(0x557d2ce22200 msgr2=0x557d2cea8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.068+0000 7f0c5effd700 0 client.27097 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.069+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 shutdown_connections 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.070+0000 7f0c992bdb80 1 -- 172.21.15.17:0/4153744996 wait complete. 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.070+0000 7f0c992bdb80 20 client.27097 trim_cache size 0 max 16384 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:50:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:50:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:50:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0c680a15d0 msgr2=0x7f0c680a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0c680a15d0 0x7f0c680a3a90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009c10 tx=0x7f0c7800b040 comp rx=0 tx=0).stop 2023-10-05T15:50:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 msgr2=0x7f0c8010ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:50:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c8010ee90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400e940 tx=0x7f0c7400ed00 comp rx=0 tx=0).stop 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 shutdown_connections 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f0c680a15d0 0x7f0c680a3a90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c80077470 0x7f0c8010ee90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c80075870 0x7f0c8010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 --2- 172.21.15.17:0/3972164185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c80076ab0 0x7f0c8010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.073+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 >> 172.21.15.17:0/3972164185 conn(0x7f0c800fe660 msgr2=0x7f0c80100350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.074+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 shutdown_connections 2023-10-05T15:50:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:50:47.074+0000 7f0c859ff700 1 -- 172.21.15.17:0/3972164185 wait complete. 2023-10-05T15:50:48.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 730.0 s, 513.6 tps, lat 194.001 ms stddev 63.411 2023-10-05T15:50:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:47 smithi167 ceph-mon[133366]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 541 op/s 2023-10-05T15:50:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:47 smithi079 ceph-mon[132936]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 541 op/s 2023-10-05T15:50:48.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:47 smithi017 ceph-mon[129107]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 541 op/s 2023-10-05T15:50:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:50 smithi167 ceph-mon[133366]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 604 op/s 2023-10-05T15:50:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:50 smithi079 ceph-mon[132936]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 604 op/s 2023-10-05T15:50:50.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:50 smithi017 ceph-mon[129107]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 604 op/s 2023-10-05T15:50:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:52 smithi167 ceph-mon[133366]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 635 op/s 2023-10-05T15:50:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:52 smithi079 ceph-mon[132936]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 635 op/s 2023-10-05T15:50:52.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:52 smithi017 ceph-mon[129107]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 635 op/s 2023-10-05T15:50:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 735.0 s, 458.6 tps, lat 216.821 ms stddev 69.360 2023-10-05T15:50:54.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:54 smithi167 ceph-mon[133366]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 555 op/s 2023-10-05T15:50:54.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:54 smithi079 ceph-mon[132936]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 555 op/s 2023-10-05T15:50:54.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:54 smithi017 ceph-mon[129107]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.0 MiB/s wr, 555 op/s 2023-10-05T15:50:56.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:56 smithi167 ceph-mon[133366]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.0 MiB/s wr, 726 op/s 2023-10-05T15:50:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:56 smithi079 ceph-mon[132936]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.0 MiB/s wr, 726 op/s 2023-10-05T15:50:56.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:56 smithi017 ceph-mon[129107]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.0 MiB/s wr, 726 op/s 2023-10-05T15:50:58.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 740.0 s, 463.4 tps, lat 216.728 ms stddev 66.606 2023-10-05T15:50:58.334 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:50:58 smithi167 ceph-mon[133366]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 513 op/s 2023-10-05T15:50:58.423 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:50:58 smithi079 ceph-mon[132936]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 513 op/s 2023-10-05T15:50:58.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:50:58 smithi017 ceph-mon[129107]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.5 MiB/s wr, 513 op/s 2023-10-05T15:51:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:00 smithi167 ceph-mon[133366]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 577 op/s 2023-10-05T15:51:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.334+0000 7f44d3dff700 1 -- 172.21.15.17:0/3679821271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 msgr2=0x7f44cc111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.334+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3679821271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc111b20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009990 tx=0x7f44c4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.338+0000 7f44d3dff700 1 -- 172.21.15.17:0/3679821271 shutdown_connections 2023-10-05T15:51:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.338+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3679821271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc111b20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.338+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3679821271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44cc107eb0 0x7f44cc1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.338+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3679821271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44cc108810 0x7f44cc10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.338+0000 7f44d3dff700 1 -- 172.21.15.17:0/3679821271 >> 172.21.15.17:0/3679821271 conn(0x7f44cc06dd10 msgr2=0x7f44cc070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.340+0000 7f44d3dff700 1 -- 172.21.15.17:0/3679821271 shutdown_connections 2023-10-05T15:51:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.340+0000 7f44d3dff700 1 -- 172.21.15.17:0/3679821271 wait complete. 2023-10-05T15:51:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.341+0000 7f44d3dff700 1 Processor -- start 2023-10-05T15:51:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 -- start start 2023-10-05T15:51:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44cc107eb0 0x7f44cc1a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44cc108810 0x7f44cc1a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc1a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1a7450 con 0x7f44cc108810 2023-10-05T15:51:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1a75c0 con 0x7f44cc10f730 2023-10-05T15:51:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.342+0000 7f44d3dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44cc1a7780 con 0x7f44cc107eb0 2023-10-05T15:51:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.343+0000 7f44d239c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc1a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.343+0000 7f44d239c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc1a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39406/0 (socket says 172.21.15.17:39406) 2023-10-05T15:51:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.343+0000 7f44d239c700 1 -- 172.21.15.17:0/3875895377 learned_addr learned my addr 172.21.15.17:0/3875895377 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.343+0000 7f44d239c700 1 -- 172.21.15.17:0/3875895377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44cc107eb0 msgr2=0x7f44cc1a5a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:51:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.343+0000 7f44d239c700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44cc107eb0 0x7f44cc1a5a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.343+0000 7f44d239c700 1 -- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44cc108810 msgr2=0x7f44cc1a5f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:51:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.344+0000 7f44d239c700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44cc108810 0x7f44cc1a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.344+0000 7f44d239c700 1 -- 172.21.15.17:0/3875895377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40095f0 con 0x7f44cc10f730 2023-10-05T15:51:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.344+0000 7f44d239c700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc1a6df0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f44c4005910 tx=0x7f44c4005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.345+0000 7f44caffd700 1 -- 172.21.15.17:0/3875895377 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c401d070 con 0x7f44cc10f730 2023-10-05T15:51:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.345+0000 7f44caffd700 1 -- 172.21.15.17:0/3875895377 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c4004080 con 0x7f44cc10f730 2023-10-05T15:51:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.345+0000 7f44caffd700 1 -- 172.21.15.17:0/3875895377 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4005290 con 0x7f44cc10f730 2023-10-05T15:51:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.345+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc1a7a00 con 0x7f44cc10f730 2023-10-05T15:51:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.345+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44cc1ae220 con 0x7f44cc10f730 2023-10-05T15:51:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.352+0000 7f44caffd700 1 -- 172.21.15.17:0/3875895377 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f44c40048e0 con 0x7f44cc10f730 2023-10-05T15:51:00.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:00 smithi079 ceph-mon[132936]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 577 op/s 2023-10-05T15:51:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.353+0000 7f44e773fb80 1 Processor -- start 2023-10-05T15:51:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 -- start start 2023-10-05T15:51:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f51c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f51d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 0x56516f524220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f484400 con 0x56516f51bec0 2023-10-05T15:51:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f475bc0 con 0x56516f51d990 2023-10-05T15:51:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.354+0000 7f44e773fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f4734e0 con 0x56516f51cfd0 2023-10-05T15:51:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.355+0000 7f44caffd700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f44bc0a1650 0x7f44bc0a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.356+0000 7f44caffd700 1 -- 172.21.15.17:0/3875895377 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f44c40cdbf0 con 0x7f44cc10f730 2023-10-05T15:51:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.357+0000 7f44d139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 0x56516f524220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.357+0000 7f44d139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 0x56516f524220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39416/0 (socket says 172.21.15.17:39416) 2023-10-05T15:51:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.357+0000 7f44d139a700 1 -- 172.21.15.17:0/2706309141 learned_addr learned my addr 172.21.15.17:0/2706309141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.357+0000 7f44d139a700 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f51c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.358+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f51d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.358+0000 7f44d139a700 1 -- 172.21.15.17:0/2706309141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 msgr2=0x56516f51d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.358+0000 7f44d139a700 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f51d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.358+0000 7f44d139a700 1 -- 172.21.15.17:0/2706309141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 msgr2=0x56516f51c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.358+0000 7f44d139a700 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f51c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.358+0000 7f44d139a700 1 -- 172.21.15.17:0/2706309141 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56516f299d80 con 0x56516f51d990 2023-10-05T15:51:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.359+0000 7f44d139a700 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 0x56516f524220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f44b800bf80 tx=0x7f44b800b530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4851fff85db13677 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.359+0000 7f44b7fff700 1 -- 172.21.15.17:0/2706309141 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8012cd0 con 0x56516f51d990 2023-10-05T15:51:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.359+0000 7f44b7fff700 1 -- 172.21.15.17:0/2706309141 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44b8012e30 con 0x56516f51d990 2023-10-05T15:51:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.359+0000 7f44b7fff700 1 -- 172.21.15.17:0/2706309141 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8006330 con 0x56516f51d990 2023-10-05T15:51:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.359+0000 7f44d239c700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f44bc0a1650 0x7f44bc0a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.360+0000 7f44d239c700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f44bc0a1650 0x7f44bc0a3b10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f44c409a8a0 tx=0x7f44c4021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 -- 172.21.15.17:0/2706309141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 msgr2=0x56516f524220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 0x56516f524220 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f44b800bf80 tx=0x7f44b800b530 comp rx=0 tx=0).stop 2023-10-05T15:51:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 -- 172.21.15.17:0/2706309141 shutdown_connections 2023-10-05T15:51:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51d990 0x56516f524220 secure :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f44b800bf80 tx=0x7f44b800b530 comp rx=0 tx=0).stop 2023-10-05T15:51:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f51c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2706309141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f51d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.363+0000 7f44e773fb80 1 -- 172.21.15.17:0/2706309141 >> 172.21.15.17:0/2706309141 conn(0x56516f490200 msgr2=0x56516f516bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.364+0000 7f44e773fb80 1 -- 172.21.15.17:0/2706309141 shutdown_connections 2023-10-05T15:51:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.364+0000 7f44e773fb80 1 -- 172.21.15.17:0/2706309141 wait complete. 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.365+0000 7f44e773fb80 1 -- start start 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.366+0000 7f44e773fb80 1 Processor -- start 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 0x56516f525e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51cfd0 0x56516f5263b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f52b3e0 0x56516f52d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f46edd0 con 0x56516f52b3e0 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f40b6b0 con 0x56516f51cfd0 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f40b350 con 0x56516f51bec0 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44e773fb80 10 client.0 _ll_register_callbacks cb 0x56516f2687a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44d139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 0x56516f525e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44d139a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 0x56516f525e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:34506/0 (socket says 172.21.15.17:34506) 2023-10-05T15:51:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44d139a700 1 -- 172.21.15.17:0/2481269940 learned_addr learned my addr 172.21.15.17:0/2481269940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.367+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51cfd0 0x56516f5263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.368+0000 7f44d139a700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f52b3e0 0x56516f52d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.368+0000 7f44d139a700 1 -- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51cfd0 msgr2=0x56516f5263b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.368+0000 7f44d139a700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51cfd0 0x56516f5263b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.368+0000 7f44d139a700 1 -- 172.21.15.17:0/2481269940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f52b3e0 msgr2=0x56516f52d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.368+0000 7f44d139a700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f52b3e0 0x56516f52d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.368+0000 7f44d139a700 1 -- 172.21.15.17:0/2481269940 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b8013040 con 0x56516f51bec0 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.369+0000 7f44d139a700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 0x56516f525e70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f44b800b4d0 tx=0x7f44b8004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbcaebdd1f88aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.369+0000 7f44b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.369+0000 7f44b57fa700 1 -- 172.21.15.17:0/2481269940 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b80062e0 con 0x56516f51bec0 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.369+0000 7f44b57fa700 1 -- 172.21.15.17:0/2481269940 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f44b8006440 con 0x56516f51bec0 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.370+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56516f50ed50 con 0x56516f51bec0 2023-10-05T15:51:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.370+0000 7f44b57fa700 1 -- 172.21.15.17:0/2481269940 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44b8006600 con 0x56516f51bec0 2023-10-05T15:51:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.371+0000 7f44e773fb80 10 client.27103 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.371+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56516f282c00 con 0x56516f51bec0 2023-10-05T15:51:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.371+0000 7f44b57fa700 1 -- 172.21.15.17:0/2481269940 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56516f50ed50 con 0x56516f51bec0 2023-10-05T15:51:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.371+0000 7f44b57fa700 1 -- 172.21.15.17:0/2481269940 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f44b8018470 con 0x56516f51bec0 2023-10-05T15:51:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44e773fb80 10 client.27103 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44e773fb80 10 client.27103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44e773fb80 20 client.27103 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f542ef0 0x56516f545310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44e773fb80 4 client.27103 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56516f467db0 con 0x56516f542ef0 2023-10-05T15:51:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.372+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f542ef0 0x56516f545310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.374+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f542ef0 0x56516f545310 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b05dece10b605e23 server_cookie=a29f03c4e0e7584c in_seq=0 out_seq=0 2023-10-05T15:51:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.375+0000 7f44b57fa700 10 client.27103 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.376+0000 7f44b57fa700 1 -- 172.21.15.17:0/2481269940 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56516f467db0 con 0x56516f542ef0 2023-10-05T15:51:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.376+0000 7f44b57fa700 10 client.27103 handle_command_reply: tid=0 2023-10-05T15:51:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.376+0000 7f44e773fb80 1 client.27103 shutdown 2023-10-05T15:51:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 msgr2=0x56516f525e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 0x56516f525e70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f44b800b4d0 tx=0x7f44b8004860 comp rx=0 tx=0).stop 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 shutdown_connections 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f542ef0 0x56516f545310 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f52b3e0 0x56516f52d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51bec0 0x56516f525e70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 --2- 172.21.15.17:0/2481269940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f51cfd0 0x56516f5263b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 >> 172.21.15.17:0/2481269940 conn(0x56516f490200 msgr2=0x56516f516250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.377+0000 7f44b57fa700 0 client.27103 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.378+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 shutdown_connections 2023-10-05T15:51:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.378+0000 7f44e773fb80 1 -- 172.21.15.17:0/2481269940 wait complete. 2023-10-05T15:51:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.379+0000 7f44e773fb80 20 client.27103 trim_cache size 0 max 16384 2023-10-05T15:51:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.409+0000 7f44e773fb80 1 Processor -- start 2023-10-05T15:51:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 -- start start 2023-10-05T15:51:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f525520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5240f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f516250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f2ef8c0 con 0x56516f51bec0 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f524630 con 0x56516f52b3e0 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.410+0000 7f44e773fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f513860 con 0x56516f51cfd0 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.412+0000 7f44d1b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5240f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.412+0000 7f44d1b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5240f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:34508/0 (socket says 172.21.15.17:34508) 2023-10-05T15:51:00.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.412+0000 7f44d1b9b700 1 -- 172.21.15.17:0/23741406 learned_addr learned my addr 172.21.15.17:0/23741406 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:00.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.412+0000 7f44d139a700 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f516250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.412+0000 7f44d139a700 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f525520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.413+0000 7f44d1b9b700 1 -- 172.21.15.17:0/23741406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 msgr2=0x56516f516250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.413+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f516250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.413+0000 7f44d1b9b700 1 -- 172.21.15.17:0/23741406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 msgr2=0x56516f525520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.413+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f525520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.413+0000 7f44d1b9b700 1 -- 172.21.15.17:0/23741406 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56516f2c01f0 con 0x56516f51cfd0 2023-10-05T15:51:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.413+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5240f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56516f545bc0 tx=0x7f44c0009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d918c928701d4e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:00.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.414+0000 7f44c8bff700 1 -- 172.21.15.17:0/23741406 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0004b40 con 0x56516f51cfd0 2023-10-05T15:51:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.414+0000 7f44c8bff700 1 -- 172.21.15.17:0/23741406 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c001d070 con 0x56516f51cfd0 2023-10-05T15:51:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.414+0000 7f44c8bff700 1 -- 172.21.15.17:0/23741406 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0004050 con 0x56516f51cfd0 2023-10-05T15:51:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 -- 172.21.15.17:0/23741406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 msgr2=0x56516f5240f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5240f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56516f545bc0 tx=0x7f44c0009040 comp rx=0 tx=0).stop 2023-10-05T15:51:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 -- 172.21.15.17:0/23741406 shutdown_connections 2023-10-05T15:51:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f516250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f525520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 --2- 172.21.15.17:0/23741406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5240f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.419+0000 7f44e773fb80 1 -- 172.21.15.17:0/23741406 >> 172.21.15.17:0/23741406 conn(0x56516f490200 msgr2=0x56516f549c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:00.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.420+0000 7f44e773fb80 1 -- 172.21.15.17:0/23741406 shutdown_connections 2023-10-05T15:51:00.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.420+0000 7f44e773fb80 1 -- 172.21.15.17:0/23741406 wait complete. 2023-10-05T15:51:00.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.421+0000 7f44e773fb80 1 -- start start 2023-10-05T15:51:00.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.421+0000 7f44e773fb80 1 Processor -- start 2023-10-05T15:51:00.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f5523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f595a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f595fb0 con 0x56516f51bec0 2023-10-05T15:51:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f596120 con 0x56516f52b3e0 2023-10-05T15:51:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56516f5962e0 con 0x56516f51cfd0 2023-10-05T15:51:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.423+0000 7f44e773fb80 10 client.0 _ll_register_callbacks cb 0x7f44b8012160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f595a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f595a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39448/0 (socket says 172.21.15.17:39448) 2023-10-05T15:51:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 -- 172.21.15.17:0/469831745 learned_addr learned my addr 172.21.15.17:0/469831745 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f5523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 -- 172.21.15.17:0/469831745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 msgr2=0x56516f5528e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:51:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5528e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 -- 172.21.15.17:0/469831745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 msgr2=0x56516f5523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f5523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.425+0000 7f44d139a700 1 -- 172.21.15.17:0/469831745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0011040 con 0x56516f52b3e0 2023-10-05T15:51:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.426+0000 7f44d139a700 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f595a70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f44b8018aa0 tx=0x7f44b8033040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da16ffc64f8bf313 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.426+0000 7f44b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.427+0000 7f44b57fa700 1 -- 172.21.15.17:0/469831745 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8036040 con 0x56516f52b3e0 2023-10-05T15:51:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.427+0000 7f44b57fa700 1 -- 172.21.15.17:0/469831745 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f44b8000e40 con 0x56516f52b3e0 2023-10-05T15:51:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.427+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44b8012e30 con 0x56516f52b3e0 2023-10-05T15:51:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.427+0000 7f44b57fa700 1 -- 172.21.15.17:0/469831745 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44b800b870 con 0x56516f52b3e0 2023-10-05T15:51:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.427+0000 7f44e773fb80 10 client.27188 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.427+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56516f298250 con 0x56516f52b3e0 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44b57fa700 1 -- 172.21.15.17:0/469831745 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44b8045080 con 0x56516f52b3e0 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44b57fa700 1 -- 172.21.15.17:0/469831745 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f44b8003680 con 0x56516f52b3e0 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44e773fb80 10 client.27188 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44e773fb80 10 client.27188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44e773fb80 20 client.27188 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44e773fb80 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f597a20 0x56516f599e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44e773fb80 4 client.27188 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:51:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.428+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56516f467ad0 con 0x56516f597a20 2023-10-05T15:51:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.429+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f597a20 0x56516f599e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.430+0000 7f44d1b9b700 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f597a20 0x56516f599e40 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0bdb708ab830470 server_cookie=8e8908b7d3150af0 in_seq=0 out_seq=0 2023-10-05T15:51:00.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.430+0000 7f44b57fa700 10 client.27188 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:00.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:00 smithi017 ceph-mon[129107]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.1 MiB/s wr, 577 op/s 2023-10-05T15:51:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.455+0000 7f44b57fa700 1 -- 172.21.15.17:0/469831745 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56516f467ad0 con 0x56516f597a20 2023-10-05T15:51:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.455+0000 7f44b57fa700 10 client.27188 handle_command_reply: tid=0 2023-10-05T15:51:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.455+0000 7f44e773fb80 1 client.27188 shutdown 2023-10-05T15:51:00.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.457+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 msgr2=0x56516f595a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.457+0000 7f44e773fb80 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f595a70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f44b8018aa0 tx=0x7f44b8033040 comp rx=0 tx=0).stop 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 shutdown_connections 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44e773fb80 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56516f597a20 0x56516f599e40 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44e773fb80 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56516f52b3e0 0x56516f595a70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44e773fb80 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56516f51bec0 0x56516f5523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44e773fb80 1 --2- 172.21.15.17:0/469831745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56516f51cfd0 0x56516f5528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 >> 172.21.15.17:0/469831745 conn(0x56516f490200 msgr2=0x56516f516aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.458+0000 7f44b57fa700 0 client.27188 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.459+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 shutdown_connections 2023-10-05T15:51:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.459+0000 7f44e773fb80 1 -- 172.21.15.17:0/469831745 wait complete. 2023-10-05T15:51:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.460+0000 7f44e773fb80 20 client.27188 trim_cache size 0 max 16384 2023-10-05T15:51:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:51:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:51:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:51:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f44bc0a1650 msgr2=0x7f44bc0a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f44bc0a1650 0x7f44bc0a3b10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f44c409a8a0 tx=0x7f44c4021000 comp rx=0 tx=0).stop 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 msgr2=0x7f44cc1a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc1a6df0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f44c4005910 tx=0x7f44c4005ef0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 shutdown_connections 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f44bc0a1650 0x7f44bc0a3b10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44cc10f730 0x7f44cc1a6df0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44cc107eb0 0x7f44cc1a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 --2- 172.21.15.17:0/3875895377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f44cc108810 0x7f44cc1a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.461+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 >> 172.21.15.17:0/3875895377 conn(0x7f44cc06dd10 msgr2=0x7f44cc06f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.462+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 shutdown_connections 2023-10-05T15:51:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:00.464+0000 7f44d3dff700 1 -- 172.21.15.17:0/3875895377 wait complete. 2023-10-05T15:51:02.339 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:02 smithi167 ceph-mon[133366]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.5 MiB/s wr, 607 op/s 2023-10-05T15:51:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:02 smithi079 ceph-mon[132936]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.5 MiB/s wr, 607 op/s 2023-10-05T15:51:02.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:02 smithi017 ceph-mon[129107]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.5 MiB/s wr, 607 op/s 2023-10-05T15:51:03.196 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 745.0 s, 509.5 tps, lat 196.360 ms stddev 63.818 2023-10-05T15:51:04.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:04 smithi167 ceph-mon[133366]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 534 op/s 2023-10-05T15:51:04.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:04 smithi079 ceph-mon[132936]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 534 op/s 2023-10-05T15:51:04.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:04 smithi017 ceph-mon[129107]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 534 op/s 2023-10-05T15:51:05.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:05 smithi017 ceph-mon[129107]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 703 op/s 2023-10-05T15:51:05.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:05 smithi167 ceph-mon[133366]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 703 op/s 2023-10-05T15:51:05.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:05 smithi079 ceph-mon[132936]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 703 op/s 2023-10-05T15:51:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 750.0 s, 497.6 tps, lat 201.558 ms stddev 62.884 2023-10-05T15:51:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:08 smithi167 ceph-mon[133366]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 522 op/s 2023-10-05T15:51:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:08 smithi079 ceph-mon[132936]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 522 op/s 2023-10-05T15:51:08.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:08 smithi017 ceph-mon[129107]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.1 MiB/s wr, 522 op/s 2023-10-05T15:51:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:10 smithi167 ceph-mon[133366]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 636 op/s 2023-10-05T15:51:10.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:10 smithi079 ceph-mon[132936]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 636 op/s 2023-10-05T15:51:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:10 smithi017 ceph-mon[129107]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 636 op/s 2023-10-05T15:51:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:12 smithi167 ceph-mon[133366]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.9 MiB/s wr, 658 op/s 2023-10-05T15:51:12.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:12 smithi079 ceph-mon[132936]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.9 MiB/s wr, 658 op/s 2023-10-05T15:51:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:12 smithi017 ceph-mon[129107]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.9 MiB/s wr, 658 op/s 2023-10-05T15:51:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 755.0 s, 489.4 tps, lat 203.763 ms stddev 76.888 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 -- 172.21.15.17:0/2319982649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104aa0 msgr2=0x7f3328104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 --2- 172.21.15.17:0/2319982649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104aa0 0x7f3328104f20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f332000b0a0 tx=0x7f332000b3b0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 -- 172.21.15.17:0/2319982649 shutdown_connections 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 --2- 172.21.15.17:0/2319982649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104aa0 0x7f3328104f20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 --2- 172.21.15.17:0/2319982649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33280ff760 0x7f3328101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 --2- 172.21.15.17:0/2319982649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33281020d0 0x7f3328104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 -- 172.21.15.17:0/2319982649 >> 172.21.15.17:0/2319982649 conn(0x7f33280fb340 msgr2=0x7f33280fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 -- 172.21.15.17:0/2319982649 shutdown_connections 2023-10-05T15:51:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.734+0000 7f332dfff700 1 -- 172.21.15.17:0/2319982649 wait complete. 2023-10-05T15:51:13.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.736+0000 7f332dfff700 1 Processor -- start 2023-10-05T15:51:13.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.736+0000 7f332dfff700 1 -- start start 2023-10-05T15:51:13.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f332dfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33280ff760 0x7f332810ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f332dfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33281020d0 0x7f332810b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f332dfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3328104aa0 0x7f332810c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f332dfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332810c8b0 con 0x7f33281020d0 2023-10-05T15:51:13.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f332dfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332810ca20 con 0x7f3328104aa0 2023-10-05T15:51:13.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f332dfff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332810cbe0 con 0x7f33280ff760 2023-10-05T15:51:13.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f33277fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33280ff760 0x7f332810ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f33277fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33280ff760 0x7f332810ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:34872/0 (socket says 172.21.15.17:34872) 2023-10-05T15:51:13.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.737+0000 7f33277fe700 1 -- 172.21.15.17:0/920150493 learned_addr learned my addr 172.21.15.17:0/920150493 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:13.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.738+0000 7f3327fff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3328104aa0 0x7f332810c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.738+0000 7f331ffff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33281020d0 0x7f332810b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.739+0000 7f3327fff700 1 -- 172.21.15.17:0/920150493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33280ff760 msgr2=0x7f332810ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.739+0000 7f3327fff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33280ff760 0x7f332810ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.739+0000 7f3327fff700 1 -- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33281020d0 msgr2=0x7f332810b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.739+0000 7f3327fff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33281020d0 0x7f332810b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.739+0000 7f3327fff700 1 -- 172.21.15.17:0/920150493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320009d00 con 0x7f3328104aa0 2023-10-05T15:51:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.739+0000 7f3327fff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3328104aa0 0x7f332810c250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3320009fd0 tx=0x7f3320004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.740+0000 7f33257fa700 1 -- 172.21.15.17:0/920150493 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000e040 con 0x7f3328104aa0 2023-10-05T15:51:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.740+0000 7f33257fa700 1 -- 172.21.15.17:0/920150493 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33200094b0 con 0x7f3328104aa0 2023-10-05T15:51:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.740+0000 7f33257fa700 1 -- 172.21.15.17:0/920150493 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332001bbc0 con 0x7f3328104aa0 2023-10-05T15:51:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.740+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332810ce60 con 0x7f3328104aa0 2023-10-05T15:51:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.740+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332810d670 con 0x7f3328104aa0 2023-10-05T15:51:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.746+0000 7f33257fa700 1 -- 172.21.15.17:0/920150493 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f332001bd20 con 0x7f3328104aa0 2023-10-05T15:51:13.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.746+0000 7f33418b5b80 1 Processor -- start 2023-10-05T15:51:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 -- start start 2023-10-05T15:51:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b1fd0 0x55ef472b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef47219400 con 0x55ef472b0ec0 2023-10-05T15:51:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef4720abc0 con 0x55ef472b2990 2023-10-05T15:51:13.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.747+0000 7f33418b5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef472084e0 con 0x55ef472b1fd0 2023-10-05T15:51:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.748+0000 7f331ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.748+0000 7f331ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472b9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56088/0 (socket says 172.21.15.17:56088) 2023-10-05T15:51:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.748+0000 7f331ffff700 1 -- 172.21.15.17:0/240541687 learned_addr learned my addr 172.21.15.17:0/240541687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.748+0000 7f331ffff700 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.749+0000 7f33277fe700 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b1fd0 0x55ef472b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.749+0000 7f331ffff700 1 -- 172.21.15.17:0/240541687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b1fd0 msgr2=0x55ef472b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.749+0000 7f331ffff700 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b1fd0 0x55ef472b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.749+0000 7f331ffff700 1 -- 172.21.15.17:0/240541687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 msgr2=0x55ef472b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.749+0000 7f331ffff700 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.749+0000 7f331ffff700 1 -- 172.21.15.17:0/240541687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef4702ed80 con 0x55ef472b2990 2023-10-05T15:51:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.750+0000 7f331ffff700 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472b9220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33180117a0 tx=0x7f331800a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d1b3cd1d9ff6a36 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:13.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.750+0000 7f331dffb700 1 -- 172.21.15.17:0/240541687 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318004020 con 0x55ef472b2990 2023-10-05T15:51:13.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.750+0000 7f33257fa700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33140a1650 0x7f33140a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.750+0000 7f33257fa700 1 -- 172.21.15.17:0/920150493 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f33200cee50 con 0x7f3328104aa0 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.751+0000 7f331dffb700 1 -- 172.21.15.17:0/240541687 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3318004830 con 0x55ef472b2990 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.751+0000 7f331dffb700 1 -- 172.21.15.17:0/240541687 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318005310 con 0x55ef472b2990 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.752+0000 7f33277fe700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33140a1650 0x7f33140a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.752+0000 7f33418b5b80 1 -- 172.21.15.17:0/240541687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 msgr2=0x55ef472b9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.752+0000 7f33418b5b80 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472b9220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f33180117a0 tx=0x7f331800a760 comp rx=0 tx=0).stop 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.753+0000 7f33277fe700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33140a1650 0x7f33140a3b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3310005fd0 tx=0x7f3310008510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:13.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.754+0000 7f33418b5b80 1 -- 172.21.15.17:0/240541687 shutdown_connections 2023-10-05T15:51:13.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.754+0000 7f33418b5b80 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472b9220 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.754+0000 7f33418b5b80 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.754+0000 7f33418b5b80 1 --2- 172.21.15.17:0/240541687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b1fd0 0x55ef472b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.754+0000 7f33418b5b80 1 -- 172.21.15.17:0/240541687 >> 172.21.15.17:0/240541687 conn(0x55ef47225200 msgr2=0x55ef472abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:13.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.755+0000 7f33418b5b80 1 -- 172.21.15.17:0/240541687 shutdown_connections 2023-10-05T15:51:13.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.755+0000 7f33418b5b80 1 -- 172.21.15.17:0/240541687 wait complete. 2023-10-05T15:51:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.756+0000 7f33418b5b80 1 -- start start 2023-10-05T15:51:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.756+0000 7f33418b5b80 1 Processor -- start 2023-10-05T15:51:13.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b0ec0 0x55ef472baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472baff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef47203dd0 con 0x55ef472b1fd0 2023-10-05T15:51:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef471a06b0 con 0x55ef472b0ec0 2023-10-05T15:51:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef471a0350 con 0x55ef472b2990 2023-10-05T15:51:13.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33418b5b80 10 client.0 _ll_register_callbacks cb 0x55ef46ffd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f3327fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f3327fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:34896/0 (socket says 172.21.15.17:34896) 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f3327fff700 1 -- 172.21.15.17:0/2328092709 learned_addr learned my addr 172.21.15.17:0/2328092709 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.757+0000 7f33277fe700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b0ec0 0x55ef472baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.758+0000 7f331ffff700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.758+0000 7f3327fff700 1 -- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b0ec0 msgr2=0x55ef472baab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.758+0000 7f3327fff700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b0ec0 0x55ef472baab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.758+0000 7f3327fff700 1 -- 172.21.15.17:0/2328092709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 msgr2=0x55ef472baff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.758+0000 7f3327fff700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472baff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.758+0000 7f3327fff700 1 -- 172.21.15.17:0/2328092709 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3318019040 con 0x55ef472b2990 2023-10-05T15:51:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.759+0000 7f3327fff700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3320098870 tx=0x7f332009ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd4a2b1a4b82683a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:13.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.759+0000 7f3306ffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:51:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.760+0000 7f3306ffd700 1 -- 172.21.15.17:0/2328092709 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332009e030 con 0x55ef472b2990 2023-10-05T15:51:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.760+0000 7f3306ffd700 1 -- 172.21.15.17:0/2328092709 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f332009f070 con 0x55ef472b2990 2023-10-05T15:51:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.760+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef472a3d50 con 0x55ef472b2990 2023-10-05T15:51:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.761+0000 7f3306ffd700 1 -- 172.21.15.17:0/2328092709 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33200a2070 con 0x55ef472b2990 2023-10-05T15:51:13.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.761+0000 7f33418b5b80 10 client.27115 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:13.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.761+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55ef47017c00 con 0x55ef472b2990 2023-10-05T15:51:13.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.762+0000 7f3306ffd700 1 -- 172.21.15.17:0/2328092709 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ef472a3d50 con 0x55ef472b2990 2023-10-05T15:51:13.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.762+0000 7f3306ffd700 1 -- 172.21.15.17:0/2328092709 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33200a3c70 con 0x55ef472b2990 2023-10-05T15:51:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.764+0000 7f33418b5b80 10 client.27115 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.764+0000 7f33418b5b80 10 client.27115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.764+0000 7f33418b5b80 20 client.27115 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.764+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef472c66b0 0x55ef472c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.764+0000 7f33418b5b80 4 client.27115 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:13.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.764+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef471fcdb0 con 0x55ef472c66b0 2023-10-05T15:51:13.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.767+0000 7f33277fe700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef472c66b0 0x55ef472c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.770+0000 7f33277fe700 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef472c66b0 0x55ef472c8ad0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d3ffab4b1f0f4e server_cookie=5dc22fde78a21896 in_seq=0 out_seq=0 2023-10-05T15:51:13.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.770+0000 7f3306ffd700 10 client.27115 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.771+0000 7f3306ffd700 1 -- 172.21.15.17:0/2328092709 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ef471fcdb0 con 0x55ef472c66b0 2023-10-05T15:51:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.771+0000 7f3306ffd700 10 client.27115 handle_command_reply: tid=0 2023-10-05T15:51:13.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.771+0000 7f33418b5b80 1 client.27115 shutdown 2023-10-05T15:51:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 msgr2=0x55ef472c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3320098870 tx=0x7f332009ba10 comp rx=0 tx=0).stop 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 shutdown_connections 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef472c66b0 0x55ef472c8ad0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2030 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b0ec0 0x55ef472baab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2328092709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472baff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 >> 172.21.15.17:0/2328092709 conn(0x55ef47225200 msgr2=0x55ef472ab250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:13.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f3306ffd700 0 client.27115 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 shutdown_connections 2023-10-05T15:51:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.772+0000 7f33418b5b80 1 -- 172.21.15.17:0/2328092709 wait complete. 2023-10-05T15:51:13.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.773+0000 7f33418b5b80 20 client.27115 trim_cache size 0 max 16384 2023-10-05T15:51:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.803+0000 7f33418b5b80 1 Processor -- start 2023-10-05T15:51:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.803+0000 7f33418b5b80 1 -- start start 2023-10-05T15:51:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 0x55ef472c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f33418b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef470848c0 con 0x55ef472b0ec0 2023-10-05T15:51:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f33418b5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef471fcde0 con 0x55ef472b1fd0 2023-10-05T15:51:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f33418b5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef472acf50 con 0x55ef472b2990 2023-10-05T15:51:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f331ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 0x55ef472c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f331ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 0x55ef472c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56100/0 (socket says 172.21.15.17:56100) 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.804+0000 7f331ffff700 1 -- 172.21.15.17:0/2613566562 learned_addr learned my addr 172.21.15.17:0/2613566562 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.805+0000 7f3327fff700 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.805+0000 7f331ffff700 1 -- 172.21.15.17:0/2613566562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 msgr2=0x55ef472c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.805+0000 7f331ffff700 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.805+0000 7f331ffff700 1 -- 172.21.15.17:0/2613566562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 msgr2=0x55ef472aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.805+0000 7f331ffff700 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.805+0000 7f331ffff700 1 -- 172.21.15.17:0/2613566562 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef470551f0 con 0x55ef472b1fd0 2023-10-05T15:51:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.806+0000 7f331ffff700 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 0x55ef472c1f50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f33180117a0 tx=0x7f331800af00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e0a9e89fe3bfd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.806+0000 7f331e7fc700 1 -- 172.21.15.17:0/2613566562 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318023040 con 0x55ef472b1fd0 2023-10-05T15:51:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.806+0000 7f331e7fc700 1 -- 172.21.15.17:0/2613566562 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3318015040 con 0x55ef472b1fd0 2023-10-05T15:51:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.806+0000 7f331e7fc700 1 -- 172.21.15.17:0/2613566562 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33180056f0 con 0x55ef472b1fd0 2023-10-05T15:51:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 -- 172.21.15.17:0/2613566562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 msgr2=0x55ef472c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 0x55ef472c1f50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f33180117a0 tx=0x7f331800af00 comp rx=0 tx=0).stop 2023-10-05T15:51:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 -- 172.21.15.17:0/2613566562 shutdown_connections 2023-10-05T15:51:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b2990 0x55ef472c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b0ec0 0x55ef472aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 --2- 172.21.15.17:0/2613566562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b1fd0 0x55ef472c1f50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 -- 172.21.15.17:0/2613566562 >> 172.21.15.17:0/2613566562 conn(0x55ef47225200 msgr2=0x55ef472abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 -- 172.21.15.17:0/2613566562 shutdown_connections 2023-10-05T15:51:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.808+0000 7f33418b5b80 1 -- 172.21.15.17:0/2613566562 wait complete. 2023-10-05T15:51:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.809+0000 7f33418b5b80 1 -- start start 2023-10-05T15:51:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.809+0000 7f33418b5b80 1 Processor -- start 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b0ec0 0x55ef472bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472bde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef472c13e0 con 0x55ef472b1fd0 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef472c1550 con 0x55ef472b2990 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef472c1710 con 0x55ef472b0ec0 2023-10-05T15:51:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.810+0000 7f33418b5b80 10 client.0 _ll_register_callbacks cb 0x7f332009bbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472c0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56102/0 (socket says 172.21.15.17:56102) 2023-10-05T15:51:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 -- 172.21.15.17:0/3654777765 learned_addr learned my addr 172.21.15.17:0/3654777765 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f33277fe700 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b0ec0 0x55ef472bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 -- 172.21.15.17:0/3654777765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b0ec0 msgr2=0x55ef472bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b0ec0 0x55ef472bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 -- 172.21.15.17:0/3654777765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 msgr2=0x55ef472bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 -- 172.21.15.17:0/3654777765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef4702ed80 con 0x55ef472b2990 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.811+0000 7f3327fff700 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472c0ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3320098300 tx=0x7f332009c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f893f0aa8eeea1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.812+0000 7f3306ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.812+0000 7f3306ffd700 1 -- 172.21.15.17:0/3654777765 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332009e070 con 0x55ef472b2990 2023-10-05T15:51:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.812+0000 7f3306ffd700 1 -- 172.21.15.17:0/3654777765 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3320097c40 con 0x55ef472b2990 2023-10-05T15:51:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.812+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3318004830 con 0x55ef472b2990 2023-10-05T15:51:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.812+0000 7f3306ffd700 1 -- 172.21.15.17:0/3654777765 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33200a2070 con 0x55ef472b2990 2023-10-05T15:51:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.812+0000 7f33418b5b80 10 client.27203 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55ef4702d250 con 0x55ef472b2990 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f3306ffd700 1 -- 172.21.15.17:0/3654777765 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3318004830 con 0x55ef472b2990 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f3306ffd700 1 -- 172.21.15.17:0/3654777765 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33200a3c70 con 0x55ef472b2990 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 10 client.27203 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 10 client.27203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 20 client.27203 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef4732bbe0 0x55ef4732e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 4 client.27203 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.813+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef471fcad0 con 0x55ef4732bbe0 2023-10-05T15:51:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.814+0000 7f33277fe700 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef4732bbe0 0x55ef4732e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:13.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.814+0000 7f33277fe700 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef4732bbe0 0x55ef4732e000 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47cc4e834d3d0b1c server_cookie=a219196cb3469253 in_seq=0 out_seq=0 2023-10-05T15:51:13.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.814+0000 7f3306ffd700 10 client.27203 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f3306ffd700 1 -- 172.21.15.17:0/3654777765 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef471fcad0 con 0x55ef4732bbe0 2023-10-05T15:51:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f3306ffd700 10 client.27203 handle_command_reply: tid=0 2023-10-05T15:51:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f33418b5b80 1 client.27203 shutdown 2023-10-05T15:51:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 msgr2=0x55ef472c0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f33418b5b80 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472c0ea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3320098300 tx=0x7f332009c640 comp rx=0 tx=0).stop 2023-10-05T15:51:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 shutdown_connections 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.836+0000 7f33418b5b80 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55ef4732bbe0 0x55ef4732e000 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.837+0000 7f33418b5b80 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ef472b2990 0x55ef472c0ea0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.837+0000 7f33418b5b80 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ef472b0ec0 0x55ef472bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.837+0000 7f33418b5b80 1 --2- 172.21.15.17:0/3654777765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef472b1fd0 0x55ef472bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.837+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 >> 172.21.15.17:0/3654777765 conn(0x55ef47225200 msgr2=0x55ef472b9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.837+0000 7f3306ffd700 0 client.27203 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.838+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 shutdown_connections 2023-10-05T15:51:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.838+0000 7f33418b5b80 1 -- 172.21.15.17:0/3654777765 wait complete. 2023-10-05T15:51:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:51:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:51:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:51:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.842+0000 7f33418b5b80 20 client.27203 trim_cache size 0 max 16384 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33140a1650 msgr2=0x7f33140a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33140a1650 0x7f33140a3b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3310005fd0 tx=0x7f3310008510 comp rx=0 tx=0).stop 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3328104aa0 msgr2=0x7f332810c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3328104aa0 0x7f332810c250 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3320009fd0 tx=0x7f3320004c80 comp rx=0 tx=0).stop 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 shutdown_connections 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33140a1650 0x7f33140a3b10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3328104aa0 0x7f332810c250 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33280ff760 0x7f332810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 --2- 172.21.15.17:0/920150493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f33281020d0 0x7f332810b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.845+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 >> 172.21.15.17:0/920150493 conn(0x7f33280fb340 msgr2=0x7f3328100410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.847+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 shutdown_connections 2023-10-05T15:51:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:13.847+0000 7f332dfff700 1 -- 172.21.15.17:0/920150493 wait complete. 2023-10-05T15:51:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:14 smithi167 ceph-mon[133366]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 572 op/s 2023-10-05T15:51:14.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:14 smithi079 ceph-mon[132936]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 572 op/s 2023-10-05T15:51:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:14 smithi017 ceph-mon[129107]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 572 op/s 2023-10-05T15:51:16.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:51:16.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:16 smithi017 ceph-mon[129107]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.8 MiB/s wr, 745 op/s 2023-10-05T15:51:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:16 smithi167 ceph-mon[133366]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.8 MiB/s wr, 745 op/s 2023-10-05T15:51:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:16 smithi079 ceph-mon[132936]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.8 MiB/s wr, 745 op/s 2023-10-05T15:51:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.601+0000 7f96149ff700 1 -- 172.21.15.17:0/117874705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 msgr2=0x7f9610102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.601+0000 7f96149ff700 1 --2- 172.21.15.17:0/117874705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610102500 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009990 tx=0x7f95f8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.602+0000 7f96149ff700 1 -- 172.21.15.17:0/117874705 shutdown_connections 2023-10-05T15:51:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.602+0000 7f96149ff700 1 --2- 172.21.15.17:0/117874705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9610102a40 0x7f9610109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.602+0000 7f96149ff700 1 --2- 172.21.15.17:0/117874705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610100ea0 0x7f96101012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.602+0000 7f96149ff700 1 --2- 172.21.15.17:0/117874705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610102500 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.602+0000 7f96149ff700 1 -- 172.21.15.17:0/117874705 >> 172.21.15.17:0/117874705 conn(0x7f96100fc460 msgr2=0x7f96100fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:16.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.602+0000 7f96149ff700 1 -- 172.21.15.17:0/117874705 shutdown_connections 2023-10-05T15:51:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.603+0000 7f96149ff700 1 -- 172.21.15.17:0/117874705 wait complete. 2023-10-05T15:51:16.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.605+0000 7f96149ff700 1 Processor -- start 2023-10-05T15:51:16.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.605+0000 7f96149ff700 1 -- start start 2023-10-05T15:51:16.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.605+0000 7f96149ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9610100ea0 0x7f9610194990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.605+0000 7f96149ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.605+0000 7f96149ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610102a40 0x7f9610194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.605+0000 7f96149ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96101ad4e0 con 0x7f9610100ea0 2023-10-05T15:51:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.606+0000 7f96149ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961006a8d0 con 0x7f9610102a40 2023-10-05T15:51:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.606+0000 7f96149ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961006aa90 con 0x7f9610102080 2023-10-05T15:51:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.606+0000 7f9607fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.606+0000 7f9607fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44420/0 (socket says 172.21.15.17:44420) 2023-10-05T15:51:16.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.606+0000 7f9607fff700 1 -- 172.21.15.17:0/2196656072 learned_addr learned my addr 172.21.15.17:0/2196656072 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:16.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f960ed9d700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610102a40 0x7f9610194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f9607fff700 1 -- 172.21.15.17:0/2196656072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610102a40 msgr2=0x7f9610194f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f9607fff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610102a40 0x7f9610194f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f9607fff700 1 -- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9610100ea0 msgr2=0x7f9610194990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f9607fff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9610100ea0 0x7f9610194990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f9607fff700 1 -- 172.21.15.17:0/2196656072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80095f0 con 0x7f9610102080 2023-10-05T15:51:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f960ed9d700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610102a40 0x7f9610194f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:51:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.607+0000 7f9607fff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610199ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c010 tx=0x7f95f8003b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.608+0000 7f96077fe700 1 -- 172.21.15.17:0/2196656072 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f801d070 con 0x7f9610102080 2023-10-05T15:51:16.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.608+0000 7f96077fe700 1 -- 172.21.15.17:0/2196656072 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f800bde0 con 0x7f9610102080 2023-10-05T15:51:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.608+0000 7f96077fe700 1 -- 172.21.15.17:0/2196656072 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800fce0 con 0x7f9610102080 2023-10-05T15:51:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.608+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961006ad10 con 0x7f9610102080 2023-10-05T15:51:16.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.608+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961006b170 con 0x7f9610102080 2023-10-05T15:51:16.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.616+0000 7f96077fe700 1 -- 172.21.15.17:0/2196656072 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f95f8003f20 con 0x7f9610102080 2023-10-05T15:51:16.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.618+0000 7f962828db80 1 Processor -- start 2023-10-05T15:51:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.619+0000 7f962828db80 1 -- start start 2023-10-05T15:51:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.620+0000 7f962828db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a01680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.620+0000 7f962828db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a02480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.620+0000 7f962828db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a02ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.620+0000 7f962828db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18969460 con 0x55fa18a01260 2023-10-05T15:51:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.620+0000 7f962828db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1895ac20 con 0x55fa18a01bc0 2023-10-05T15:51:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.620+0000 7f962828db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18958540 con 0x55fa18a02a60 2023-10-05T15:51:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.621+0000 7f960e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a02480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.621+0000 7f960e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a02480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52170/0 (socket says 172.21.15.17:52170) 2023-10-05T15:51:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.621+0000 7f960e59c700 1 -- 172.21.15.17:0/3092971547 learned_addr learned my addr 172.21.15.17:0/3092971547 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.622+0000 7f96077fe700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95fc0a1600 0x7f95fc0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.622+0000 7f96077fe700 1 -- 172.21.15.17:0/2196656072 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f95f80ce0e0 con 0x7f9610102080 2023-10-05T15:51:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.623+0000 7f960e59c700 1 -- 172.21.15.17:0/3092971547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 msgr2=0x55fa18a02ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:51:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.623+0000 7f960e59c700 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a02ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.623+0000 7f960e59c700 1 -- 172.21.15.17:0/3092971547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 msgr2=0x55fa18a01680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.623+0000 7f960e59c700 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a01680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.623+0000 7f960e59c700 1 -- 172.21.15.17:0/3092971547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa1877ede0 con 0x55fa18a01bc0 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.623+0000 7f960ed9d700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95fc0a1600 0x7f95fc0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.624+0000 7f960e59c700 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a02480 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f960002dbb0 tx=0x7f960002dec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=670a70db20c6623e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.626+0000 7f960ed9d700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95fc0a1600 0x7f95fc0a3ac0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9608009c40 tx=0x7f960800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.626+0000 7f9604ff9700 1 -- 172.21.15.17:0/3092971547 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960002fb00 con 0x55fa18a01bc0 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.626+0000 7f9604ff9700 1 -- 172.21.15.17:0/3092971547 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f960002fc60 con 0x55fa18a01bc0 2023-10-05T15:51:16.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.626+0000 7f9604ff9700 1 -- 172.21.15.17:0/3092971547 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600031630 con 0x55fa18a01bc0 2023-10-05T15:51:16.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.631+0000 7f962828db80 1 -- 172.21.15.17:0/3092971547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 msgr2=0x55fa18a02480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.631+0000 7f962828db80 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a02480 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f960002dbb0 tx=0x7f960002dec0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.632+0000 7f962828db80 1 -- 172.21.15.17:0/3092971547 shutdown_connections 2023-10-05T15:51:16.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.632+0000 7f962828db80 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a02ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.632+0000 7f962828db80 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a01680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.632+0000 7f962828db80 1 --2- 172.21.15.17:0/3092971547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a02480 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.632+0000 7f962828db80 1 -- 172.21.15.17:0/3092971547 >> 172.21.15.17:0/3092971547 conn(0x55fa18975260 msgr2=0x55fa189fc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:16.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.634+0000 7f962828db80 1 -- 172.21.15.17:0/3092971547 shutdown_connections 2023-10-05T15:51:16.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.635+0000 7f962828db80 1 -- 172.21.15.17:0/3092971547 wait complete. 2023-10-05T15:51:16.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.636+0000 7f962828db80 1 -- start start 2023-10-05T15:51:16.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.636+0000 7f962828db80 1 Processor -- start 2023-10-05T15:51:16.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a0b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a0b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18953e30 con 0x55fa18a01260 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa188f0710 con 0x55fa18a01bc0 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa188f03b0 con 0x55fa18a02a60 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.637+0000 7f962828db80 10 client.0 _ll_register_callbacks cb 0x55fa1874d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.638+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.639+0000 7f9607fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a0b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.639+0000 7f960e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a0b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.639+0000 7f960e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a0b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45010/0 (socket says 172.21.15.17:45010) 2023-10-05T15:51:16.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.639+0000 7f960e59c700 1 -- 172.21.15.17:0/910745322 learned_addr learned my addr 172.21.15.17:0/910745322 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.640+0000 7f960e59c700 1 -- 172.21.15.17:0/910745322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 msgr2=0x55fa18a126c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.640+0000 7f960e59c700 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a126c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.640+0000 7f960e59c700 1 -- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 msgr2=0x55fa18a0b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.640+0000 7f960e59c700 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a0b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.640+0000 7f960e59c700 1 -- 172.21.15.17:0/910745322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960002d810 con 0x55fa18a01260 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.642+0000 7f960e59c700 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a0b140 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9600005d60 tx=0x7f9600032470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da059951e316b7d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:16.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.642+0000 7f95f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:51:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.642+0000 7f95f5ffb700 1 -- 172.21.15.17:0/910745322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600032ea0 con 0x55fa18a01260 2023-10-05T15:51:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.642+0000 7f95f5ffb700 1 -- 172.21.15.17:0/910745322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f96000328c0 con 0x55fa18a01260 2023-10-05T15:51:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.642+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa189f3f10 con 0x55fa18a01260 2023-10-05T15:51:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.643+0000 7f95f5ffb700 1 -- 172.21.15.17:0/910745322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f960003d450 con 0x55fa18a01260 2023-10-05T15:51:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.643+0000 7f962828db80 10 client.17166 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:16.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.643+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55fa18767c60 con 0x55fa18a01260 2023-10-05T15:51:16.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.646+0000 7f95f5ffb700 1 -- 172.21.15.17:0/910745322 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa189f3f10 con 0x55fa18a01260 2023-10-05T15:51:16.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.646+0000 7f95f5ffb700 1 -- 172.21.15.17:0/910745322 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9600031640 con 0x55fa18a01260 2023-10-05T15:51:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f962828db80 10 client.17166 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f962828db80 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f962828db80 20 client.17166 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f962828db80 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a16d40 0x55fa18a19160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f962828db80 4 client.17166 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa1894ce10 con 0x55fa18a16d40 2023-10-05T15:51:16.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.647+0000 7f9607fff700 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a16d40 0x55fa18a19160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.648+0000 7f95f5ffb700 10 client.17166 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:16.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.648+0000 7f9607fff700 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a16d40 0x55fa18a19160 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a286ee0006d6bb4 server_cookie=de4514319950e0f0 in_seq=0 out_seq=0 2023-10-05T15:51:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.649+0000 7f95f5ffb700 1 -- 172.21.15.17:0/910745322 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa1894ce10 con 0x55fa18a16d40 2023-10-05T15:51:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.649+0000 7f95f5ffb700 10 client.17166 handle_command_reply: tid=0 2023-10-05T15:51:16.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.649+0000 7f962828db80 1 client.17166 shutdown 2023-10-05T15:51:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.650+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 msgr2=0x55fa18a0b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.650+0000 7f962828db80 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a0b140 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9600005d60 tx=0x7f9600032470 comp rx=0 tx=0).stop 2023-10-05T15:51:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 shutdown_connections 2023-10-05T15:51:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a16d40 0x55fa18a19160 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a126c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a0b140 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 --2- 172.21.15.17:0/910745322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a0b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 >> 172.21.15.17:0/910745322 conn(0x55fa18975260 msgr2=0x55fa189fbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:16.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f95f5ffb700 0 client.17166 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 shutdown_connections 2023-10-05T15:51:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.651+0000 7f962828db80 1 -- 172.21.15.17:0/910745322 wait complete. 2023-10-05T15:51:16.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.653+0000 7f962828db80 20 client.17166 trim_cache size 0 max 16384 2023-10-05T15:51:16.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.694+0000 7f962828db80 1 Processor -- start 2023-10-05T15:51:16.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.704+0000 7f962828db80 1 -- start start 2023-10-05T15:51:16.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f962828db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a01260 0x55fa18a09d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f962828db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01bc0 0x55fa18a0a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f962828db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a02a60 0x55fa18a12680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f962828db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa187d4920 con 0x55fa18a01bc0 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f962828db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18a00f10 con 0x55fa18a02a60 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f962828db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18a136b0 con 0x55fa18a01260 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f960e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a01260 0x55fa18a09d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f960e59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a01260 0x55fa18a09d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:44442/0 (socket says 172.21.15.17:44442) 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.705+0000 7f960e59c700 1 -- 172.21.15.17:0/3132375149 learned_addr learned my addr 172.21.15.17:0/3132375149 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:16.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.706+0000 7f960ed9d700 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a02a60 0x55fa18a12680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.708+0000 7f9607fff700 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01bc0 0x55fa18a0a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.709+0000 7f960ed9d700 1 -- 172.21.15.17:0/3132375149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a01260 msgr2=0x55fa18a09d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.709+0000 7f960ed9d700 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a01260 0x55fa18a09d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.709+0000 7f960ed9d700 1 -- 172.21.15.17:0/3132375149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01bc0 msgr2=0x55fa18a0a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.709+0000 7f960ed9d700 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01bc0 0x55fa18a0a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.709+0000 7f960ed9d700 1 -- 172.21.15.17:0/3132375149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa187a5250 con 0x55fa18a02a60 2023-10-05T15:51:16.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.710+0000 7f960ed9d700 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a02a60 0x55fa18a12680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9608004b10 tx=0x7f9608014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41999bc89149b81 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.711+0000 7f96057fa700 1 -- 172.21.15.17:0/3132375149 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608007e40 con 0x55fa18a02a60 2023-10-05T15:51:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.711+0000 7f96057fa700 1 -- 172.21.15.17:0/3132375149 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f960800f040 con 0x55fa18a02a60 2023-10-05T15:51:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.711+0000 7f96057fa700 1 -- 172.21.15.17:0/3132375149 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608013620 con 0x55fa18a02a60 2023-10-05T15:51:16.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.712+0000 7f962828db80 1 -- 172.21.15.17:0/3132375149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a02a60 msgr2=0x55fa18a12680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.712+0000 7f962828db80 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a02a60 0x55fa18a12680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9608004b10 tx=0x7f9608014000 comp rx=0 tx=0).stop 2023-10-05T15:51:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.716+0000 7f962828db80 1 -- 172.21.15.17:0/3132375149 shutdown_connections 2023-10-05T15:51:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.716+0000 7f962828db80 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a02a60 0x55fa18a12680 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.716+0000 7f962828db80 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a01260 0x55fa18a09d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.716+0000 7f962828db80 1 --2- 172.21.15.17:0/3132375149 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01bc0 0x55fa18a0a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.716+0000 7f962828db80 1 -- 172.21.15.17:0/3132375149 >> 172.21.15.17:0/3132375149 conn(0x55fa18975260 msgr2=0x55fa18a08f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.717+0000 7f962828db80 1 -- 172.21.15.17:0/3132375149 shutdown_connections 2023-10-05T15:51:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.717+0000 7f962828db80 1 -- 172.21.15.17:0/3132375149 wait complete. 2023-10-05T15:51:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.718+0000 7f962828db80 1 -- start start 2023-10-05T15:51:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.718+0000 7f962828db80 1 Processor -- start 2023-10-05T15:51:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a10720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a10c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a11c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18a121b0 con 0x55fa18a01260 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18a12320 con 0x55fa18a01bc0 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18a124e0 con 0x55fa18a02a60 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f962828db80 10 client.0 _ll_register_callbacks cb 0x7f960002da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f9607fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a10c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f9607fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a10c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:52210/0 (socket says 172.21.15.17:52210) 2023-10-05T15:51:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.719+0000 7f9607fff700 1 -- 172.21.15.17:0/3020699812 learned_addr learned my addr 172.21.15.17:0/3020699812 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:16.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f960e59c700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a10720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f960ed9d700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a11c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f9607fff700 1 -- 172.21.15.17:0/3020699812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 msgr2=0x55fa18a11c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f9607fff700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a11c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f9607fff700 1 -- 172.21.15.17:0/3020699812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 msgr2=0x55fa18a10720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:16.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f9607fff700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a10720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.722+0000 7f9607fff700 1 -- 172.21.15.17:0/3020699812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960801d040 con 0x55fa18a01bc0 2023-10-05T15:51:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.723+0000 7f9607fff700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a10c60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f95f80cb7e0 tx=0x7f95f8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20042f55656ed1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.723+0000 7f95f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.723+0000 7f95f5ffb700 1 -- 172.21.15.17:0/3020699812 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f809b090 con 0x55fa18a01bc0 2023-10-05T15:51:16.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.723+0000 7f95f5ffb700 1 -- 172.21.15.17:0/3020699812 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f95f809f1e0 con 0x55fa18a01bc0 2023-10-05T15:51:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.724+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f960002fc60 con 0x55fa18a01bc0 2023-10-05T15:51:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.724+0000 7f960e59c700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a10720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:51:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.724+0000 7f95f5ffb700 1 -- 172.21.15.17:0/3020699812 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f80b92a0 con 0x55fa18a01bc0 2023-10-05T15:51:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.724+0000 7f962828db80 10 client.27215 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.724+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55fa1877d2b0 con 0x55fa18a01bc0 2023-10-05T15:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f95f5ffb700 1 -- 172.21.15.17:0/3020699812 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f960002fc60 con 0x55fa18a01bc0 2023-10-05T15:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f95f5ffb700 1 -- 172.21.15.17:0/3020699812 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f95f809b2f0 con 0x55fa18a01bc0 2023-10-05T15:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f962828db80 10 client.27215 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f962828db80 10 client.27215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f962828db80 20 client.27215 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:16.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f962828db80 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a6ba50 0x55fa18a6de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f962828db80 4 client.27215 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:51:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.725+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fa1894cb30 con 0x55fa18a6ba50 2023-10-05T15:51:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.726+0000 7f960e59c700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a6ba50 0x55fa18a6de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.727+0000 7f95f5ffb700 10 client.27215 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.728+0000 7f960e59c700 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a6ba50 0x55fa18a6de70 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc7155d717dd45b server_cookie=4d66d8af809dc739 in_seq=0 out_seq=0 2023-10-05T15:51:16.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.728+0000 7f95f5ffb700 1 -- 172.21.15.17:0/3020699812 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fa1894cb30 con 0x55fa18a6ba50 2023-10-05T15:51:16.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.728+0000 7f95f5ffb700 10 client.27215 handle_command_reply: tid=0 2023-10-05T15:51:16.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.728+0000 7f962828db80 1 client.27215 shutdown 2023-10-05T15:51:16.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.729+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 msgr2=0x55fa18a10c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.729+0000 7f962828db80 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a10c60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f95f80cb7e0 tx=0x7f95f8009310 comp rx=0 tx=0).stop 2023-10-05T15:51:16.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 shutdown_connections 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fa18a6ba50 0x55fa18a6de70 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fa18a02a60 0x55fa18a11c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fa18a01260 0x55fa18a10720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 --2- 172.21.15.17:0/3020699812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa18a01bc0 0x55fa18a10c60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 >> 172.21.15.17:0/3020699812 conn(0x55fa18975260 msgr2=0x55fa18a09d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f95f5ffb700 0 client.27215 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:16.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.730+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 shutdown_connections 2023-10-05T15:51:16.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.731+0000 7f962828db80 1 -- 172.21.15.17:0/3020699812 wait complete. 2023-10-05T15:51:16.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.731+0000 7f962828db80 20 client.27215 trim_cache size 0 max 16384 2023-10-05T15:51:16.735 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:51:16.735 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:51:16.735 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:51:16.735 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:51:16.735 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:51:16.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:51:16.736 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:51:16.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:51:16.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:51:16.736 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95fc0a1600 msgr2=0x7f95fc0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95fc0a1600 0x7f95fc0a3ac0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9608009c40 tx=0x7f960800b040 comp rx=0 tx=0).stop 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 msgr2=0x7f9610199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610199ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c010 tx=0x7f95f8003b00 comp rx=0 tx=0).stop 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 shutdown_connections 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f95fc0a1600 0x7f95fc0a3ac0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9610102a40 0x7f9610194f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9610100ea0 0x7f9610194990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 --2- 172.21.15.17:0/2196656072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9610102080 0x7f9610199ee0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.733+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 >> 172.21.15.17:0/2196656072 conn(0x7f96100fc460 msgr2=0x7f9610073430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.734+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 shutdown_connections 2023-10-05T15:51:16.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:16.734+0000 7f96149ff700 1 -- 172.21.15.17:0/2196656072 wait complete. 2023-10-05T15:51:16.776 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:51:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 760.0 s, 415.2 tps, lat 242.095 ms stddev 88.757 2023-10-05T15:51:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:18 smithi167 ceph-mon[133366]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 556 op/s 2023-10-05T15:51:18.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:18 smithi079 ceph-mon[132936]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 556 op/s 2023-10-05T15:51:18.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:18 smithi017 ceph-mon[129107]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 556 op/s 2023-10-05T15:51:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:20 smithi167 ceph-mon[133366]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2023-10-05T15:51:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:20 smithi079 ceph-mon[132936]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2023-10-05T15:51:20.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:20 smithi017 ceph-mon[129107]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2023-10-05T15:51:22.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:22 smithi167 ceph-mon[133366]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2023-10-05T15:51:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:22 smithi079 ceph-mon[132936]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2023-10-05T15:51:22.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:22 smithi017 ceph-mon[129107]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2023-10-05T15:51:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 765.0 s, 575.0 tps, lat 172.830 ms stddev 55.263 2023-10-05T15:51:24.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:24 smithi167 ceph-mon[133366]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 555 op/s 2023-10-05T15:51:24.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:24 smithi079 ceph-mon[132936]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 555 op/s 2023-10-05T15:51:24.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:24 smithi017 ceph-mon[129107]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 555 op/s 2023-10-05T15:51:26.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:26 smithi167 ceph-mon[133366]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 771 op/s 2023-10-05T15:51:26.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:26 smithi079 ceph-mon[132936]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 771 op/s 2023-10-05T15:51:26.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:26 smithi017 ceph-mon[129107]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 771 op/s 2023-10-05T15:51:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1719206815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 msgr2=0x7fd1a0107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1719206815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a0107950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd1900099c0 tx=0x7fd190009cd0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1719206815 shutdown_connections 2023-10-05T15:51:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1719206815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1a01090c0 0x7fd1a010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1719206815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a0107950 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1719206815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 0x7fd1a0108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1719206815 >> 172.21.15.17:0/1719206815 conn(0x7fd1a00764b0 msgr2=0x7fd1a0078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.102+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1719206815 shutdown_connections 2023-10-05T15:51:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.103+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1719206815 wait complete. 2023-10-05T15:51:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.104+0000 7fd1a7dff700 1 Processor -- start 2023-10-05T15:51:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 -- start start 2023-10-05T15:51:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a007e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 0x7fd1a007eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1a01090c0 0x7fd1a007f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0080050 con 0x7fd1a01090c0 2023-10-05T15:51:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a00801c0 con 0x7fd1a0107530 2023-10-05T15:51:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.105+0000 7fd1a7dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0080380 con 0x7fd1a0108720 2023-10-05T15:51:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.106+0000 7fd1a5b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a007e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.106+0000 7fd1a539a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 0x7fd1a007eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.106+0000 7fd1a539a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 0x7fd1a007eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:41258/0 (socket says 172.21.15.17:41258) 2023-10-05T15:51:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.106+0000 7fd1a539a700 1 -- 172.21.15.17:0/1791731401 learned_addr learned my addr 172.21.15.17:0/1791731401 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.106+0000 7fd1a639c700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1a01090c0 0x7fd1a007f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.107+0000 7fd1a5b9b700 1 -- 172.21.15.17:0/1791731401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 msgr2=0x7fd1a007eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.107+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 0x7fd1a007eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.107+0000 7fd1a5b9b700 1 -- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1a01090c0 msgr2=0x7fd1a007f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.107+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1a01090c0 0x7fd1a007f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.107+0000 7fd1a5b9b700 1 -- 172.21.15.17:0/1791731401 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900095f0 con 0x7fd1a0107530 2023-10-05T15:51:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.107+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a007e5e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd190009990 tx=0x7fd190003a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.108+0000 7fd196ffd700 1 -- 172.21.15.17:0/1791731401 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19001d070 con 0x7fd1a0107530 2023-10-05T15:51:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.108+0000 7fd196ffd700 1 -- 172.21.15.17:0/1791731401 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd19000bd80 con 0x7fd1a0107530 2023-10-05T15:51:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.108+0000 7fd196ffd700 1 -- 172.21.15.17:0/1791731401 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19000fdf0 con 0x7fd1a0107530 2023-10-05T15:51:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.108+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a0080600 con 0x7fd1a0107530 2023-10-05T15:51:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.108+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a0080e90 con 0x7fd1a0107530 2023-10-05T15:51:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.115+0000 7fd196ffd700 1 -- 172.21.15.17:0/1791731401 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd19000f5f0 con 0x7fd1a0107530 2023-10-05T15:51:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.115+0000 7fd1bb7c1b80 1 Processor -- start 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 -- start start 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108e8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108ef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481084f400 con 0x5648108e7fd0 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x564810840bc0 con 0x5648108e8990 2023-10-05T15:51:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.116+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56481083e4e0 con 0x5648108e6ec0 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.117+0000 7fd1a539a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.117+0000 7fd1a539a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108ef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53090/0 (socket says 172.21.15.17:53090) 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.117+0000 7fd1a539a700 1 -- 172.21.15.17:0/2831115083 learned_addr learned my addr 172.21.15.17:0/2831115083 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.117+0000 7fd1a539a700 1 -- 172.21.15.17:0/2831115083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 msgr2=0x5648108e72e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.117+0000 7fd1a539a700 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108e72e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.117+0000 7fd1a539a700 1 -- 172.21.15.17:0/2831115083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 msgr2=0x5648108e8450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.118+0000 7fd1a539a700 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108e8450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.118+0000 7fd1a539a700 1 -- 172.21.15.17:0/2831115083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564810664d80 con 0x5648108e8990 2023-10-05T15:51:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.118+0000 7fd1a539a700 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108ef220 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd19800e240 tx=0x7fd198009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e670f2ac68d829e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.119+0000 7fd18bfff700 1 -- 172.21.15.17:0/2831115083 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198014480 con 0x5648108e8990 2023-10-05T15:51:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.119+0000 7fd18bfff700 1 -- 172.21.15.17:0/2831115083 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd19800f040 con 0x5648108e8990 2023-10-05T15:51:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.119+0000 7fd18bfff700 1 -- 172.21.15.17:0/2831115083 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198013910 con 0x5648108e8990 2023-10-05T15:51:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.119+0000 7fd196ffd700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd18c0a1680 0x7fd18c0a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.119+0000 7fd196ffd700 1 -- 172.21.15.17:0/1791731401 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd1900cdee0 con 0x7fd1a0107530 2023-10-05T15:51:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.120+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/2831115083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 msgr2=0x5648108ef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.120+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108ef220 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd19800e240 tx=0x7fd198009790 comp rx=0 tx=0).stop 2023-10-05T15:51:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.123+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/2831115083 shutdown_connections 2023-10-05T15:51:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.123+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108ef220 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.123+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.123+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/2831115083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.123+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/2831115083 >> 172.21.15.17:0/2831115083 conn(0x56481085b200 msgr2=0x5648108e1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.124+0000 7fd1a639c700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd18c0a1680 0x7fd18c0a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.124+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/2831115083 shutdown_connections 2023-10-05T15:51:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.124+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/2831115083 wait complete. 2023-10-05T15:51:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.125+0000 7fd1bb7c1b80 1 -- start start 2023-10-05T15:51:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.125+0000 7fd1bb7c1b80 1 Processor -- start 2023-10-05T15:51:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.125+0000 7fd1a639c700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd18c0a1680 0x7fd18c0a3b40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006fd0 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e6ec0 0x5648108f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e8990 0x5648108f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564810839dd0 con 0x5648108e7fd0 2023-10-05T15:51:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648107d66b0 con 0x5648108e6ec0 2023-10-05T15:51:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648107d6350 con 0x5648108e8990 2023-10-05T15:51:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.126+0000 7fd1bb7c1b80 10 client.0 _ll_register_callbacks cb 0x5648106337a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.127+0000 7fd1a5b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e6ec0 0x5648108f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.127+0000 7fd1a5b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e6ec0 0x5648108f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53092/0 (socket says 172.21.15.17:53092) 2023-10-05T15:51:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.127+0000 7fd1a5b9b700 1 -- 172.21.15.17:0/273489362 learned_addr learned my addr 172.21.15.17:0/273489362 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.127+0000 7fd1a539a700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.128+0000 7fd1a639c700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e8990 0x5648108f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.128+0000 7fd1a539a700 1 -- 172.21.15.17:0/273489362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e8990 msgr2=0x5648108f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.128+0000 7fd1a539a700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e8990 0x5648108f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.128+0000 7fd1a539a700 1 -- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e6ec0 msgr2=0x5648108f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.128+0000 7fd1a539a700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e6ec0 0x5648108f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.128+0000 7fd1a539a700 1 -- 172.21.15.17:0/273489362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd198009da0 con 0x5648108e7fd0 2023-10-05T15:51:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.129+0000 7fd1a539a700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f1090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd198000f80 tx=0x7fd198014b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4349bb2e2ea365 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.129+0000 7fd1897fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:51:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.131+0000 7fd1897fa700 1 -- 172.21.15.17:0/273489362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980138b0 con 0x5648108e7fd0 2023-10-05T15:51:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.131+0000 7fd1897fa700 1 -- 172.21.15.17:0/273489362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd198006e40 con 0x5648108e7fd0 2023-10-05T15:51:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.131+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648108d9d50 con 0x5648108e7fd0 2023-10-05T15:51:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.132+0000 7fd1897fa700 1 -- 172.21.15.17:0/273489362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd198013a10 con 0x5648108e7fd0 2023-10-05T15:51:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.132+0000 7fd1bb7c1b80 10 client.17178 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.132+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56481064dc00 con 0x5648108e7fd0 2023-10-05T15:51:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.133+0000 7fd1897fa700 1 -- 172.21.15.17:0/273489362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5648108d9d50 con 0x5648108e7fd0 2023-10-05T15:51:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.133+0000 7fd1897fa700 1 -- 172.21.15.17:0/273489362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd19801c3b0 con 0x5648108e7fd0 2023-10-05T15:51:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.134+0000 7fd1bb7c1b80 10 client.17178 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.134+0000 7fd1bb7c1b80 10 client.17178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:27.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.135+0000 7fd1bb7c1b80 20 client.17178 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.135+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648108fc830 0x5648108fec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.135+0000 7fd1bb7c1b80 4 client.17178 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.135+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564810832db0 con 0x5648108fc830 2023-10-05T15:51:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.137+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648108fc830 0x5648108fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.138+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648108fc830 0x5648108fec50 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cbd5fb176b63f69 server_cookie=e723a4830d805618 in_seq=0 out_seq=0 2023-10-05T15:51:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.138+0000 7fd1897fa700 10 client.17178 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:27.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.139+0000 7fd1897fa700 1 -- 172.21.15.17:0/273489362 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564810832db0 con 0x5648108fc830 2023-10-05T15:51:27.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.139+0000 7fd1897fa700 10 client.17178 handle_command_reply: tid=0 2023-10-05T15:51:27.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.139+0000 7fd1bb7c1b80 1 client.17178 shutdown 2023-10-05T15:51:27.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 msgr2=0x5648108f1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f1090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd198000f80 tx=0x7fd198014b90 comp rx=0 tx=0).stop 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 shutdown_connections 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648108fc830 0x5648108fec50 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e8990 0x5648108f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e6ec0 0x5648108f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/273489362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f1090 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 >> 172.21.15.17:0/273489362 conn(0x56481085b200 msgr2=0x5648108e1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1897fa700 0 client.17178 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.140+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 shutdown_connections 2023-10-05T15:51:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.141+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/273489362 wait complete. 2023-10-05T15:51:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.141+0000 7fd1bb7c1b80 20 client.17178 trim_cache size 0 max 16384 2023-10-05T15:51:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 Processor -- start 2023-10-05T15:51:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 -- start start 2023-10-05T15:51:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e7fd0 0x5648108f1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e8990 0x5648108f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648106ba8c0 con 0x5648108e8990 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648108f0040 con 0x5648108e7fd0 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.171+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648108f06c0 con 0x5648108e6ec0 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a5b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a539a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e7fd0 0x5648108f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a5b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:41274/0 (socket says 172.21.15.17:41274) 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a5b9b700 1 -- 172.21.15.17:0/1482786302 learned_addr learned my addr 172.21.15.17:0/1482786302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a639c700 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e8990 0x5648108f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a539a700 1 -- 172.21.15.17:0/1482786302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 msgr2=0x5648108f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a539a700 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a539a700 1 -- 172.21.15.17:0/1482786302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e8990 msgr2=0x5648108f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a539a700 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e8990 0x5648108f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.172+0000 7fd1a539a700 1 -- 172.21.15.17:0/1482786302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56481068b1f0 con 0x5648108e7fd0 2023-10-05T15:51:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.173+0000 7fd1a539a700 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e7fd0 0x5648108f1070 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd198004c20 tx=0x7fd19801cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426409e061f9c572 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.173+0000 7fd194bff700 1 -- 172.21.15.17:0/1482786302 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19801dd70 con 0x5648108e7fd0 2023-10-05T15:51:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.174+0000 7fd194bff700 1 -- 172.21.15.17:0/1482786302 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1980139f0 con 0x5648108e7fd0 2023-10-05T15:51:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.174+0000 7fd194bff700 1 -- 172.21.15.17:0/1482786302 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19801cea0 con 0x5648108e7fd0 2023-10-05T15:51:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/1482786302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e7fd0 msgr2=0x5648108f1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e7fd0 0x5648108f1070 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd198004c20 tx=0x7fd19801cb50 comp rx=0 tx=0).stop 2023-10-05T15:51:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/1482786302 shutdown_connections 2023-10-05T15:51:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e8990 0x5648108f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/1482786302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e7fd0 0x5648108f1070 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/1482786302 >> 172.21.15.17:0/1482786302 conn(0x56481085b200 msgr2=0x5648108eee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.175+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/1482786302 shutdown_connections 2023-10-05T15:51:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.176+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/1482786302 wait complete. 2023-10-05T15:51:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.176+0000 7fd1bb7c1b80 1 -- start start 2023-10-05T15:51:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.176+0000 7fd1bb7c1b80 1 Processor -- start 2023-10-05T15:51:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648108f72c0 con 0x5648108e7fd0 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648108f7430 con 0x5648108e8990 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648108f75f0 con 0x5648108e6ec0 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.177+0000 7fd1bb7c1b80 10 client.0 _ll_register_callbacks cb 0x7fd19800e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.178+0000 7fd1a639c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.178+0000 7fd1a639c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53122/0 (socket says 172.21.15.17:53122) 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.178+0000 7fd1a639c700 1 -- 172.21.15.17:0/3295253886 learned_addr learned my addr 172.21.15.17:0/3295253886 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.178+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1a639c700 1 -- 172.21.15.17:0/3295253886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 msgr2=0x5648108f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1a639c700 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1a639c700 1 -- 172.21.15.17:0/3295253886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 msgr2=0x5648108f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1a639c700 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1a639c700 1 -- 172.21.15.17:0/3295253886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56481064dc00 con 0x5648108e8990 2023-10-05T15:51:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1a639c700 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108f6d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd19c014d20 tx=0x7fd19c004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed77fe838bf0a23b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.179+0000 7fd1897fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.180+0000 7fd1897fa700 1 -- 172.21.15.17:0/3295253886 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c014720 con 0x5648108e8990 2023-10-05T15:51:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.180+0000 7fd1897fa700 1 -- 172.21.15.17:0/3295253886 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd19c012e10 con 0x5648108e8990 2023-10-05T15:51:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.180+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd19800f040 con 0x5648108e8990 2023-10-05T15:51:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.181+0000 7fd1897fa700 1 -- 172.21.15.17:0/3295253886 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd19c014e00 con 0x5648108e8990 2023-10-05T15:51:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.181+0000 7fd1bb7c1b80 10 client.27233 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.181+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x564810663250 con 0x5648108e8990 2023-10-05T15:51:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1897fa700 1 -- 172.21.15.17:0/3295253886 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd19800f040 con 0x5648108e8990 2023-10-05T15:51:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1897fa700 1 -- 172.21.15.17:0/3295253886 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd19c02a530 con 0x5648108e8990 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1bb7c1b80 10 client.27233 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1bb7c1b80 10 client.27233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1bb7c1b80 20 client.27233 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648109510c0 0x5648109534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1bb7c1b80 4 client.27233 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564810832ad0 con 0x5648109510c0 2023-10-05T15:51:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.182+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648109510c0 0x5648109534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.183+0000 7fd1a5b9b700 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648109510c0 0x5648109534b0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d3f36df2d91ee7 server_cookie=9bfc162c163999e9 in_seq=0 out_seq=0 2023-10-05T15:51:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.184+0000 7fd1897fa700 10 client.27233 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.219+0000 7fd1897fa700 1 -- 172.21.15.17:0/3295253886 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564810832ad0 con 0x5648109510c0 2023-10-05T15:51:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.219+0000 7fd1897fa700 10 client.27233 handle_command_reply: tid=0 2023-10-05T15:51:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.221+0000 7fd1bb7c1b80 1 client.27233 shutdown 2023-10-05T15:51:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.224+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 msgr2=0x5648108f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.224+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108f6d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd19c014d20 tx=0x7fd19c004860 comp rx=0 tx=0).stop 2023-10-05T15:51:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 shutdown_connections 2023-10-05T15:51:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5648109510c0 0x5648109534b0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5648108e8990 0x5648108f6d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648108e6ec0 0x5648108f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1bb7c1b80 1 --2- 172.21.15.17:0/3295253886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5648108e7fd0 0x5648108f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 >> 172.21.15.17:0/3295253886 conn(0x56481085b200 msgr2=0x5648108f0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.228+0000 7fd1897fa700 0 client.27233 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.229+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 shutdown_connections 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.229+0000 7fd1bb7c1b80 1 -- 172.21.15.17:0/3295253886 wait complete. 2023-10-05T15:51:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.229+0000 7fd1bb7c1b80 20 client.27233 trim_cache size 0 max 16384 2023-10-05T15:51:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:51:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:51:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:51:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:51:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.230+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd18c0a1680 msgr2=0x7fd18c0a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.230+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd18c0a1680 0x7fd18c0a3b40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006fd0 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.230+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 msgr2=0x7fd1a007e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.230+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a007e5e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd190009990 tx=0x7fd190003a50 comp rx=0 tx=0).stop 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 shutdown_connections 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd18c0a1680 0x7fd18c0a3b40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1a01090c0 0x7fd1a007f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1a0107530 0x7fd1a007e5e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 --2- 172.21.15.17:0/1791731401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1a0108720 0x7fd1a007eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 >> 172.21.15.17:0/1791731401 conn(0x7fd1a00764b0 msgr2=0x7fd1a0078710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.231+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 shutdown_connections 2023-10-05T15:51:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:27.232+0000 7fd1a7dff700 1 -- 172.21.15.17:0/1791731401 wait complete. 2023-10-05T15:51:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 770.0 s, 395.5 tps, lat 127.404 ms stddev 73.338 2023-10-05T15:51:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:28 smithi167 ceph-mon[133366]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 582 op/s 2023-10-05T15:51:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:28 smithi079 ceph-mon[132936]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 582 op/s 2023-10-05T15:51:28.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:28 smithi017 ceph-mon[129107]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 582 op/s 2023-10-05T15:51:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:30 smithi167 ceph-mon[133366]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 682 op/s 2023-10-05T15:51:30.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:30 smithi079 ceph-mon[132936]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 682 op/s 2023-10-05T15:51:30.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:30 smithi017 ceph-mon[129107]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 682 op/s 2023-10-05T15:51:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:32 smithi167 ceph-mon[133366]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 745 op/s 2023-10-05T15:51:32.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:32 smithi079 ceph-mon[132936]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 745 op/s 2023-10-05T15:51:32.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:32 smithi017 ceph-mon[129107]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 745 op/s 2023-10-05T15:51:33.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 775.0 s, 380.2 tps, lat 395.315 ms stddev 1551.996 2023-10-05T15:51:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:34 smithi167 ceph-mon[133366]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 657 op/s 2023-10-05T15:51:34.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:34 smithi079 ceph-mon[132936]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 657 op/s 2023-10-05T15:51:34.451 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:34 smithi017 ceph-mon[129107]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 657 op/s 2023-10-05T15:51:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:36 smithi167 ceph-mon[133366]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-05T15:51:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:36 smithi079 ceph-mon[132936]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-05T15:51:36.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:36 smithi017 ceph-mon[129107]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-05T15:51:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 780.0 s, 624.6 tps, lat 158.621 ms stddev 58.523 2023-10-05T15:51:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:38 smithi167 ceph-mon[133366]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.5 MiB/s wr, 617 op/s 2023-10-05T15:51:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:38 smithi079 ceph-mon[132936]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.5 MiB/s wr, 617 op/s 2023-10-05T15:51:38.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:38 smithi017 ceph-mon[129107]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.5 MiB/s wr, 617 op/s 2023-10-05T15:51:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:40 smithi167 ceph-mon[133366]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 679 op/s 2023-10-05T15:51:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:40 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:51:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:40 smithi079 ceph-mon[132936]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 679 op/s 2023-10-05T15:51:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:40 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:51:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:40 smithi017 ceph-mon[129107]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.9 MiB/s wr, 679 op/s 2023-10-05T15:51:40.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:40 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.498+0000 7fda057ff700 1 -- 172.21.15.17:0/12684051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda0010a820 msgr2=0x7fda0010ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.498+0000 7fda057ff700 1 --2- 172.21.15.17:0/12684051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda0010a820 0x7fda0010ccb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009990 tx=0x7fd9e8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 -- 172.21.15.17:0/12684051 shutdown_connections 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 --2- 172.21.15.17:0/12684051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda0010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 --2- 172.21.15.17:0/12684051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda00107eb0 0x7fda0010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 --2- 172.21.15.17:0/12684051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda0010a820 0x7fda0010ccb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 -- 172.21.15.17:0/12684051 >> 172.21.15.17:0/12684051 conn(0x7fda0006dd10 msgr2=0x7fda00070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 -- 172.21.15.17:0/12684051 shutdown_connections 2023-10-05T15:51:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.499+0000 7fda057ff700 1 -- 172.21.15.17:0/12684051 wait complete. 2023-10-05T15:51:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 Processor -- start 2023-10-05T15:51:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 -- start start 2023-10-05T15:51:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda00107eb0 0x7fda001a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0010a820 0x7fda001a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda001a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda001a7420 con 0x7fda0010a820 2023-10-05T15:51:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda001a7590 con 0x7fda0010d1f0 2023-10-05T15:51:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.501+0000 7fda057ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda001a7750 con 0x7fda00107eb0 2023-10-05T15:51:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.502+0000 7fd9ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda001a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.502+0000 7fd9ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda001a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40096/0 (socket says 172.21.15.17:40096) 2023-10-05T15:51:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.502+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2000128893 learned_addr learned my addr 172.21.15.17:0/2000128893 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.502+0000 7fd9feffd700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda00107eb0 0x7fda001a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.502+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0010a820 0x7fda001a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.503+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2000128893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda00107eb0 msgr2=0x7fda001a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.503+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda00107eb0 0x7fda001a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.503+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0010a820 msgr2=0x7fda001a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.503+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0010a820 0x7fda001a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.503+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2000128893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e80095f0 con 0x7fda0010d1f0 2023-10-05T15:51:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.504+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda001a6dc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800e940 tx=0x7fd9f800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.504+0000 7fd9fcff9700 1 -- 172.21.15.17:0/2000128893 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8004a30 con 0x7fda0010d1f0 2023-10-05T15:51:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.504+0000 7fd9fcff9700 1 -- 172.21.15.17:0/2000128893 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9f80054b0 con 0x7fda0010d1f0 2023-10-05T15:51:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.504+0000 7fd9fcff9700 1 -- 172.21.15.17:0/2000128893 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800cbc0 con 0x7fda0010d1f0 2023-10-05T15:51:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.504+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda001a7a30 con 0x7fda0010d1f0 2023-10-05T15:51:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.504+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda001ae1f0 con 0x7fda0010d1f0 2023-10-05T15:51:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.511+0000 7fda19102b80 1 Processor -- start 2023-10-05T15:51:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.515+0000 7fd9fcff9700 1 -- 172.21.15.17:0/2000128893 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fd9f800cd20 con 0x7fda0010d1f0 2023-10-05T15:51:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.515+0000 7fda19102b80 1 -- start start 2023-10-05T15:51:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fda19102b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f121ec0 0x56096f1222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fda19102b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 0x56096f123450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fda19102b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f123990 0x56096f12a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fda19102b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f08a400 con 0x56096f123990 2023-10-05T15:51:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fda19102b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f07bbc0 con 0x56096f121ec0 2023-10-05T15:51:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fda19102b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f0794e0 con 0x56096f122fd0 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fd9feffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 0x56096f123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fd9f67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f121ec0 0x56096f1222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fd9feffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 0x56096f123450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33898/0 (socket says 172.21.15.17:33898) 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.516+0000 7fd9feffd700 1 -- 172.21.15.17:0/1879182956 learned_addr learned my addr 172.21.15.17:0/1879182956 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f123990 0x56096f12a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9feffd700 1 -- 172.21.15.17:0/1879182956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f121ec0 msgr2=0x56096f1222e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f121ec0 0x56096f1222e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9feffd700 1 -- 172.21.15.17:0/1879182956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f123990 msgr2=0x56096f12a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f123990 0x56096f12a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9feffd700 1 -- 172.21.15.17:0/1879182956 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56096ee9fd80 con 0x56096f122fd0 2023-10-05T15:51:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.517+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f121ec0 0x56096f1222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:51:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.518+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 0x56096f123450 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0011650 tx=0x7fd9f0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e591a6e0e482dc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.518+0000 7fd9f57fa700 1 -- 172.21.15.17:0/1879182956 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000e040 con 0x56096f122fd0 2023-10-05T15:51:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.518+0000 7fd9f57fa700 1 -- 172.21.15.17:0/1879182956 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9f000f040 con 0x56096f122fd0 2023-10-05T15:51:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.518+0000 7fd9f57fa700 1 -- 172.21.15.17:0/1879182956 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0015850 con 0x56096f122fd0 2023-10-05T15:51:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.520+0000 7fd9fcff9700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9ec0a1650 0x7fd9ec0a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.520+0000 7fd9fcff9700 1 -- 172.21.15.17:0/2000128893 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9f8014070 con 0x7fda0010d1f0 2023-10-05T15:51:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.522+0000 7fda19102b80 1 -- 172.21.15.17:0/1879182956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 msgr2=0x56096f123450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.522+0000 7fda19102b80 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 0x56096f123450 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0011650 tx=0x7fd9f0009920 comp rx=0 tx=0).stop 2023-10-05T15:51:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.523+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9ec0a1650 0x7fd9ec0a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fda19102b80 1 -- 172.21.15.17:0/1879182956 shutdown_connections 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fda19102b80 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f123990 0x56096f12a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fda19102b80 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f121ec0 0x56096f1222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fda19102b80 1 --2- 172.21.15.17:0/1879182956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f122fd0 0x56096f123450 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fda19102b80 1 -- 172.21.15.17:0/1879182956 >> 172.21.15.17:0/1879182956 conn(0x56096f096200 msgr2=0x56096f11cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9ec0a1650 0x7fd9ec0a3b10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8006010 tx=0x7fd9e800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.525+0000 7fda19102b80 1 -- 172.21.15.17:0/1879182956 shutdown_connections 2023-10-05T15:51:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.526+0000 7fda19102b80 1 -- 172.21.15.17:0/1879182956 wait complete. 2023-10-05T15:51:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.527+0000 7fda19102b80 1 -- start start 2023-10-05T15:51:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.527+0000 7fda19102b80 1 Processor -- start 2023-10-05T15:51:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 0x56096f12bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f122fd0 0x56096f12c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f123990 0x56096f133160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f074dd0 con 0x56096f122fd0 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f0116b0 con 0x56096f123990 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f011350 con 0x56096f121ec0 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fda19102b80 10 client.0 _ll_register_callbacks cb 0x56096ee6e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fd9feffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 0x56096f12bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fd9feffd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 0x56096f12bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33910/0 (socket says 172.21.15.17:33910) 2023-10-05T15:51:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fd9feffd700 1 -- 172.21.15.17:0/1428031491 learned_addr learned my addr 172.21.15.17:0/1428031491 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.528+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f122fd0 0x56096f12c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.529+0000 7fd9feffd700 1 -- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f123990 msgr2=0x56096f133160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:51:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.529+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f123990 0x56096f133160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.529+0000 7fd9feffd700 1 -- 172.21.15.17:0/1428031491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f122fd0 msgr2=0x56096f12c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.529+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f122fd0 0x56096f12c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.529+0000 7fd9feffd700 1 -- 172.21.15.17:0/1428031491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e8020040 con 0x56096f121ec0 2023-10-05T15:51:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.530+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 0x56096f12bbe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0007c10 tx=0x7fd9f0006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f852d17a2c8be6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.530+0000 7fd9e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:51:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.530+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1428031491 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000e070 con 0x56096f121ec0 2023-10-05T15:51:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.530+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1428031491 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9f0004ce0 con 0x56096f121ec0 2023-10-05T15:51:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.530+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56096f114d50 con 0x56096f121ec0 2023-10-05T15:51:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.532+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1428031491 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9f0003a00 con 0x56096f121ec0 2023-10-05T15:51:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.532+0000 7fda19102b80 10 client.27160 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.532+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fd9f0011330 con 0x56096f121ec0 2023-10-05T15:51:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1428031491 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56096f114d50 con 0x56096f121ec0 2023-10-05T15:51:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1428031491 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd9f0004790 con 0x56096f121ec0 2023-10-05T15:51:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fda19102b80 10 client.27160 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fda19102b80 10 client.27160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fda19102b80 20 client.27160 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fda19102b80 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f137940 0x56096f139d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fda19102b80 4 client.27160 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.533+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56096f06ddb0 con 0x56096f137940 2023-10-05T15:51:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.534+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f137940 0x56096f139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.535+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f137940 0x56096f139d60 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a52dd694b410bb0c server_cookie=69c3f45cd8b1acf8 in_seq=0 out_seq=0 2023-10-05T15:51:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.535+0000 7fd9e67fc700 10 client.27160 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.536+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1428031491 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56096f06ddb0 con 0x56096f137940 2023-10-05T15:51:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.536+0000 7fd9e67fc700 10 client.27160 handle_command_reply: tid=0 2023-10-05T15:51:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.537+0000 7fda19102b80 1 client.27160 shutdown 2023-10-05T15:51:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.537+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 msgr2=0x56096f12bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.537+0000 7fda19102b80 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 0x56096f12bbe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0007c10 tx=0x7fd9f0006000 comp rx=0 tx=0).stop 2023-10-05T15:51:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 shutdown_connections 2023-10-05T15:51:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fda19102b80 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f137940 0x56096f139d60 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fda19102b80 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f123990 0x56096f133160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fda19102b80 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f121ec0 0x56096f12bbe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fda19102b80 1 --2- 172.21.15.17:0/1428031491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f122fd0 0x56096f12c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fd9e67fc700 0 client.27160 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.538+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 >> 172.21.15.17:0/1428031491 conn(0x56096f096200 msgr2=0x56096f11c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.539+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 shutdown_connections 2023-10-05T15:51:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.539+0000 7fda19102b80 1 -- 172.21.15.17:0/1428031491 wait complete. 2023-10-05T15:51:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.539+0000 7fda19102b80 20 client.27160 trim_cache size 0 max 16384 2023-10-05T15:51:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.568+0000 7fda19102b80 1 Processor -- start 2023-10-05T15:51:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.568+0000 7fda19102b80 1 -- start start 2023-10-05T15:51:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fda19102b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f11c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fda19102b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f133120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fda19102b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f12a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fda19102b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f12b7b0 con 0x56096f121ec0 2023-10-05T15:51:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fda19102b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096eef58c0 con 0x56096f122fd0 2023-10-05T15:51:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fda19102b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f126500 con 0x56096f123990 2023-10-05T15:51:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fd9f67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f133120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fd9f67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f133120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:40114/0 (socket says 172.21.15.17:40114) 2023-10-05T15:51:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.569+0000 7fd9f67fc700 1 -- 172.21.15.17:0/2900172488 learned_addr learned my addr 172.21.15.17:0/2900172488 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.570+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f12a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.570+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2900172488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 msgr2=0x56096f133120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.570+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f133120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.571+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2900172488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 msgr2=0x56096f11c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.571+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f11c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.571+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/2900172488 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56096ee88c00 con 0x56096f123990 2023-10-05T15:51:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.571+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f12a8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9f809a0c0 tx=0x7fd9f8009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce085d9bd67ab7a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.572+0000 7fd9f5ffb700 1 -- 172.21.15.17:0/2900172488 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80b1070 con 0x56096f123990 2023-10-05T15:51:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.572+0000 7fd9f5ffb700 1 -- 172.21.15.17:0/2900172488 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9f8005620 con 0x56096f123990 2023-10-05T15:51:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.572+0000 7fd9f5ffb700 1 -- 172.21.15.17:0/2900172488 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80caa20 con 0x56096f123990 2023-10-05T15:51:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.572+0000 7fda19102b80 1 -- 172.21.15.17:0/2900172488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 msgr2=0x56096f12a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.572+0000 7fda19102b80 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f12a8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd9f809a0c0 tx=0x7fd9f8009640 comp rx=0 tx=0).stop 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 -- 172.21.15.17:0/2900172488 shutdown_connections 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f12a8d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f11c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 --2- 172.21.15.17:0/2900172488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f133120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 -- 172.21.15.17:0/2900172488 >> 172.21.15.17:0/2900172488 conn(0x56096f096200 msgr2=0x56096f13e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 -- 172.21.15.17:0/2900172488 shutdown_connections 2023-10-05T15:51:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.573+0000 7fda19102b80 1 -- 172.21.15.17:0/2900172488 wait complete. 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 -- start start 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 Processor -- start 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f131140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f132150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f132690 con 0x56096f121ec0 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f132800 con 0x56096f122fd0 2023-10-05T15:51:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096f1329c0 con 0x56096f123990 2023-10-05T15:51:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.574+0000 7fda19102b80 10 client.0 _ll_register_callbacks cb 0x7fd9f00097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.575+0000 7fd9ff7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.575+0000 7fd9ff7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f132150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:33938/0 (socket says 172.21.15.17:33938) 2023-10-05T15:51:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.575+0000 7fd9ff7fe700 1 -- 172.21.15.17:0/1894792051 learned_addr learned my addr 172.21.15.17:0/1894792051 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.575+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f131140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.575+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9f67fc700 1 -- 172.21.15.17:0/1894792051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 msgr2=0x56096f132150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f132150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9f67fc700 1 -- 172.21.15.17:0/1894792051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 msgr2=0x56096f130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9f67fc700 1 -- 172.21.15.17:0/1894792051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda001ae1f0 con 0x56096f122fd0 2023-10-05T15:51:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9ff7fe700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f132150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:51:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9f67fc700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f131140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8005930 tx=0x7fd9e8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=835b47972e0748ee server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.576+0000 7fd9e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.577+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1894792051 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80390c0 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.577+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1894792051 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fd9e8039220 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.577+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9f000f040 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.577+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1894792051 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9e80393e0 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.577+0000 7fda19102b80 10 client.27248 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.577+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x56096eec61f0 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1894792051 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9f000f040 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1894792051 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd9e8040030 con 0x56096f122fd0 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fda19102b80 10 client.27248 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fda19102b80 10 client.27248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fda19102b80 20 client.27248 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fda19102b80 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f18c490 0x56096f18e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fda19102b80 4 client.27248 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:51:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56096f06dad0 con 0x56096f18c490 2023-10-05T15:51:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.578+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f18c490 0x56096f18e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.579+0000 7fd9feffd700 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f18c490 0x56096f18e8d0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=638e6b86a8362de server_cookie=3ba2fb5da3bf070 in_seq=0 out_seq=0 2023-10-05T15:51:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.579+0000 7fd9e67fc700 10 client.27248 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.597+0000 7fd9e67fc700 1 -- 172.21.15.17:0/1894792051 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56096f06dad0 con 0x56096f18c490 2023-10-05T15:51:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.597+0000 7fd9e67fc700 10 client.27248 handle_command_reply: tid=0 2023-10-05T15:51:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.598+0000 7fda19102b80 1 client.27248 shutdown 2023-10-05T15:51:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 msgr2=0x56096f131140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f131140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8005930 tx=0x7fd9e8009310 comp rx=0 tx=0).stop 2023-10-05T15:51:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 shutdown_connections 2023-10-05T15:51:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x56096f18c490 0x56096f18e8d0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56096f123990 0x56096f132150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56096f121ec0 0x56096f130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 --2- 172.21.15.17:0/1894792051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56096f122fd0 0x56096f131140 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 >> 172.21.15.17:0/1894792051 conn(0x56096f096200 msgr2=0x56096f12a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.599+0000 7fd9e67fc700 0 client.27248 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.600+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 shutdown_connections 2023-10-05T15:51:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.600+0000 7fda19102b80 1 -- 172.21.15.17:0/1894792051 wait complete. 2023-10-05T15:51:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.600+0000 7fda19102b80 20 client.27248 trim_cache size 0 max 16384 2023-10-05T15:51:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:51:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:51:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:51:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.602+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9ec0a1650 msgr2=0x7fd9ec0a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.602+0000 7fda057ff700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9ec0a1650 0x7fd9ec0a3b10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8006010 tx=0x7fd9e800b260 comp rx=0 tx=0).stop 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.602+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 msgr2=0x7fda001a6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.602+0000 7fda057ff700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda001a6dc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800e940 tx=0x7fd9f800ec50 comp rx=0 tx=0).stop 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 shutdown_connections 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fd9ec0a1650 0x7fd9ec0a3b10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda0010d1f0 0x7fda001a6dc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda00107eb0 0x7fda001a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 --2- 172.21.15.17:0/2000128893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0010a820 0x7fda001a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 >> 172.21.15.17:0/2000128893 conn(0x7fda0006dd10 msgr2=0x7fda00109800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 shutdown_connections 2023-10-05T15:51:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:40.603+0000 7fda057ff700 1 -- 172.21.15.17:0/2000128893 wait complete. 2023-10-05T15:51:42.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:42 smithi079 ceph-mon[132936]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 689 op/s 2023-10-05T15:51:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:42 smithi017 ceph-mon[129107]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 689 op/s 2023-10-05T15:51:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:42 smithi167 ceph-mon[133366]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 689 op/s 2023-10-05T15:51:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 785.0 s, 475.4 tps, lat 211.936 ms stddev 72.523 2023-10-05T15:51:44.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:51:44.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:51:44.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:51:44.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:43 smithi167 ceph-mon[133366]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 560 op/s 2023-10-05T15:51:44.764 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:51:44.764 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:51:44.765 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:51:44.765 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:43 smithi079 ceph-mon[132936]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 560 op/s 2023-10-05T15:51:44.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:51:44.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:51:44.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:51:44.765 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:43 smithi017 ceph-mon[129107]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.8 MiB/s wr, 560 op/s 2023-10-05T15:51:46.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:46 smithi167 ceph-mon[133366]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 713 op/s 2023-10-05T15:51:46.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:46 smithi079 ceph-mon[132936]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 713 op/s 2023-10-05T15:51:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:46 smithi017 ceph-mon[129107]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 713 op/s 2023-10-05T15:51:46.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:51:47.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.191+0000 7f33651ff700 1 -- 172.21.15.17:0/1328280249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360074ef0 msgr2=0x7f3360073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.191+0000 7f33651ff700 1 --2- 172.21.15.17:0/1328280249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360074ef0 0x7f3360073340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f33480098f0 tx=0x7f3348009c00 comp rx=0 tx=0).stop 2023-10-05T15:51:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.192+0000 7f33651ff700 1 -- 172.21.15.17:0/1328280249 shutdown_connections 2023-10-05T15:51:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.192+0000 7f33651ff700 1 --2- 172.21.15.17:0/1328280249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f336010f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.192+0000 7f33651ff700 1 --2- 172.21.15.17:0/1328280249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360074ef0 0x7f3360073340 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.192+0000 7f33651ff700 1 --2- 172.21.15.17:0/1328280249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3360073910 0x7f3360073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.192+0000 7f33651ff700 1 -- 172.21.15.17:0/1328280249 >> 172.21.15.17:0/1328280249 conn(0x7f33600fc430 msgr2=0x7f33600fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:47.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.193+0000 7f33651ff700 1 -- 172.21.15.17:0/1328280249 shutdown_connections 2023-10-05T15:51:47.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.193+0000 7f33651ff700 1 -- 172.21.15.17:0/1328280249 wait complete. 2023-10-05T15:51:47.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.194+0000 7f33651ff700 1 Processor -- start 2023-10-05T15:51:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 -- start start 2023-10-05T15:51:47.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360073910 0x7f336006f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3360074ef0 0x7f336006fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f33601ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600703b0 con 0x7f3360074ef0 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33601ad740 con 0x7f336010d4b0 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.195+0000 7f33651ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33601ad880 con 0x7f3360073910 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.196+0000 7f335f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f33601ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.196+0000 7f335f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f33601ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54296/0 (socket says 172.21.15.17:54296) 2023-10-05T15:51:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.196+0000 7f335f59e700 1 -- 172.21.15.17:0/4246245257 learned_addr learned my addr 172.21.15.17:0/4246245257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.196+0000 7f3356d9d700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360073910 0x7f336006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.197+0000 7f335ed9d700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3360074ef0 0x7f336006fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.203+0000 7f335f59e700 1 -- 172.21.15.17:0/4246245257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360073910 msgr2=0x7f336006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.203+0000 7f335f59e700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360073910 0x7f336006f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.203+0000 7f335f59e700 1 -- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3360074ef0 msgr2=0x7f336006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.203+0000 7f335f59e700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3360074ef0 0x7f336006fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.203+0000 7f335f59e700 1 -- 172.21.15.17:0/4246245257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348009520 con 0x7f336010d4b0 2023-10-05T15:51:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.204+0000 7f335f59e700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f33601ad200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f335800c110 tx=0x7f335800c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.205+0000 7f335cd99700 1 -- 172.21.15.17:0/4246245257 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358017070 con 0x7f336010d4b0 2023-10-05T15:51:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.205+0000 7f335cd99700 1 -- 172.21.15.17:0/4246245257 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f335800e050 con 0x7f336010d4b0 2023-10-05T15:51:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.205+0000 7f335cd99700 1 -- 172.21.15.17:0/4246245257 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358007880 con 0x7f336010d4b0 2023-10-05T15:51:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.206+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33601ada80 con 0x7f336010d4b0 2023-10-05T15:51:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.206+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33601adf10 con 0x7f336010d4b0 2023-10-05T15:51:47.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.213+0000 7f3378ad6b80 1 Processor -- start 2023-10-05T15:51:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.216+0000 7f335cd99700 1 -- 172.21.15.17:0/4246245257 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f335800cad0 con 0x7f336010d4b0 2023-10-05T15:51:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.219+0000 7f335cd99700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33400a1650 0x7f33400a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.219+0000 7f335cd99700 1 -- 172.21.15.17:0/4246245257 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f33580cc450 con 0x7f336010d4b0 2023-10-05T15:51:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.220+0000 7f3378ad6b80 1 -- start start 2023-10-05T15:51:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.221+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15023680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.221+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15024480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.221+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c15024ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.221+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f8b460 con 0x558c15023bc0 2023-10-05T15:51:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.221+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f7cc20 con 0x558c15023260 2023-10-05T15:51:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.221+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f7a540 con 0x558c15024a60 2023-10-05T15:51:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.222+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15023680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.222+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15023680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54300/0 (socket says 172.21.15.17:54300) 2023-10-05T15:51:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.222+0000 7f3356d9d700 1 -- 172.21.15.17:0/1169915672 learned_addr learned my addr 172.21.15.17:0/1169915672 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.222+0000 7f335f59e700 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c15024ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f3356d9d700 1 -- 172.21.15.17:0/1169915672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 msgr2=0x558c15024ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f3356d9d700 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c15024ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f3356d9d700 1 -- 172.21.15.17:0/1169915672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 msgr2=0x558c15024480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:51:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f3356d9d700 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15024480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f3356d9d700 1 -- 172.21.15.17:0/1169915672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c14da0de0 con 0x558c15023260 2023-10-05T15:51:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f3356d9d700 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15023680 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3348009810 tx=0x7f3348005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67dece978a20f115 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.223+0000 7f335ed9d700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33400a1650 0x7f33400a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.224+0000 7f335559a700 1 -- 172.21.15.17:0/1169915672 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334801c040 con 0x558c15023260 2023-10-05T15:51:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.224+0000 7f335559a700 1 -- 172.21.15.17:0/1169915672 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334800fda0 con 0x558c15023260 2023-10-05T15:51:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.224+0000 7f335559a700 1 -- 172.21.15.17:0/1169915672 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480052a0 con 0x558c15023260 2023-10-05T15:51:47.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.225+0000 7f335ed9d700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33400a1650 0x7f33400a3b10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3360074c10 tx=0x7f3350009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:47.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.226+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1169915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 msgr2=0x558c15023680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.226+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15023680 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3348009810 tx=0x7f3348005960 comp rx=0 tx=0).stop 2023-10-05T15:51:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.226+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1169915672 shutdown_connections 2023-10-05T15:51:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.226+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c15024ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.227+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15023680 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.227+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1169915672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15024480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.227+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1169915672 >> 172.21.15.17:0/1169915672 conn(0x558c14f97260 msgr2=0x558c1501e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.227+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1169915672 shutdown_connections 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.232+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1169915672 wait complete. 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.233+0000 7f3378ad6b80 1 -- start start 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.233+0000 7f3378ad6b80 1 Processor -- start 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.234+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c1503e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.234+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c1503e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.234+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15024a60 0x558c150455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.234+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f75e30 con 0x558c15023bc0 2023-10-05T15:51:47.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.234+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f12710 con 0x558c15024a60 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.234+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f123b0 con 0x558c15023260 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.235+0000 7f3378ad6b80 10 client.0 _ll_register_callbacks cb 0x558c14d6f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.235+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c1503e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.235+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c1503e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:43786/0 (socket says 172.21.15.17:43786) 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.235+0000 7f3356d9d700 1 -- 172.21.15.17:0/1131666965 learned_addr learned my addr 172.21.15.17:0/1131666965 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.236+0000 7f335f59e700 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15024a60 0x558c150455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.236+0000 7f3356d9d700 1 -- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15024a60 msgr2=0x558c150455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.236+0000 7f3356d9d700 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15024a60 0x558c150455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.236+0000 7f3356d9d700 1 -- 172.21.15.17:0/1131666965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 msgr2=0x558c1503e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.236+0000 7f3356d9d700 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c1503e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.236+0000 7f3356d9d700 1 -- 172.21.15.17:0/1131666965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3360110250 con 0x558c15023260 2023-10-05T15:51:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.237+0000 7f3356d9d700 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c1503e020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3348000c00 tx=0x7f334800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e85ad976278dfe95 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.237+0000 7f334e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:51:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.237+0000 7f334e7fc700 1 -- 172.21.15.17:0/1131666965 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334801c040 con 0x558c15023260 2023-10-05T15:51:47.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.237+0000 7f334e7fc700 1 -- 172.21.15.17:0/1131666965 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3348005250 con 0x558c15023260 2023-10-05T15:51:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.238+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c15015f10 con 0x558c15023260 2023-10-05T15:51:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.238+0000 7f334e7fc700 1 -- 172.21.15.17:0/1131666965 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3348005410 con 0x558c15023260 2023-10-05T15:51:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.238+0000 7f3378ad6b80 10 client.27178 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.238+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558c14d89c60 con 0x558c15023260 2023-10-05T15:51:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f334e7fc700 1 -- 172.21.15.17:0/1131666965 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c15015f10 con 0x558c15023260 2023-10-05T15:51:47.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f334e7fc700 1 -- 172.21.15.17:0/1131666965 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3348015020 con 0x558c15023260 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f3378ad6b80 10 client.27178 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f3378ad6b80 10 client.27178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f3378ad6b80 20 client.27178 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c150498d0 0x558c1504bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f3378ad6b80 4 client.27178 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.239+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c14f6ee10 con 0x558c150498d0 2023-10-05T15:51:47.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.241+0000 7f335ed9d700 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c150498d0 0x558c1504bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.242+0000 7f335ed9d700 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c150498d0 0x558c1504bcf0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fddee4b07184923 server_cookie=7879b05f986f9ded in_seq=0 out_seq=0 2023-10-05T15:51:47.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.242+0000 7f334e7fc700 10 client.27178 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.243+0000 7f334e7fc700 1 -- 172.21.15.17:0/1131666965 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c14f6ee10 con 0x558c150498d0 2023-10-05T15:51:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.243+0000 7f334e7fc700 10 client.27178 handle_command_reply: tid=0 2023-10-05T15:51:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.243+0000 7f3378ad6b80 1 client.27178 shutdown 2023-10-05T15:51:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 msgr2=0x558c1503e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c1503e020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3348000c00 tx=0x7f334800f740 comp rx=0 tx=0).stop 2023-10-05T15:51:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 shutdown_connections 2023-10-05T15:51:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c150498d0 0x558c1504bcf0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15024a60 0x558c150455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c1503e020 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/1131666965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c1503e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 >> 172.21.15.17:0/1131666965 conn(0x558c14f97260 msgr2=0x558c1501df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.245+0000 7f334e7fc700 0 client.27178 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.246+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 shutdown_connections 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.246+0000 7f3378ad6b80 1 -- 172.21.15.17:0/1131666965 wait complete. 2023-10-05T15:51:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.247+0000 7f3378ad6b80 20 client.27178 trim_cache size 0 max 16384 2023-10-05T15:51:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 Processor -- start 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 -- start start 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c15045e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 0x558c15045560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15024a60 0x558c1502ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14df6920 con 0x558c15024a60 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c14f6ee10 con 0x558c15023bc0 2023-10-05T15:51:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.282+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c1501f270 con 0x558c15023260 2023-10-05T15:51:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.283+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 0x558c15045560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.283+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 0x558c15045560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54314/0 (socket says 172.21.15.17:54314) 2023-10-05T15:51:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.283+0000 7f335ed9d700 1 -- 172.21.15.17:0/847486917 learned_addr learned my addr 172.21.15.17:0/847486917 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.283+0000 7f3356d9d700 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c15045e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.284+0000 7f3356d9d700 1 -- 172.21.15.17:0/847486917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 msgr2=0x558c15045560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.284+0000 7f3356d9d700 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 0x558c15045560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.284+0000 7f3356d9d700 1 -- 172.21.15.17:0/847486917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15024a60 msgr2=0x558c1502ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.284+0000 7f3356d9d700 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15024a60 0x558c1502ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.284+0000 7f3356d9d700 1 -- 172.21.15.17:0/847486917 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c14dc7250 con 0x558c15023260 2023-10-05T15:51:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.284+0000 7f335ed9d700 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 0x558c15045560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:51:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.285+0000 7f3356d9d700 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c15045e30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3348009810 tx=0x7f3348005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ff6ed0898d6d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.285+0000 7f3355d9b700 1 -- 172.21.15.17:0/847486917 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334801c030 con 0x558c15023260 2023-10-05T15:51:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.285+0000 7f3355d9b700 1 -- 172.21.15.17:0/847486917 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334800b9b0 con 0x558c15023260 2023-10-05T15:51:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.285+0000 7f3355d9b700 1 -- 172.21.15.17:0/847486917 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348005250 con 0x558c15023260 2023-10-05T15:51:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.286+0000 7f3378ad6b80 1 -- 172.21.15.17:0/847486917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 msgr2=0x558c15045e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.286+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c15045e30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3348009810 tx=0x7f3348005fa0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 -- 172.21.15.17:0/847486917 shutdown_connections 2023-10-05T15:51:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15024a60 0x558c1502ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15023260 0x558c15045e30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/847486917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023bc0 0x558c15045560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 -- 172.21.15.17:0/847486917 >> 172.21.15.17:0/847486917 conn(0x558c14f97260 msgr2=0x558c1503ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 -- 172.21.15.17:0/847486917 shutdown_connections 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 -- 172.21.15.17:0/847486917 wait complete. 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.287+0000 7f3378ad6b80 1 -- start start 2023-10-05T15:51:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 Processor -- start 2023-10-05T15:51:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15044d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15045280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c150433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c150438e0 con 0x558c15023bc0 2023-10-05T15:51:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c15043a50 con 0x558c15023260 2023-10-05T15:51:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.288+0000 7f3378ad6b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c15043bc0 con 0x558c15024a60 2023-10-05T15:51:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.289+0000 7f3378ad6b80 10 client.0 _ll_register_callbacks cb 0x7f3350005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.289+0000 7f335ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15045280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.289+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15044d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.289+0000 7f3356d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15044d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:54328/0 (socket says 172.21.15.17:54328) 2023-10-05T15:51:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.289+0000 7f3356d9d700 1 -- 172.21.15.17:0/3097162024 learned_addr learned my addr 172.21.15.17:0/3097162024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.289+0000 7f335f59e700 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c150433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.290+0000 7f3356d9d700 1 -- 172.21.15.17:0/3097162024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 msgr2=0x558c150433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.290+0000 7f3356d9d700 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c150433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.290+0000 7f3356d9d700 1 -- 172.21.15.17:0/3097162024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 msgr2=0x558c15045280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.290+0000 7f3356d9d700 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15045280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.290+0000 7f3356d9d700 1 -- 172.21.15.17:0/3097162024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3350017070 con 0x558c15023260 2023-10-05T15:51:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.291+0000 7f3356d9d700 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15044d40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3348006010 tx=0x7f334802b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e63181b5dfd680c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.291+0000 7f334e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.291+0000 7f334e7fc700 1 -- 172.21.15.17:0/3097162024 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334801c040 con 0x558c15023260 2023-10-05T15:51:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.292+0000 7f334e7fc700 1 -- 172.21.15.17:0/3097162024 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3348042070 con 0x558c15023260 2023-10-05T15:51:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.292+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f334800fda0 con 0x558c15023260 2023-10-05T15:51:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.292+0000 7f334e7fc700 1 -- 172.21.15.17:0/3097162024 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3348005460 con 0x558c15023260 2023-10-05T15:51:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.293+0000 7f3378ad6b80 10 client.27266 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.293+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558c14d89c60 con 0x558c15023260 2023-10-05T15:51:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f334e7fc700 1 -- 172.21.15.17:0/3097162024 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f334800fda0 con 0x558c15023260 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f334e7fc700 1 -- 172.21.15.17:0/3097162024 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3348015070 con 0x558c15023260 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f3378ad6b80 10 client.27266 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f3378ad6b80 10 client.27266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f3378ad6b80 20 client.27266 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c1509e400 0x558c150a0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f3378ad6b80 4 client.27266 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:51:47.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.294+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558c14f6eb30 con 0x558c1509e400 2023-10-05T15:51:47.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.295+0000 7f335ed9d700 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c1509e400 0x558c150a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:47.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.296+0000 7f335ed9d700 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c1509e400 0x558c150a0820 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4164870d5853785 server_cookie=92be800166942700 in_seq=0 out_seq=0 2023-10-05T15:51:47.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.296+0000 7f334e7fc700 10 client.27266 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.296+0000 7f334e7fc700 1 -- 172.21.15.17:0/3097162024 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558c14f6eb30 con 0x558c1509e400 2023-10-05T15:51:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.296+0000 7f334e7fc700 10 client.27266 handle_command_reply: tid=0 2023-10-05T15:51:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.296+0000 7f3378ad6b80 1 client.27266 shutdown 2023-10-05T15:51:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.297+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 msgr2=0x558c15044d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.297+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15044d40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3348006010 tx=0x7f334802b460 comp rx=0 tx=0).stop 2023-10-05T15:51:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 shutdown_connections 2023-10-05T15:51:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c1509e400 0x558c150a0820 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c15024a60 0x558c150433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c15023260 0x558c15044d40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f3378ad6b80 1 --2- 172.21.15.17:0/3097162024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c15023bc0 0x558c15045280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 >> 172.21.15.17:0/3097162024 conn(0x558c14f97260 msgr2=0x558c15045e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.298+0000 7f334e7fc700 0 client.27266 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:47.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.299+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 shutdown_connections 2023-10-05T15:51:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.300+0000 7f3378ad6b80 1 -- 172.21.15.17:0/3097162024 wait complete. 2023-10-05T15:51:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.306+0000 7f3378ad6b80 20 client.27266 trim_cache size 0 max 16384 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:51:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:51:47.309 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:51:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33400a1650 msgr2=0x7f33400a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33400a1650 0x7f33400a3b10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3360074c10 tx=0x7f3350009260 comp rx=0 tx=0).stop 2023-10-05T15:51:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 msgr2=0x7f33601ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f33601ad200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f335800c110 tx=0x7f335800c420 comp rx=0 tx=0).stop 2023-10-05T15:51:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 shutdown_connections 2023-10-05T15:51:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33400a1650 0x7f33400a3b10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f336010d4b0 0x7f33601ad200 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3360073910 0x7f336006f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 --2- 172.21.15.17:0/4246245257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3360074ef0 0x7f336006fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 >> 172.21.15.17:0/4246245257 conn(0x7f33600fc430 msgr2=0x7f33600fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 shutdown_connections 2023-10-05T15:51:47.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:51:47.308+0000 7f33651ff700 1 -- 172.21.15.17:0/4246245257 wait complete. 2023-10-05T15:51:47.347 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:51:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 790.0 s, 406.2 tps, lat 243.591 ms stddev 108.561 2023-10-05T15:51:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:48 smithi167 ceph-mon[133366]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.3 MiB/s wr, 527 op/s 2023-10-05T15:51:48.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:48 smithi079 ceph-mon[132936]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.3 MiB/s wr, 527 op/s 2023-10-05T15:51:48.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:48 smithi017 ceph-mon[129107]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.3 MiB/s wr, 527 op/s 2023-10-05T15:51:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:50 smithi167 ceph-mon[133366]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 607 op/s 2023-10-05T15:51:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:50 smithi079 ceph-mon[132936]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 607 op/s 2023-10-05T15:51:50.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:50 smithi017 ceph-mon[129107]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 10 MiB/s wr, 607 op/s 2023-10-05T15:51:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:52 smithi167 ceph-mon[133366]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 649 op/s 2023-10-05T15:51:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:52 smithi079 ceph-mon[132936]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 649 op/s 2023-10-05T15:51:52.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:52 smithi017 ceph-mon[129107]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 649 op/s 2023-10-05T15:51:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 795.0 s, 506.2 tps, lat 198.134 ms stddev 67.085 2023-10-05T15:51:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 -- 172.21.15.17:0/3190386491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10a820 msgr2=0x7f8a3c1115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 --2- 172.21.15.17:0/3190386491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10a820 0x7f8a3c1115f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009990 tx=0x7f8a30009ca0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 -- 172.21.15.17:0/3190386491 shutdown_connections 2023-10-05T15:51:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 --2- 172.21.15.17:0/3190386491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c10aca0 0x7f8a3c113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 --2- 172.21.15.17:0/3190386491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a3c107eb0 0x7f8a3c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 --2- 172.21.15.17:0/3190386491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10a820 0x7f8a3c1115f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.864+0000 7f8a409ff700 1 -- 172.21.15.17:0/3190386491 >> 172.21.15.17:0/3190386491 conn(0x7f8a3c06dd10 msgr2=0x7f8a3c070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.867+0000 7f8a409ff700 1 -- 172.21.15.17:0/3190386491 shutdown_connections 2023-10-05T15:51:53.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.867+0000 7f8a409ff700 1 -- 172.21.15.17:0/3190386491 wait complete. 2023-10-05T15:51:53.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.869+0000 7f8a409ff700 1 Processor -- start 2023-10-05T15:51:53.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.869+0000 7f8a409ff700 1 -- start start 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a409ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107eb0 0x7f8a3c1a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a409ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a3c10a820 0x7f8a3c1a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a409ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10aca0 0x7f8a3c1a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a409ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1a30d0 con 0x7f8a3c107eb0 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a409ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1a3240 con 0x7f8a3c10a820 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a409ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1a3400 con 0x7f8a3c10aca0 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a3ad9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10aca0 0x7f8a3c1a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a3ad9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10aca0 0x7f8a3c1a2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50380/0 (socket says 172.21.15.17:50380) 2023-10-05T15:51:53.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.870+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/2940015325 learned_addr learned my addr 172.21.15.17:0/2940015325 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.871+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107eb0 0x7f8a3c1a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.872+0000 7f8a3a59c700 1 -- 172.21.15.17:0/2940015325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10aca0 msgr2=0x7f8a3c1a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.872+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10aca0 0x7f8a3c1a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.872+0000 7f8a3a59c700 1 -- 172.21.15.17:0/2940015325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a3c10a820 msgr2=0x7f8a3c1a1bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-05T15:51:53.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.872+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a3c10a820 0x7f8a3c1a1bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.872+0000 7f8a3a59c700 1 -- 172.21.15.17:0/2940015325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300095f0 con 0x7f8a3c107eb0 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.872+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107eb0 0x7f8a3c1a16b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c006fd0 tx=0x7f8a2c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.875+0000 7f8a2b7fe700 1 -- 172.21.15.17:0/2940015325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c014d70 con 0x7f8a3c107eb0 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.875+0000 7f8a2b7fe700 1 -- 172.21.15.17:0/2940015325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a2c01c8d0 con 0x7f8a3c107eb0 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.875+0000 7f8a2b7fe700 1 -- 172.21.15.17:0/2940015325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c01a6c0 con 0x7f8a3c107eb0 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.875+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c1a36e0 con 0x7f8a3c107eb0 2023-10-05T15:51:53.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.875+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c10b3b0 con 0x7f8a3c107eb0 2023-10-05T15:51:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.887+0000 7f8a543ecb80 1 Processor -- start 2023-10-05T15:51:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.889+0000 7f8a543ecb80 1 -- start start 2023-10-05T15:51:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.889+0000 7f8a2b7fe700 1 -- 172.21.15.17:0/2940015325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f8a2c01ca40 con 0x7f8a3c107eb0 2023-10-05T15:51:53.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c676062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c67607460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c6760e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6755d400 con 0x558c676079a0 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6754ebc0 con 0x558c67606fe0 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6754c4e0 con 0x558c67605ed0 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a3ad9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c676062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a3ad9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c676062f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50392/0 (socket says 172.21.15.17:50392) 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.890+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/343654039 learned_addr learned my addr 172.21.15.17:0/343654039 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.891+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c67607460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.892+0000 7f8a2b7fe700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a240a1680 0x7f8a240a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.892+0000 7f8a2b7fe700 1 -- 172.21.15.17:0/2940015325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8a2c0d4560 con 0x7f8a3c107eb0 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.895+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/343654039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 msgr2=0x558c67607460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.895+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c67607460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.895+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/343654039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 msgr2=0x558c6760e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.895+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c6760e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.895+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/343654039 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c67372d80 con 0x558c67605ed0 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.896+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c676062f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009fa0 tx=0x7f8a340091b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a872e5d57cd56a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.896+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a240a1680 0x7f8a240a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.898+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a240a1680 0x7f8a240a3b40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8a3403c000 tx=0x7f8a34035b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.899+0000 7f8a28ff9700 1 -- 172.21.15.17:0/343654039 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340363f0 con 0x558c67605ed0 2023-10-05T15:51:53.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.899+0000 7f8a28ff9700 1 -- 172.21.15.17:0/343654039 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a340369e0 con 0x558c67605ed0 2023-10-05T15:51:53.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.899+0000 7f8a28ff9700 1 -- 172.21.15.17:0/343654039 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34035780 con 0x558c67605ed0 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.900+0000 7f8a543ecb80 1 -- 172.21.15.17:0/343654039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 msgr2=0x558c676062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.900+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c676062f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009fa0 tx=0x7f8a340091b0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 -- 172.21.15.17:0/343654039 shutdown_connections 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c6760e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c676062f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/343654039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c67607460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 -- 172.21.15.17:0/343654039 >> 172.21.15.17:0/343654039 conn(0x558c67569200 msgr2=0x558c675efbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:53.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 -- 172.21.15.17:0/343654039 shutdown_connections 2023-10-05T15:51:53.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.901+0000 7f8a543ecb80 1 -- 172.21.15.17:0/343654039 wait complete. 2023-10-05T15:51:53.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.902+0000 7f8a543ecb80 1 -- start start 2023-10-05T15:51:53.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.903+0000 7f8a543ecb80 1 Processor -- start 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.903+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c675fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c67547dd0 con 0x558c676079a0 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c674e46b0 con 0x558c67606fe0 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c674e4350 con 0x558c67605ed0 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a543ecb80 10 client.0 _ll_register_callbacks cb 0x558c673417a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a39d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c675fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a39d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c675fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:56290/0 (socket says 172.21.15.17:56290) 2023-10-05T15:51:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.904+0000 7f8a39d9b700 1 -- 172.21.15.17:0/705636459 learned_addr learned my addr 172.21.15.17:0/705636459 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a39d9b700 1 -- 172.21.15.17:0/705636459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 msgr2=0x558c675fc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a39d9b700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675fc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a39d9b700 1 -- 172.21.15.17:0/705636459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 msgr2=0x558c67603b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a39d9b700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a39d9b700 1 -- 172.21.15.17:0/705636459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a34009bd0 con 0x558c67606fe0 2023-10-05T15:51:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.905+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:51:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.906+0000 7f8a39d9b700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c675fcb00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000ba00 tx=0x7f8a3000ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c95031ce3ad1921 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.908+0000 7f8a21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:51:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.908+0000 7f8a21ffb700 1 -- 172.21.15.17:0/705636459 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3001d070 con 0x558c67606fe0 2023-10-05T15:51:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.908+0000 7f8a21ffb700 1 -- 172.21.15.17:0/705636459 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8a30003850 con 0x558c67606fe0 2023-10-05T15:51:53.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.908+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c675e7d50 con 0x558c67606fe0 2023-10-05T15:51:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.911+0000 7f8a21ffb700 1 -- 172.21.15.17:0/705636459 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a30003a10 con 0x558c67606fe0 2023-10-05T15:51:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.917+0000 7f8a543ecb80 10 client.27272 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:53.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.917+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558c6735bc00 con 0x558c67606fe0 2023-10-05T15:51:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.918+0000 7f8a21ffb700 1 -- 172.21.15.17:0/705636459 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c675e7d50 con 0x558c67606fe0 2023-10-05T15:51:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.918+0000 7f8a21ffb700 1 -- 172.21.15.17:0/705636459 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8a30029070 con 0x558c67606fe0 2023-10-05T15:51:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a543ecb80 10 client.27272 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a543ecb80 10 client.27272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a543ecb80 20 client.27272 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c6760aa10 0x558c6760ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a543ecb80 4 client.27272 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:51:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c67540db0 con 0x558c6760aa10 2023-10-05T15:51:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.919+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c6760aa10 0x558c6760ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.920+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c6760aa10 0x558c6760ce30 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d1bf278d732309 server_cookie=d563c8d4bea077f2 in_seq=0 out_seq=0 2023-10-05T15:51:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.920+0000 7f8a21ffb700 10 client.27272 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.921+0000 7f8a21ffb700 1 -- 172.21.15.17:0/705636459 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c67540db0 con 0x558c6760aa10 2023-10-05T15:51:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.921+0000 7f8a21ffb700 10 client.27272 handle_command_reply: tid=0 2023-10-05T15:51:53.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.922+0000 7f8a543ecb80 1 client.27272 shutdown 2023-10-05T15:51:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.922+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 msgr2=0x558c675fcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:53.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.922+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c675fcb00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000ba00 tx=0x7f8a3000ba30 comp rx=0 tx=0).stop 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 shutdown_connections 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c6760aa10 0x558c6760ce30 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/705636459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c67606fe0 0x558c675fcb00 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000ba00 tx=0x7f8a3000ba30 comp rx=0 tx=0).stop 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 >> 172.21.15.17:0/705636459 conn(0x558c67569200 msgr2=0x558c675ef250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.923+0000 7f8a21ffb700 0 client.27272 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.924+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 shutdown_connections 2023-10-05T15:51:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.924+0000 7f8a543ecb80 1 -- 172.21.15.17:0/705636459 wait complete. 2023-10-05T15:51:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.924+0000 7f8a543ecb80 20 client.27272 trim_cache size 0 max 16384 2023-10-05T15:51:53.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.952+0000 7f8a543ecb80 1 Processor -- start 2023-10-05T15:51:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.953+0000 7f8a543ecb80 1 -- start start 2023-10-05T15:51:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c675fccd0 0x558c675f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c675fc190 con 0x558c676079a0 2023-10-05T15:51:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c673c88c0 con 0x558c675fccd0 2023-10-05T15:51:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c67606750 con 0x558c67605ed0 2023-10-05T15:51:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a3a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a3a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50422/0 (socket says 172.21.15.17:50422) 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a3a59c700 1 -- 172.21.15.17:0/953583060 learned_addr learned my addr 172.21.15.17:0/953583060 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.954+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c675fccd0 0x558c675f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.955+0000 7f8a3a59c700 1 -- 172.21.15.17:0/953583060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c675fccd0 msgr2=0x558c675f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.955+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c675fccd0 0x558c675f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.955+0000 7f8a3a59c700 1 -- 172.21.15.17:0/953583060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 msgr2=0x558c67603b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.955+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.955+0000 7f8a3a59c700 1 -- 172.21.15.17:0/953583060 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c673991f0 con 0x558c67605ed0 2023-10-05T15:51:53.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.956+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675f7490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c01ccf0 tx=0x7f8a2c0144c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6218caa08adc60c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:53.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.957+0000 7f8a297fa700 1 -- 172.21.15.17:0/953583060 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0a0de0 con 0x558c67605ed0 2023-10-05T15:51:53.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.957+0000 7f8a297fa700 1 -- 172.21.15.17:0/953583060 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a2c01cd40 con 0x558c67605ed0 2023-10-05T15:51:53.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.957+0000 7f8a297fa700 1 -- 172.21.15.17:0/953583060 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0a98a0 con 0x558c67605ed0 2023-10-05T15:51:53.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 -- 172.21.15.17:0/953583060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 msgr2=0x558c675f7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:53.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675f7490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c01ccf0 tx=0x7f8a2c0144c0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 -- 172.21.15.17:0/953583060 shutdown_connections 2023-10-05T15:51:53.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c675fccd0 0x558c675f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c67605ed0 0x558c675f7490 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c01ccf0 tx=0x7f8a2c0144c0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/953583060 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c676079a0 0x558c67603b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.958+0000 7f8a543ecb80 1 -- 172.21.15.17:0/953583060 >> 172.21.15.17:0/953583060 conn(0x558c67569200 msgr2=0x558c675fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:53.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.960+0000 7f8a543ecb80 1 -- 172.21.15.17:0/953583060 shutdown_connections 2023-10-05T15:51:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.961+0000 7f8a543ecb80 1 -- 172.21.15.17:0/953583060 wait complete. 2023-10-05T15:51:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.961+0000 7f8a543ecb80 1 -- start start 2023-10-05T15:51:53.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.962+0000 7f8a543ecb80 1 Processor -- start 2023-10-05T15:51:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c675fccd0 0x558c67602140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c676079a0 0x558c67602680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c67603bd0 0x558c67602bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6765e9b0 con 0x558c67603bd0 2023-10-05T15:51:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6765eb20 con 0x558c676079a0 2023-10-05T15:51:53.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6765ece0 con 0x558c675fccd0 2023-10-05T15:51:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a543ecb80 10 client.0 _ll_register_callbacks cb 0x7f8a30009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:51:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a3a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c675fccd0 0x558c67602140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a3a59c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c675fccd0 0x558c67602140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50424/0 (socket says 172.21.15.17:50424) 2023-10-05T15:51:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a3a59c700 1 -- 172.21.15.17:0/3167012874 learned_addr learned my addr 172.21.15.17:0/3167012874 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:51:53.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c67603bd0 0x558c67602bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.963+0000 7f8a39d9b700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c676079a0 0x558c67602680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/3167012874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c675fccd0 msgr2=0x558c67602140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c675fccd0 0x558c67602140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c676079a0 msgr2=0x558c67602680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:51:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c676079a0 0x558c67602680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:53.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a3ad9d700 1 -- 172.21.15.17:0/3167012874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c10b3b0 con 0x558c67603bd0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a3ad9d700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c67603bd0 0x558c67602bc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009fd0 tx=0x7f8a340359a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f26d12d5e432142 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.964+0000 7f8a21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.965+0000 7f8a21ffb700 1 -- 172.21.15.17:0/3167012874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34036b50 con 0x558c67603bd0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.965+0000 7f8a21ffb700 1 -- 172.21.15.17:0/3167012874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f8a34036cb0 con 0x558c67603bd0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.965+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a340369e0 con 0x558c67603bd0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.965+0000 7f8a21ffb700 1 -- 172.21.15.17:0/3167012874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a34036e70 con 0x558c67603bd0 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.965+0000 7f8a543ecb80 10 client.17214 fetch_fsmap learned FSMap version 43 2023-10-05T15:51:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.965+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558c67371250 con 0x558c67603bd0 2023-10-05T15:51:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a21ffb700 1 -- 172.21.15.17:0/3167012874 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a340369e0 con 0x558c67603bd0 2023-10-05T15:51:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a21ffb700 1 -- 172.21.15.17:0/3167012874 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8a34041450 con 0x558c67603bd0 2023-10-05T15:51:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a543ecb80 10 client.17214 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a543ecb80 10 client.17214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a543ecb80 20 client.17214 populate_metadata read hostname 'smithi017' 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c676606c0 0x558c67662ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a543ecb80 4 client.17214 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558c67540ad0 con 0x558c676606c0 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.966+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c676606c0 0x558c67662ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.967+0000 7f8a3a59c700 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c676606c0 0x558c67662ae0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6939ca7d7d5474f5 server_cookie=a19ac43ae9295b5d in_seq=0 out_seq=0 2023-10-05T15:51:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.967+0000 7f8a21ffb700 10 client.17214 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.992+0000 7f8a21ffb700 1 -- 172.21.15.17:0/3167012874 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558c67540ad0 con 0x558c676606c0 2023-10-05T15:51:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.992+0000 7f8a21ffb700 10 client.17214 handle_command_reply: tid=0 2023-10-05T15:51:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.992+0000 7f8a543ecb80 1 client.17214 shutdown 2023-10-05T15:51:53.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.993+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c67603bd0 msgr2=0x558c67602bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.993+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c67603bd0 0x558c67602bc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009fd0 tx=0x7f8a340359a0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.996+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 shutdown_connections 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.996+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x558c676606c0 0x558c67662ae0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.996+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558c67603bd0 0x558c67602bc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.996+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558c675fccd0 0x558c67602140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.996+0000 7f8a543ecb80 1 --2- 172.21.15.17:0/3167012874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c676079a0 0x558c67602680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.996+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 >> 172.21.15.17:0/3167012874 conn(0x558c67569200 msgr2=0x558c675f7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:54.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.997+0000 7f8a21ffb700 0 client.17214 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:51:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.998+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 shutdown_connections 2023-10-05T15:51:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.999+0000 7f8a543ecb80 1 -- 172.21.15.17:0/3167012874 wait complete. 2023-10-05T15:51:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:53.999+0000 7f8a543ecb80 20 client.17214 trim_cache size 0 max 16384 2023-10-05T15:51:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:51:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:51:54.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:51:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:51:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.001+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a240a1680 msgr2=0x7f8a240a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.001+0000 7f8a409ff700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a240a1680 0x7f8a240a3b40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8a3403c000 tx=0x7f8a34035b50 comp rx=0 tx=0).stop 2023-10-05T15:51:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.001+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107eb0 msgr2=0x7f8a3c1a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:51:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.001+0000 7f8a409ff700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107eb0 0x7f8a3c1a16b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c006fd0 tx=0x7f8a2c00b730 comp rx=0 tx=0).stop 2023-10-05T15:51:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.002+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 shutdown_connections 2023-10-05T15:51:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.002+0000 7f8a409ff700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f8a240a1680 0x7f8a240a3b40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.002+0000 7f8a409ff700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a3c10aca0 0x7f8a3c1a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.002+0000 7f8a409ff700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a3c107eb0 0x7f8a3c1a16b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.002+0000 7f8a409ff700 1 --2- 172.21.15.17:0/2940015325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a3c10a820 0x7f8a3c1a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:51:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.002+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 >> 172.21.15.17:0/2940015325 conn(0x7f8a3c06dd10 msgr2=0x7f8a3c06f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:51:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.003+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 shutdown_connections 2023-10-05T15:51:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:51:54.003+0000 7f8a409ff700 1 -- 172.21.15.17:0/2940015325 wait complete. 2023-10-05T15:51:54.336 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:54 smithi167 ceph-mon[133366]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.6 MiB/s wr, 568 op/s 2023-10-05T15:51:54.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:54 smithi079 ceph-mon[132936]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.6 MiB/s wr, 568 op/s 2023-10-05T15:51:54.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:54 smithi017 ceph-mon[129107]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.6 MiB/s wr, 568 op/s 2023-10-05T15:51:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:56 smithi079 ceph-mon[132936]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 732 op/s 2023-10-05T15:51:56.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:56 smithi017 ceph-mon[129107]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 732 op/s 2023-10-05T15:51:56.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:56 smithi167 ceph-mon[133366]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 732 op/s 2023-10-05T15:51:58.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 800.0 s, 507.0 tps, lat 197.218 ms stddev 65.894 2023-10-05T15:51:58.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:58 smithi079 ceph-mon[132936]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 594 op/s 2023-10-05T15:51:58.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:58 smithi017 ceph-mon[129107]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 594 op/s 2023-10-05T15:51:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:58 smithi167 ceph-mon[133366]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.4 MiB/s wr, 594 op/s 2023-10-05T15:51:59.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:51:59 smithi017 ceph-mon[129107]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.3 MiB/s wr, 664 op/s 2023-10-05T15:51:59.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:51:59 smithi167 ceph-mon[133366]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.3 MiB/s wr, 664 op/s 2023-10-05T15:51:59.608 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:51:59 smithi079 ceph-mon[132936]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.3 MiB/s wr, 664 op/s 2023-10-05T15:52:02.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:02 smithi079 ceph-mon[132936]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 724 op/s 2023-10-05T15:52:02.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:02 smithi017 ceph-mon[129107]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 724 op/s 2023-10-05T15:52:02.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:02 smithi167 ceph-mon[133366]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 724 op/s 2023-10-05T15:52:03.195 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 805.0 s, 365.0 tps, lat 274.026 ms stddev 358.188 2023-10-05T15:52:04.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:04 smithi079 ceph-mon[132936]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 635 op/s 2023-10-05T15:52:04.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:04 smithi017 ceph-mon[129107]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 635 op/s 2023-10-05T15:52:04.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:04 smithi167 ceph-mon[133366]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.0 MiB/s wr, 635 op/s 2023-10-05T15:52:06.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:06 smithi079 ceph-mon[132936]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 10 MiB/s wr, 766 op/s 2023-10-05T15:52:06.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:06 smithi017 ceph-mon[129107]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 10 MiB/s wr, 766 op/s 2023-10-05T15:52:06.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:06 smithi167 ceph-mon[133366]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 10 MiB/s wr, 766 op/s 2023-10-05T15:52:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.266+0000 7f9915fff700 1 -- 172.21.15.17:0/4137411254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 msgr2=0x7f99101082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.266+0000 7f9915fff700 1 --2- 172.21.15.17:0/4137411254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f99101082d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f990800b0a0 tx=0x7f990800b3b0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.267+0000 7f9915fff700 1 -- 172.21.15.17:0/4137411254 shutdown_connections 2023-10-05T15:52:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.267+0000 7f9915fff700 1 --2- 172.21.15.17:0/4137411254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 0x7f9910111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.267+0000 7f9915fff700 1 --2- 172.21.15.17:0/4137411254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f99101082d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.267+0000 7f9915fff700 1 --2- 172.21.15.17:0/4137411254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9910108810 0x7f991010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.267+0000 7f9915fff700 1 -- 172.21.15.17:0/4137411254 >> 172.21.15.17:0/4137411254 conn(0x7f991006dd10 msgr2=0x7f9910070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.269+0000 7f9915fff700 1 -- 172.21.15.17:0/4137411254 shutdown_connections 2023-10-05T15:52:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.269+0000 7f9915fff700 1 -- 172.21.15.17:0/4137411254 wait complete. 2023-10-05T15:52:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.271+0000 7f9915fff700 1 Processor -- start 2023-10-05T15:52:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.273+0000 7f9915fff700 1 -- start start 2023-10-05T15:52:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.274+0000 7f9915fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f991019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.274+0000 7f9915fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9910108810 0x7f991019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.274+0000 7f9915fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 0x7f991019e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.274+0000 7f9915fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991019ebc0 con 0x7f991010f730 2023-10-05T15:52:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.274+0000 7f9915fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991019ed30 con 0x7f9910107eb0 2023-10-05T15:52:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.274+0000 7f9915fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991019eef0 con 0x7f9910108810 2023-10-05T15:52:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.276+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f991019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.276+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f991019d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51504/0 (socket says 172.21.15.17:51504) 2023-10-05T15:52:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.276+0000 7f990f7fe700 1 -- 172.21.15.17:0/2787319152 learned_addr learned my addr 172.21.15.17:0/2787319152 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990ffff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 0x7f991019e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990f7fe700 1 -- 172.21.15.17:0/2787319152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9910108810 msgr2=0x7f991019d6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-05T15:52:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990f7fe700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9910108810 0x7f991019d6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990f7fe700 1 -- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 msgr2=0x7f991019e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990f7fe700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 0x7f991019e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990f7fe700 1 -- 172.21.15.17:0/2787319152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009d00 con 0x7f9910107eb0 2023-10-05T15:52:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990ffff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 0x7f991019e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:52:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.277+0000 7f990f7fe700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f991019d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9908007970 tx=0x7f9908004dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.278+0000 7f990cff9700 1 -- 172.21.15.17:0/2787319152 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800e040 con 0x7f9910107eb0 2023-10-05T15:52:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.278+0000 7f990cff9700 1 -- 172.21.15.17:0/2787319152 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f990800bc60 con 0x7f9910107eb0 2023-10-05T15:52:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.278+0000 7f990cff9700 1 -- 172.21.15.17:0/2787319152 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080052a0 con 0x7f9910107eb0 2023-10-05T15:52:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.278+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991019f170 con 0x7f9910107eb0 2023-10-05T15:52:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.278+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99101ae1a0 con 0x7f9910107eb0 2023-10-05T15:52:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.285+0000 7f99298acb80 1 Processor -- start 2023-10-05T15:52:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.285+0000 7f99298acb80 1 -- start start 2023-10-05T15:52:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.285+0000 7f99298acb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f99298acb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f99298acb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f99298acb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823801c400 con 0x5582380b3ec0 2023-10-05T15:52:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f99298acb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823800dbc0 con 0x5582380b4fd0 2023-10-05T15:52:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f99298acb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823800b4e0 con 0x5582380b5990 2023-10-05T15:52:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f990effd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f990effd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380bc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:43490/0 (socket says 172.21.15.17:43490) 2023-10-05T15:52:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f990effd700 1 -- 172.21.15.17:0/3222666829 learned_addr learned my addr 172.21.15.17:0/3222666829 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.286+0000 7f990cff9700 1 -- 172.21.15.17:0/2787319152 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f9908005400 con 0x7f9910107eb0 2023-10-05T15:52:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.287+0000 7f990effd700 1 -- 172.21.15.17:0/3222666829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 msgr2=0x5582380b5450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:52:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.287+0000 7f990effd700 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380b5450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.287+0000 7f990effd700 1 -- 172.21.15.17:0/3222666829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 msgr2=0x5582380b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.287+0000 7f990effd700 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.287+0000 7f990effd700 1 -- 172.21.15.17:0/3222666829 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558237e31d80 con 0x5582380b5990 2023-10-05T15:52:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.287+0000 7f990effd700 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380bc220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f990400bb10 tx=0x7f990400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58cd34ccad578bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.288+0000 7f98f5ffb700 1 -- 172.21.15.17:0/3222666829 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904004a30 con 0x5582380b5990 2023-10-05T15:52:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.288+0000 7f98f5ffb700 1 -- 172.21.15.17:0/3222666829 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f990400dcc0 con 0x5582380b5990 2023-10-05T15:52:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.288+0000 7f98f5ffb700 1 -- 172.21.15.17:0/3222666829 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040054e0 con 0x5582380b5990 2023-10-05T15:52:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.289+0000 7f990cff9700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98f80a15b0 0x7f98f80a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.289+0000 7f99298acb80 1 -- 172.21.15.17:0/3222666829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 msgr2=0x5582380bc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.289+0000 7f99298acb80 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380bc220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f990400bb10 tx=0x7f990400be20 comp rx=0 tx=0).stop 2023-10-05T15:52:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.289+0000 7f990cff9700 1 -- 172.21.15.17:0/2787319152 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f99080ce0f0 con 0x7f9910107eb0 2023-10-05T15:52:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 -- 172.21.15.17:0/3222666829 shutdown_connections 2023-10-05T15:52:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380bc220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 --2- 172.21.15.17:0/3222666829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 -- 172.21.15.17:0/3222666829 >> 172.21.15.17:0/3222666829 conn(0x558238028200 msgr2=0x5582380aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 -- 172.21.15.17:0/3222666829 shutdown_connections 2023-10-05T15:52:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f99298acb80 1 -- 172.21.15.17:0/3222666829 wait complete. 2023-10-05T15:52:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.290+0000 7f990ffff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98f80a15b0 0x7f98f80a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.291+0000 7f99298acb80 1 -- start start 2023-10-05T15:52:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.291+0000 7f99298acb80 1 Processor -- start 2023-10-05T15:52:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.291+0000 7f990ffff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98f80a15b0 0x7f98f80a3a70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9900005950 tx=0x7f99000058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 0x5582380be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558238006dd0 con 0x5582380b4fd0 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x558237fa36b0 con 0x5582380b3ec0 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558237fa3350 con 0x5582380b5990 2023-10-05T15:52:07.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f99298acb80 10 client.0 _ll_register_callbacks cb 0x558237e007a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f990effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 0x5582380be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f990effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 0x5582380be120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34306/0 (socket says 172.21.15.17:34306) 2023-10-05T15:52:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.292+0000 7f990effd700 1 -- 172.21.15.17:0/1355856251 learned_addr learned my addr 172.21.15.17:0/1355856251 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990f7fe700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990ffff700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990effd700 1 -- 172.21.15.17:0/1355856251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 msgr2=0x5582380c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990effd700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990effd700 1 -- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 msgr2=0x5582380bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990effd700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.293+0000 7f990effd700 1 -- 172.21.15.17:0/1355856251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990400b740 con 0x5582380b4fd0 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.294+0000 7f990effd700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 0x5582380be120 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f990400da60 tx=0x7f990400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e971e5cac70a65 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.294+0000 7f98eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:52:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.294+0000 7f98eeffd700 1 -- 172.21.15.17:0/1355856251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904003680 con 0x5582380b4fd0 2023-10-05T15:52:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.294+0000 7f98eeffd700 1 -- 172.21.15.17:0/1355856251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f99040037e0 con 0x5582380b4fd0 2023-10-05T15:52:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.294+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582380a6d50 con 0x5582380b4fd0 2023-10-05T15:52:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.295+0000 7f98eeffd700 1 -- 172.21.15.17:0/1355856251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99040039a0 con 0x5582380b4fd0 2023-10-05T15:52:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.295+0000 7f99298acb80 10 client.17220 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.295+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558237e1ac00 con 0x5582380b4fd0 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f98eeffd700 1 -- 172.21.15.17:0/1355856251 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5582380a6d50 con 0x5582380b4fd0 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f98eeffd700 1 -- 172.21.15.17:0/1355856251 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9904010ad0 con 0x5582380b4fd0 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f99298acb80 10 client.17220 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f99298acb80 10 client.17220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f99298acb80 20 client.17220 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f99298acb80 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5582380c9aa0 0x5582380cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f99298acb80 4 client.17220 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:52:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.296+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558237fffdb0 con 0x5582380c9aa0 2023-10-05T15:52:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.297+0000 7f990f7fe700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5582380c9aa0 0x5582380cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.300+0000 7f990f7fe700 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5582380c9aa0 0x5582380cbec0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d7294398522a2f server_cookie=8743054e65190a7b in_seq=0 out_seq=0 2023-10-05T15:52:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.300+0000 7f98eeffd700 10 client.17220 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.301+0000 7f98eeffd700 1 -- 172.21.15.17:0/1355856251 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558237fffdb0 con 0x5582380c9aa0 2023-10-05T15:52:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.301+0000 7f98eeffd700 10 client.17220 handle_command_reply: tid=0 2023-10-05T15:52:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.301+0000 7f99298acb80 1 client.17220 shutdown 2023-10-05T15:52:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.302+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 msgr2=0x5582380be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.302+0000 7f99298acb80 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 0x5582380be120 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f990400da60 tx=0x7f990400da90 comp rx=0 tx=0).stop 2023-10-05T15:52:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.304+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 shutdown_connections 2023-10-05T15:52:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.304+0000 7f99298acb80 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5582380c9aa0 0x5582380cbec0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.304+0000 7f99298acb80 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.304+0000 7f99298acb80 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.304+0000 7f99298acb80 1 --2- 172.21.15.17:0/1355856251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b4fd0 0x5582380be120 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.304+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 >> 172.21.15.17:0/1355856251 conn(0x558238028200 msgr2=0x5582380ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.305+0000 7f98eeffd700 0 client.17220 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.305+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 shutdown_connections 2023-10-05T15:52:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.305+0000 7f99298acb80 1 -- 172.21.15.17:0/1355856251 wait complete. 2023-10-05T15:52:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.307+0000 7f99298acb80 20 client.17220 trim_cache size 0 max 16384 2023-10-05T15:52:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 Processor -- start 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 -- start start 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b4fd0 0x5582380c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b5990 0x5582380bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558237e878c0 con 0x5582380b5990 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582380bd750 con 0x5582380b3ec0 2023-10-05T15:52:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.332+0000 7f99298acb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582380ab860 con 0x5582380b4fd0 2023-10-05T15:52:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.333+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.333+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51532/0 (socket says 172.21.15.17:51532) 2023-10-05T15:52:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.333+0000 7f990f7fe700 1 -- 172.21.15.17:0/3883789328 learned_addr learned my addr 172.21.15.17:0/3883789328 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.333+0000 7f990ffff700 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b5990 0x5582380bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.334+0000 7f990effd700 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b4fd0 0x5582380c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.334+0000 7f990f7fe700 1 -- 172.21.15.17:0/3883789328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b4fd0 msgr2=0x5582380c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.334+0000 7f990f7fe700 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b4fd0 0x5582380c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.334+0000 7f990f7fe700 1 -- 172.21.15.17:0/3883789328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b5990 msgr2=0x5582380bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.334+0000 7f990f7fe700 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b5990 0x5582380bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.334+0000 7f990f7fe700 1 -- 172.21.15.17:0/3883789328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558237e581f0 con 0x5582380b3ec0 2023-10-05T15:52:07.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.335+0000 7f990f7fe700 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380c5930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9908000f80 tx=0x7f99080a1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=451455a9dfb7ccf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.336+0000 7f98f67fc700 1 -- 172.21.15.17:0/3883789328 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990809b820 con 0x5582380b3ec0 2023-10-05T15:52:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.336+0000 7f98f67fc700 1 -- 172.21.15.17:0/3883789328 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f990809b120 con 0x5582380b3ec0 2023-10-05T15:52:07.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.336+0000 7f98f67fc700 1 -- 172.21.15.17:0/3883789328 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99080cb900 con 0x5582380b3ec0 2023-10-05T15:52:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.337+0000 7f99298acb80 1 -- 172.21.15.17:0/3883789328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 msgr2=0x5582380c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.337+0000 7f99298acb80 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380c5930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9908000f80 tx=0x7f99080a1040 comp rx=0 tx=0).stop 2023-10-05T15:52:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.338+0000 7f99298acb80 1 -- 172.21.15.17:0/3883789328 shutdown_connections 2023-10-05T15:52:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.338+0000 7f99298acb80 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b5990 0x5582380bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.338+0000 7f99298acb80 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b3ec0 0x5582380c5930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.338+0000 7f99298acb80 1 --2- 172.21.15.17:0/3883789328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b4fd0 0x5582380c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.338+0000 7f99298acb80 1 -- 172.21.15.17:0/3883789328 >> 172.21.15.17:0/3883789328 conn(0x558238028200 msgr2=0x5582380cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.339+0000 7f99298acb80 1 -- 172.21.15.17:0/3883789328 shutdown_connections 2023-10-05T15:52:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.342+0000 7f99298acb80 1 -- 172.21.15.17:0/3883789328 wait complete. 2023-10-05T15:52:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.342+0000 7f99298acb80 1 -- start start 2023-10-05T15:52:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.343+0000 7f99298acb80 1 Processor -- start 2023-10-05T15:52:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380c2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582380c3fb0 con 0x5582380b3ec0 2023-10-05T15:52:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582380c4120 con 0x5582380b4fd0 2023-10-05T15:52:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582380c42e0 con 0x5582380b5990 2023-10-05T15:52:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f99298acb80 10 client.0 _ll_register_callbacks cb 0x7f990400b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f990effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f990effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:51536/0 (socket says 172.21.15.17:51536) 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.344+0000 7f990effd700 1 -- 172.21.15.17:0/3073878957 learned_addr learned my addr 172.21.15.17:0/3073878957 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.345+0000 7f990ffff700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.345+0000 7f990f7fe700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.345+0000 7f990ffff700 1 -- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 msgr2=0x5582380c2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.345+0000 7f990ffff700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380c2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.346+0000 7f990ffff700 1 -- 172.21.15.17:0/3073878957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 msgr2=0x5582380c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.346+0000 7f990ffff700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380c2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.346+0000 7f990ffff700 1 -- 172.21.15.17:0/3073878957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99101ae1a0 con 0x5582380b5990 2023-10-05T15:52:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.346+0000 7f990ffff700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c3a70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f99000094b0 tx=0x7f99000047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97207c3ccef98732 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.346+0000 7f98eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:52:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.348+0000 7f98eeffd700 1 -- 172.21.15.17:0/3073878957 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900025070 con 0x5582380b5990 2023-10-05T15:52:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.348+0000 7f98eeffd700 1 -- 172.21.15.17:0/3073878957 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f9900012d20 con 0x5582380b5990 2023-10-05T15:52:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.349+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f990400dcc0 con 0x5582380b5990 2023-10-05T15:52:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.349+0000 7f98eeffd700 1 -- 172.21.15.17:0/3073878957 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9900020430 con 0x5582380b5990 2023-10-05T15:52:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.349+0000 7f99298acb80 10 client.27217 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.349+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558237e30250 con 0x5582380b5990 2023-10-05T15:52:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f98eeffd700 1 -- 172.21.15.17:0/3073878957 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f990400dcc0 con 0x5582380b5990 2023-10-05T15:52:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f98eeffd700 1 -- 172.21.15.17:0/3073878957 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f990001a070 con 0x5582380b5990 2023-10-05T15:52:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f99298acb80 10 client.27217 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f99298acb80 10 client.27217 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f99298acb80 20 client.27217 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f99298acb80 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55823811df80 0x558238120370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f99298acb80 4 client.27217 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:52:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558237fffad0 con 0x55823811df80 2023-10-05T15:52:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.350+0000 7f990f7fe700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55823811df80 0x558238120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.351+0000 7f990f7fe700 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55823811df80 0x558238120370 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f7eccfd1d8d6c26 server_cookie=e334f6f247b0f325 in_seq=0 out_seq=0 2023-10-05T15:52:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.351+0000 7f98eeffd700 10 client.27217 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.372+0000 7f98eeffd700 1 -- 172.21.15.17:0/3073878957 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558237fffad0 con 0x55823811df80 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.372+0000 7f98eeffd700 10 client.27217 handle_command_reply: tid=0 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.372+0000 7f99298acb80 1 client.27217 shutdown 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.372+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 msgr2=0x5582380c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.372+0000 7f99298acb80 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c3a70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f99000094b0 tx=0x7f99000047c0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 shutdown_connections 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55823811df80 0x558238120370 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5582380b5990 0x5582380c3a70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5582380b3ec0 0x5582380c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 --2- 172.21.15.17:0/3073878957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5582380b4fd0 0x5582380c2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 >> 172.21.15.17:0/3073878957 conn(0x558238028200 msgr2=0x5582380c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:07.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f98eeffd700 0 client.27217 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:07.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 shutdown_connections 2023-10-05T15:52:07.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.373+0000 7f99298acb80 1 -- 172.21.15.17:0/3073878957 wait complete. 2023-10-05T15:52:07.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.374+0000 7f99298acb80 20 client.27217 trim_cache size 0 max 16384 2023-10-05T15:52:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:52:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:52:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:52:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:52:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98f80a15b0 msgr2=0x7f98f80a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98f80a15b0 0x7f98f80a3a70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9900005950 tx=0x7f99000058e0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 msgr2=0x7f991019d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f991019d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9908007970 tx=0x7f9908004dd0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 shutdown_connections 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f98f80a15b0 0x7f98f80a3a70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f991010f730 0x7f991019e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9910107eb0 0x7f991019d1a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 --2- 172.21.15.17:0/2787319152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9910108810 0x7f991019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 >> 172.21.15.17:0/2787319152 conn(0x7f991006dd10 msgr2=0x7f991006f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 shutdown_connections 2023-10-05T15:52:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:07.375+0000 7f9915fff700 1 -- 172.21.15.17:0/2787319152 wait complete. 2023-10-05T15:52:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 810.0 s, 406.0 tps, lat 247.691 ms stddev 486.724 2023-10-05T15:52:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:08 smithi167 ceph-mon[133366]: pgmap v835: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.2 MiB/s wr, 602 op/s 2023-10-05T15:52:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:08 smithi079 ceph-mon[132936]: pgmap v835: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.2 MiB/s wr, 602 op/s 2023-10-05T15:52:08.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:08 smithi017 ceph-mon[129107]: pgmap v835: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 8.2 MiB/s wr, 602 op/s 2023-10-05T15:52:10.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:10 smithi167 ceph-mon[133366]: pgmap v836: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.4 MiB/s wr, 628 op/s 2023-10-05T15:52:10.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:10 smithi079 ceph-mon[132936]: pgmap v836: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.4 MiB/s wr, 628 op/s 2023-10-05T15:52:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:10 smithi017 ceph-mon[129107]: pgmap v836: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 8.4 MiB/s wr, 628 op/s 2023-10-05T15:52:12.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:12 smithi167 ceph-mon[133366]: pgmap v837: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.3 MiB/s wr, 624 op/s 2023-10-05T15:52:12.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:12 smithi079 ceph-mon[132936]: pgmap v837: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.3 MiB/s wr, 624 op/s 2023-10-05T15:52:12.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:12 smithi017 ceph-mon[129107]: pgmap v837: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 8.3 MiB/s wr, 624 op/s 2023-10-05T15:52:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 815.0 s, 492.8 tps, lat 201.829 ms stddev 63.022 2023-10-05T15:52:14.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:14 smithi167 ceph-mon[133366]: pgmap v838: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.0 MiB/s wr, 497 op/s 2023-10-05T15:52:14.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:14 smithi079 ceph-mon[132936]: pgmap v838: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.0 MiB/s wr, 497 op/s 2023-10-05T15:52:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:14 smithi017 ceph-mon[129107]: pgmap v838: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.0 MiB/s wr, 497 op/s 2023-10-05T15:52:16.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:16 smithi167 ceph-mon[133366]: pgmap v839: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.9 MiB/s wr, 648 op/s 2023-10-05T15:52:16.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:16 smithi079 ceph-mon[132936]: pgmap v839: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.9 MiB/s wr, 648 op/s 2023-10-05T15:52:16.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:16 smithi017 ceph-mon[129107]: pgmap v839: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.9 MiB/s wr, 648 op/s 2023-10-05T15:52:17.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:52:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.738+0000 7f69dbdff700 1 -- 172.21.15.17:0/2509186408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 msgr2=0x7f69d4073d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.738+0000 7f69dbdff700 1 --2- 172.21.15.17:0/2509186408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 0x7f69d4073d30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009990 tx=0x7f69c4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.742+0000 7f69dbdff700 1 -- 172.21.15.17:0/2509186408 shutdown_connections 2023-10-05T15:52:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.742+0000 7f69dbdff700 1 --2- 172.21.15.17:0/2509186408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d410b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.742+0000 7f69dbdff700 1 --2- 172.21.15.17:0/2509186408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 0x7f69d40732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.742+0000 7f69dbdff700 1 --2- 172.21.15.17:0/2509186408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 0x7f69d4073d30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.742+0000 7f69dbdff700 1 -- 172.21.15.17:0/2509186408 >> 172.21.15.17:0/2509186408 conn(0x7f69d40fc460 msgr2=0x7f69d40fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.744+0000 7f69dbdff700 1 -- 172.21.15.17:0/2509186408 shutdown_connections 2023-10-05T15:52:17.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.745+0000 7f69dbdff700 1 -- 172.21.15.17:0/2509186408 wait complete. 2023-10-05T15:52:17.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.747+0000 7f69dbdff700 1 Processor -- start 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 -- start start 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 0x7f69d4194900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 0x7f69d4194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419c480 con 0x7f69d4074e90 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d406a8d0 con 0x7f69d4108da0 2023-10-05T15:52:17.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.748+0000 7f69dbdff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d406aa60 con 0x7f69d40738b0 2023-10-05T15:52:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.749+0000 7f69da39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.749+0000 7f69da39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:38682/0 (socket says 172.21.15.17:38682) 2023-10-05T15:52:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.749+0000 7f69da39c700 1 -- 172.21.15.17:0/1312660451 learned_addr learned my addr 172.21.15.17:0/1312660451 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:17.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.749+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 0x7f69d4194900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.750+0000 7f69d939a700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 0x7f69d4194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.750+0000 7f69da39c700 1 -- 172.21.15.17:0/1312660451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 msgr2=0x7f69d4194900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.750+0000 7f69da39c700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 0x7f69d4194900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.750+0000 7f69da39c700 1 -- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 msgr2=0x7f69d4194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.750+0000 7f69da39c700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 0x7f69d4194e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.750+0000 7f69da39c700 1 -- 172.21.15.17:0/1312660451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40095f0 con 0x7f69d4108da0 2023-10-05T15:52:17.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.751+0000 7f69d939a700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 0x7f69d4194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:52:17.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.751+0000 7f69da39c700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d419beb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00e940 tx=0x7f69cc00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.753+0000 7f69caffd700 1 -- 172.21.15.17:0/1312660451 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0097b0 con 0x7f69d4108da0 2023-10-05T15:52:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.753+0000 7f69caffd700 1 -- 172.21.15.17:0/1312660451 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69cc00ee90 con 0x7f69d4108da0 2023-10-05T15:52:17.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.753+0000 7f69caffd700 1 -- 172.21.15.17:0/1312660451 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc005450 con 0x7f69d4108da0 2023-10-05T15:52:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.754+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d406ad40 con 0x7f69d4108da0 2023-10-05T15:52:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.755+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d406b1d0 con 0x7f69d4108da0 2023-10-05T15:52:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.762+0000 7f69caffd700 1 -- 172.21.15.17:0/1312660451 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f69cc0055b0 con 0x7f69d4108da0 2023-10-05T15:52:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 Processor -- start 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 -- start start 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x55745299f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574529a0a60 0x5574529a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557452907460 con 0x55745299fbc0 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574528f8c20 con 0x55745299f260 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.763+0000 7f69ef818b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574528f6540 con 0x5574529a0a60 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.764+0000 7f69d939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x55745299f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.764+0000 7f69d939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x55745299f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:38692/0 (socket says 172.21.15.17:38692) 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.764+0000 7f69d939a700 1 -- 172.21.15.17:0/1513854724 learned_addr learned my addr 172.21.15.17:0/1513854724 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.764+0000 7f69d939a700 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574529a0a60 0x5574529a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.765+0000 7f69d939a700 1 -- 172.21.15.17:0/1513854724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574529a0a60 msgr2=0x5574529a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.765+0000 7f69d939a700 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574529a0a60 0x5574529a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.765+0000 7f69d939a700 1 -- 172.21.15.17:0/1513854724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 msgr2=0x5574529a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.765+0000 7f69d939a700 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.765+0000 7f69d939a700 1 -- 172.21.15.17:0/1513854724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745271cde0 con 0x55745299f260 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.765+0000 7f69caffd700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69c00a1600 0x7f69c00a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.766+0000 7f69caffd700 1 -- 172.21.15.17:0/1312660451 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f69cc014070 con 0x7f69d4108da0 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.766+0000 7f69d939a700 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x55745299f680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f69c4005b40 tx=0x7f69c4005ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1efcb1fbc41fc848 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.766+0000 7f69bffff700 1 -- 172.21.15.17:0/1513854724 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4003c20 con 0x55745299f260 2023-10-05T15:52:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.766+0000 7f69bffff700 1 -- 172.21.15.17:0/1513854724 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69c40054d0 con 0x55745299f260 2023-10-05T15:52:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.766+0000 7f69bffff700 1 -- 172.21.15.17:0/1513854724 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400bb80 con 0x55745299f260 2023-10-05T15:52:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.768+0000 7f69ef818b80 1 -- 172.21.15.17:0/1513854724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 msgr2=0x55745299f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.768+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x55745299f680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f69c4005b40 tx=0x7f69c4005ab0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.771+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69c00a1600 0x7f69c00a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.771+0000 7f69ef818b80 1 -- 172.21.15.17:0/1513854724 shutdown_connections 2023-10-05T15:52:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.772+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574529a0a60 0x5574529a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.772+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x55745299f680 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.772+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1513854724 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.772+0000 7f69ef818b80 1 -- 172.21.15.17:0/1513854724 >> 172.21.15.17:0/1513854724 conn(0x557452913260 msgr2=0x55745299a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.773+0000 7f69ef818b80 1 -- 172.21.15.17:0/1513854724 shutdown_connections 2023-10-05T15:52:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.773+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69c00a1600 0x7f69c00a3ac0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f69d0011500 tx=0x7f69d0009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.773+0000 7f69ef818b80 1 -- 172.21.15.17:0/1513854724 wait complete. 2023-10-05T15:52:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.773+0000 7f69ef818b80 1 -- start start 2023-10-05T15:52:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.774+0000 7f69ef818b80 1 Processor -- start 2023-10-05T15:52:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x5574529a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299fbc0 0x5574529a9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574528f1e30 con 0x5574529a0a60 2023-10-05T15:52:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745288e710 con 0x55745299f260 2023-10-05T15:52:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745288e3b0 con 0x55745299fbc0 2023-10-05T15:52:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.775+0000 7f69ef818b80 10 client.0 _ll_register_callbacks cb 0x5574526eb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.776+0000 7f69d939a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299fbc0 0x5574529a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.776+0000 7f69d9b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x5574529a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.776+0000 7f69d939a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299fbc0 0x5574529a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38710/0 (socket says 172.21.15.17:38710) 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.776+0000 7f69d939a700 1 -- 172.21.15.17:0/1565274595 learned_addr learned my addr 172.21.15.17:0/1565274595 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.777+0000 7f69da39c700 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.777+0000 7f69d9b9b700 1 -- 172.21.15.17:0/1565274595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299fbc0 msgr2=0x5574529a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.777+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299fbc0 0x5574529a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.777+0000 7f69d9b9b700 1 -- 172.21.15.17:0/1565274595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 msgr2=0x5574529b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.777+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.777+0000 7f69d9b9b700 1 -- 172.21.15.17:0/1565274595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d410be30 con 0x55745299f260 2023-10-05T15:52:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.778+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x5574529a8fd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009fd0 tx=0x7f69d0004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=269aa5a44b77784d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.778+0000 7f69bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:52:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.778+0000 7f69bd7fa700 1 -- 172.21.15.17:0/1565274595 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d000e040 con 0x55745299f260 2023-10-05T15:52:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.779+0000 7f69bd7fa700 1 -- 172.21.15.17:0/1565274595 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f69d001c040 con 0x55745299f260 2023-10-05T15:52:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.779+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557452991f10 con 0x55745299f260 2023-10-05T15:52:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.779+0000 7f69bd7fa700 1 -- 172.21.15.17:0/1565274595 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69d0015e00 con 0x55745299f260 2023-10-05T15:52:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.779+0000 7f69ef818b80 10 client.27305 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:17.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.779+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x557452705c60 con 0x55745299f260 2023-10-05T15:52:17.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.780+0000 7f69bd7fa700 1 -- 172.21.15.17:0/1565274595 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557452991f10 con 0x55745299f260 2023-10-05T15:52:17.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.780+0000 7f69bd7fa700 1 -- 172.21.15.17:0/1565274595 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f69d00057c0 con 0x55745299f260 2023-10-05T15:52:17.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.780+0000 7f69ef818b80 10 client.27305 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.780+0000 7f69ef818b80 10 client.27305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.781+0000 7f69ef818b80 20 client.27305 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.781+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5574529b4e50 0x5574529b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.781+0000 7f69ef818b80 4 client.27305 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:52:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.781+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574528eae10 con 0x5574529b4e50 2023-10-05T15:52:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.782+0000 7f69d939a700 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5574529b4e50 0x5574529b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.783+0000 7f69d939a700 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5574529b4e50 0x5574529b7270 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b001ff15e7d1ac server_cookie=f46de38863366bd1 in_seq=0 out_seq=0 2023-10-05T15:52:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.783+0000 7f69bd7fa700 10 client.27305 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.784+0000 7f69bd7fa700 1 -- 172.21.15.17:0/1565274595 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5574528eae10 con 0x5574529b4e50 2023-10-05T15:52:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.784+0000 7f69bd7fa700 10 client.27305 handle_command_reply: tid=0 2023-10-05T15:52:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.784+0000 7f69ef818b80 1 client.27305 shutdown 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 msgr2=0x5574529a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x5574529a8fd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009fd0 tx=0x7f69d0004b40 comp rx=0 tx=0).stop 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 shutdown_connections 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5574529b4e50 0x5574529b7270 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299f260 0x5574529a8fd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 --2- 172.21.15.17:0/1565274595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299fbc0 0x5574529a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.786+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 >> 172.21.15.17:0/1565274595 conn(0x557452913260 msgr2=0x557452999f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.787+0000 7f69bd7fa700 0 client.27305 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:17.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.790+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 shutdown_connections 2023-10-05T15:52:17.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.790+0000 7f69ef818b80 1 -- 172.21.15.17:0/1565274595 wait complete. 2023-10-05T15:52:17.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.794+0000 7f69ef818b80 20 client.27305 trim_cache size 0 max 16384 2023-10-05T15:52:17.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.827+0000 7f69ef818b80 1 Processor -- start 2023-10-05T15:52:17.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.827+0000 7f69ef818b80 1 -- start start 2023-10-05T15:52:17.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.828+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.828+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.828+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574529a0a60 0x5574529a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.828+0000 7f69ef818b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557452772920 con 0x55745299fbc0 2023-10-05T15:52:17.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.828+0000 7f69ef818b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574529a8480 con 0x5574529a0a60 2023-10-05T15:52:17.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.828+0000 7f69ef818b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574529a4540 con 0x55745299f260 2023-10-05T15:52:17.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.831+0000 7f69d9b9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.831+0000 7f69da39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574529a0a60 0x5574529a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.831+0000 7f69da39c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574529a0a60 0x5574529a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:38716/0 (socket says 172.21.15.17:38716) 2023-10-05T15:52:17.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.831+0000 7f69da39c700 1 -- 172.21.15.17:0/2935645804 learned_addr learned my addr 172.21.15.17:0/2935645804 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.831+0000 7f69d939a700 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.832+0000 7f69d939a700 1 -- 172.21.15.17:0/2935645804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 msgr2=0x5574529a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.832+0000 7f69d939a700 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.832+0000 7f69d939a700 1 -- 172.21.15.17:0/2935645804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574529a0a60 msgr2=0x5574529a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.832+0000 7f69d939a700 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574529a0a60 0x5574529a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.832+0000 7f69d939a700 1 -- 172.21.15.17:0/2935645804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557452743250 con 0x55745299fbc0 2023-10-05T15:52:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.832+0000 7f69d939a700 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529b0510 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x5574529b5230 tx=0x7f69c4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f0626967d8c206 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.833+0000 7f69c8bff700 1 -- 172.21.15.17:0/2935645804 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4051040 con 0x55745299fbc0 2023-10-05T15:52:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.833+0000 7f69c8bff700 1 -- 172.21.15.17:0/2935645804 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69c4003b40 con 0x55745299fbc0 2023-10-05T15:52:17.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.833+0000 7f69c8bff700 1 -- 172.21.15.17:0/2935645804 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400f6c0 con 0x55745299fbc0 2023-10-05T15:52:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 -- 172.21.15.17:0/2935645804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 msgr2=0x5574529b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529b0510 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x5574529b5230 tx=0x7f69c4005c00 comp rx=0 tx=0).stop 2023-10-05T15:52:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 -- 172.21.15.17:0/2935645804 shutdown_connections 2023-10-05T15:52:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5574529a0a60 0x5574529a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 --2- 172.21.15.17:0/2935645804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55745299fbc0 0x5574529b0510 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.835+0000 7f69ef818b80 1 -- 172.21.15.17:0/2935645804 >> 172.21.15.17:0/2935645804 conn(0x557452913260 msgr2=0x5574529a7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:17.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.836+0000 7f69ef818b80 1 -- 172.21.15.17:0/2935645804 shutdown_connections 2023-10-05T15:52:17.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.837+0000 7f69ef818b80 1 -- 172.21.15.17:0/2935645804 wait complete. 2023-10-05T15:52:17.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.838+0000 7f69ef818b80 1 -- start start 2023-10-05T15:52:17.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.838+0000 7f69ef818b80 1 Processor -- start 2023-10-05T15:52:17.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299fbc0 0x5574529aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574529b0050 con 0x5574529a0a60 2023-10-05T15:52:17.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574529b01c0 con 0x55745299fbc0 2023-10-05T15:52:17.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574529b0380 con 0x55745299f260 2023-10-05T15:52:17.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.839+0000 7f69ef818b80 10 client.0 _ll_register_callbacks cb 0x7f69d00177e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:17.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.840+0000 7f69d939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299fbc0 0x5574529aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.840+0000 7f69d939a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299fbc0 0x5574529aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:38724/0 (socket says 172.21.15.17:38724) 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.840+0000 7f69d939a700 1 -- 172.21.15.17:0/628525758 learned_addr learned my addr 172.21.15.17:0/628525758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.840+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69da39c700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69d9b9b700 1 -- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299fbc0 msgr2=0x5574529aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299fbc0 0x5574529aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69d9b9b700 1 -- 172.21.15.17:0/628525758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 msgr2=0x5574529afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69d9b9b700 1 -- 172.21.15.17:0/628525758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55745271cde0 con 0x55745299f260 2023-10-05T15:52:17.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.841+0000 7f69d9b9b700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529ae690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f69d0021000 tx=0x7f69d00297e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1031d05f2c072ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:17.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.842+0000 7f69bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:52:17.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.842+0000 7f69bd7fa700 1 -- 172.21.15.17:0/628525758 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d000e040 con 0x55745299f260 2023-10-05T15:52:17.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.842+0000 7f69bd7fa700 1 -- 172.21.15.17:0/628525758 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f69d0029be0 con 0x55745299f260 2023-10-05T15:52:17.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.842+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69c40054d0 con 0x55745299f260 2023-10-05T15:52:17.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.843+0000 7f69bd7fa700 1 -- 172.21.15.17:0/628525758 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69d0029da0 con 0x55745299f260 2023-10-05T15:52:17.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.843+0000 7f69ef818b80 10 client.27235 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:17.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.843+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55745271b2b0 con 0x55745299f260 2023-10-05T15:52:17.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.843+0000 7f69bd7fa700 1 -- 172.21.15.17:0/628525758 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69c40054d0 con 0x55745299f260 2023-10-05T15:52:17.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69bd7fa700 1 -- 172.21.15.17:0/628525758 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f69d003d3f0 con 0x55745299f260 2023-10-05T15:52:17.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69ef818b80 10 client.27235 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:17.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69ef818b80 10 client.27235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:17.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69ef818b80 20 client.27235 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69ef818b80 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557452a09e30 0x557452a0c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69ef818b80 4 client.27235 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.844+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5574528eab30 con 0x557452a09e30 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.845+0000 7f69d939a700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557452a09e30 0x557452a0c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.846+0000 7f69d939a700 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557452a09e30 0x557452a0c250 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324930ac7d110e3e server_cookie=35df617d61762156 in_seq=0 out_seq=0 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.846+0000 7f69bd7fa700 10 client.27235 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.846+0000 7f69bd7fa700 1 -- 172.21.15.17:0/628525758 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5574528eab30 con 0x557452a09e30 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.846+0000 7f69bd7fa700 10 client.27235 handle_command_reply: tid=0 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.846+0000 7f69ef818b80 1 client.27235 shutdown 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.847+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 msgr2=0x5574529ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.847+0000 7f69ef818b80 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529ae690 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f69d0021000 tx=0x7f69d00297e0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 shutdown_connections 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x557452a09e30 0x557452a0c250 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5574529a0a60 0x5574529afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55745299f260 0x5574529ae690 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 --2- 172.21.15.17:0/628525758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55745299fbc0 0x5574529aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 >> 172.21.15.17:0/628525758 conn(0x557452913260 msgr2=0x5574529a6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69bd7fa700 0 client.27235 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 shutdown_connections 2023-10-05T15:52:17.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.849+0000 7f69ef818b80 1 -- 172.21.15.17:0/628525758 wait complete. 2023-10-05T15:52:17.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.851+0000 7f69ef818b80 20 client.27235 trim_cache size 0 max 16384 2023-10-05T15:52:17.856 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:52:17.856 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:52:17.856 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:52:17.856 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:52:17.856 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:52:17.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:52:17.857 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:52:17.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:52:17.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:52:17.857 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:52:17.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.855+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69c00a1600 msgr2=0x7f69c00a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.855+0000 7f69dbdff700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69c00a1600 0x7f69c00a3ac0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f69d0011500 tx=0x7f69d0009920 comp rx=0 tx=0).stop 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.855+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 msgr2=0x7f69d419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.855+0000 7f69dbdff700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d419beb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00e940 tx=0x7f69cc00ec50 comp rx=0 tx=0).stop 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.856+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 shutdown_connections 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.856+0000 7f69dbdff700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f69c00a1600 0x7f69c00a3ac0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.856+0000 7f69dbdff700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69d4108da0 0x7f69d419beb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.856+0000 7f69dbdff700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69d40738b0 0x7f69d4194900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.856+0000 7f69dbdff700 1 --2- 172.21.15.17:0/1312660451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69d4074e90 0x7f69d4194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.856+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 >> 172.21.15.17:0/1312660451 conn(0x7f69d40fc460 msgr2=0x7f69d40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:17.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.857+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 shutdown_connections 2023-10-05T15:52:17.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:17.861+0000 7f69dbdff700 1 -- 172.21.15.17:0/1312660451 wait complete. 2023-10-05T15:52:17.904 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:52:18.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 820.0 s, 510.0 tps, lat 195.372 ms stddev 78.553 2023-10-05T15:52:18.198 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:18 smithi017 ceph-mon[129107]: pgmap v840: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 516 op/s 2023-10-05T15:52:18.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:18 smithi167 ceph-mon[133366]: pgmap v840: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 516 op/s 2023-10-05T15:52:18.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:18 smithi079 ceph-mon[132936]: pgmap v840: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.8 MiB/s wr, 516 op/s 2023-10-05T15:52:20.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:20 smithi167 ceph-mon[133366]: pgmap v841: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-05T15:52:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:20 smithi079 ceph-mon[132936]: pgmap v841: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-05T15:52:20.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:20 smithi017 ceph-mon[129107]: pgmap v841: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-05T15:52:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.631+0000 7fec1a3ff700 1 -- 172.21.15.17:0/2078461678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 msgr2=0x7fec1410cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.631+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/2078461678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 0x7fec1410cf30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fec08009990 tx=0x7fec08009ca0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.633+0000 7fec1a3ff700 1 -- 172.21.15.17:0/2078461678 shutdown_connections 2023-10-05T15:52:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.633+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/2078461678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 0x7fec1410fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.633+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/2078461678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1410a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.633+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/2078461678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 0x7fec1410cf30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.633+0000 7fec1a3ff700 1 -- 172.21.15.17:0/2078461678 >> 172.21.15.17:0/2078461678 conn(0x7fec1406e0b0 msgr2=0x7fec14070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.636+0000 7fec1a3ff700 1 -- 172.21.15.17:0/2078461678 shutdown_connections 2023-10-05T15:52:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.638+0000 7fec1a3ff700 1 -- 172.21.15.17:0/2078461678 wait complete. 2023-10-05T15:52:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.640+0000 7fec1a3ff700 1 Processor -- start 2023-10-05T15:52:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.640+0000 7fec1a3ff700 1 -- start start 2023-10-05T15:52:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec1a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1419d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec1a3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 0x7fec1419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec1a3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 0x7fec1419e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec1a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1419ed60 con 0x7fec14108120 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec1a3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1419eed0 con 0x7fec1410aae0 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec1a3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1419f090 con 0x7fec1410d5c0 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec13fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1419d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec13fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1419d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43686/0 (socket says 172.21.15.17:43686) 2023-10-05T15:52:20.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 0x7fec1419d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.641+0000 7fec13fff700 1 -- 172.21.15.17:0/637254813 learned_addr learned my addr 172.21.15.17:0/637254813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec1899c700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 0x7fec1419e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec13fff700 1 -- 172.21.15.17:0/637254813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 msgr2=0x7fec1419e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec13fff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 0x7fec1419e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec13fff700 1 -- 172.21.15.17:0/637254813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 msgr2=0x7fec1419d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec13fff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 0x7fec1419d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec13fff700 1 -- 172.21.15.17:0/637254813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec080095f0 con 0x7fec14108120 2023-10-05T15:52:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.642+0000 7fec1899c700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 0x7fec1419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:52:20.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.643+0000 7fec13fff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1419d2f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fec0400b530 tx=0x7fec0400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.643+0000 7fec117fa700 1 -- 172.21.15.17:0/637254813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04011830 con 0x7fec14108120 2023-10-05T15:52:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.643+0000 7fec117fa700 1 -- 172.21.15.17:0/637254813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec04011e20 con 0x7fec14108120 2023-10-05T15:52:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.643+0000 7fec117fa700 1 -- 172.21.15.17:0/637254813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400f2e0 con 0x7fec14108120 2023-10-05T15:52:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.643+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1419f370 con 0x7fec14108120 2023-10-05T15:52:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.644+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec141a3bc0 con 0x7fec14108120 2023-10-05T15:52:20.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.651+0000 7fec2dd2bb80 1 Processor -- start 2023-10-05T15:52:20.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.651+0000 7fec117fa700 1 -- 172.21.15.17:0/637254813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fec04011990 con 0x7fec14108120 2023-10-05T15:52:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 -- start start 2023-10-05T15:52:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a03450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a03990 0x55fdf3a0a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf396a400 con 0x55fdf3a03990 2023-10-05T15:52:20.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf395bbc0 con 0x55fdf3a02fd0 2023-10-05T15:52:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.653+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf39594e0 con 0x55fdf3a01ec0 2023-10-05T15:52:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.654+0000 7fec1899c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.654+0000 7fec1899c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38742/0 (socket says 172.21.15.17:38742) 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.654+0000 7fec1899c700 1 -- 172.21.15.17:0/2387922435 learned_addr learned my addr 172.21.15.17:0/2387922435 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.654+0000 7fec13fff700 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a03450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.654+0000 7fec137fe700 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a03990 0x55fdf3a0a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.655+0000 7fec137fe700 1 -- 172.21.15.17:0/2387922435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 msgr2=0x55fdf3a022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.655+0000 7fec137fe700 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a022e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.655+0000 7fec137fe700 1 -- 172.21.15.17:0/2387922435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 msgr2=0x55fdf3a03450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.655+0000 7fec137fe700 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a03450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.655+0000 7fec137fe700 1 -- 172.21.15.17:0/2387922435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdf377fd80 con 0x55fdf3a03990 2023-10-05T15:52:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.656+0000 7fec137fe700 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a03990 0x55fdf3a0a220 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fec080098e0 tx=0x7fec08005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d7c4ef3a27e0fa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.656+0000 7fec117fa700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7febfc0a1680 0x7febfc0a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.656+0000 7fec117fa700 1 -- 172.21.15.17:0/637254813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fec040ccb40 con 0x7fec14108120 2023-10-05T15:52:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.656+0000 7febfa7fc700 1 -- 172.21.15.17:0/2387922435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800b7d0 con 0x55fdf3a03990 2023-10-05T15:52:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.657+0000 7febfa7fc700 1 -- 172.21.15.17:0/2387922435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec08003850 con 0x55fdf3a03990 2023-10-05T15:52:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.657+0000 7febfa7fc700 1 -- 172.21.15.17:0/2387922435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800e6b0 con 0x55fdf3a03990 2023-10-05T15:52:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.657+0000 7fec1899c700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7febfc0a1680 0x7febfc0a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2387922435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a03990 msgr2=0x55fdf3a0a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a03990 0x55fdf3a0a220 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fec080098e0 tx=0x7fec08005510 comp rx=0 tx=0).stop 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2387922435 shutdown_connections 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a03990 0x55fdf3a0a220 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2387922435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a03450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2387922435 >> 172.21.15.17:0/2387922435 conn(0x55fdf3976200 msgr2=0x55fdf39fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:20.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.658+0000 7fec1899c700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7febfc0a1680 0x7febfc0a3b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55fdf3a01c60 tx=0x7fec0c007800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.659+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2387922435 shutdown_connections 2023-10-05T15:52:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.659+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2387922435 wait complete. 2023-10-05T15:52:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.660+0000 7fec2dd2bb80 1 -- start start 2023-10-05T15:52:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.660+0000 7fec2dd2bb80 1 Processor -- start 2023-10-05T15:52:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a0bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a0c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 0x55fdf3a13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf3954dd0 con 0x55fdf3a02fd0 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf38f16b0 con 0x55fdf3a03990 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf38f1350 con 0x55fdf3a01ec0 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec2dd2bb80 10 client.0 _ll_register_callbacks cb 0x55fdf374e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.661+0000 7fec1899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 0x55fdf3a13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 0x55fdf3a13090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:38770/0 (socket says 172.21.15.17:38770) 2023-10-05T15:52:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 -- 172.21.15.17:0/1209601834 learned_addr learned my addr 172.21.15.17:0/1209601834 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 -- 172.21.15.17:0/1209601834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 msgr2=0x55fdf3a0bb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:52:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a0bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 -- 172.21.15.17:0/1209601834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 msgr2=0x55fdf3a0c050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:52:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a0c050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.662+0000 7fec1899c700 1 -- 172.21.15.17:0/1209601834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0801a040 con 0x55fdf3a03990 2023-10-05T15:52:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.666+0000 7fec1899c700 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 0x55fdf3a13090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0107a0 tx=0x7fec0c004b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c9994b77b836d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.666+0000 7febf37fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:52:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.666+0000 7febf37fe700 1 -- 172.21.15.17:0/1209601834 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01b850 con 0x55fdf3a03990 2023-10-05T15:52:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.666+0000 7febf37fe700 1 -- 172.21.15.17:0/1209601834 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fec0c021070 con 0x55fdf3a03990 2023-10-05T15:52:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.667+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdf39f4d50 con 0x55fdf3a03990 2023-10-05T15:52:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.668+0000 7febf37fe700 1 -- 172.21.15.17:0/1209601834 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec0c01b9b0 con 0x55fdf3a03990 2023-10-05T15:52:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.670+0000 7fec2dd2bb80 10 client.27323 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.670+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55fdf3768c00 con 0x55fdf3a03990 2023-10-05T15:52:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.671+0000 7febf37fe700 1 -- 172.21.15.17:0/1209601834 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fdf39f4d50 con 0x55fdf3a03990 2023-10-05T15:52:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.671+0000 7febf37fe700 1 -- 172.21.15.17:0/1209601834 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fec0c025d00 con 0x55fdf3a03990 2023-10-05T15:52:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.671+0000 7fec2dd2bb80 10 client.27323 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.671+0000 7fec2dd2bb80 10 client.27323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.671+0000 7fec2dd2bb80 20 client.27323 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.671+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a17970 0x55fdf3a19d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.672+0000 7fec2dd2bb80 4 client.27323 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:52:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.672+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdf394ddb0 con 0x55fdf3a17970 2023-10-05T15:52:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.672+0000 7fec13fff700 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a17970 0x55fdf3a19d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.674+0000 7fec13fff700 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a17970 0x55fdf3a19d90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e84a17460f574ca4 server_cookie=9fcf97656c7ca01 in_seq=0 out_seq=0 2023-10-05T15:52:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.674+0000 7febf37fe700 10 client.27323 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.675+0000 7febf37fe700 1 -- 172.21.15.17:0/1209601834 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fdf394ddb0 con 0x55fdf3a17970 2023-10-05T15:52:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.675+0000 7febf37fe700 10 client.27323 handle_command_reply: tid=0 2023-10-05T15:52:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 client.27323 shutdown 2023-10-05T15:52:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 msgr2=0x55fdf3a13090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 0x55fdf3a13090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0107a0 tx=0x7fec0c004b60 comp rx=0 tx=0).stop 2023-10-05T15:52:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 shutdown_connections 2023-10-05T15:52:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a17970 0x55fdf3a19d90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a03990 0x55fdf3a13090 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a0bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/1209601834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a0c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 >> 172.21.15.17:0/1209601834 conn(0x55fdf3976200 msgr2=0x55fdf39fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.676+0000 7febf37fe700 0 client.27323 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.677+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 shutdown_connections 2023-10-05T15:52:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.677+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/1209601834 wait complete. 2023-10-05T15:52:20.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.677+0000 7fec2dd2bb80 20 client.27323 trim_cache size 0 max 16384 2023-10-05T15:52:20.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.706+0000 7fec2dd2bb80 1 Processor -- start 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.706+0000 7fec2dd2bb80 1 -- start start 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.707+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a01ec0 0x55fdf39fc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.707+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a13050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.707+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a19980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.707+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf37d58c0 con 0x55fdf3a01ec0 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.707+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf3a0afc0 con 0x55fdf3a02fd0 2023-10-05T15:52:20.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.707+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf3a14d80 con 0x55fdf3a03990 2023-10-05T15:52:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a13050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a13050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:38784/0 (socket says 172.21.15.17:38784) 2023-10-05T15:52:20.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 -- 172.21.15.17:0/2090878488 learned_addr learned my addr 172.21.15.17:0/2090878488 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec1899c700 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a19980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec13fff700 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a01ec0 0x55fdf39fc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 -- 172.21.15.17:0/2090878488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 msgr2=0x55fdf3a19980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a19980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 -- 172.21.15.17:0/2090878488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a01ec0 msgr2=0x55fdf39fc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a01ec0 0x55fdf39fc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec137fe700 1 -- 172.21.15.17:0/2090878488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdf37a61f0 con 0x55fdf3a02fd0 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.708+0000 7fec13fff700 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a01ec0 0x55fdf39fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:52:20.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.709+0000 7fec137fe700 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a13050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fec08009f10 tx=0x7fec08005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ca05235b09173c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.709+0000 7febfaffd700 1 -- 172.21.15.17:0/2090878488 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08009290 con 0x55fdf3a02fd0 2023-10-05T15:52:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.709+0000 7febfaffd700 1 -- 172.21.15.17:0/2090878488 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec08004150 con 0x55fdf3a02fd0 2023-10-05T15:52:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.709+0000 7febfaffd700 1 -- 172.21.15.17:0/2090878488 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08021450 con 0x55fdf3a02fd0 2023-10-05T15:52:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.710+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2090878488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 msgr2=0x55fdf3a13050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.710+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a13050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fec08009f10 tx=0x7fec08005e80 comp rx=0 tx=0).stop 2023-10-05T15:52:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2090878488 shutdown_connections 2023-10-05T15:52:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a19980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a01ec0 0x55fdf39fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/2090878488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a13050 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2090878488 >> 172.21.15.17:0/2090878488 conn(0x55fdf3976200 msgr2=0x55fdf3a0a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2090878488 shutdown_connections 2023-10-05T15:52:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.711+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/2090878488 wait complete. 2023-10-05T15:52:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 -- start start 2023-10-05T15:52:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 Processor -- start 2023-10-05T15:52:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a10930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a11940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf3a11e80 con 0x55fdf3a02fd0 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf3a11ff0 con 0x55fdf3a01ec0 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf3a121b0 con 0x55fdf3a03990 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.712+0000 7fec2dd2bb80 10 client.0 _ll_register_callbacks cb 0x7fec0c00ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a11940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec13fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a11940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38766/0 (socket says 172.21.15.17:38766) 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 -- 172.21.15.17:0/85578714 learned_addr learned my addr 172.21.15.17:0/85578714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec137fe700 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a10930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 -- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a01ec0 msgr2=0x55fdf3a103f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a103f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 -- 172.21.15.17:0/85578714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 msgr2=0x55fdf3a10930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a10930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.713+0000 7fec1899c700 1 -- 172.21.15.17:0/85578714 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdf377fd80 con 0x55fdf3a03990 2023-10-05T15:52:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.714+0000 7fec1899c700 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a11940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0107a0 tx=0x7fec0c00f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=426ebb1d5dc3381f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.714+0000 7febf37fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:52:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.714+0000 7febf37fe700 1 -- 172.21.15.17:0/85578714 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01b650 con 0x55fdf3a03990 2023-10-05T15:52:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.714+0000 7febf37fe700 1 -- 172.21.15.17:0/85578714 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fec0c021040 con 0x55fdf3a03990 2023-10-05T15:52:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.714+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec08003850 con 0x55fdf3a03990 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.715+0000 7febf37fe700 1 -- 172.21.15.17:0/85578714 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec0c01b7b0 con 0x55fdf3a03990 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.715+0000 7fec2dd2bb80 10 client.27244 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.715+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55fdf377e250 con 0x55fdf3a03990 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.715+0000 7febf37fe700 1 -- 172.21.15.17:0/85578714 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec08003850 con 0x55fdf3a03990 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7febf37fe700 1 -- 172.21.15.17:0/85578714 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fec0c004520 con 0x55fdf3a03990 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7fec2dd2bb80 10 client.27244 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7fec2dd2bb80 10 client.27244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7fec2dd2bb80 20 client.27244 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:20.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a6bce0 0x55fdf3a6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:20.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7fec2dd2bb80 4 client.27244 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:52:20.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.716+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fdf394dad0 con 0x55fdf3a6bce0 2023-10-05T15:52:20.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.717+0000 7fec13fff700 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a6bce0 0x55fdf3a6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:20.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.718+0000 7fec13fff700 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a6bce0 0x55fdf3a6e0d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d25a23906e44a187 server_cookie=fa4ca3ad91eceb88 in_seq=0 out_seq=0 2023-10-05T15:52:20.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.718+0000 7febf37fe700 10 client.27244 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.737+0000 7febf37fe700 1 -- 172.21.15.17:0/85578714 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fdf394dad0 con 0x55fdf3a6bce0 2023-10-05T15:52:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.737+0000 7febf37fe700 10 client.27244 handle_command_reply: tid=0 2023-10-05T15:52:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.738+0000 7fec2dd2bb80 1 client.27244 shutdown 2023-10-05T15:52:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.738+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 msgr2=0x55fdf3a11940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.738+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a11940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0107a0 tx=0x7fec0c00f9d0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 shutdown_connections 2023-10-05T15:52:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55fdf3a6bce0 0x55fdf3a6e0d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fdf3a03990 0x55fdf3a11940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fdf3a01ec0 0x55fdf3a103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 --2- 172.21.15.17:0/85578714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fdf3a02fd0 0x55fdf3a10930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 >> 172.21.15.17:0/85578714 conn(0x55fdf3976200 msgr2=0x55fdf39fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7febf37fe700 0 client.27244 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 shutdown_connections 2023-10-05T15:52:20.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.739+0000 7fec2dd2bb80 1 -- 172.21.15.17:0/85578714 wait complete. 2023-10-05T15:52:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:52:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:52:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:52:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:52:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.741+0000 7fec2dd2bb80 20 client.27244 trim_cache size 0 max 16384 2023-10-05T15:52:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.743+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7febfc0a1680 msgr2=0x7febfc0a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.743+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7febfc0a1680 0x7febfc0a3b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55fdf3a01c60 tx=0x7fec0c007800 comp rx=0 tx=0).stop 2023-10-05T15:52:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.743+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 msgr2=0x7fec1419d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.743+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1419d2f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fec0400b530 tx=0x7fec0400b840 comp rx=0 tx=0).stop 2023-10-05T15:52:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.744+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 shutdown_connections 2023-10-05T15:52:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.744+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7febfc0a1680 0x7febfc0a3b40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.744+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec1410d5c0 0x7fec1419e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.744+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec14108120 0x7fec1419d2f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.744+0000 7fec1a3ff700 1 --2- 172.21.15.17:0/637254813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec1410aae0 0x7fec1419d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.744+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 >> 172.21.15.17:0/637254813 conn(0x7fec1406e0b0 msgr2=0x7fec14108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.745+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 shutdown_connections 2023-10-05T15:52:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:20.745+0000 7fec1a3ff700 1 -- 172.21.15.17:0/637254813 wait complete. 2023-10-05T15:52:22.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:22 smithi017 ceph-mon[129107]: pgmap v842: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.5 MiB/s wr, 600 op/s 2023-10-05T15:52:22.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:22 smithi167 ceph-mon[133366]: pgmap v842: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.5 MiB/s wr, 600 op/s 2023-10-05T15:52:22.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:22 smithi079 ceph-mon[132936]: pgmap v842: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.5 MiB/s wr, 600 op/s 2023-10-05T15:52:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 825.0 s, 387.2 tps, lat 262.046 ms stddev 236.259 2023-10-05T15:52:23.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:23 smithi017 ceph-mon[129107]: pgmap v843: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 543 op/s 2023-10-05T15:52:23.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:23 smithi167 ceph-mon[133366]: pgmap v843: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 543 op/s 2023-10-05T15:52:23.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:23 smithi079 ceph-mon[132936]: pgmap v843: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.7 MiB/s wr, 543 op/s 2023-10-05T15:52:26.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:26 smithi017 ceph-mon[129107]: pgmap v844: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.2 MiB/s wr, 696 op/s 2023-10-05T15:52:26.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:26 smithi167 ceph-mon[133366]: pgmap v844: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.2 MiB/s wr, 696 op/s 2023-10-05T15:52:26.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:26 smithi079 ceph-mon[132936]: pgmap v844: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.2 MiB/s wr, 696 op/s 2023-10-05T15:52:28.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 830.0 s, 493.7 tps, lat 199.394 ms stddev 60.654 2023-10-05T15:52:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:28 smithi167 ceph-mon[133366]: pgmap v845: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.6 MiB/s wr, 532 op/s 2023-10-05T15:52:28.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:28 smithi079 ceph-mon[132936]: pgmap v845: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.6 MiB/s wr, 532 op/s 2023-10-05T15:52:28.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:28 smithi017 ceph-mon[129107]: pgmap v845: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.6 MiB/s wr, 532 op/s 2023-10-05T15:52:30.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:30 smithi167 ceph-mon[133366]: pgmap v846: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 610 op/s 2023-10-05T15:52:30.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:30 smithi079 ceph-mon[132936]: pgmap v846: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 610 op/s 2023-10-05T15:52:30.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:30 smithi017 ceph-mon[129107]: pgmap v846: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.4 MiB/s wr, 610 op/s 2023-10-05T15:52:32.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:32 smithi167 ceph-mon[133366]: pgmap v847: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.7 MiB/s wr, 642 op/s 2023-10-05T15:52:32.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:32 smithi079 ceph-mon[132936]: pgmap v847: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.7 MiB/s wr, 642 op/s 2023-10-05T15:52:32.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:32 smithi017 ceph-mon[129107]: pgmap v847: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.7 MiB/s wr, 642 op/s 2023-10-05T15:52:33.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 835.0 s, 449.6 tps, lat 224.019 ms stddev 73.472 2023-10-05T15:52:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.029+0000 7fece2bff700 1 -- 172.21.15.17:0/1162157838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc100880 msgr2=0x7fecdc105120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.029+0000 7fece2bff700 1 --2- 172.21.15.17:0/1162157838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc100880 0x7fecdc105120 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fecd400b0a0 tx=0x7fecd400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.031+0000 7fece2bff700 1 -- 172.21.15.17:0/1162157838 shutdown_connections 2023-10-05T15:52:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.032+0000 7fece2bff700 1 --2- 172.21.15.17:0/1162157838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc100880 0x7fecdc105120 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.032+0000 7fece2bff700 1 --2- 172.21.15.17:0/1162157838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecdc0fed90 0x7fecdc0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.032+0000 7fece2bff700 1 --2- 172.21.15.17:0/1162157838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecdc0ffec0 0x7fecdc100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.032+0000 7fece2bff700 1 -- 172.21.15.17:0/1162157838 >> 172.21.15.17:0/1162157838 conn(0x7fecdc0fa690 msgr2=0x7fecdc0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.039+0000 7fece2bff700 1 -- 172.21.15.17:0/1162157838 shutdown_connections 2023-10-05T15:52:34.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.039+0000 7fece2bff700 1 -- 172.21.15.17:0/1162157838 wait complete. 2023-10-05T15:52:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.041+0000 7fece2bff700 1 Processor -- start 2023-10-05T15:52:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.041+0000 7fece2bff700 1 -- start start 2023-10-05T15:52:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.041+0000 7fece2bff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 0x7fecdc19d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.041+0000 7fece2bff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecdc0ffec0 0x7fecdc19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece2bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecdc100880 0x7fecdc19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece2bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc19ed50 con 0x7fecdc100880 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece2bff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc19eec0 con 0x7fecdc0ffec0 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece2bff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc19f080 con 0x7fecdc0fed90 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece099b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 0x7fecdc19d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece099b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 0x7fecdc19d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38572/0 (socket says 172.21.15.17:38572) 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.042+0000 7fece099b700 1 -- 172.21.15.17:0/192932720 learned_addr learned my addr 172.21.15.17:0/192932720 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fecd3fff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecdc0ffec0 0x7fecdc19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fece099b700 1 -- 172.21.15.17:0/192932720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecdc0ffec0 msgr2=0x7fecdc19d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fece099b700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecdc0ffec0 0x7fecdc19d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fece099b700 1 -- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecdc100880 msgr2=0x7fecdc19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fece099b700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecdc100880 0x7fecdc19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fece099b700 1 -- 172.21.15.17:0/192932720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4009d00 con 0x7fecdc0fed90 2023-10-05T15:52:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.043+0000 7fece099b700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 0x7fecdc19d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecd800b550 tx=0x7fecd800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.044+0000 7fecd1ffb700 1 -- 172.21.15.17:0/192932720 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8011830 con 0x7fecdc0fed90 2023-10-05T15:52:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.044+0000 7fecd1ffb700 1 -- 172.21.15.17:0/192932720 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecd8011e20 con 0x7fecdc0fed90 2023-10-05T15:52:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.044+0000 7fecd1ffb700 1 -- 172.21.15.17:0/192932720 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8010e10 con 0x7fecdc0fed90 2023-10-05T15:52:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.045+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc19f360 con 0x7fecdc0fed90 2023-10-05T15:52:34.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.045+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc106c10 con 0x7fecdc0fed90 2023-10-05T15:52:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.052+0000 7fecf6598b80 1 Processor -- start 2023-10-05T15:52:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.052+0000 7fecf6598b80 1 -- start start 2023-10-05T15:52:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.053+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.053+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a05fd0 0x5635b4a06450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.053+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.053+0000 7fecf6598b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b496d400 con 0x5635b4a05fd0 2023-10-05T15:52:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.053+0000 7fecf6598b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b495ebc0 con 0x5635b4a04ec0 2023-10-05T15:52:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.053+0000 7fecf6598b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b495c4e0 con 0x5635b4a06990 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fece119c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38578/0 (socket says 172.21.15.17:38578) 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 -- 172.21.15.17:0/2653872503 learned_addr learned my addr 172.21.15.17:0/2653872503 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 -- 172.21.15.17:0/2653872503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 msgr2=0x5635b4a052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 -- 172.21.15.17:0/2653872503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a05fd0 msgr2=0x5635b4a06450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a05fd0 0x5635b4a06450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.054+0000 7fecd3fff700 1 -- 172.21.15.17:0/2653872503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b4782d80 con 0x5635b4a06990 2023-10-05T15:52:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.055+0000 7fecd3fff700 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0d220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feccc007810 tx=0x7feccc007b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a42a09a2f73e5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.055+0000 7fecc2ffd700 1 -- 172.21.15.17:0/2653872503 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0125f0 con 0x5635b4a06990 2023-10-05T15:52:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.055+0000 7fecc2ffd700 1 -- 172.21.15.17:0/2653872503 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feccc012be0 con 0x5635b4a06990 2023-10-05T15:52:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.055+0000 7fecc2ffd700 1 -- 172.21.15.17:0/2653872503 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc013cc0 con 0x5635b4a06990 2023-10-05T15:52:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.056+0000 7fecf6598b80 1 -- 172.21.15.17:0/2653872503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 msgr2=0x5635b4a0d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.056+0000 7fecf6598b80 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0d220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feccc007810 tx=0x7feccc007b20 comp rx=0 tx=0).stop 2023-10-05T15:52:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.057+0000 7fecf6598b80 1 -- 172.21.15.17:0/2653872503 shutdown_connections 2023-10-05T15:52:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.057+0000 7fecf6598b80 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0d220 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.057+0000 7fecf6598b80 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.057+0000 7fecf6598b80 1 --2- 172.21.15.17:0/2653872503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a05fd0 0x5635b4a06450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.057+0000 7fecf6598b80 1 -- 172.21.15.17:0/2653872503 >> 172.21.15.17:0/2653872503 conn(0x5635b4979200 msgr2=0x5635b49ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:34.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.057+0000 7fecd1ffb700 1 -- 172.21.15.17:0/192932720 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fecd8011990 con 0x7fecdc0fed90 2023-10-05T15:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.058+0000 7fecf6598b80 1 -- 172.21.15.17:0/2653872503 shutdown_connections 2023-10-05T15:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.058+0000 7fecf6598b80 1 -- 172.21.15.17:0/2653872503 wait complete. 2023-10-05T15:52:34.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.059+0000 7fecf6598b80 1 -- start start 2023-10-05T15:52:34.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 Processor -- start 2023-10-05T15:52:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a0ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a16680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b4957dd0 con 0x5635b4a14290 2023-10-05T15:52:34.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b48f46b0 con 0x5635b4a04ec0 2023-10-05T15:52:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.060+0000 7fecf6598b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b48f4350 con 0x5635b4a06990 2023-10-05T15:52:34.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.061+0000 7fecf6598b80 10 client.0 _ll_register_callbacks cb 0x5635b47517a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:34.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.061+0000 7fece119c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a0ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.061+0000 7fece099b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.061+0000 7fece119c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a0ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:49084/0 (socket says 172.21.15.17:49084) 2023-10-05T15:52:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.061+0000 7fece119c700 1 -- 172.21.15.17:0/344074894 learned_addr learned my addr 172.21.15.17:0/344074894 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.061+0000 7fecd3fff700 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a16680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.062+0000 7fece119c700 1 -- 172.21.15.17:0/344074894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 msgr2=0x5635b4a0f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.062+0000 7fece119c700 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.062+0000 7fece119c700 1 -- 172.21.15.17:0/344074894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 msgr2=0x5635b4a16680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.062+0000 7fece119c700 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a16680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.062+0000 7fece119c700 1 -- 172.21.15.17:0/344074894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc00e040 con 0x5635b4a04ec0 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.062+0000 7fece119c700 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a0ed20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007a90 tx=0x7fecd40094d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d0e3d27af6a8b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.063+0000 7fecbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.063+0000 7fecd1ffb700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecc40a1560 0x7fecc40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.063+0000 7fece099b700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecc40a1560 0x7fecc40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.063+0000 7fecd1ffb700 1 -- 172.21.15.17:0/192932720 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fecd80cea50 con 0x7fecdc0fed90 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.064+0000 7fecbbfff700 1 -- 172.21.15.17:0/344074894 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd400e040 con 0x5635b4a04ec0 2023-10-05T15:52:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.064+0000 7fecbbfff700 1 -- 172.21.15.17:0/344074894 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fecd4004de0 con 0x5635b4a04ec0 2023-10-05T15:52:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.064+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635b49f7d50 con 0x5635b4a04ec0 2023-10-05T15:52:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.064+0000 7fecbbfff700 1 -- 172.21.15.17:0/344074894 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecd4005050 con 0x5635b4a04ec0 2023-10-05T15:52:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.064+0000 7fecf6598b80 10 client.27338 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.064+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5635b476bc00 con 0x5635b4a04ec0 2023-10-05T15:52:34.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.066+0000 7fecbbfff700 1 -- 172.21.15.17:0/344074894 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635b49f7d50 con 0x5635b4a04ec0 2023-10-05T15:52:34.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.066+0000 7fecbbfff700 1 -- 172.21.15.17:0/344074894 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fecd4019070 con 0x5635b4a04ec0 2023-10-05T15:52:34.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.066+0000 7fece099b700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecc40a1560 0x7fecc40a3a20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fecd809b670 tx=0x7fecd8011f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:34.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.066+0000 7fecf6598b80 10 client.27338 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.066+0000 7fecf6598b80 10 client.27338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.066+0000 7fecf6598b80 20 client.27338 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.067+0000 7fecf6598b80 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a1afb0 0x5635b4a1d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.067+0000 7fecf6598b80 4 client.27338 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.067+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635b4950db0 con 0x5635b4a1afb0 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.067+0000 7fecd3fff700 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a1afb0 0x5635b4a1d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.068+0000 7fecd3fff700 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a1afb0 0x5635b4a1d3d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5a1f57241bf52 server_cookie=cb08ad0da1134f27 in_seq=0 out_seq=0 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.068+0000 7fecbbfff700 10 client.27338 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.069+0000 7fecbbfff700 1 -- 172.21.15.17:0/344074894 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5635b4950db0 con 0x5635b4a1afb0 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.069+0000 7fecbbfff700 10 client.27338 handle_command_reply: tid=0 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.069+0000 7fecf6598b80 1 client.27338 shutdown 2023-10-05T15:52:34.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 msgr2=0x5635b4a0ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a0ed20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007a90 tx=0x7fecd40094d0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 shutdown_connections 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a1afb0 0x5635b4a1d3d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a16680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a04ec0 0x5635b4a0ed20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 --2- 172.21.15.17:0/344074894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a06990 0x5635b4a0f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 >> 172.21.15.17:0/344074894 conn(0x5635b4979200 msgr2=0x5635b49ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:34.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.070+0000 7fecbbfff700 0 client.27338 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:34.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.073+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 shutdown_connections 2023-10-05T15:52:34.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.073+0000 7fecf6598b80 1 -- 172.21.15.17:0/344074894 wait complete. 2023-10-05T15:52:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.075+0000 7fecf6598b80 20 client.27338 trim_cache size 0 max 16384 2023-10-05T15:52:34.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.105+0000 7fecf6598b80 1 Processor -- start 2023-10-05T15:52:34.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.105+0000 7fecf6598b80 1 -- start start 2023-10-05T15:52:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 0x5635b4a052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fecf6598b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b47d88c0 con 0x5635b4a14290 2023-10-05T15:52:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fecf6598b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b4a2b0f0 con 0x5635b4a06990 2023-10-05T15:52:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fecf6598b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b4a0ccc0 con 0x5635b4a04ec0 2023-10-05T15:52:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.106+0000 7fece119c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 0x5635b4a052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 0x5635b4a052a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:38588/0 (socket says 172.21.15.17:38588) 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 -- 172.21.15.17:0/3353547828 learned_addr learned my addr 172.21.15.17:0/3353547828 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 -- 172.21.15.17:0/3353547828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 msgr2=0x5635b4a2abb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 -- 172.21.15.17:0/3353547828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 msgr2=0x5635b4a008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.107+0000 7fece119c700 1 -- 172.21.15.17:0/3353547828 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b47a91f0 con 0x5635b4a04ec0 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.108+0000 7fece119c700 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 0x5635b4a052a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009fd0 tx=0x7fecd400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6053d7cabfd32f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.108+0000 7fecc37fe700 1 -- 172.21.15.17:0/3353547828 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4006160 con 0x5635b4a04ec0 2023-10-05T15:52:34.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.108+0000 7fecc37fe700 1 -- 172.21.15.17:0/3353547828 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecd401c7c0 con 0x5635b4a04ec0 2023-10-05T15:52:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.108+0000 7fecc37fe700 1 -- 172.21.15.17:0/3353547828 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4025410 con 0x5635b4a04ec0 2023-10-05T15:52:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 -- 172.21.15.17:0/3353547828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 msgr2=0x5635b4a052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 0x5635b4a052a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009fd0 tx=0x7fecd400b7b0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 -- 172.21.15.17:0/3353547828 shutdown_connections 2023-10-05T15:52:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a14290 0x5635b4a008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a04ec0 0x5635b4a052a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3353547828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.109+0000 7fecf6598b80 1 -- 172.21.15.17:0/3353547828 >> 172.21.15.17:0/3353547828 conn(0x5635b4979200 msgr2=0x5635b49ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.110+0000 7fecf6598b80 1 -- 172.21.15.17:0/3353547828 shutdown_connections 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.110+0000 7fecf6598b80 1 -- 172.21.15.17:0/3353547828 wait complete. 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.110+0000 7fecf6598b80 1 -- start start 2023-10-05T15:52:34.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.111+0000 7fecf6598b80 1 Processor -- start 2023-10-05T15:52:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a04ec0 0x5635b4a29bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a14290 0x5635b4a6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b4a2a940 con 0x5635b4a04ec0 2023-10-05T15:52:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b4a2aab0 con 0x5635b4a06990 2023-10-05T15:52:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b4a7ead0 con 0x5635b4a14290 2023-10-05T15:52:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecf6598b80 10 client.0 _ll_register_callbacks cb 0x7fecd4007910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecd3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecd3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:49092/0 (socket says 172.21.15.17:49092) 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.112+0000 7fecd3fff700 1 -- 172.21.15.17:0/3781150338 learned_addr learned my addr 172.21.15.17:0/3781150338 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.113+0000 7fecd3fff700 1 -- 172.21.15.17:0/3781150338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a14290 msgr2=0x5635b4a6d500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.113+0000 7fecd3fff700 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a14290 0x5635b4a6d500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.113+0000 7fecd3fff700 1 -- 172.21.15.17:0/3781150338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a04ec0 msgr2=0x5635b4a29bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.113+0000 7fecd3fff700 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a04ec0 0x5635b4a29bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.113+0000 7fecd3fff700 1 -- 172.21.15.17:0/3781150338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635b476bc00 con 0x5635b4a06990 2023-10-05T15:52:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.114+0000 7fecd3fff700 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2a130 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feccc007e70 tx=0x7feccc007020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1504a28172b4ec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:34.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.114+0000 7fecbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:52:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.116+0000 7fecbbfff700 1 -- 172.21.15.17:0/3781150338 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc012e10 con 0x5635b4a06990 2023-10-05T15:52:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.116+0000 7fecbbfff700 1 -- 172.21.15.17:0/3781150338 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7feccc022070 con 0x5635b4a06990 2023-10-05T15:52:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.116+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feccc012be0 con 0x5635b4a06990 2023-10-05T15:52:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecbbfff700 1 -- 172.21.15.17:0/3781150338 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7feccc024330 con 0x5635b4a06990 2023-10-05T15:52:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecf6598b80 10 client.27341 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5635b4781250 con 0x5635b4a06990 2023-10-05T15:52:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecbbfff700 1 -- 172.21.15.17:0/3781150338 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feccc012be0 con 0x5635b4a06990 2023-10-05T15:52:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecbbfff700 1 -- 172.21.15.17:0/3781150338 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feccc024810 con 0x5635b4a06990 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecf6598b80 10 client.27341 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecf6598b80 10 client.27341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecf6598b80 20 client.27341 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.117+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a80460 0x5635b4a82880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.118+0000 7fecf6598b80 4 client.27341 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.118+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5635b4950ad0 con 0x5635b4a80460 2023-10-05T15:52:34.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.118+0000 7fece119c700 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a80460 0x5635b4a82880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.119+0000 7fece119c700 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a80460 0x5635b4a82880 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=241121bb31371959 server_cookie=30467d0f865fc9cc in_seq=0 out_seq=0 2023-10-05T15:52:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.119+0000 7fecbbfff700 10 client.27341 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.144+0000 7fecbbfff700 1 -- 172.21.15.17:0/3781150338 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5635b4950ad0 con 0x5635b4a80460 2023-10-05T15:52:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.144+0000 7fecbbfff700 10 client.27341 handle_command_reply: tid=0 2023-10-05T15:52:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.144+0000 7fecf6598b80 1 client.27341 shutdown 2023-10-05T15:52:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 msgr2=0x5635b4a2a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2a130 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feccc007e70 tx=0x7feccc007020 comp rx=0 tx=0).stop 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 shutdown_connections 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x5635b4a80460 0x5635b4a82880 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5635b4a14290 0x5635b4a6d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b4a04ec0 0x5635b4a29bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 --2- 172.21.15.17:0/3781150338 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5635b4a06990 0x5635b4a2a130 secure :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7feccc007e70 tx=0x7feccc007020 comp rx=0 tx=0).stop 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 >> 172.21.15.17:0/3781150338 conn(0x5635b4979200 msgr2=0x5635b4a008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:34.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.145+0000 7fecbbfff700 0 client.27341 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:34.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.147+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 shutdown_connections 2023-10-05T15:52:34.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.147+0000 7fecf6598b80 1 -- 172.21.15.17:0/3781150338 wait complete. 2023-10-05T15:52:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.147+0000 7fecf6598b80 20 client.27341 trim_cache size 0 max 16384 2023-10-05T15:52:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:52:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:52:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:52:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:52:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecc40a1560 msgr2=0x7fecc40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecc40a1560 0x7fecc40a3a20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fecd809b670 tx=0x7fecd8011f90 comp rx=0 tx=0).stop 2023-10-05T15:52:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 msgr2=0x7fecdc19d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 0x7fecdc19d330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecd800b550 tx=0x7fecd800b910 comp rx=0 tx=0).stop 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 shutdown_connections 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fecc40a1560 0x7fecc40a3a20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecdc100880 0x7fecdc19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecdc0fed90 0x7fecdc19d330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 --2- 172.21.15.17:0/192932720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecdc0ffec0 0x7fecdc19d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.148+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 >> 172.21.15.17:0/192932720 conn(0x7fecdc0fa690 msgr2=0x7fecdc0fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.149+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 shutdown_connections 2023-10-05T15:52:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:34.149+0000 7fece2bff700 1 -- 172.21.15.17:0/192932720 wait complete. 2023-10-05T15:52:34.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:34 smithi167 ceph-mon[133366]: pgmap v848: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.0 MiB/s wr, 568 op/s 2023-10-05T15:52:34.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:34 smithi079 ceph-mon[132936]: pgmap v848: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.0 MiB/s wr, 568 op/s 2023-10-05T15:52:34.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:34 smithi017 ceph-mon[129107]: pgmap v848: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.0 MiB/s wr, 568 op/s 2023-10-05T15:52:36.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:36 smithi167 ceph-mon[133366]: pgmap v849: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.0 MiB/s wr, 715 op/s 2023-10-05T15:52:36.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:36 smithi079 ceph-mon[132936]: pgmap v849: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.0 MiB/s wr, 715 op/s 2023-10-05T15:52:36.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:36 smithi017 ceph-mon[129107]: pgmap v849: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.0 MiB/s wr, 715 op/s 2023-10-05T15:52:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 840.0 s, 524.8 tps, lat 191.317 ms stddev 65.824 2023-10-05T15:52:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:38 smithi167 ceph-mon[133366]: pgmap v850: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.2 MiB/s wr, 563 op/s 2023-10-05T15:52:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:38 smithi079 ceph-mon[132936]: pgmap v850: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.2 MiB/s wr, 563 op/s 2023-10-05T15:52:38.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:38 smithi017 ceph-mon[129107]: pgmap v850: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.2 MiB/s wr, 563 op/s 2023-10-05T15:52:40.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:40 smithi167 ceph-mon[133366]: pgmap v851: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.0 MiB/s wr, 626 op/s 2023-10-05T15:52:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:40 smithi079 ceph-mon[132936]: pgmap v851: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.0 MiB/s wr, 626 op/s 2023-10-05T15:52:40.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:40 smithi017 ceph-mon[129107]: pgmap v851: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.0 MiB/s wr, 626 op/s 2023-10-05T15:52:42.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:42 smithi167 ceph-mon[133366]: pgmap v852: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.9 MiB/s wr, 630 op/s 2023-10-05T15:52:42.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:42 smithi079 ceph-mon[132936]: pgmap v852: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.9 MiB/s wr, 630 op/s 2023-10-05T15:52:42.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:42 smithi017 ceph-mon[129107]: pgmap v852: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.9 MiB/s wr, 630 op/s 2023-10-05T15:52:43.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 845.0 s, 497.7 tps, lat 199.100 ms stddev 61.255 2023-10-05T15:52:43.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:43 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:52:43.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:43 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:52:43.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:43 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:52:44.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:44 smithi079 ceph-mon[132936]: pgmap v853: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.5 MiB/s wr, 559 op/s 2023-10-05T15:52:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:44 smithi017 ceph-mon[129107]: pgmap v853: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.5 MiB/s wr, 559 op/s 2023-10-05T15:52:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:44 smithi167 ceph-mon[133366]: pgmap v853: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.5 MiB/s wr, 559 op/s 2023-10-05T15:52:45.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:52:45.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:52:45.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:52:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:52:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:52:45.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:52:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:52:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:52:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:52:46.367 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:46 smithi079 ceph-mon[132936]: pgmap v854: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.3 MiB/s wr, 692 op/s 2023-10-05T15:52:46.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:46 smithi017 ceph-mon[129107]: pgmap v854: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.3 MiB/s wr, 692 op/s 2023-10-05T15:52:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:46 smithi167 ceph-mon[133366]: pgmap v854: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.3 MiB/s wr, 692 op/s 2023-10-05T15:52:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.431+0000 7f12e29ff700 1 -- 172.21.15.17:0/902774280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc10d1f0 msgr2=0x7f12dc10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.431+0000 7f12e29ff700 1 --2- 172.21.15.17:0/902774280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc10d1f0 0x7f12dc10d670 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f12d400b0a0 tx=0x7f12d400b3b0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.432+0000 7f12e29ff700 1 -- 172.21.15.17:0/902774280 shutdown_connections 2023-10-05T15:52:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.432+0000 7f12e29ff700 1 --2- 172.21.15.17:0/902774280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc10d1f0 0x7f12dc10d670 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.432+0000 7f12e29ff700 1 --2- 172.21.15.17:0/902774280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc107eb0 0x7f12dc10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.432+0000 7f12e29ff700 1 --2- 172.21.15.17:0/902774280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc10a820 0x7f12dc10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.432+0000 7f12e29ff700 1 -- 172.21.15.17:0/902774280 >> 172.21.15.17:0/902774280 conn(0x7f12dc06dd10 msgr2=0x7f12dc070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.434+0000 7f12e29ff700 1 -- 172.21.15.17:0/902774280 shutdown_connections 2023-10-05T15:52:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.434+0000 7f12e29ff700 1 -- 172.21.15.17:0/902774280 wait complete. 2023-10-05T15:52:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.435+0000 7f12e29ff700 1 Processor -- start 2023-10-05T15:52:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 -- start start 2023-10-05T15:52:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 0x7f12dc1a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc10d1f0 0x7f12dc1a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc1a6f30 0x7f12dc1a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc1a7980 con 0x7f12dc10d1f0 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc1a7af0 con 0x7f12dc1a6f30 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.436+0000 7f12e29ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc1a7cb0 con 0x7f12dc10a820 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.437+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 0x7f12dc1a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.437+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 0x7f12dc1a5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50862/0 (socket says 172.21.15.17:50862) 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.437+0000 7f12dbfff700 1 -- 172.21.15.17:0/2523630894 learned_addr learned my addr 172.21.15.17:0/2523630894 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.437+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc1a6f30 0x7f12dc1a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.438+0000 7f12db7fe700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc10d1f0 0x7f12dc1a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.438+0000 7f12dbfff700 1 -- 172.21.15.17:0/2523630894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc1a6f30 msgr2=0x7f12dc1a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.438+0000 7f12dbfff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc1a6f30 0x7f12dc1a73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.438+0000 7f12dbfff700 1 -- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc10d1f0 msgr2=0x7f12dc1a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.438+0000 7f12dbfff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc10d1f0 0x7f12dc1a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.438+0000 7f12dbfff700 1 -- 172.21.15.17:0/2523630894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4009d00 con 0x7f12dc10a820 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.439+0000 7f12dbfff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 0x7f12dc1a5b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b500 tx=0x7f12cc00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.439+0000 7f12d97fa700 1 -- 172.21.15.17:0/2523630894 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc011830 con 0x7f12dc10a820 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.439+0000 7f12d97fa700 1 -- 172.21.15.17:0/2523630894 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12cc011e20 con 0x7f12dc10a820 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.439+0000 7f12d97fa700 1 -- 172.21.15.17:0/2523630894 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc010ce0 con 0x7f12dc10a820 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.440+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc079110 con 0x7f12dc10a820 2023-10-05T15:52:47.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.440+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc079650 con 0x7f12dc10a820 2023-10-05T15:52:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.449+0000 7f12d97fa700 1 -- 172.21.15.17:0/2523630894 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f12cc010480 con 0x7f12dc10a820 2023-10-05T15:52:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.455+0000 7f12f641cb80 1 Processor -- start 2023-10-05T15:52:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 -- start start 2023-10-05T15:52:47.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d6333762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633377450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d63337e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6332de400 con 0x55d633377990 2023-10-05T15:52:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6332cfbc0 con 0x55d633376fd0 2023-10-05T15:52:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.456+0000 7f12f641cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6332cd4e0 con 0x55d633375ec0 2023-10-05T15:52:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.457+0000 7f12e0f9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d6333762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.457+0000 7f12e0f9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d6333762e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50872/0 (socket says 172.21.15.17:50872) 2023-10-05T15:52:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.457+0000 7f12e0f9c700 1 -- 172.21.15.17:0/3138065508 learned_addr learned my addr 172.21.15.17:0/3138065508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.457+0000 7f12d97fa700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12c40e55e0 0x7f12c40e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.457+0000 7f12d97fa700 1 -- 172.21.15.17:0/2523630894 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f12cc0cca70 con 0x7f12dc10a820 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.457+0000 7f12e0f9c700 1 -- 172.21.15.17:0/3138065508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 msgr2=0x55d633377450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12dbfff700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633377450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12db7fe700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d63337e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633377450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12e0f9c700 1 -- 172.21.15.17:0/3138065508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 msgr2=0x55d63337e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d63337e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12e0f9c700 1 -- 172.21.15.17:0/3138065508 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6330f3d80 con 0x55d633375ec0 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12dbfff700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633377450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:52:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.458+0000 7f12db7fe700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d63337e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:52:47.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.459+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d6333762e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12d4007bf0 tx=0x7f12d4007cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf9ed67aebe5ca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:47.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.459+0000 7f12c27fc700 1 -- 172.21.15.17:0/3138065508 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400e040 con 0x55d633375ec0 2023-10-05T15:52:47.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.459+0000 7f12c27fc700 1 -- 172.21.15.17:0/3138065508 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12d40076e0 con 0x55d633375ec0 2023-10-05T15:52:47.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.459+0000 7f12c27fc700 1 -- 172.21.15.17:0/3138065508 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d401e6c0 con 0x55d633375ec0 2023-10-05T15:52:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.460+0000 7f12f641cb80 1 -- 172.21.15.17:0/3138065508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 msgr2=0x55d6333762e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.460+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d6333762e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12d4007bf0 tx=0x7f12d4007cd0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 -- 172.21.15.17:0/3138065508 shutdown_connections 2023-10-05T15:52:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d63337e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d6333762e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3138065508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633377450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 -- 172.21.15.17:0/3138065508 >> 172.21.15.17:0/3138065508 conn(0x55d6332ea200 msgr2=0x55d633370bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 -- 172.21.15.17:0/3138065508 shutdown_connections 2023-10-05T15:52:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.461+0000 7f12f641cb80 1 -- 172.21.15.17:0/3138065508 wait complete. 2023-10-05T15:52:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.462+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12c40e55e0 0x7f12c40e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.462+0000 7f12f641cb80 1 -- start start 2023-10-05T15:52:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.462+0000 7f12f641cb80 1 Processor -- start 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d63337faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633380030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633377990 0x55d633387090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6332c8dd0 con 0x55d633375ec0 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6332656b0 con 0x55d633376fd0 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d633265350 con 0x55d633377990 2023-10-05T15:52:47.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.463+0000 7f12f641cb80 10 client.0 _ll_register_callbacks cb 0x55d6330c27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.464+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12c40e55e0 0x7f12c40e7aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f12d40061a0 tx=0x7f12d40094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:47.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.464+0000 7f12db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633380030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.464+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d63337faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.464+0000 7f12db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633380030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39932/0 (socket says 172.21.15.17:39932) 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.464+0000 7f12db7fe700 1 -- 172.21.15.17:0/3571235488 learned_addr learned my addr 172.21.15.17:0/3571235488 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.464+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633377990 0x55d633387090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12db7fe700 1 -- 172.21.15.17:0/3571235488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633377990 msgr2=0x55d633387090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12db7fe700 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633377990 0x55d633387090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12db7fe700 1 -- 172.21.15.17:0/3571235488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 msgr2=0x55d63337faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12db7fe700 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d63337faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12db7fe700 1 -- 172.21.15.17:0/3571235488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc10e290 con 0x55d633376fd0 2023-10-05T15:52:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12db7fe700 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633380030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f12d0012840 tx=0x7f12d0012b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d386490adc3527a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.465+0000 7f12bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:52:47.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12bb7fe700 1 -- 172.21.15.17:0/3571235488 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0010750 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12bb7fe700 1 -- 172.21.15.17:0/3571235488 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f12d00108b0 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d633368d50 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12bb7fe700 1 -- 172.21.15.17:0/3571235488 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12d0010a70 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12f641cb80 10 client.27350 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d6330dcc00 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.466+0000 7f12bb7fe700 1 -- 172.21.15.17:0/3571235488 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d633368d50 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12bb7fe700 1 -- 172.21.15.17:0/3571235488 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f12d000ec90 con 0x55d633376fd0 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12f641cb80 10 client.27350 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12f641cb80 10 client.27350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12f641cb80 20 client.27350 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d63338b8f0 0x55d63338dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12f641cb80 4 client.27350 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:52:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6332c1db0 con 0x55d63338b8f0 2023-10-05T15:52:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.467+0000 7f12dbfff700 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d63338b8f0 0x55d63338dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.468+0000 7f12dbfff700 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d63338b8f0 0x55d63338dd10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16414be7d8b8018b server_cookie=30cbcc066451447 in_seq=0 out_seq=0 2023-10-05T15:52:47.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.468+0000 7f12bb7fe700 10 client.27350 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:47.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.469+0000 7f12bb7fe700 1 -- 172.21.15.17:0/3571235488 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d6332c1db0 con 0x55d63338b8f0 2023-10-05T15:52:47.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.469+0000 7f12bb7fe700 10 client.27350 handle_command_reply: tid=0 2023-10-05T15:52:47.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.469+0000 7f12f641cb80 1 client.27350 shutdown 2023-10-05T15:52:47.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.469+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 msgr2=0x55d633380030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.469+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633380030 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f12d0012840 tx=0x7f12d0012b50 comp rx=0 tx=0).stop 2023-10-05T15:52:47.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 shutdown_connections 2023-10-05T15:52:47.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d63338b8f0 0x55d63338dd10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633377990 0x55d633387090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d63337faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 --2- 172.21.15.17:0/3571235488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633380030 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12bb7fe700 0 client.27350 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 >> 172.21.15.17:0/3571235488 conn(0x55d6332ea200 msgr2=0x55d633370250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 shutdown_connections 2023-10-05T15:52:47.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.470+0000 7f12f641cb80 1 -- 172.21.15.17:0/3571235488 wait complete. 2023-10-05T15:52:47.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.471+0000 7f12f641cb80 20 client.27350 trim_cache size 0 max 16384 2023-10-05T15:52:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 Processor -- start 2023-10-05T15:52:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 -- start start 2023-10-05T15:52:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d6333773b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633376fd0 0x55d633387050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 0x55d63337ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6331498c0 con 0x55d633375ec0 2023-10-05T15:52:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d633388cd0 con 0x55d633377990 2023-10-05T15:52:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.498+0000 7f12f641cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d63337a450 con 0x55d633376fd0 2023-10-05T15:52:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.499+0000 7f12e0f9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 0x55d63337ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.499+0000 7f12e0f9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 0x55d63337ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39948/0 (socket says 172.21.15.17:39948) 2023-10-05T15:52:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.499+0000 7f12e0f9c700 1 -- 172.21.15.17:0/452038632 learned_addr learned my addr 172.21.15.17:0/452038632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.500+0000 7f12e0f9c700 1 -- 172.21.15.17:0/452038632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633376fd0 msgr2=0x55d633387050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:52:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.500+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633376fd0 0x55d633387050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.500+0000 7f12e0f9c700 1 -- 172.21.15.17:0/452038632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 msgr2=0x55d6333773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.500+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d6333773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.500+0000 7f12e0f9c700 1 -- 172.21.15.17:0/452038632 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d63311a1f0 con 0x55d633377990 2023-10-05T15:52:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.500+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 0x55d63337ddd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55d633375c60 tx=0x7f12d4028000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f326419ce07ea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.501+0000 7f12c2ffd700 1 -- 172.21.15.17:0/452038632 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4007520 con 0x55d633377990 2023-10-05T15:52:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.501+0000 7f12c2ffd700 1 -- 172.21.15.17:0/452038632 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12d40050c0 con 0x55d633377990 2023-10-05T15:52:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.501+0000 7f12c2ffd700 1 -- 172.21.15.17:0/452038632 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d401e6c0 con 0x55d633377990 2023-10-05T15:52:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 -- 172.21.15.17:0/452038632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 msgr2=0x55d63337ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 0x55d63337ddd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55d633375c60 tx=0x7f12d4028000 comp rx=0 tx=0).stop 2023-10-05T15:52:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 -- 172.21.15.17:0/452038632 shutdown_connections 2023-10-05T15:52:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633377990 0x55d63337ddd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633375ec0 0x55d6333773b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 --2- 172.21.15.17:0/452038632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633376fd0 0x55d633387050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 -- 172.21.15.17:0/452038632 >> 172.21.15.17:0/452038632 conn(0x55d6332ea200 msgr2=0x55d6333878a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.502+0000 7f12f641cb80 1 -- 172.21.15.17:0/452038632 shutdown_connections 2023-10-05T15:52:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.503+0000 7f12f641cb80 1 -- 172.21.15.17:0/452038632 wait complete. 2023-10-05T15:52:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.503+0000 7f12f641cb80 1 -- start start 2023-10-05T15:52:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 Processor -- start 2023-10-05T15:52:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d633384a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633384fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d633385fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6333864f0 con 0x55d633377990 2023-10-05T15:52:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d633386660 con 0x55d633376fd0 2023-10-05T15:52:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d633386820 con 0x55d633375ec0 2023-10-05T15:52:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.504+0000 7f12f641cb80 10 client.0 _ll_register_callbacks cb 0x7f12d0009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.505+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d633384a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.505+0000 7f12dbfff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d633384a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50902/0 (socket says 172.21.15.17:50902) 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.505+0000 7f12dbfff700 1 -- 172.21.15.17:0/2907892302 learned_addr learned my addr 172.21.15.17:0/2907892302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.505+0000 7f12db7fe700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633384fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12e0f9c700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d633385fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12db7fe700 1 -- 172.21.15.17:0/2907892302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 msgr2=0x55d633384a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12db7fe700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d633384a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12db7fe700 1 -- 172.21.15.17:0/2907892302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 msgr2=0x55d633385fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12db7fe700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d633385fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12db7fe700 1 -- 172.21.15.17:0/2907892302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6330f3d80 con 0x55d633376fd0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12db7fe700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633384fa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55d63333b990 tx=0x7f12d001ab40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b6c5b6900337c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.506+0000 7f12bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.507+0000 7f12bb7fe700 1 -- 172.21.15.17:0/2907892302 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0005270 con 0x55d633376fd0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.507+0000 7f12bb7fe700 1 -- 172.21.15.17:0/2907892302 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f12d0000e40 con 0x55d633376fd0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.507+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12d40076e0 con 0x55d633376fd0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.507+0000 7f12bb7fe700 1 -- 172.21.15.17:0/2907892302 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12d001a680 con 0x55d633376fd0 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.507+0000 7f12f641cb80 10 client.27356 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.507+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d6330f2250 con 0x55d633376fd0 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12bb7fe700 1 -- 172.21.15.17:0/2907892302 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12d40076e0 con 0x55d633376fd0 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12bb7fe700 1 -- 172.21.15.17:0/2907892302 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f12d0024070 con 0x55d633376fd0 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12f641cb80 10 client.27356 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12f641cb80 10 client.27356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12f641cb80 20 client.27356 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12f641cb80 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d6333e0390 0x55d6333e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12f641cb80 4 client.27356 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:52:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.508+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d6332c1ad0 con 0x55d6333e0390 2023-10-05T15:52:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.509+0000 7f12dbfff700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d6333e0390 0x55d6333e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.510+0000 7f12bb7fe700 10 client.27356 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.510+0000 7f12dbfff700 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d6333e0390 0x55d6333e27b0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18aaeb64981ae27 server_cookie=4486c30ec4c61a94 in_seq=0 out_seq=0 2023-10-05T15:52:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.597+0000 7f12bb7fe700 1 -- 172.21.15.17:0/2907892302 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d6332c1ad0 con 0x55d6333e0390 2023-10-05T15:52:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.597+0000 7f12bb7fe700 10 client.27356 handle_command_reply: tid=0 2023-10-05T15:52:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.597+0000 7f12f641cb80 1 client.27356 shutdown 2023-10-05T15:52:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 msgr2=0x55d633384fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633384fa0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55d63333b990 tx=0x7f12d001ab40 comp rx=0 tx=0).stop 2023-10-05T15:52:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 shutdown_connections 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d6333e0390 0x55d6333e27b0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d633377990 0x55d633385fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12bb7fe700 0 client.27356 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d633375ec0 0x55d633384a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 --2- 172.21.15.17:0/2907892302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d633376fd0 0x55d633384fa0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 >> 172.21.15.17:0/2907892302 conn(0x55d6332ea200 msgr2=0x55d6333878a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 shutdown_connections 2023-10-05T15:52:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 1 -- 172.21.15.17:0/2907892302 wait complete. 2023-10-05T15:52:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.598+0000 7f12f641cb80 20 client.27356 trim_cache size 0 max 16384 2023-10-05T15:52:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:52:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:52:47.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:52:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:52:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12c40e55e0 msgr2=0x7f12c40e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12c40e55e0 0x7f12c40e7aa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f12d40061a0 tx=0x7f12d40094f0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 msgr2=0x7f12dc1a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 0x7f12dc1a5b70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b500 tx=0x7f12cc00b810 comp rx=0 tx=0).stop 2023-10-05T15:52:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 shutdown_connections 2023-10-05T15:52:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f12c40e55e0 0x7f12c40e7aa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12dc1a6f30 0x7f12dc1a73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc10a820 0x7f12dc1a5b70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 --2- 172.21.15.17:0/2523630894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12dc10d1f0 0x7f12dc1a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.599+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 >> 172.21.15.17:0/2523630894 conn(0x7f12dc06dd10 msgr2=0x7f12dc1097e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.600+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 shutdown_connections 2023-10-05T15:52:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:52:47.600+0000 7f12e29ff700 1 -- 172.21.15.17:0/2523630894 wait complete. 2023-10-05T15:52:47.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-05T15:52:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 850.0 s, 267.4 tps, lat 108.506 ms stddev 82.692 2023-10-05T15:52:48.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.270+0000 7f583edff700 1 -- 172.21.15.17:0/3879785066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58380677b0 msgr2=0x7f58380ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.270+0000 7f583edff700 1 --2- 172.21.15.17:0/3879785066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58380677b0 0x7f58380ff540 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f582c009990 tx=0x7f582c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.270+0000 7f583edff700 1 -- 172.21.15.17:0/3879785066 shutdown_connections 2023-10-05T15:52:48.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.270+0000 7f583edff700 1 --2- 172.21.15.17:0/3879785066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5838100730 0x7f5838100be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.271+0000 7f583edff700 1 --2- 172.21.15.17:0/3879785066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58380677b0 0x7f58380ff540 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.271+0000 7f583edff700 1 --2- 172.21.15.17:0/3879785066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5838067c60 0x7f58380ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.271+0000 7f583edff700 1 -- 172.21.15.17:0/3879785066 >> 172.21.15.17:0/3879785066 conn(0x7f58380faab0 msgr2=0x7f58380fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.271+0000 7f583edff700 1 -- 172.21.15.17:0/3879785066 shutdown_connections 2023-10-05T15:52:48.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.271+0000 7f583edff700 1 -- 172.21.15.17:0/3879785066 wait complete. 2023-10-05T15:52:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.273+0000 7f583edff700 1 Processor -- start 2023-10-05T15:52:48.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.273+0000 7f583edff700 1 -- start start 2023-10-05T15:52:48.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.273+0000 7f583edff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 0x7f5838196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583edff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838067c60 0x7f5838197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583edff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5838100730 0x7f583819e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583edff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583819e660 con 0x7f5838100730 2023-10-05T15:52:48.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583edff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583819e7a0 con 0x7f5838067c60 2023-10-05T15:52:48.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583edff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583819e930 con 0x7f58380677b0 2023-10-05T15:52:48.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583cb9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 0x7f5838196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583cb9b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 0x7f5838196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50920/0 (socket says 172.21.15.17:50920) 2023-10-05T15:52:48.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.274+0000 7f583cb9b700 1 -- 172.21.15.17:0/222635496 learned_addr learned my addr 172.21.15.17:0/222635496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.275+0000 7f583d39c700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5838100730 0x7f583819e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.275+0000 7f583cb9b700 1 -- 172.21.15.17:0/222635496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838067c60 msgr2=0x7f5838197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.275+0000 7f583cb9b700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838067c60 0x7f5838197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.275+0000 7f583cb9b700 1 -- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5838100730 msgr2=0x7f583819e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.275+0000 7f583cb9b700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5838100730 0x7f583819e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.275+0000 7f583cb9b700 1 -- 172.21.15.17:0/222635496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0095f0 con 0x7f58380677b0 2023-10-05T15:52:48.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.276+0000 7f583cb9b700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 0x7f5838196ae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f582c005f50 tx=0x7f582c00bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:48.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.276+0000 7f5835ffb700 1 -- 172.21.15.17:0/222635496 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c003c60 con 0x7f58380677b0 2023-10-05T15:52:48.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.277+0000 7f5835ffb700 1 -- 172.21.15.17:0/222635496 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f582c023070 con 0x7f58380677b0 2023-10-05T15:52:48.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.277+0000 7f5835ffb700 1 -- 172.21.15.17:0/222635496 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c01fd90 con 0x7f58380677b0 2023-10-05T15:52:48.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.277+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5838108a90 con 0x7f58380677b0 2023-10-05T15:52:48.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.277+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5838108ef0 con 0x7f58380677b0 2023-10-05T15:52:48.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.284+0000 7f5852663b80 1 Processor -- start 2023-10-05T15:52:48.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 -- start start 2023-10-05T15:52:48.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e16a70 0x561473e16e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e17c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473d76460 con 0x561473e18270 2023-10-05T15:52:48.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473d67c20 con 0x561473e173d0 2023-10-05T15:52:48.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.285+0000 7f5852663b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473d65540 con 0x561473e16a70 2023-10-05T15:52:48.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.286+0000 7f583d39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e16a70 0x561473e16e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.286+0000 7f583d39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e16a70 0x561473e16e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50924/0 (socket says 172.21.15.17:50924) 2023-10-05T15:52:48.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.286+0000 7f583d39c700 1 -- 172.21.15.17:0/2704561378 learned_addr learned my addr 172.21.15.17:0/2704561378 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.289+0000 7f5835ffb700 1 -- 172.21.15.17:0/222635496 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f582c025030 con 0x7f58380677b0 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.289+0000 7f5837fff700 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e186f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.289+0000 7f5837fff700 1 -- 172.21.15.17:0/2704561378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e16a70 msgr2=0x561473e16e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.289+0000 7f5837fff700 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e16a70 0x561473e16e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.290+0000 7f5837fff700 1 -- 172.21.15.17:0/2704561378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 msgr2=0x561473e17c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.290+0000 7f5837fff700 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e17c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.290+0000 7f5837fff700 1 -- 172.21.15.17:0/2704561378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561473b8bde0 con 0x561473e18270 2023-10-05T15:52:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.291+0000 7f5835ffb700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58280a1500 0x7f58280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.291+0000 7f5835ffb700 1 -- 172.21.15.17:0/222635496 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f582c0ce1c0 con 0x7f58380677b0 2023-10-05T15:52:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.292+0000 7f5837fff700 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e186f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f58380ff260 tx=0x7f582400ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4970106b9304b94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:48.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.293+0000 7f583d39c700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58280a1500 0x7f58280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.294+0000 7f5822ffd700 1 -- 172.21.15.17:0/2704561378 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400cc10 con 0x561473e18270 2023-10-05T15:52:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.294+0000 7f5822ffd700 1 -- 172.21.15.17:0/2704561378 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58240044b0 con 0x561473e18270 2023-10-05T15:52:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.294+0000 7f5822ffd700 1 -- 172.21.15.17:0/2704561378 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824003d50 con 0x561473e18270 2023-10-05T15:52:48.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.295+0000 7f583d39c700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58280a1500 0x7f58280a39c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5830009f10 tx=0x7f5830009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 -- 172.21.15.17:0/2704561378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 msgr2=0x561473e186f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e186f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f58380ff260 tx=0x7f582400ad20 comp rx=0 tx=0).stop 2023-10-05T15:52:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 -- 172.21.15.17:0/2704561378 shutdown_connections 2023-10-05T15:52:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e186f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e16a70 0x561473e16e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 --2- 172.21.15.17:0/2704561378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e17c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.296+0000 7f5852663b80 1 -- 172.21.15.17:0/2704561378 >> 172.21.15.17:0/2704561378 conn(0x561473d82260 msgr2=0x561473e09140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:48.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.297+0000 7f5852663b80 1 -- 172.21.15.17:0/2704561378 shutdown_connections 2023-10-05T15:52:48.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.297+0000 7f5852663b80 1 -- 172.21.15.17:0/2704561378 wait complete. 2023-10-05T15:52:48.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.298+0000 7f5852663b80 1 -- start start 2023-10-05T15:52:48.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.298+0000 7f5852663b80 1 Processor -- start 2023-10-05T15:52:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e31910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e31e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 0x561473e38e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473d60e30 con 0x561473e16a70 2023-10-05T15:52:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473cfd710 con 0x561473e173d0 2023-10-05T15:52:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473cfd3b0 con 0x561473e18270 2023-10-05T15:52:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.299+0000 7f5852663b80 10 client.0 _ll_register_callbacks cb 0x561473b5a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 0x561473e38e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 0x561473e38e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50928/0 (socket says 172.21.15.17:50928) 2023-10-05T15:52:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 -- 172.21.15.17:0/2428150734 learned_addr learned my addr 172.21.15.17:0/2428150734 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583cb9b700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e31910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f5837fff700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e31e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 -- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 msgr2=0x561473e31e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e31e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 -- 172.21.15.17:0/2428150734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 msgr2=0x561473e31910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e31910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.300+0000 7f583d39c700 1 -- 172.21.15.17:0/2428150734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582400a6a0 con 0x561473e18270 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.301+0000 7f583cb9b700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e31910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.301+0000 7f583d39c700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 0x561473e38e90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5830018e70 tx=0x7f5830004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ca1022f4abff0c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.301+0000 7f5817fff700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:52:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.301+0000 7f5817fff700 1 -- 172.21.15.17:0/2428150734 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830027070 con 0x561473e18270 2023-10-05T15:52:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.301+0000 7f5817fff700 1 -- 172.21.15.17:0/2428150734 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5830003a00 con 0x561473e18270 2023-10-05T15:52:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.302+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561473e00f10 con 0x561473e18270 2023-10-05T15:52:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.302+0000 7f5817fff700 1 -- 172.21.15.17:0/2428150734 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5830003bc0 con 0x561473e18270 2023-10-05T15:52:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.302+0000 7f5852663b80 10 client.27280 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:48.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.302+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x561473b74c60 con 0x561473e18270 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.303+0000 7f5817fff700 1 -- 172.21.15.17:0/2428150734 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561473e00f10 con 0x561473e18270 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.303+0000 7f5817fff700 1 -- 172.21.15.17:0/2428150734 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f583002a020 con 0x561473e18270 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.303+0000 7f5852663b80 10 client.27280 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.303+0000 7f5852663b80 10 client.27280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.304+0000 7f5852663b80 20 client.27280 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.304+0000 7f5852663b80 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e3d770 0x561473e3fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.304+0000 7f5852663b80 4 client.27280 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:52:48.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.304+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561473d59e10 con 0x561473e3d770 2023-10-05T15:52:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.304+0000 7f583cb9b700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e3d770 0x561473e3fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.316+0000 7f583cb9b700 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e3d770 0x561473e3fb90 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b5cae84d61f8a1 server_cookie=f5dd5675d53d2e71 in_seq=0 out_seq=0 2023-10-05T15:52:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.317+0000 7f5817fff700 10 client.27280 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:48.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.319+0000 7f5817fff700 1 -- 172.21.15.17:0/2428150734 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561473d59e10 con 0x561473e3d770 2023-10-05T15:52:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.319+0000 7f5817fff700 10 client.27280 handle_command_reply: tid=0 2023-10-05T15:52:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.320+0000 7f5852663b80 1 client.27280 shutdown 2023-10-05T15:52:48.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.320+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 msgr2=0x561473e38e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.320+0000 7f5852663b80 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 0x561473e38e90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5830018e70 tx=0x7f5830004ad0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.324+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 shutdown_connections 2023-10-05T15:52:48.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.324+0000 7f5852663b80 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e3d770 0x561473e3fb90 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.324+0000 7f5852663b80 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e18270 0x561473e38e90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.324+0000 7f5852663b80 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e31910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.324+0000 7f5852663b80 1 --2- 172.21.15.17:0/2428150734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e173d0 0x561473e31e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.324+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 >> 172.21.15.17:0/2428150734 conn(0x561473d82260 msgr2=0x561473e08f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.325+0000 7f5817fff700 0 client.27280 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.326+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 shutdown_connections 2023-10-05T15:52:48.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.327+0000 7f5852663b80 1 -- 172.21.15.17:0/2428150734 wait complete. 2023-10-05T15:52:48.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.331+0000 7f5852663b80 20 client.27280 trim_cache size 0 max 16384 2023-10-05T15:52:48.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:48 smithi167 ceph-mon[133366]: pgmap v855: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 553 op/s 2023-10-05T15:52:48.358 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:48 smithi079 ceph-mon[132936]: pgmap v855: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 553 op/s 2023-10-05T15:52:48.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.364+0000 7f5852663b80 1 Processor -- start 2023-10-05T15:52:48.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.364+0000 7f5852663b80 1 -- start start 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5852663b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e16a70 0x561473e1b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5852663b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e1b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5852663b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e38e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5852663b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473be1920 con 0x561473e18270 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5852663b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473e17b20 con 0x561473e16a70 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5852663b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473e32b00 con 0x561473e173d0 2023-10-05T15:52:48.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5837fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e1b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5837fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e1b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50938/0 (socket says 172.21.15.17:50938) 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.365+0000 7f5837fff700 1 -- 172.21.15.17:0/361946539 learned_addr learned my addr 172.21.15.17:0/361946539 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.366+0000 7f583d39c700 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e38e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.366+0000 7f5837fff700 1 -- 172.21.15.17:0/361946539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e16a70 msgr2=0x561473e1b250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.366+0000 7f5837fff700 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e16a70 0x561473e1b250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.366+0000 7f5837fff700 1 -- 172.21.15.17:0/361946539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 msgr2=0x561473e38e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.366+0000 7f5837fff700 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e38e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.366+0000 7f5837fff700 1 -- 172.21.15.17:0/361946539 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561473bb2250 con 0x561473e173d0 2023-10-05T15:52:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.367+0000 7f5837fff700 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e1b790 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5824016000 tx=0x7f582400a970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429e5c01cadca7dd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.368+0000 7f58237fe700 1 -- 172.21.15.17:0/361946539 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582401e040 con 0x561473e173d0 2023-10-05T15:52:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.368+0000 7f58237fe700 1 -- 172.21.15.17:0/361946539 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f582400aeb0 con 0x561473e173d0 2023-10-05T15:52:48.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.368+0000 7f58237fe700 1 -- 172.21.15.17:0/361946539 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400fda0 con 0x561473e173d0 2023-10-05T15:52:48.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.369+0000 7f5852663b80 1 -- 172.21.15.17:0/361946539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 msgr2=0x561473e1b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.369+0000 7f5852663b80 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e1b790 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5824016000 tx=0x7f582400a970 comp rx=0 tx=0).stop 2023-10-05T15:52:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.374+0000 7f5852663b80 1 -- 172.21.15.17:0/361946539 shutdown_connections 2023-10-05T15:52:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.374+0000 7f5852663b80 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e18270 0x561473e38e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.374+0000 7f5852663b80 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e16a70 0x561473e1b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.374+0000 7f5852663b80 1 --2- 172.21.15.17:0/361946539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e1b790 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.374+0000 7f5852663b80 1 -- 172.21.15.17:0/361946539 >> 172.21.15.17:0/361946539 conn(0x561473d82260 msgr2=0x561473e30520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:48.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.375+0000 7f5852663b80 1 -- 172.21.15.17:0/361946539 shutdown_connections 2023-10-05T15:52:48.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.376+0000 7f5852663b80 1 -- 172.21.15.17:0/361946539 wait complete. 2023-10-05T15:52:48.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.376+0000 7f5852663b80 1 -- start start 2023-10-05T15:52:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.377+0000 7f5852663b80 1 Processor -- start 2023-10-05T15:52:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.377+0000 7f5852663b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e36cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.377+0000 7f5852663b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e37210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.377+0000 7f5852663b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e18270 0x561473e38220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5852663b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473e38760 con 0x561473e16a70 2023-10-05T15:52:48.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5852663b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473e388d0 con 0x561473e18270 2023-10-05T15:52:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5852663b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561473e38a90 con 0x561473e173d0 2023-10-05T15:52:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5852663b80 10 client.0 _ll_register_callbacks cb 0x7f5830018810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:52:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5837fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e37210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5837fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e37210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:50948/0 (socket says 172.21.15.17:50948) 2023-10-05T15:52:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.378+0000 7f5837fff700 1 -- 172.21.15.17:0/3618166837 learned_addr learned my addr 172.21.15.17:0/3618166837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:52:48.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.379+0000 7f583cb9b700 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e36cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.379+0000 7f583cb9b700 1 -- 172.21.15.17:0/3618166837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 msgr2=0x561473e37210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.379+0000 7f583cb9b700 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e37210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.379+0000 7f583cb9b700 1 -- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e18270 msgr2=0x561473e38220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:52:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.379+0000 7f583cb9b700 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e18270 0x561473e38220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.379+0000 7f583cb9b700 1 -- 172.21.15.17:0/3618166837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561473b8bde0 con 0x561473e16a70 2023-10-05T15:52:48.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.380+0000 7f583cb9b700 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e36cd0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c010 tx=0x7f582c0a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707de0b8ee65ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:52:48.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.380+0000 7f5817fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:52:48.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.381+0000 7f5817fff700 1 -- 172.21.15.17:0/3618166837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c09b170 con 0x561473e16a70 2023-10-05T15:52:48.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.381+0000 7f5817fff700 1 -- 172.21.15.17:0/3618166837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f582c09f2c0 con 0x561473e16a70 2023-10-05T15:52:48.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.381+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58240044b0 con 0x561473e16a70 2023-10-05T15:52:48.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.381+0000 7f5817fff700 1 -- 172.21.15.17:0/3618166837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f582c0a3470 con 0x561473e16a70 2023-10-05T15:52:48.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.382+0000 7f5852663b80 10 client.17283 fetch_fsmap learned FSMap version 43 2023-10-05T15:52:48.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.382+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x561473b8a2b0 con 0x561473e16a70 2023-10-05T15:52:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5817fff700 1 -- 172.21.15.17:0/3618166837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58240044b0 con 0x561473e16a70 2023-10-05T15:52:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5817fff700 1 -- 172.21.15.17:0/3618166837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f582c0b9240 con 0x561473e16a70 2023-10-05T15:52:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5852663b80 10 client.17283 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:52:48.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5852663b80 10 client.17283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-05T15:52:48.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5852663b80 20 client.17283 populate_metadata read hostname 'smithi017' 2023-10-05T15:52:48.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5852663b80 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e92310 0x561473e94730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:52:48.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5852663b80 4 client.17283 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-05T15:52:48.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561473d59b30 con 0x561473e92310 2023-10-05T15:52:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.383+0000 7f5837fff700 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e92310 0x561473e94730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:52:48.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.390+0000 7f5837fff700 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e92310 0x561473e94730 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3b6854918fa4bc1 server_cookie=31d8c85f57338089 in_seq=0 out_seq=0 2023-10-05T15:52:48.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.391+0000 7f5817fff700 10 client.17283 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:48.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.393+0000 7f5817fff700 1 -- 172.21.15.17:0/3618166837 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561473d59b30 con 0x561473e92310 2023-10-05T15:52:48.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.393+0000 7f5817fff700 10 client.17283 handle_command_reply: tid=0 2023-10-05T15:52:48.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.402+0000 7f5852663b80 1 client.17283 shutdown 2023-10-05T15:52:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.405+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 msgr2=0x561473e36cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.405+0000 7f5852663b80 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e36cd0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c010 tx=0x7f582c0a1040 comp rx=0 tx=0).stop 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 shutdown_connections 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5852663b80 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x561473e92310 0x561473e94730 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5852663b80 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561473e18270 0x561473e38220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5852663b80 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561473e16a70 0x561473e36cd0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5852663b80 1 --2- 172.21.15.17:0/3618166837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561473e173d0 0x561473e37210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 >> 172.21.15.17:0/3618166837 conn(0x561473d82260 msgr2=0x561473e1b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.412+0000 7f5817fff700 0 client.17283 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:52:48.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.415+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 shutdown_connections 2023-10-05T15:52:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.415+0000 7f5852663b80 1 -- 172.21.15.17:0/3618166837 wait complete. 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.417+0000 7f5852663b80 20 client.17283 trim_cache size 0 max 16384 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "a4213df7-a1dc-4129-ad0a-b4ae19e75a02": { 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-10-05T15:52:48.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "a4213df7-a1dc-4129-ad0a-b4ae19e75a02", 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.418+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58280a1500 msgr2=0x7f58280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.418+0000 7f583edff700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58280a1500 0x7f58280a39c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5830009f10 tx=0x7f5830009040 comp rx=0 tx=0).stop 2023-10-05T15:52:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.418+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 msgr2=0x7f5838196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.418+0000 7f583edff700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 0x7f5838196ae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f582c005f50 tx=0x7f582c00bdb0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.419+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 shutdown_connections 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.419+0000 7f583edff700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f58280a1500 0x7f58280a39c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.419+0000 7f583edff700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5838100730 0x7f583819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.419+0000 7f583edff700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58380677b0 0x7f5838196ae0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.419+0000 7f583edff700 1 --2- 172.21.15.17:0/222635496 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5838067c60 0x7f5838197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:52:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.419+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 >> 172.21.15.17:0/222635496 conn(0x7f58380faab0 msgr2=0x7f58380fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:52:48.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.420+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 shutdown_connections 2023-10-05T15:52:48.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:52:48.420+0000 7f583edff700 1 -- 172.21.15.17:0/222635496 wait complete. 2023-10-05T15:52:48.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:48 smithi017 ceph-mon[129107]: pgmap v855: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.4 MiB/s wr, 553 op/s 2023-10-05T15:52:48.462 INFO:tasks.cephfs.filesystem:scrub status for tag:a4213df7-a1dc-4129-ad0a-b4ae19e75a02 - {'path': '/', 'tag': 'a4213df7-a1dc-4129-ad0a-b4ae19e75a02', 'options': 'recursive,force'} 2023-10-05T15:52:48.463 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/cephfs/filesystem.py", line 1730, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-10-05T15:52:50.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:50 smithi167 ceph-mon[133366]: pgmap v856: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 649 op/s 2023-10-05T15:52:50.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:50 smithi079 ceph-mon[132936]: pgmap v856: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 649 op/s 2023-10-05T15:52:50.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:50 smithi017 ceph-mon[129107]: pgmap v856: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 649 op/s 2023-10-05T15:52:52.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:52 smithi167 ceph-mon[133366]: pgmap v857: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 664 op/s 2023-10-05T15:52:52.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:52 smithi079 ceph-mon[132936]: pgmap v857: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 664 op/s 2023-10-05T15:52:52.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:52 smithi017 ceph-mon[129107]: pgmap v857: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 664 op/s 2023-10-05T15:52:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 855.0 s, 505.0 tps, lat 340.029 ms stddev 795.463 2023-10-05T15:52:54.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:54 smithi079 ceph-mon[132936]: pgmap v858: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.6 MiB/s wr, 570 op/s 2023-10-05T15:52:54.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:54 smithi017 ceph-mon[129107]: pgmap v858: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.6 MiB/s wr, 570 op/s 2023-10-05T15:52:54.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:54 smithi167 ceph-mon[133366]: pgmap v858: 129 pgs: 129 active+clean; 1.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.6 MiB/s wr, 570 op/s 2023-10-05T15:52:56.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:56 smithi079 ceph-mon[132936]: pgmap v859: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 663 op/s 2023-10-05T15:52:56.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:56 smithi017 ceph-mon[129107]: pgmap v859: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 663 op/s 2023-10-05T15:52:56.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:56 smithi167 ceph-mon[133366]: pgmap v859: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.1 MiB/s wr, 663 op/s 2023-10-05T15:52:58.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 860.0 s, 494.6 tps, lat 194.369 ms stddev 66.532 2023-10-05T15:52:58.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:52:58 smithi167 ceph-mon[133366]: pgmap v860: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 548 op/s 2023-10-05T15:52:58.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:52:58 smithi079 ceph-mon[132936]: pgmap v860: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 548 op/s 2023-10-05T15:52:58.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:52:58 smithi017 ceph-mon[129107]: pgmap v860: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.5 MiB/s wr, 548 op/s 2023-10-05T15:53:00.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:00 smithi017 ceph-mon[129107]: pgmap v861: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 597 op/s 2023-10-05T15:53:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:00 smithi167 ceph-mon[133366]: pgmap v861: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 597 op/s 2023-10-05T15:53:00.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:00 smithi079 ceph-mon[132936]: pgmap v861: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 597 op/s 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 -- 172.21.15.17:0/469240527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0881090c0 msgr2=0x7fc08810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 --2- 172.21.15.17:0/469240527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0881090c0 0x7fc08810f970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc080009990 tx=0x7fc080009ca0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 -- 172.21.15.17:0/469240527 shutdown_connections 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 --2- 172.21.15.17:0/469240527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0881090c0 0x7fc08810f970 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 --2- 172.21.15.17:0/469240527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc088107530 0x7fc088107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 --2- 172.21.15.17:0/469240527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc088108720 0x7fc088108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.843+0000 7fc0905ff700 1 -- 172.21.15.17:0/469240527 >> 172.21.15.17:0/469240527 conn(0x7fc0880764b0 msgr2=0x7fc088078910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:00.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.844+0000 7fc0905ff700 1 -- 172.21.15.17:0/469240527 shutdown_connections 2023-10-05T15:53:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.845+0000 7fc0905ff700 1 -- 172.21.15.17:0/469240527 wait complete. 2023-10-05T15:53:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.846+0000 7fc0905ff700 1 Processor -- start 2023-10-05T15:53:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 -- start start 2023-10-05T15:53:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc088107530 0x7fc08806f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 0x7fc08806fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0881090c0 0x7fc088070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088071270 con 0x7fc0881090c0 2023-10-05T15:53:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880713e0 con 0x7fc088107530 2023-10-05T15:53:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.847+0000 7fc0905ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880715a0 con 0x7fc088108720 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.848+0000 7fc08db9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 0x7fc08806fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.848+0000 7fc08db9a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 0x7fc08806fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53466/0 (socket says 172.21.15.17:53466) 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.848+0000 7fc08db9a700 1 -- 172.21.15.17:0/74622838 learned_addr learned my addr 172.21.15.17:0/74622838 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.848+0000 7fc08e39b700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc088107530 0x7fc08806f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.849+0000 7fc08db9a700 1 -- 172.21.15.17:0/74622838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc088107530 msgr2=0x7fc08806f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.849+0000 7fc08db9a700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc088107530 0x7fc08806f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.849+0000 7fc08db9a700 1 -- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0881090c0 msgr2=0x7fc088070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.849+0000 7fc08db9a700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0881090c0 0x7fc088070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.849+0000 7fc08db9a700 1 -- 172.21.15.17:0/74622838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009c40 con 0x7fc088108720 2023-10-05T15:53:00.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.850+0000 7fc08db9a700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 0x7fc08806fd40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c370 tx=0x7fc08400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.853+0000 7fc07b7fe700 1 -- 172.21.15.17:0/74622838 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084017070 con 0x7fc088108720 2023-10-05T15:53:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.854+0000 7fc07b7fe700 1 -- 172.21.15.17:0/74622838 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc08400f040 con 0x7fc088108720 2023-10-05T15:53:00.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.854+0000 7fc07b7fe700 1 -- 172.21.15.17:0/74622838 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400e050 con 0x7fc088108720 2023-10-05T15:53:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.854+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0800095f0 con 0x7fc088108720 2023-10-05T15:53:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.854+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc088071e50 con 0x7fc088108720 2023-10-05T15:53:00.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.862+0000 7fc0a3f47b80 1 Processor -- start 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 -- start start 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28a9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd2810400 con 0x559dd28a7ec0 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd2801bc0 con 0x559dd28a9990 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.863+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd27ff4e0 con 0x559dd28a8fd0 2023-10-05T15:53:00.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.864+0000 7fc07b7fe700 1 -- 172.21.15.17:0/74622838 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fc084003a00 con 0x7fc088108720 2023-10-05T15:53:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.864+0000 7fc08db9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.864+0000 7fc08db9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44426/0 (socket says 172.21.15.17:44426) 2023-10-05T15:53:00.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.864+0000 7fc08db9a700 1 -- 172.21.15.17:0/3397140832 learned_addr learned my addr 172.21.15.17:0/3397140832 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:00.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.866+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3397140832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 msgr2=0x559dd28a9450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28a9450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3397140832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 msgr2=0x559dd28b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3397140832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd2625d80 con 0x559dd28a7ec0 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc07b7fe700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc0740a1650 0x7fc0740a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.867+0000 7fc08db9a700 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.868+0000 7fc07b7fe700 1 -- 172.21.15.17:0/74622838 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc0840ccb70 con 0x7fc088108720 2023-10-05T15:53:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.868+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a82e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc080009990 tx=0x7fc080005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddcb05ef00df585 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:00.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.868+0000 7fc08e39b700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc0740a1650 0x7fc0740a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.869+0000 7fc08e39b700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc0740a1650 0x7fc0740a3b10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005950 tx=0x7fc07c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.871+0000 7fc078bfe700 1 -- 172.21.15.17:0/3397140832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08001d070 con 0x559dd28a7ec0 2023-10-05T15:53:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.871+0000 7fc078bfe700 1 -- 172.21.15.17:0/3397140832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc08000bc40 con 0x559dd28a7ec0 2023-10-05T15:53:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.871+0000 7fc078bfe700 1 -- 172.21.15.17:0/3397140832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080003a00 con 0x559dd28a7ec0 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.872+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3397140832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 msgr2=0x559dd28a82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.872+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a82e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc080009990 tx=0x7fc080005c00 comp rx=0 tx=0).stop 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.873+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3397140832 shutdown_connections 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.873+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.873+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a82e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.873+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3397140832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.873+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3397140832 >> 172.21.15.17:0/3397140832 conn(0x559dd281c200 msgr2=0x559dd28a2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.873+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3397140832 shutdown_connections 2023-10-05T15:53:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.874+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3397140832 wait complete. 2023-10-05T15:53:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.874+0000 7fc0a3f47b80 1 -- start start 2023-10-05T15:53:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 Processor -- start 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd27fadd0 con 0x559dd28a7ec0 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd27976b0 con 0x559dd28a9990 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd2797350 con 0x559dd28a8fd0 2023-10-05T15:53:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.875+0000 7fc0a3f47b80 10 client.0 _ll_register_callbacks cb 0x559dd25f47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.876+0000 7fc08eb9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.876+0000 7fc08eb9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44440/0 (socket says 172.21.15.17:44440) 2023-10-05T15:53:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.876+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3422240039 learned_addr learned my addr 172.21.15.17:0/3422240039 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.876+0000 7fc08db9a700 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3422240039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 msgr2=0x559dd28b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3422240039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 msgr2=0x559dd28b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc08eb9c700 1 -- 172.21.15.17:0/3422240039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc088071e50 con 0x559dd28a9990 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b90e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc0800098e0 tx=0x7fc08000bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=829516a009aebbbd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.877+0000 7fc071ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:53:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.878+0000 7fc071ffb700 1 -- 172.21.15.17:0/3422240039 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08001d050 con 0x559dd28a9990 2023-10-05T15:53:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.878+0000 7fc071ffb700 1 -- 172.21.15.17:0/3422240039 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc08002b470 con 0x559dd28a9990 2023-10-05T15:53:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.878+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559dd289ad50 con 0x559dd28a9990 2023-10-05T15:53:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.878+0000 7fc071ffb700 1 -- 172.21.15.17:0/3422240039 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08002b630 con 0x559dd28a9990 2023-10-05T15:53:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.878+0000 7fc0a3f47b80 10 client.27374 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.878+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fc0881102c0 con 0x559dd28a9990 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc071ffb700 1 -- 172.21.15.17:0/3422240039 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559dd289ad50 con 0x559dd28a9990 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc071ffb700 1 -- 172.21.15.17:0/3422240039 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc080022760 con 0x559dd28a9990 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc0a3f47b80 10 client.27374 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc0a3f47b80 10 client.27374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc0a3f47b80 20 client.27374 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd28bd4d0 0x559dd28bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc0a3f47b80 4 client.27374 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:53:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.879+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559dd27f3db0 con 0x559dd28bd4d0 2023-10-05T15:53:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.880+0000 7fc08e39b700 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd28bd4d0 0x559dd28bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.881+0000 7fc08e39b700 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd28bd4d0 0x559dd28bf8c0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df03e077730149e server_cookie=ba084d4e05f80e8f in_seq=0 out_seq=0 2023-10-05T15:53:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.883+0000 7fc071ffb700 10 client.27374 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.883+0000 7fc071ffb700 1 -- 172.21.15.17:0/3422240039 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559dd27f3db0 con 0x559dd28bd4d0 2023-10-05T15:53:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.883+0000 7fc071ffb700 10 client.27374 handle_command_reply: tid=0 2023-10-05T15:53:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.884+0000 7fc0a3f47b80 1 client.27374 shutdown 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 msgr2=0x559dd28b90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b90e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc0800098e0 tx=0x7fc08000bf70 comp rx=0 tx=0).stop 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 shutdown_connections 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd28bd4d0 0x559dd28bf8c0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b90e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/3422240039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 >> 172.21.15.17:0/3422240039 conn(0x559dd281c200 msgr2=0x559dd28a2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:00.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc071ffb700 0 client.27374 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 shutdown_connections 2023-10-05T15:53:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.885+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/3422240039 wait complete. 2023-10-05T15:53:00.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.886+0000 7fc0a3f47b80 20 client.27374 trim_cache size 0 max 16384 2023-10-05T15:53:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.907+0000 7fc0a3f47b80 1 Processor -- start 2023-10-05T15:53:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.907+0000 7fc0a3f47b80 1 -- start start 2023-10-05T15:53:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.908+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.908+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.908+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.908+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd267b8c0 con 0x559dd28a7ec0 2023-10-05T15:53:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.908+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd28ad600 con 0x559dd28a9990 2023-10-05T15:53:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.908+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd28a4340 con 0x559dd28a8fd0 2023-10-05T15:53:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:44446/0 (socket says 172.21.15.17:44446) 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 -- 172.21.15.17:0/1309908313 learned_addr learned my addr 172.21.15.17:0/1309908313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08e39b700 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 -- 172.21.15.17:0/1309908313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 msgr2=0x559dd28b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 -- 172.21.15.17:0/1309908313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 msgr2=0x559dd28a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 -- 172.21.15.17:0/1309908313 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd260ec00 con 0x559dd28a9990 2023-10-05T15:53:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.909+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b1210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc080001eb0 tx=0x7fc080000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c02d85d8d8a9cfb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.910+0000 7fc0793ff700 1 -- 172.21.15.17:0/1309908313 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08001d070 con 0x559dd28a9990 2023-10-05T15:53:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.910+0000 7fc0793ff700 1 -- 172.21.15.17:0/1309908313 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc08001e040 con 0x559dd28a9990 2023-10-05T15:53:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.910+0000 7fc0793ff700 1 -- 172.21.15.17:0/1309908313 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000f8c0 con 0x559dd28a9990 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/1309908313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 msgr2=0x559dd28b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b1210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc080001eb0 tx=0x7fc080000bc0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/1309908313 shutdown_connections 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a9990 0x559dd28b1210 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/1309908313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a8fd0 0x559dd28b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/1309908313 >> 172.21.15.17:0/1309908313 conn(0x559dd281c200 msgr2=0x559dd28c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.911+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/1309908313 shutdown_connections 2023-10-05T15:53:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.912+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/1309908313 wait complete. 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.912+0000 7fc0a3f47b80 1 -- start start 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.912+0000 7fc0a3f47b80 1 Processor -- start 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a8fd0 0x559dd28b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 0x559dd28b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd28b8480 con 0x559dd28a7ec0 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd28b85f0 con 0x559dd28a8fd0 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd28b87b0 con 0x559dd28a9990 2023-10-05T15:53:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.913+0000 7fc0a3f47b80 10 client.0 _ll_register_callbacks cb 0x7fc0840d0370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.914+0000 7fc08eb9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 0x559dd28b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.914+0000 7fc08eb9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 0x559dd28b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:53510/0 (socket says 172.21.15.17:53510) 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.914+0000 7fc08eb9c700 1 -- 172.21.15.17:0/246339139 learned_addr learned my addr 172.21.15.17:0/246339139 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.914+0000 7fc08e39b700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08eb9c700 1 -- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a8fd0 msgr2=0x559dd28b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08db9a700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a8fd0 0x559dd28b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a8fd0 0x559dd28b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08eb9c700 1 -- 172.21.15.17:0/246339139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 msgr2=0x559dd28b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08eb9c700 1 -- 172.21.15.17:0/246339139 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0881102c0 con 0x559dd28a9990 2023-10-05T15:53:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08e39b700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.915+0000 7fc08db9a700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a8fd0 0x559dd28b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.916+0000 7fc08eb9c700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 0x559dd28b7f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc08000f460 tx=0x7fc0800226a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afcf4cd7e6417ff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.916+0000 7fc071ffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.916+0000 7fc071ffb700 1 -- 172.21.15.17:0/246339139 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08001d070 con 0x559dd28a9990 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.916+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc08000bc40 con 0x559dd28a9990 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.916+0000 7fc071ffb700 1 -- 172.21.15.17:0/246339139 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fc080000e40 con 0x559dd28a9990 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.917+0000 7fc071ffb700 1 -- 172.21.15.17:0/246339139 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc080022940 con 0x559dd28a9990 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.917+0000 7fc0a3f47b80 10 client.27295 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.917+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x559dd264c1f0 con 0x559dd28a9990 2023-10-05T15:53:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc071ffb700 1 -- 172.21.15.17:0/246339139 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc08000bc40 con 0x559dd28a9990 2023-10-05T15:53:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc071ffb700 1 -- 172.21.15.17:0/246339139 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc080048070 con 0x559dd28a9990 2023-10-05T15:53:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc0a3f47b80 10 client.27295 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc0a3f47b80 10 client.27295 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc0a3f47b80 20 client.27295 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd2911890 0x559dd2913c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc0a3f47b80 4 client.27295 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:53:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.918+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559dd27f3ad0 con 0x559dd2911890 2023-10-05T15:53:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.920+0000 7fc08e39b700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd2911890 0x559dd2913c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.921+0000 7fc08e39b700 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd2911890 0x559dd2913c80 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc092e518d6fd99 server_cookie=972bcf911de39985 in_seq=0 out_seq=0 2023-10-05T15:53:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.921+0000 7fc071ffb700 10 client.27295 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:00.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.943+0000 7fc071ffb700 1 -- 172.21.15.17:0/246339139 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559dd27f3ad0 con 0x559dd2911890 2023-10-05T15:53:00.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.943+0000 7fc071ffb700 10 client.27295 handle_command_reply: tid=0 2023-10-05T15:53:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.943+0000 7fc0a3f47b80 1 client.27295 shutdown 2023-10-05T15:53:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.943+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 msgr2=0x559dd28b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.943+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 0x559dd28b7f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc08000f460 tx=0x7fc0800226a0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.944+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 shutdown_connections 2023-10-05T15:53:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.944+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x559dd2911890 0x559dd2913c80 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.944+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dd28a9990 0x559dd28b7f40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.944+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd28a7ec0 0x559dd28b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.944+0000 7fc0a3f47b80 1 --2- 172.21.15.17:0/246339139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559dd28a8fd0 0x559dd28b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.944+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 >> 172.21.15.17:0/246339139 conn(0x559dd281c200 msgr2=0x559dd28afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.945+0000 7fc071ffb700 0 client.27295 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.945+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 shutdown_connections 2023-10-05T15:53:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.945+0000 7fc0a3f47b80 1 -- 172.21.15.17:0/246339139 wait complete. 2023-10-05T15:53:00.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.946+0000 7fc0a3f47b80 20 client.27295 trim_cache size 0 max 16384 2023-10-05T15:53:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:53:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:53:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:53:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc0740a1650 msgr2=0x7fc0740a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc0740a1650 0x7fc0740a3b10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005950 tx=0x7fc07c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 msgr2=0x7fc08806fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 0x7fc08806fd40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c370 tx=0x7fc08400c730 comp rx=0 tx=0).stop 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 shutdown_connections 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fc0740a1650 0x7fc0740a3b10 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005950 tx=0x7fc07c0058e0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0881090c0 0x7fc088070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc088107530 0x7fc08806f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 --2- 172.21.15.17:0/74622838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc088108720 0x7fc08806fd40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.950+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 >> 172.21.15.17:0/74622838 conn(0x7fc0880764b0 msgr2=0x7fc08810bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.951+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 shutdown_connections 2023-10-05T15:53:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:00.951+0000 7fc0905ff700 1 -- 172.21.15.17:0/74622838 wait complete. 2023-10-05T15:53:02.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:02 smithi017 ceph-mon[129107]: pgmap v862: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 597 op/s 2023-10-05T15:53:02.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:02 smithi167 ceph-mon[133366]: pgmap v862: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 597 op/s 2023-10-05T15:53:02.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:02 smithi079 ceph-mon[132936]: pgmap v862: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.8 MiB/s wr, 597 op/s 2023-10-05T15:53:03.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 865.0 s, 437.4 tps, lat 236.375 ms stddev 101.228 2023-10-05T15:53:04.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:04 smithi017 ceph-mon[129107]: pgmap v863: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.1 MiB/s wr, 514 op/s 2023-10-05T15:53:04.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:04 smithi167 ceph-mon[133366]: pgmap v863: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.1 MiB/s wr, 514 op/s 2023-10-05T15:53:04.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:04 smithi079 ceph-mon[132936]: pgmap v863: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.1 MiB/s wr, 514 op/s 2023-10-05T15:53:06.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:06 smithi017 ceph-mon[129107]: pgmap v864: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 633 op/s 2023-10-05T15:53:06.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:06 smithi167 ceph-mon[133366]: pgmap v864: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 633 op/s 2023-10-05T15:53:06.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:06 smithi079 ceph-mon[132936]: pgmap v864: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.1 MiB/s wr, 633 op/s 2023-10-05T15:53:08.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 870.0 s, 445.8 tps, lat 215.086 ms stddev 71.462 2023-10-05T15:53:08.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:08 smithi167 ceph-mon[133366]: pgmap v865: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 544 op/s 2023-10-05T15:53:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:08 smithi079 ceph-mon[132936]: pgmap v865: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 544 op/s 2023-10-05T15:53:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:08 smithi017 ceph-mon[129107]: pgmap v865: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.7 MiB/s wr, 544 op/s 2023-10-05T15:53:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:10 smithi017 ceph-mon[129107]: pgmap v866: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 582 op/s 2023-10-05T15:53:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:10 smithi167 ceph-mon[133366]: pgmap v866: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 582 op/s 2023-10-05T15:53:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:10 smithi079 ceph-mon[132936]: pgmap v866: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.5 MiB/s wr, 582 op/s 2023-10-05T15:53:12.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:12 smithi017 ceph-mon[129107]: pgmap v867: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 640 op/s 2023-10-05T15:53:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:12 smithi167 ceph-mon[133366]: pgmap v867: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 640 op/s 2023-10-05T15:53:12.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:12 smithi079 ceph-mon[132936]: pgmap v867: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.5 MiB/s wr, 640 op/s 2023-10-05T15:53:13.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 875.0 s, 407.6 tps, lat 255.072 ms stddev 249.121 2023-10-05T15:53:13.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:13 smithi167 ceph-mon[133366]: pgmap v868: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 542 op/s 2023-10-05T15:53:13.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:13 smithi079 ceph-mon[132936]: pgmap v868: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 542 op/s 2023-10-05T15:53:13.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:13 smithi017 ceph-mon[129107]: pgmap v868: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 542 op/s 2023-10-05T15:53:14.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/2393873625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 msgr2=0x7fe9c4104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/2393873625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c4104560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009990 tx=0x7fe9b8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/2393873625 shutdown_connections 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/2393873625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 0x7fe9c4104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/2393873625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9c40ff760 0x7fe9c4101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/2393873625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c4104560 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.223+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/2393873625 >> 172.21.15.17:0/2393873625 conn(0x7fe9c40fb340 msgr2=0x7fe9c40fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.224+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/2393873625 shutdown_connections 2023-10-05T15:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.224+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/2393873625 wait complete. 2023-10-05T15:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.225+0000 7fe9ca5ff700 1 Processor -- start 2023-10-05T15:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.226+0000 7fe9ca5ff700 1 -- start start 2023-10-05T15:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.226+0000 7fe9ca5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9c40ff760 0x7fe9c419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.226+0000 7fe9ca5ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c419d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.226+0000 7fe9ca5ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 0x7fe9c419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9ca5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c419ecc0 con 0x7fe9c40ff760 2023-10-05T15:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9ca5ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c419ee30 con 0x7fe9c41020d0 2023-10-05T15:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9ca5ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c419eff0 con 0x7fe9c4104aa0 2023-10-05T15:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c419d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c419d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45450/0 (socket says 172.21.15.17:45450) 2023-10-05T15:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9c37fe700 1 -- 172.21.15.17:0/431872934 learned_addr learned my addr 172.21.15.17:0/431872934 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 0x7fe9c419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.227+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9c40ff760 0x7fe9c419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.228+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/431872934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 msgr2=0x7fe9c419d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.228+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c419d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.228+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9c40ff760 msgr2=0x7fe9c419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.228+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9c40ff760 0x7fe9c419d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.228+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/431872934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80095f0 con 0x7fe9c4104aa0 2023-10-05T15:53:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.229+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 0x7fe9c419e660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc007f10 tx=0x7fe9bc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.229+0000 7fe9c17fa700 1 -- 172.21.15.17:0/431872934 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00ddd0 con 0x7fe9c4104aa0 2023-10-05T15:53:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.229+0000 7fe9c17fa700 1 -- 172.21.15.17:0/431872934 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9bc00f040 con 0x7fe9c4104aa0 2023-10-05T15:53:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.229+0000 7fe9c17fa700 1 -- 172.21.15.17:0/431872934 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0059b0 con 0x7fe9c4104aa0 2023-10-05T15:53:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.230+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c419f2d0 con 0x7fe9c4104aa0 2023-10-05T15:53:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.230+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c41a5a90 con 0x7fe9c4104aa0 2023-10-05T15:53:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.236+0000 7fe9de021b80 1 Processor -- start 2023-10-05T15:53:14.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.239+0000 7fe9c17fa700 1 -- 172.21.15.17:0/431872934 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe9bc004ad0 con 0x7fe9c4104aa0 2023-10-05T15:53:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.241+0000 7fe9c17fa700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9ac0a1650 0x7fe9ac0a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.241+0000 7fe9c17fa700 1 -- 172.21.15.17:0/431872934 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe9bc0cc920 con 0x7fe9c4104aa0 2023-10-05T15:53:14.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.242+0000 7fe9c37fe700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9ac0a1650 0x7fe9ac0a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 -- start start 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c95ef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c95f0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c95f7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c9557400 con 0x55a3c95effd0 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c9548bc0 con 0x55a3c95f0990 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9de021b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c95464e0 con 0x55a3c95eeec0 2023-10-05T15:53:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.243+0000 7fe9c37fe700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9ac0a1650 0x7fe9ac0a3b10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800b5c0 tx=0x7fe9b8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.244+0000 7fe9c3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c95ef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.244+0000 7fe9c3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c95ef2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35582/0 (socket says 172.21.15.17:35582) 2023-10-05T15:53:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.244+0000 7fe9c3fff700 1 -- 172.21.15.17:0/4153126019 learned_addr learned my addr 172.21.15.17:0/4153126019 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.244+0000 7fe9c37fe700 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c95f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.244+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c95f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.246+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/4153126019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 msgr2=0x55a3c95ef2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.246+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c95ef2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.246+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/4153126019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 msgr2=0x55a3c95f0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.246+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c95f0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.246+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/4153126019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c936cd80 con 0x55a3c95f0990 2023-10-05T15:53:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.246+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c95f7220 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc099540 tx=0x7fe9bc0991a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=147928a7ead7e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.249+0000 7fe9aa7fc700 1 -- 172.21.15.17:0/4153126019 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc099840 con 0x55a3c95f0990 2023-10-05T15:53:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.249+0000 7fe9aa7fc700 1 -- 172.21.15.17:0/4153126019 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9bc09d990 con 0x55a3c95f0990 2023-10-05T15:53:14.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.249+0000 7fe9aa7fc700 1 -- 172.21.15.17:0/4153126019 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc099aa0 con 0x55a3c95f0990 2023-10-05T15:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.254+0000 7fe9de021b80 1 -- 172.21.15.17:0/4153126019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 msgr2=0x55a3c95f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.254+0000 7fe9de021b80 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c95f7220 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc099540 tx=0x7fe9bc0991a0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 -- 172.21.15.17:0/4153126019 shutdown_connections 2023-10-05T15:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c95f7220 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c95ef2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 --2- 172.21.15.17:0/4153126019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c95f0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 -- 172.21.15.17:0/4153126019 >> 172.21.15.17:0/4153126019 conn(0x55a3c9563200 msgr2=0x55a3c95e9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 -- 172.21.15.17:0/4153126019 shutdown_connections 2023-10-05T15:53:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.260+0000 7fe9de021b80 1 -- 172.21.15.17:0/4153126019 wait complete. 2023-10-05T15:53:14.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.261+0000 7fe9de021b80 1 -- start start 2023-10-05T15:53:14.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.261+0000 7fe9de021b80 1 Processor -- start 2023-10-05T15:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c960a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c96110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c9541dd0 con 0x55a3c95eeec0 2023-10-05T15:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c94de6b0 con 0x55a3c95effd0 2023-10-05T15:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c94de350 con 0x55a3c95f0990 2023-10-05T15:53:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.262+0000 7fe9de021b80 10 client.0 _ll_register_callbacks cb 0x55a3c933b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.263+0000 7fe9c8b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c96110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.263+0000 7fe9c8b9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c96110e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35596/0 (socket says 172.21.15.17:35596) 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.263+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/3561017762 learned_addr learned my addr 172.21.15.17:0/3561017762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 msgr2=0x55a3c960a0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c960a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/3561017762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 msgr2=0x55a3c9609b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/3561017762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c41a5a90 con 0x55a3c95f0990 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c96110e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00dfd0 tx=0x7fe9bc099010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=163e943073ebfffd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:14.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:53:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9a37fe700 1 -- 172.21.15.17:0/3561017762 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0b20d0 con 0x55a3c95f0990 2023-10-05T15:53:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.264+0000 7fe9a37fe700 1 -- 172.21.15.17:0/3561017762 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe9bc099840 con 0x55a3c95f0990 2023-10-05T15:53:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.265+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3c95e1d50 con 0x55a3c95f0990 2023-10-05T15:53:14.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.265+0000 7fe9a37fe700 1 -- 172.21.15.17:0/3561017762 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9bc0a1bd0 con 0x55a3c95f0990 2023-10-05T15:53:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.267+0000 7fe9de021b80 10 client.27307 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:14.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.267+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55a3c9355c00 con 0x55a3c95f0990 2023-10-05T15:53:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.268+0000 7fe9a37fe700 1 -- 172.21.15.17:0/3561017762 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9bc0a5030 con 0x55a3c95f0990 2023-10-05T15:53:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9a37fe700 1 -- 172.21.15.17:0/3561017762 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9bc095730 con 0x55a3c95f0990 2023-10-05T15:53:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9de021b80 10 client.27307 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9de021b80 10 client.27307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9de021b80 20 client.27307 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9de021b80 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c96156a0 0x55a3c9617ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9de021b80 4 client.27307 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:53:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.269+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3c953adb0 con 0x55a3c96156a0 2023-10-05T15:53:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.270+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c96156a0 0x55a3c9617ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.272+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c96156a0 0x55a3c9617ac0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844434b7a2b376c2 server_cookie=98fc0351ae8e542c in_seq=0 out_seq=0 2023-10-05T15:53:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.272+0000 7fe9a37fe700 10 client.27307 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.273+0000 7fe9a37fe700 1 -- 172.21.15.17:0/3561017762 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a3c953adb0 con 0x55a3c96156a0 2023-10-05T15:53:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.273+0000 7fe9a37fe700 10 client.27307 handle_command_reply: tid=0 2023-10-05T15:53:14.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.273+0000 7fe9de021b80 1 client.27307 shutdown 2023-10-05T15:53:14.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.275+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 msgr2=0x55a3c96110e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.275+0000 7fe9de021b80 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c96110e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00dfd0 tx=0x7fe9bc099010 comp rx=0 tx=0).stop 2023-10-05T15:53:14.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 shutdown_connections 2023-10-05T15:53:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9de021b80 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c96156a0 0x55a3c9617ac0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9de021b80 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c96110e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9de021b80 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9de021b80 1 --2- 172.21.15.17:0/3561017762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c960a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 >> 172.21.15.17:0/3561017762 conn(0x55a3c9563200 msgr2=0x55a3c95e9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.277+0000 7fe9a37fe700 0 client.27307 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.278+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 shutdown_connections 2023-10-05T15:53:14.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.278+0000 7fe9de021b80 1 -- 172.21.15.17:0/3561017762 wait complete. 2023-10-05T15:53:14.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.279+0000 7fe9de021b80 20 client.27307 trim_cache size 0 max 16384 2023-10-05T15:53:14.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.309+0000 7fe9de021b80 1 Processor -- start 2023-10-05T15:53:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.310+0000 7fe9de021b80 1 -- start start 2023-10-05T15:53:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.310+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.310+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c9611000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.310+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c9608770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.310+0000 7fe9de021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c93c28c0 con 0x55a3c95eeec0 2023-10-05T15:53:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.310+0000 7fe9de021b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c95e68c0 con 0x55a3c95effd0 2023-10-05T15:53:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.311+0000 7fe9de021b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c95efc30 con 0x55a3c95f0990 2023-10-05T15:53:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.311+0000 7fe9c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c9611000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.311+0000 7fe9c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c9611000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:45466/0 (socket says 172.21.15.17:45466) 2023-10-05T15:53:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.311+0000 7fe9c37fe700 1 -- 172.21.15.17:0/1236877361 learned_addr learned my addr 172.21.15.17:0/1236877361 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.311+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.312+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c9608770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.312+0000 7fe9c3fff700 1 -- 172.21.15.17:0/1236877361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 msgr2=0x55a3c9608770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.312+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c9608770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.312+0000 7fe9c3fff700 1 -- 172.21.15.17:0/1236877361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 msgr2=0x55a3c9611000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.312+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c9611000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.312+0000 7fe9c3fff700 1 -- 172.21.15.17:0/1236877361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3c93931f0 con 0x55a3c95eeec0 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.313+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55a3c9615a80 tx=0x7fe9b4007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b898644c5762ee27 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:14.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.313+0000 7fe9aaffd700 1 -- 172.21.15.17:0/1236877361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4014590 con 0x55a3c95eeec0 2023-10-05T15:53:14.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.313+0000 7fe9aaffd700 1 -- 172.21.15.17:0/1236877361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9b4014b80 con 0x55a3c95eeec0 2023-10-05T15:53:14.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.313+0000 7fe9aaffd700 1 -- 172.21.15.17:0/1236877361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4022b60 con 0x55a3c95eeec0 2023-10-05T15:53:14.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.314+0000 7fe9de021b80 1 -- 172.21.15.17:0/1236877361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 msgr2=0x55a3c9609210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.314+0000 7fe9de021b80 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x55a3c9615a80 tx=0x7fe9b4007be0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.315+0000 7fe9de021b80 1 -- 172.21.15.17:0/1236877361 shutdown_connections 2023-10-05T15:53:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.315+0000 7fe9de021b80 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95f0990 0x55a3c9608770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.315+0000 7fe9de021b80 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95eeec0 0x55a3c9609210 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.315+0000 7fe9de021b80 1 --2- 172.21.15.17:0/1236877361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95effd0 0x55a3c9611000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.315+0000 7fe9de021b80 1 -- 172.21.15.17:0/1236877361 >> 172.21.15.17:0/1236877361 conn(0x55a3c9563200 msgr2=0x55a3c95e9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:14.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.320+0000 7fe9de021b80 1 -- 172.21.15.17:0/1236877361 shutdown_connections 2023-10-05T15:53:14.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.323+0000 7fe9de021b80 1 -- 172.21.15.17:0/1236877361 wait complete. 2023-10-05T15:53:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.324+0000 7fe9de021b80 1 -- start start 2023-10-05T15:53:14.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.324+0000 7fe9de021b80 1 Processor -- start 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c960ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c960d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c9610220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c9610760 con 0x55a3c95effd0 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c96108d0 con 0x55a3c95f0990 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3c9610a90 con 0x55a3c95eeec0 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.325+0000 7fe9de021b80 10 client.0 _ll_register_callbacks cb 0x7fe9b4007240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.326+0000 7fe9c3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c960ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.326+0000 7fe9c3fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c960ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:35622/0 (socket says 172.21.15.17:35622) 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.326+0000 7fe9c3fff700 1 -- 172.21.15.17:0/2531631999 learned_addr learned my addr 172.21.15.17:0/2531631999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:14.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.326+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c9610220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.326+0000 7fe9c37fe700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c960d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/2531631999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 msgr2=0x55a3c960ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c960ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/2531631999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 msgr2=0x55a3c960d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c960d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9c8b9c700 1 -- 172.21.15.17:0/2531631999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b400e040 con 0x55a3c95f0990 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9c8b9c700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c9610220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00d7b0 tx=0x7fe9bc099220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a3b9ae0157bc14f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9a37fe700 1 -- 172.21.15.17:0/2531631999 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0a1bd0 con 0x55a3c95f0990 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9a37fe700 1 -- 172.21.15.17:0/2531631999 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe9bc0a1740 con 0x55a3c95f0990 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.327+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9bc09d990 con 0x55a3c95f0990 2023-10-05T15:53:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.328+0000 7fe9a37fe700 1 -- 172.21.15.17:0/2531631999 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9bc0a1900 con 0x55a3c95f0990 2023-10-05T15:53:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.328+0000 7fe9de021b80 10 client.27392 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.328+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55a3c936b250 con 0x55a3c95f0990 2023-10-05T15:53:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.328+0000 7fe9a37fe700 1 -- 172.21.15.17:0/2531631999 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9bc09d990 con 0x55a3c95f0990 2023-10-05T15:53:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.329+0000 7fe9a37fe700 1 -- 172.21.15.17:0/2531631999 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9bc09cab0 con 0x55a3c95f0990 2023-10-05T15:53:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9de021b80 10 client.27392 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9de021b80 10 client.27392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9de021b80 20 client.27392 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9de021b80 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c967afa0 0x55a3c967d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9de021b80 4 client.27392 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:53:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3c953aad0 con 0x55a3c967afa0 2023-10-05T15:53:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.330+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c967afa0 0x55a3c967d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.331+0000 7fe9c3fff700 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c967afa0 0x55a3c967d3c0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc9247a1fd15538 server_cookie=65934eda3df00973 in_seq=0 out_seq=0 2023-10-05T15:53:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.331+0000 7fe9a37fe700 10 client.27392 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.363+0000 7fe9a37fe700 1 -- 172.21.15.17:0/2531631999 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3c953aad0 con 0x55a3c967afa0 2023-10-05T15:53:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.363+0000 7fe9a37fe700 10 client.27392 handle_command_reply: tid=0 2023-10-05T15:53:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.363+0000 7fe9de021b80 1 client.27392 shutdown 2023-10-05T15:53:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 msgr2=0x55a3c9610220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c9610220 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00d7b0 tx=0x7fe9bc099220 comp rx=0 tx=0).stop 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 shutdown_connections 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55a3c967afa0 0x55a3c967d3c0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3c95f0990 0x55a3c9610220 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3c95eeec0 0x55a3c960ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 --2- 172.21.15.17:0/2531631999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a3c95effd0 0x55a3c960d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.364+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 >> 172.21.15.17:0/2531631999 conn(0x55a3c9563200 msgr2=0x55a3c9608770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.365+0000 7fe9a37fe700 0 client.27392 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.366+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 shutdown_connections 2023-10-05T15:53:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.367+0000 7fe9de021b80 1 -- 172.21.15.17:0/2531631999 wait complete. 2023-10-05T15:53:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.372+0000 7fe9de021b80 20 client.27392 trim_cache size 0 max 16384 2023-10-05T15:53:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:53:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:53:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:53:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:53:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.375+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9ac0a1650 msgr2=0x7fe9ac0a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.375+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9ac0a1650 0x7fe9ac0a3b10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800b5c0 tx=0x7fe9b8005fd0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.375+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 msgr2=0x7fe9c419e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.375+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 0x7fe9c419e660 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc007f10 tx=0x7fe9bc00d3b0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 shutdown_connections 2023-10-05T15:53:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe9ac0a1650 0x7fe9ac0a3b10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9c4104aa0 0x7fe9c419e660 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9c40ff760 0x7fe9c419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 --2- 172.21.15.17:0/431872934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9c41020d0 0x7fe9c419d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 >> 172.21.15.17:0/431872934 conn(0x7fe9c40fb340 msgr2=0x7fe9c4100410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:14.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 shutdown_connections 2023-10-05T15:53:14.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:14.376+0000 7fe9ca5ff700 1 -- 172.21.15.17:0/431872934 wait complete. 2023-10-05T15:53:16.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:16 smithi017 ceph-mon[129107]: pgmap v869: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2023-10-05T15:53:16.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:16 smithi167 ceph-mon[133366]: pgmap v869: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2023-10-05T15:53:16.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:16 smithi079 ceph-mon[132936]: pgmap v869: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2023-10-05T15:53:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 880.0 s, 422.8 tps, lat 236.884 ms stddev 91.415 2023-10-05T15:53:18.356 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:18 smithi079 ceph-mon[132936]: pgmap v870: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 565 op/s 2023-10-05T15:53:18.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:18 smithi017 ceph-mon[129107]: pgmap v870: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 565 op/s 2023-10-05T15:53:18.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:18 smithi167 ceph-mon[133366]: pgmap v870: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 565 op/s 2023-10-05T15:53:20.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:20 smithi079 ceph-mon[132936]: pgmap v871: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 613 op/s 2023-10-05T15:53:20.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:20 smithi017 ceph-mon[129107]: pgmap v871: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 613 op/s 2023-10-05T15:53:20.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:20 smithi167 ceph-mon[133366]: pgmap v871: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 613 op/s 2023-10-05T15:53:22.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:22 smithi079 ceph-mon[132936]: pgmap v872: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 632 op/s 2023-10-05T15:53:22.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:22 smithi017 ceph-mon[129107]: pgmap v872: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 632 op/s 2023-10-05T15:53:22.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:22 smithi167 ceph-mon[133366]: pgmap v872: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 632 op/s 2023-10-05T15:53:23.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 885.0 s, 544.1 tps, lat 183.839 ms stddev 68.745 2023-10-05T15:53:24.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:24 smithi017 ceph-mon[129107]: pgmap v873: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 514 op/s 2023-10-05T15:53:24.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:24 smithi167 ceph-mon[133366]: pgmap v873: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 514 op/s 2023-10-05T15:53:24.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:24 smithi079 ceph-mon[132936]: pgmap v873: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 514 op/s 2023-10-05T15:53:26.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:26 smithi017 ceph-mon[129107]: pgmap v874: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2023-10-05T15:53:26.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:26 smithi167 ceph-mon[133366]: pgmap v874: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2023-10-05T15:53:26.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:26 smithi079 ceph-mon[132936]: pgmap v874: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2023-10-05T15:53:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.643+0000 7f338c7ff700 1 -- 172.21.15.17:0/3561350629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f338410a820 msgr2=0x7f338410ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.643+0000 7f338c7ff700 1 --2- 172.21.15.17:0/3561350629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f338410a820 0x7f338410ccb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f33800098f0 tx=0x7f3380009c00 comp rx=0 tx=0).stop 2023-10-05T15:53:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.648+0000 7f338c7ff700 1 -- 172.21.15.17:0/3561350629 shutdown_connections 2023-10-05T15:53:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.648+0000 7f338c7ff700 1 --2- 172.21.15.17:0/3561350629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f338410d1f0 0x7f338410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.648+0000 7f338c7ff700 1 --2- 172.21.15.17:0/3561350629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3384107eb0 0x7f338410a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.648+0000 7f338c7ff700 1 --2- 172.21.15.17:0/3561350629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f338410a820 0x7f338410ccb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.648+0000 7f338c7ff700 1 -- 172.21.15.17:0/3561350629 >> 172.21.15.17:0/3561350629 conn(0x7f338406dd10 msgr2=0x7f3384070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.648+0000 7f338c7ff700 1 -- 172.21.15.17:0/3561350629 shutdown_connections 2023-10-05T15:53:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.649+0000 7f338c7ff700 1 -- 172.21.15.17:0/3561350629 wait complete. 2023-10-05T15:53:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.651+0000 7f338c7ff700 1 Processor -- start 2023-10-05T15:53:27.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.654+0000 7f338c7ff700 1 -- start start 2023-10-05T15:53:27.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.654+0000 7f338c7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384107eb0 0x7f33841a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.655+0000 7f338c7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 0x7f33841a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.655+0000 7f338c7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f338410d1f0 0x7f33841a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.655+0000 7f338c7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841a7430 con 0x7f338410a820 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.655+0000 7f338c7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841a75a0 con 0x7f3384107eb0 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.655+0000 7f338c7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841a7760 con 0x7f338410d1f0 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.656+0000 7f338a59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384107eb0 0x7f33841a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.656+0000 7f3389d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 0x7f33841a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.656+0000 7f3389d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 0x7f33841a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53842/0 (socket says 172.21.15.17:53842) 2023-10-05T15:53:27.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.656+0000 7f3389d9a700 1 -- 172.21.15.17:0/1925336635 learned_addr learned my addr 172.21.15.17:0/1925336635 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f338410d1f0 0x7f33841a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f3389d9a700 1 -- 172.21.15.17:0/1925336635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f338410d1f0 msgr2=0x7f33841a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f3389d9a700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f338410d1f0 0x7f33841a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f3389d9a700 1 -- 172.21.15.17:0/1925336635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384107eb0 msgr2=0x7f33841a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f3389d9a700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384107eb0 0x7f33841a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f3389d9a700 1 -- 172.21.15.17:0/1925336635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c009d00 con 0x7f338410a820 2023-10-05T15:53:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f338a59b700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384107eb0 0x7f33841a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-05T15:53:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.657+0000 7f3389d9a700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 0x7f33841a5f50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f33800094f0 tx=0x7f338000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.658+0000 7f337b7fe700 1 -- 172.21.15.17:0/1925336635 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005550 con 0x7f338410a820 2023-10-05T15:53:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.658+0000 7f337b7fe700 1 -- 172.21.15.17:0/1925336635 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33800056b0 con 0x7f338410a820 2023-10-05T15:53:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.658+0000 7f337b7fe700 1 -- 172.21.15.17:0/1925336635 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380021a20 con 0x7f338410a820 2023-10-05T15:53:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.658+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3380009520 con 0x7f338410a820 2023-10-05T15:53:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.658+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33841a7c20 con 0x7f338410a820 2023-10-05T15:53:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.665+0000 7f33a0105b80 1 Processor -- start 2023-10-05T15:53:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 -- start start 2023-10-05T15:53:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d8342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 0x55d04d835450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d835990 0x55d04d83c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d79c400 con 0x55d04d835990 2023-10-05T15:53:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d78dbc0 con 0x55d04d834fd0 2023-10-05T15:53:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.666+0000 7f33a0105b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d78b4e0 con 0x55d04d833ec0 2023-10-05T15:53:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 0x55d04d835450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 0x55d04d835450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35246/0 (socket says 172.21.15.17:35246) 2023-10-05T15:53:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 -- 172.21.15.17:0/1067609082 learned_addr learned my addr 172.21.15.17:0/1067609082 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d8342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 -- 172.21.15.17:0/1067609082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 msgr2=0x55d04d8342e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d8342e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 -- 172.21.15.17:0/1067609082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d835990 msgr2=0x55d04d83c220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d835990 0x55d04d83c220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.667+0000 7f338a59b700 1 -- 172.21.15.17:0/1067609082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d04d5b1d80 con 0x55d04d834fd0 2023-10-05T15:53:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.668+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d8342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.668+0000 7f338a59b700 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 0x55d04d835450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3374008d30 tx=0x7f337400e630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f7d8e06fa0fe82 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.669+0000 7f337b7fe700 1 -- 172.21.15.17:0/1925336635 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3380003680 con 0x7f338410a820 2023-10-05T15:53:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.669+0000 7f3378ff9700 1 -- 172.21.15.17:0/1067609082 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374008e80 con 0x55d04d834fd0 2023-10-05T15:53:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.669+0000 7f3378ff9700 1 -- 172.21.15.17:0/1067609082 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3374004cc0 con 0x55d04d834fd0 2023-10-05T15:53:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.669+0000 7f3378ff9700 1 -- 172.21.15.17:0/1067609082 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374010690 con 0x55d04d834fd0 2023-10-05T15:53:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.670+0000 7f33a0105b80 1 -- 172.21.15.17:0/1067609082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 msgr2=0x55d04d835450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.670+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 0x55d04d835450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3374008d30 tx=0x7f337400e630 comp rx=0 tx=0).stop 2023-10-05T15:53:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.671+0000 7f337b7fe700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33700a1650 0x7f33700a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.671+0000 7f337b7fe700 1 -- 172.21.15.17:0/1925336635 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f33800ce680 con 0x7f338410a820 2023-10-05T15:53:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.672+0000 7f33a0105b80 1 -- 172.21.15.17:0/1067609082 shutdown_connections 2023-10-05T15:53:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.672+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d835990 0x55d04d83c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.672+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d8342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.672+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1067609082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d834fd0 0x55d04d835450 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.672+0000 7f33a0105b80 1 -- 172.21.15.17:0/1067609082 >> 172.21.15.17:0/1067609082 conn(0x55d04d7a8200 msgr2=0x55d04d82ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.673+0000 7f33a0105b80 1 -- 172.21.15.17:0/1067609082 shutdown_connections 2023-10-05T15:53:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.673+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33700a1650 0x7f33700a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.674+0000 7f33a0105b80 1 -- 172.21.15.17:0/1067609082 wait complete. 2023-10-05T15:53:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.674+0000 7f33a0105b80 1 -- start start 2023-10-05T15:53:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.675+0000 7f33a0105b80 1 Processor -- start 2023-10-05T15:53:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d833ec0 0x55d04d83dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d83e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33700a1650 0x7f33700a3b10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f337c009fd0 tx=0x7f337c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d835990 0x55d04d845190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d786dd0 con 0x55d04d834fd0 2023-10-05T15:53:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d7236b0 con 0x55d04d833ec0 2023-10-05T15:53:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d723350 con 0x55d04d835990 2023-10-05T15:53:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f33a0105b80 10 client.0 _ll_register_callbacks cb 0x55d04d5807a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f338ad9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d835990 0x55d04d845190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f338ad9c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d835990 0x55d04d845190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:37648/0 (socket says 172.21.15.17:37648) 2023-10-05T15:53:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.676+0000 7f338ad9c700 1 -- 172.21.15.17:0/4019537500 learned_addr learned my addr 172.21.15.17:0/4019537500 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f3389d9a700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d83e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f338a59b700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d833ec0 0x55d04d83dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f3389d9a700 1 -- 172.21.15.17:0/4019537500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d835990 msgr2=0x55d04d845190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f3389d9a700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d835990 0x55d04d845190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f3389d9a700 1 -- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d833ec0 msgr2=0x55d04d83dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f3389d9a700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d833ec0 0x55d04d83dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.677+0000 7f3389d9a700 1 -- 172.21.15.17:0/4019537500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c009150 con 0x55d04d834fd0 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.678+0000 7f3389d9a700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d83e150 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3380005d70 tx=0x7f338009af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca3ab56a7fd7b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.678+0000 7f336dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-10-05T15:53:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.679+0000 7f336dffb700 1 -- 172.21.15.17:0/4019537500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338009bd30 con 0x55d04d834fd0 2023-10-05T15:53:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.679+0000 7f336dffb700 1 -- 172.21.15.17:0/4019537500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f338009b630 con 0x55d04d834fd0 2023-10-05T15:53:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.679+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d04d826d50 con 0x55d04d834fd0 2023-10-05T15:53:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.679+0000 7f336dffb700 1 -- 172.21.15.17:0/4019537500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f338009f780 con 0x55d04d834fd0 2023-10-05T15:53:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.679+0000 7f33a0105b80 10 client.17313 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.679+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f3374008990 con 0x55d04d834fd0 2023-10-05T15:53:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f336dffb700 1 -- 172.21.15.17:0/4019537500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d04d826d50 con 0x55d04d834fd0 2023-10-05T15:53:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f336dffb700 1 -- 172.21.15.17:0/4019537500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33800a34a0 con 0x55d04d834fd0 2023-10-05T15:53:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f33a0105b80 10 client.17313 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f33a0105b80 10 client.17313 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f33a0105b80 20 client.17313 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f33a0105b80 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d849700 0x55d04d84bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f33a0105b80 4 client.17313 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:53:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.680+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d04d77fdb0 con 0x55d04d849700 2023-10-05T15:53:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.681+0000 7f338a59b700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d849700 0x55d04d84bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.684+0000 7f338a59b700 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d849700 0x55d04d84bb20 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514cd629d1cec022 server_cookie=2f39bbd231cd7471 in_seq=0 out_seq=0 2023-10-05T15:53:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.684+0000 7f336dffb700 10 client.17313 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.685+0000 7f336dffb700 1 -- 172.21.15.17:0/4019537500 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d04d77fdb0 con 0x55d04d849700 2023-10-05T15:53:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.685+0000 7f336dffb700 10 client.17313 handle_command_reply: tid=0 2023-10-05T15:53:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.685+0000 7f33a0105b80 1 client.17313 shutdown 2023-10-05T15:53:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.686+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 msgr2=0x55d04d83e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.686+0000 7f33a0105b80 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d83e150 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3380005d70 tx=0x7f338009af90 comp rx=0 tx=0).stop 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 shutdown_connections 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d849700 0x55d04d84bb20 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d835990 0x55d04d845190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d833ec0 0x55d04d83dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 --2- 172.21.15.17:0/4019537500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d83e150 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f336dffb700 0 client.17313 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 >> 172.21.15.17:0/4019537500 conn(0x55d04d7a8200 msgr2=0x55d04d82e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 shutdown_connections 2023-10-05T15:53:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.687+0000 7f33a0105b80 1 -- 172.21.15.17:0/4019537500 wait complete. 2023-10-05T15:53:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.688+0000 7f33a0105b80 20 client.17313 trim_cache size 0 max 16384 2023-10-05T15:53:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.718+0000 7f33a0105b80 1 Processor -- start 2023-10-05T15:53:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.718+0000 7f33a0105b80 1 -- start start 2023-10-05T15:53:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.719+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d833ec0 0x55d04d83c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.719+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d834fd0 0x55d04d8450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.719+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d845960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.719+0000 7f33a0105b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d83d7e0 con 0x55d04d833ec0 2023-10-05T15:53:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.719+0000 7f33a0105b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d6078c0 con 0x55d04d835990 2023-10-05T15:53:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.719+0000 7f33a0105b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d82b860 con 0x55d04d834fd0 2023-10-05T15:53:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.720+0000 7f338ad9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d845960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.720+0000 7f338ad9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d845960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:35260/0 (socket says 172.21.15.17:35260) 2023-10-05T15:53:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.720+0000 7f338ad9c700 1 -- 172.21.15.17:0/1761465901 learned_addr learned my addr 172.21.15.17:0/1761465901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.720+0000 7f3389d9a700 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d834fd0 0x55d04d8450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.720+0000 7f338a59b700 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d833ec0 0x55d04d83c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.721+0000 7f338ad9c700 1 -- 172.21.15.17:0/1761465901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d834fd0 msgr2=0x55d04d8450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.721+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d834fd0 0x55d04d8450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.721+0000 7f338ad9c700 1 -- 172.21.15.17:0/1761465901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d833ec0 msgr2=0x55d04d83c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.721+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d833ec0 0x55d04d83c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.721+0000 7f338ad9c700 1 -- 172.21.15.17:0/1761465901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d04d59ac00 con 0x55d04d835990 2023-10-05T15:53:27.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.722+0000 7f338ad9c700 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d845960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f337c0093b0 tx=0x7f337c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7283916aed7387a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:27.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.722+0000 7f33797fa700 1 -- 172.21.15.17:0/1761465901 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c01d040 con 0x55d04d835990 2023-10-05T15:53:27.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.723+0000 7f33797fa700 1 -- 172.21.15.17:0/1761465901 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f337c00f040 con 0x55d04d835990 2023-10-05T15:53:27.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.723+0000 7f33797fa700 1 -- 172.21.15.17:0/1761465901 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c00e050 con 0x55d04d835990 2023-10-05T15:53:27.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.723+0000 7f33a0105b80 1 -- 172.21.15.17:0/1761465901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 msgr2=0x55d04d845960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.723+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d845960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f337c0093b0 tx=0x7f337c004ad0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 -- 172.21.15.17:0/1761465901 shutdown_connections 2023-10-05T15:53:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d845960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d833ec0 0x55d04d83c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 --2- 172.21.15.17:0/1761465901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d834fd0 0x55d04d8450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 -- 172.21.15.17:0/1761465901 >> 172.21.15.17:0/1761465901 conn(0x55d04d7a8200 msgr2=0x55d04d82eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 -- 172.21.15.17:0/1761465901 shutdown_connections 2023-10-05T15:53:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.724+0000 7f33a0105b80 1 -- 172.21.15.17:0/1761465901 wait complete. 2023-10-05T15:53:27.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.725+0000 7f33a0105b80 1 -- start start 2023-10-05T15:53:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.725+0000 7f33a0105b80 1 Processor -- start 2023-10-05T15:53:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d842b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d8430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d8440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d844620 con 0x55d04d834fd0 2023-10-05T15:53:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d844790 con 0x55d04d835990 2023-10-05T15:53:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04d844950 con 0x55d04d833ec0 2023-10-05T15:53:27.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.726+0000 7f33a0105b80 10 client.0 _ll_register_callbacks cb 0x55d04d5807a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:27.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d842b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338ad9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d8440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d842b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:37670/0 (socket says 172.21.15.17:37670) 2023-10-05T15:53:27.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 -- 172.21.15.17:0/2420294758 learned_addr learned my addr 172.21.15.17:0/2420294758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f3389d9a700 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d8430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 -- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 msgr2=0x55d04d8440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d8440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 -- 172.21.15.17:0/2420294758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 msgr2=0x55d04d8430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d8430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.727+0000 7f338a59b700 1 -- 172.21.15.17:0/2420294758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c016780 con 0x55d04d833ec0 2023-10-05T15:53:27.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.728+0000 7f338a59b700 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d842b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3374008420 tx=0x7f337400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=593df3c6ffa8aea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.728+0000 7f336dffb700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.728+0000 7f336dffb700 1 -- 172.21.15.17:0/2420294758 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337401f040 con 0x55d04d833ec0 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.729+0000 7f336dffb700 1 -- 172.21.15.17:0/2420294758 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3374027d40 con 0x55d04d833ec0 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.729+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3374004cc0 con 0x55d04d833ec0 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.729+0000 7f336dffb700 1 -- 172.21.15.17:0/2420294758 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3374027070 con 0x55d04d833ec0 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.729+0000 7f33a0105b80 10 client.27325 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.729+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55d04d5d81f0 con 0x55d04d833ec0 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f336dffb700 1 -- 172.21.15.17:0/2420294758 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3374004cc0 con 0x55d04d833ec0 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f336dffb700 1 -- 172.21.15.17:0/2420294758 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3374004e30 con 0x55d04d833ec0 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f33a0105b80 10 client.27325 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f33a0105b80 10 client.27325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f33a0105b80 20 client.27325 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f33a0105b80 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d89e1b0 0x55d04d8a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f33a0105b80 4 client.27325 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:53:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.730+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d04d77fad0 con 0x55d04d89e1b0 2023-10-05T15:53:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.733+0000 7f3389d9a700 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d89e1b0 0x55d04d8a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.734+0000 7f3389d9a700 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d89e1b0 0x55d04d8a05a0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2255f029e8af92 server_cookie=19a60b08e1a52790 in_seq=0 out_seq=0 2023-10-05T15:53:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.734+0000 7f336dffb700 10 client.27325 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.763+0000 7f336dffb700 1 -- 172.21.15.17:0/2420294758 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d04d77fad0 con 0x55d04d89e1b0 2023-10-05T15:53:27.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.763+0000 7f336dffb700 10 client.27325 handle_command_reply: tid=0 2023-10-05T15:53:27.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.763+0000 7f33a0105b80 1 client.27325 shutdown 2023-10-05T15:53:27.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.763+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 msgr2=0x55d04d842b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.763+0000 7f33a0105b80 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d842b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3374008420 tx=0x7f337400eee0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 shutdown_connections 2023-10-05T15:53:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f33a0105b80 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55d04d89e1b0 0x55d04d8a05a0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f33a0105b80 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d04d835990 0x55d04d8440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f33a0105b80 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d04d833ec0 0x55d04d842b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f33a0105b80 1 --2- 172.21.15.17:0/2420294758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d04d834fd0 0x55d04d8430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 >> 172.21.15.17:0/2420294758 conn(0x55d04d7a8200 msgr2=0x55d04d83c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.767+0000 7f336dffb700 0 client.27325 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.768+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 shutdown_connections 2023-10-05T15:53:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.768+0000 7f33a0105b80 1 -- 172.21.15.17:0/2420294758 wait complete. 2023-10-05T15:53:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.768+0000 7f33a0105b80 20 client.27325 trim_cache size 0 max 16384 2023-10-05T15:53:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:53:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:53:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:53:27.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:53:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.770+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33700a1650 msgr2=0x7f33700a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.770+0000 7f338c7ff700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33700a1650 0x7f33700a3b10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f337c009fd0 tx=0x7f337c009040 comp rx=0 tx=0).stop 2023-10-05T15:53:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.770+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 msgr2=0x7f33841a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.770+0000 7f338c7ff700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 0x7f33841a5f50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f33800094f0 tx=0x7f338000bc30 comp rx=0 tx=0).stop 2023-10-05T15:53:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.770+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 shutdown_connections 2023-10-05T15:53:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.770+0000 7f338c7ff700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f33700a1650 0x7f33700a3b10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.771+0000 7f338c7ff700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f338410d1f0 0x7f33841a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.771+0000 7f338c7ff700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3384107eb0 0x7f33841a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.771+0000 7f338c7ff700 1 --2- 172.21.15.17:0/1925336635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f338410a820 0x7f33841a5f50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:27.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.771+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 >> 172.21.15.17:0/1925336635 conn(0x7f338406dd10 msgr2=0x7f33841097d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:27.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.771+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 shutdown_connections 2023-10-05T15:53:27.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:27.772+0000 7f338c7ff700 1 -- 172.21.15.17:0/1925336635 wait complete. 2023-10-05T15:53:28.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 890.0 s, 414.4 tps, lat 240.630 ms stddev 90.753 2023-10-05T15:53:28.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:28 smithi167 ceph-mon[133366]: pgmap v875: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 554 op/s 2023-10-05T15:53:28.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:28 smithi079 ceph-mon[132936]: pgmap v875: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 554 op/s 2023-10-05T15:53:28.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:28 smithi017 ceph-mon[129107]: pgmap v875: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 554 op/s 2023-10-05T15:53:30.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:30 smithi079 ceph-mon[132936]: pgmap v876: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 619 op/s 2023-10-05T15:53:30.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:30 smithi017 ceph-mon[129107]: pgmap v876: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 619 op/s 2023-10-05T15:53:30.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:30 smithi167 ceph-mon[133366]: pgmap v876: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 619 op/s 2023-10-05T15:53:32.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:32 smithi079 ceph-mon[132936]: pgmap v877: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 630 op/s 2023-10-05T15:53:32.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:32 smithi017 ceph-mon[129107]: pgmap v877: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 630 op/s 2023-10-05T15:53:32.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:32 smithi167 ceph-mon[133366]: pgmap v877: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 630 op/s 2023-10-05T15:53:33.193 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 895.0 s, 455.6 tps, lat 217.643 ms stddev 77.007 2023-10-05T15:53:34.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:34 smithi017 ceph-mon[129107]: pgmap v878: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.2 MiB/s wr, 561 op/s 2023-10-05T15:53:34.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:34 smithi167 ceph-mon[133366]: pgmap v878: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.2 MiB/s wr, 561 op/s 2023-10-05T15:53:34.606 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:34 smithi079 ceph-mon[132936]: pgmap v878: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.2 MiB/s wr, 561 op/s 2023-10-05T15:53:36.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:36 smithi017 ceph-mon[129107]: pgmap v879: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.7 MiB/s wr, 695 op/s 2023-10-05T15:53:36.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:36 smithi167 ceph-mon[133366]: pgmap v879: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.7 MiB/s wr, 695 op/s 2023-10-05T15:53:36.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:36 smithi079 ceph-mon[132936]: pgmap v879: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.7 MiB/s wr, 695 op/s 2023-10-05T15:53:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 900.0 s, 452.6 tps, lat 224.933 ms stddev 92.901 2023-10-05T15:53:38.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:38 smithi167 ceph-mon[133366]: pgmap v880: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.9 MiB/s wr, 549 op/s 2023-10-05T15:53:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:38 smithi079 ceph-mon[132936]: pgmap v880: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.9 MiB/s wr, 549 op/s 2023-10-05T15:53:38.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:38 smithi017 ceph-mon[129107]: pgmap v880: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.9 MiB/s wr, 549 op/s 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:transaction type: 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:scaling factor: 32 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:query mode: simple 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:number of clients: 100 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:number of threads: 4 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:duration: 900 s 2023-10-05T15:53:38.524 INFO:teuthology.orchestra.run.smithi017.stdout:number of transactions actually processed: 484140 2023-10-05T15:53:38.525 INFO:teuthology.orchestra.run.smithi017.stdout:latency average = 185.832 ms 2023-10-05T15:53:38.525 INFO:teuthology.orchestra.run.smithi017.stdout:latency stddev = 301.540 ms 2023-10-05T15:53:38.525 INFO:teuthology.orchestra.run.smithi017.stdout:tps = 537.734632 (including connections establishing) 2023-10-05T15:53:38.525 INFO:teuthology.orchestra.run.smithi017.stdout:tps = 537.746448 (excluding connections establishing) 2023-10-05T15:53:38.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-10-05T15:53:40.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:40 smithi079 ceph-mon[132936]: pgmap v881: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 609 op/s 2023-10-05T15:53:40.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:40 smithi017 ceph-mon[129107]: pgmap v881: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 609 op/s 2023-10-05T15:53:40.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:40 smithi167 ceph-mon[133366]: pgmap v881: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 609 op/s 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.066+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/3056466985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 msgr2=0x7f3d2410a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.066+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/3056466985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d2410a510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3d140098f0 tx=0x7f3d14009c00 comp rx=0 tx=0).stop 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.067+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/3056466985 shutdown_connections 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.067+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/3056466985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2410d5c0 0x7f3d2410fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.067+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/3056466985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d2410a510 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.067+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/3056466985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 0x7f3d2410cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.067+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/3056466985 >> 172.21.15.17:0/3056466985 conn(0x7f3d2406e0b0 msgr2=0x7f3d24070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.075+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/3056466985 shutdown_connections 2023-10-05T15:53:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.075+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/3056466985 wait complete. 2023-10-05T15:53:41.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.077+0000 7f3d2b3ff700 1 Processor -- start 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.077+0000 7f3d2b3ff700 1 -- start start 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.077+0000 7f3d2b3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d241a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.077+0000 7f3d2b3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 0x7f3d241a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2410d5c0 0x7f3d241a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241a7480 con 0x7f3d2410d5c0 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2b3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241a75f0 con 0x7f3d24108120 2023-10-05T15:53:41.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2b3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241a77b0 con 0x7f3d2410aae0 2023-10-05T15:53:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2899a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 0x7f3d241a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d241a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2899a700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 0x7f3d241a5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39028/0 (socket says 172.21.15.17:39028) 2023-10-05T15:53:41.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.078+0000 7f3d2899a700 1 -- 172.21.15.17:0/1385829101 learned_addr learned my addr 172.21.15.17:0/1385829101 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.080+0000 7f3d2919b700 1 -- 172.21.15.17:0/1385829101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 msgr2=0x7f3d241a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.080+0000 7f3d2919b700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 0x7f3d241a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.080+0000 7f3d2919b700 1 -- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2410d5c0 msgr2=0x7f3d241a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.080+0000 7f3d2919b700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2410d5c0 0x7f3d241a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.080+0000 7f3d2919b700 1 -- 172.21.15.17:0/1385829101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14009520 con 0x7f3d24108120 2023-10-05T15:53:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.080+0000 7f3d2919b700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d241a5a60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000c00 tx=0x7f3d1400b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.081+0000 7f3d1a7fc700 1 -- 172.21.15.17:0/1385829101 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1401c070 con 0x7f3d24108120 2023-10-05T15:53:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.081+0000 7f3d1a7fc700 1 -- 172.21.15.17:0/1385829101 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d1400f7d0 con 0x7f3d24108120 2023-10-05T15:53:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.081+0000 7f3d1a7fc700 1 -- 172.21.15.17:0/1385829101 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14003900 con 0x7f3d24108120 2023-10-05T15:53:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.082+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d241a7a30 con 0x7f3d24108120 2023-10-05T15:53:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.082+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d241a7c80 con 0x7f3d24108120 2023-10-05T15:53:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.090+0000 7f3d3ed1db80 1 Processor -- start 2023-10-05T15:53:41.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 -- start start 2023-10-05T15:53:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789acfd0 0x55b7789ad450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 0x55b7789b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b778914400 con 0x55b7789ad990 2023-10-05T15:53:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b778905bc0 con 0x55b7789abec0 2023-10-05T15:53:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.092+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7789034e0 con 0x55b7789acfd0 2023-10-05T15:53:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.093+0000 7f3d2899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 0x55b7789b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.093+0000 7f3d2899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 0x55b7789b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54956/0 (socket says 172.21.15.17:54956) 2023-10-05T15:53:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.093+0000 7f3d2899a700 1 -- 172.21.15.17:0/4039935589 learned_addr learned my addr 172.21.15.17:0/4039935589 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.094+0000 7f3d2899a700 1 -- 172.21.15.17:0/4039935589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789acfd0 msgr2=0x55b7789ad450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T15:53:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.094+0000 7f3d2899a700 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789acfd0 0x55b7789ad450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.094+0000 7f3d2899a700 1 -- 172.21.15.17:0/4039935589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 msgr2=0x55b7789ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.094+0000 7f3d2899a700 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.094+0000 7f3d2899a700 1 -- 172.21.15.17:0/4039935589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b778729d80 con 0x55b7789ad990 2023-10-05T15:53:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.094+0000 7f3d1a7fc700 1 -- 172.21.15.17:0/1385829101 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f3d14020030 con 0x7f3d24108120 2023-10-05T15:53:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.095+0000 7f3d2899a700 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 0x55b7789b4220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000ac80 tx=0x7f3d2000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ebe8a6cc3fc506 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.095+0000 7f3d0f7fe700 1 -- 172.21.15.17:0/4039935589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000f040 con 0x55b7789ad990 2023-10-05T15:53:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.095+0000 7f3d0f7fe700 1 -- 172.21.15.17:0/4039935589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d20007c30 con 0x55b7789ad990 2023-10-05T15:53:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.095+0000 7f3d0f7fe700 1 -- 172.21.15.17:0/4039935589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20014630 con 0x55b7789ad990 2023-10-05T15:53:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.096+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/4039935589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 msgr2=0x55b7789b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.096+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 0x55b7789b4220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000ac80 tx=0x7f3d2000af90 comp rx=0 tx=0).stop 2023-10-05T15:53:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.096+0000 7f3d1a7fc700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d100a1680 0x7f3d100a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.097+0000 7f3d1a7fc700 1 -- 172.21.15.17:0/1385829101 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3d140ce590 con 0x7f3d24108120 2023-10-05T15:53:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.098+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/4039935589 shutdown_connections 2023-10-05T15:53:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.098+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789ad990 0x55b7789b4220 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.098+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.098+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/4039935589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789acfd0 0x55b7789ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.098+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/4039935589 >> 172.21.15.17:0/4039935589 conn(0x55b778920200 msgr2=0x55b7789a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.099+0000 7f3d2999c700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d100a1680 0x7f3d100a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.100+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/4039935589 shutdown_connections 2023-10-05T15:53:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.100+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/4039935589 wait complete. 2023-10-05T15:53:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.101+0000 7f3d3ed1db80 1 -- start start 2023-10-05T15:53:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.101+0000 7f3d3ed1db80 1 Processor -- start 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789abec0 0x55b7789b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7788fedd0 con 0x55b7789abec0 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77889b6b0 con 0x55b7789acfd0 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77889b350 con 0x55b7789ad990 2023-10-05T15:53:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.102+0000 7f3d3ed1db80 10 client.0 _ll_register_callbacks cb 0x55b7786f87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.103+0000 7f3d2899a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.103+0000 7f3d2899a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50014/0 (socket says 172.21.15.17:50014) 2023-10-05T15:53:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.103+0000 7f3d2899a700 1 -- 172.21.15.17:0/2522466752 learned_addr learned my addr 172.21.15.17:0/2522466752 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:41.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2999c700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2899a700 1 -- 172.21.15.17:0/2522466752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 msgr2=0x55b7789bd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2899a700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2899a700 1 -- 172.21.15.17:0/2522466752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789abec0 msgr2=0x55b7789b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2899a700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789abec0 0x55b7789b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2899a700 1 -- 172.21.15.17:0/2522466752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2000a8b0 con 0x55b7789acfd0 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2999c700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2999c700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d100a1680 0x7f3d100a3b40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55b7789abc60 tx=0x7f3d1c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d2899a700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789b6170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000c010 tx=0x7f3d20005320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e57c3370e45f073 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.104+0000 7f3d0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.105+0000 7f3d0cff9700 1 -- 172.21.15.17:0/2522466752 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000f030 con 0x55b7789acfd0 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.105+0000 7f3d0cff9700 1 -- 172.21.15.17:0/2522466752 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3d20007da0 con 0x55b7789acfd0 2023-10-05T15:53:41.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.105+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b77899ed50 con 0x55b7789acfd0 2023-10-05T15:53:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.106+0000 7f3d0cff9700 1 -- 172.21.15.17:0/2522466752 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d20004030 con 0x55b7789acfd0 2023-10-05T15:53:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.106+0000 7f3d3ed1db80 10 client.27419 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.106+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b778712c00 con 0x55b7789acfd0 2023-10-05T15:53:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.106+0000 7f3d0cff9700 1 -- 172.21.15.17:0/2522466752 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b77899ed50 con 0x55b7789acfd0 2023-10-05T15:53:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d0cff9700 1 -- 172.21.15.17:0/2522466752 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3d20003680 con 0x55b7789acfd0 2023-10-05T15:53:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d3ed1db80 10 client.27419 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d3ed1db80 10 client.27419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d3ed1db80 20 client.27419 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b7789d2900 0x55b7789d4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d3ed1db80 4 client.27419 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-05T15:53:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7788f7db0 con 0x55b7789d2900 2023-10-05T15:53:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.107+0000 7f3d2919b700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b7789d2900 0x55b7789d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.109+0000 7f3d0cff9700 10 client.27419 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.109+0000 7f3d2919b700 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b7789d2900 0x55b7789d4d20 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1eba017610abeed server_cookie=54559358ab243e2f in_seq=0 out_seq=0 2023-10-05T15:53:41.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.110+0000 7f3d0cff9700 1 -- 172.21.15.17:0/2522466752 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7788f7db0 con 0x55b7789d2900 2023-10-05T15:53:41.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.110+0000 7f3d0cff9700 10 client.27419 handle_command_reply: tid=0 2023-10-05T15:53:41.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.110+0000 7f3d3ed1db80 1 client.27419 shutdown 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 msgr2=0x55b7789b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789b6170 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000c010 tx=0x7f3d20005320 comp rx=0 tx=0).stop 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 shutdown_connections 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b7789d2900 0x55b7789d4d20 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789abec0 0x55b7789b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/2522466752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789b6170 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d0cff9700 0 client.27419 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.111+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 >> 172.21.15.17:0/2522466752 conn(0x55b778920200 msgr2=0x55b7789a6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.112+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 shutdown_connections 2023-10-05T15:53:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.112+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/2522466752 wait complete. 2023-10-05T15:53:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.112+0000 7f3d3ed1db80 20 client.27419 trim_cache size 0 max 16384 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 Processor -- start 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 -- start start 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789acfd0 0x55b7789bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b77877f8c0 con 0x55b7789acfd0 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7789a6790 con 0x55b7789abec0 2023-10-05T15:53:41.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.143+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7789a1290 con 0x55b7789ad990 2023-10-05T15:53:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.144+0000 7f3d2999c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.144+0000 7f3d2999c700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789a6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:39044/0 (socket says 172.21.15.17:39044) 2023-10-05T15:53:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.144+0000 7f3d2999c700 1 -- 172.21.15.17:0/1294968564 learned_addr learned my addr 172.21.15.17:0/1294968564 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.144+0000 7f3d2899a700 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789acfd0 0x55b7789bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.144+0000 7f3d2919b700 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.145+0000 7f3d2999c700 1 -- 172.21.15.17:0/1294968564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 msgr2=0x55b7789a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.145+0000 7f3d2999c700 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.145+0000 7f3d2999c700 1 -- 172.21.15.17:0/1294968564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789acfd0 msgr2=0x55b7789bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.145+0000 7f3d2999c700 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789acfd0 0x55b7789bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.145+0000 7f3d2999c700 1 -- 172.21.15.17:0/1294968564 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7787501f0 con 0x55b7789ad990 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.146+0000 7f3d2999c700 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789a6250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0156b0 tx=0x7f3d1c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cbf568e389c5d05 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.146+0000 7f3d0ffff700 1 -- 172.21.15.17:0/1294968564 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c01f5f0 con 0x55b7789ad990 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.146+0000 7f3d0ffff700 1 -- 172.21.15.17:0/1294968564 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d1c00f040 con 0x55b7789ad990 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.146+0000 7f3d0ffff700 1 -- 172.21.15.17:0/1294968564 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c013930 con 0x55b7789ad990 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.147+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1294968564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 msgr2=0x55b7789a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.147+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789a6250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0156b0 tx=0x7f3d1c011000 comp rx=0 tx=0).stop 2023-10-05T15:53:41.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1294968564 shutdown_connections 2023-10-05T15:53:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789a6250 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789abec0 0x55b7789a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1294968564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789acfd0 0x55b7789bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1294968564 >> 172.21.15.17:0/1294968564 conn(0x55b778920200 msgr2=0x55b7789d9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1294968564 shutdown_connections 2023-10-05T15:53:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.148+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1294968564 wait complete. 2023-10-05T15:53:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.149+0000 7f3d3ed1db80 1 -- start start 2023-10-05T15:53:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.149+0000 7f3d3ed1db80 1 Processor -- start 2023-10-05T15:53:41.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789bc530 0x55b7789bc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7789bcef0 con 0x55b7789bc530 2023-10-05T15:53:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7789bd060 con 0x55b7789acfd0 2023-10-05T15:53:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7789bd220 con 0x55b7789ad990 2023-10-05T15:53:41.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.152+0000 7f3d3ed1db80 10 client.0 _ll_register_callbacks cb 0x7f3d2000aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-05T15:53:41.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.153+0000 7f3d2919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.153+0000 7f3d2919b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50042/0 (socket says 172.21.15.17:50042) 2023-10-05T15:53:41.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.153+0000 7f3d2919b700 1 -- 172.21.15.17:0/1533405698 learned_addr learned my addr 172.21.15.17:0/1533405698 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:41.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.153+0000 7f3d2899a700 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.154+0000 7f3d2899a700 1 -- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 msgr2=0x55b7789bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.154+0000 7f3d2899a700 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789bafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.154+0000 7f3d2899a700 1 -- 172.21.15.17:0/1533405698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789bc530 msgr2=0x55b7789bc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.154+0000 7f3d2899a700 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789bc530 0x55b7789bc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.154+0000 7f3d2899a700 1 -- 172.21.15.17:0/1533405698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c0153f0 con 0x55b7789ad990 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.156+0000 7f3d2899a700 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bb520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3d20000be0 tx=0x7f3d20003930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442af131add75954 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.156+0000 7f3d0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.157+0000 7f3d0cff9700 1 -- 172.21.15.17:0/1533405698 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2000f070 con 0x55b7789ad990 2023-10-05T15:53:41.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.157+0000 7f3d0cff9700 1 -- 172.21.15.17:0/1533405698 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f3d20000e40 con 0x55b7789ad990 2023-10-05T15:53:41.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.157+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d20007c30 con 0x55b7789ad990 2023-10-05T15:53:41.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.160+0000 7f3d0cff9700 1 -- 172.21.15.17:0/1533405698 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d20003e20 con 0x55b7789ad990 2023-10-05T15:53:41.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.160+0000 7f3d3ed1db80 10 client.27337 fetch_fsmap learned FSMap version 43 2023-10-05T15:53:41.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.160+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b778728250 con 0x55b7789ad990 2023-10-05T15:53:41.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.160+0000 7f3d0cff9700 1 -- 172.21.15.17:0/1533405698 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d20007c30 con 0x55b7789ad990 2023-10-05T15:53:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.161+0000 7f3d0cff9700 1 -- 172.21.15.17:0/1533405698 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 43) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3d2001fbc0 con 0x55b7789ad990 2023-10-05T15:53:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.161+0000 7f3d3ed1db80 10 client.27337 fetch_fsmap finished waiting for FSMap version 43 2023-10-05T15:53:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.161+0000 7f3d3ed1db80 10 client.27337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-10-05T15:53:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.161+0000 7f3d3ed1db80 20 client.27337 populate_metadata read hostname 'smithi017' 2023-10-05T15:53:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.162+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b778a27820 0x55b778a29c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.162+0000 7f3d3ed1db80 4 client.27337 mds_command: new command op to 24593 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-05T15:53:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.162+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 --> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b7788f7ad0 con 0x55b778a27820 2023-10-05T15:53:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.162+0000 7f3d2919b700 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b778a27820 0x55b778a29c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.163+0000 7f3d2919b700 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b778a27820 0x55b778a29c10 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcaeccb83d4d09b0 server_cookie=c0f5686f5b645380 in_seq=0 out_seq=0 2023-10-05T15:53:41.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.163+0000 7f3d0cff9700 10 client.27337 ms_handle_connect on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:41.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.237+0000 7f3d0cff9700 1 -- 172.21.15.17:0/1533405698 <== mds.0 v2:172.21.15.79:6838/2052945872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b7788f7ad0 con 0x55b778a27820 2023-10-05T15:53:41.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.237+0000 7f3d0cff9700 10 client.27337 handle_command_reply: tid=0 2023-10-05T15:53:41.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 client.27337 shutdown 2023-10-05T15:53:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 msgr2=0x55b7789bb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bb520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3d20000be0 tx=0x7f3d20003930 comp rx=0 tx=0).stop 2023-10-05T15:53:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 shutdown_connections 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:6838/2052945872,v1:172.21.15.79:6839/2052945872] conn(0x55b778a27820 0x55b778a29c10 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b7789bc530 0x55b7789bc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7789acfd0 0x55b7789bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 --2- 172.21.15.17:0/1533405698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7789ad990 0x55b7789bb520 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d0cff9700 0 client.27337 ms_handle_reset on v2:172.21.15.79:6838/2052945872 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 >> 172.21.15.17:0/1533405698 conn(0x55b778920200 msgr2=0x55b7789b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 shutdown_connections 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.238+0000 7f3d3ed1db80 1 -- 172.21.15.17:0/1533405698 wait complete. 2023-10-05T15:53:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.239+0000 7f3d3ed1db80 20 client.27337 trim_cache size 0 max 16384 2023-10-05T15:53:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-10-05T15:53:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-10-05T15:53:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-10-05T15:53:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.239+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d100a1680 msgr2=0x7f3d100a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.239+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d100a1680 0x7f3d100a3b40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x55b7789abc60 tx=0x7f3d1c00b040 comp rx=0 tx=0).stop 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.239+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 msgr2=0x7f3d241a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.239+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d241a5a60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3d14000c00 tx=0x7f3d1400b790 comp rx=0 tx=0).stop 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 shutdown_connections 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f3d100a1680 0x7f3d100a3b40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d2410d5c0 0x7f3d241a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d24108120 0x7f3d241a5a60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 --2- 172.21.15.17:0/1385829101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d2410aae0 0x7f3d241a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 >> 172.21.15.17:0/1385829101 conn(0x7f3d2406e0b0 msgr2=0x7f3d24108d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 shutdown_connections 2023-10-05T15:53:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-10-05T15:53:41.240+0000 7f3d2b3ff700 1 -- 172.21.15.17:0/1385829101 wait complete. 2023-10-05T15:53:42.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:42 smithi017 ceph-mon[129107]: pgmap v882: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.8 MiB/s wr, 639 op/s 2023-10-05T15:53:42.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:42 smithi167 ceph-mon[133366]: pgmap v882: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.8 MiB/s wr, 639 op/s 2023-10-05T15:53:42.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:42 smithi079 ceph-mon[132936]: pgmap v882: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.8 MiB/s wr, 639 op/s 2023-10-05T15:53:44.452 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:44 smithi017 ceph-mon[129107]: pgmap v883: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 575 op/s 2023-10-05T15:53:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:44 smithi167 ceph-mon[133366]: pgmap v883: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 575 op/s 2023-10-05T15:53:44.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:44 smithi079 ceph-mon[132936]: pgmap v883: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 575 op/s 2023-10-05T15:53:45.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:45 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:53:45.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:45 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:53:45.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:45 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:53:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:46 smithi017 ceph-mon[129107]: pgmap v884: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 907 op/s 2023-10-05T15:53:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:46 smithi167 ceph-mon[133366]: pgmap v884: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 907 op/s 2023-10-05T15:53:46.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:46 smithi079 ceph-mon[132936]: pgmap v884: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.5 MiB/s wr, 907 op/s 2023-10-05T15:53:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-10-05T15:53:47.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: Unable to set osd_memory_target on smithi017 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-05T15:53:47.448 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:47 smithi017 ceph-mon[129107]: pgmap v885: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.1 MiB/s wr, 853 op/s 2023-10-05T15:53:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-10-05T15:53:47.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: Unable to set osd_memory_target on smithi017 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-05T15:53:47.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:47 smithi167 ceph-mon[133366]: pgmap v885: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.1 MiB/s wr, 853 op/s 2023-10-05T15:53:47.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:53:47.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-10-05T15:53:47.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: Unable to set osd_memory_target on smithi017 to 232784384: error parsing value: Value '232784384' is below minimum 939524096 2023-10-05T15:53:47.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:47 smithi079 ceph-mon[132936]: pgmap v885: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.1 MiB/s wr, 853 op/s 2023-10-05T15:53:50.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:50 smithi017 ceph-mon[129107]: pgmap v886: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 900 op/s 2023-10-05T15:53:50.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-05T15:53:50.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:50 smithi167 ceph-mon[133366]: pgmap v886: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 900 op/s 2023-10-05T15:53:50.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:50 smithi079 ceph-mon[132936]: pgmap v886: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 900 op/s 2023-10-05T15:53:51.340 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2023-10-05T15:53:51.340 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-10-05T15:53:51.340 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1649367534 Oct 5 15:36 . 2023-10-05T15:53:51.340 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1649367534 Oct 5 15:36 .. 2023-10-05T15:53:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 data 2023-10-05T15:53:51.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2023-10-05T15:53:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:total 41 2023-10-05T15:53:51.341 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 . 2023-10-05T15:53:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1649367534 Oct 5 15:36 .. 2023-10-05T15:53:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 590995597 Oct 5 15:38 base 2023-10-05T15:53:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Oct 5 15:37 current_logfiles 2023-10-05T15:53:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Oct 5 15:37 global 2023-10-05T15:53:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 732 Oct 5 15:37 log 2023-10-05T15:53:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_commit_ts 2023-10-05T15:53:51.343 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_dynshmem 2023-10-05T15:53:51.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 5 15:36 pg_hba.conf 2023-10-05T15:53:51.343 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 5 15:36 pg_ident.conf 2023-10-05T15:53:51.343 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:53 pg_logical 2023-10-05T15:53:51.343 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 pg_multixact 2023-10-05T15:53:51.343 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 pg_notify 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_replslot 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_serial 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_snapshots 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 5 15:53 pg_stat 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 5 15:53 pg_stat_tmp 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:53 pg_subtrans 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_tblspc 2023-10-05T15:53:51.344 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 pg_twophase 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:36 PG_VERSION 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Oct 5 15:53 pg_wal 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:36 pg_xact 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 5 15:36 postgresql.auto.conf 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 5 15:36 postgresql.conf 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Oct 5 15:37 postmaster.opts 2023-10-05T15:53:51.345 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base: 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 590995597 Oct 5 15:38 . 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 1 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 12346 2023-10-05T15:53:51.346 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 576265351 Oct 5 15:39 12347 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:38 pgsql_tmp 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 . 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 590995597 Oct 5 15:38 .. 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 112 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 113 2023-10-05T15:53:51.347 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:37 12182 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12182_fsm 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12182_vm 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12184 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12186 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12187_fsm 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187_vm 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12189 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12191 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12192_fsm 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192_vm 2023-10-05T15:53:51.348 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12194 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12196 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12197_fsm 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197_vm 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12199 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12201 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12202_fsm 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202_vm 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12204 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12206 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207 2023-10-05T15:53:51.349 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12207_fsm 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207_vm 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12209 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12211 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12212 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12214 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12216 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 5 15:37 1247 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1247_fsm 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1247_vm 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 5 15:37 1249 2023-10-05T15:53:51.350 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1249_fsm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1249_vm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 5 15:37 1255 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1255_fsm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1255_vm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 5 15:37 1259 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1259_fsm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1259_vm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 1417 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417_vm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 1418 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418_vm 2023-10-05T15:53:51.351 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 174 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 175 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2187 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2224 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224_vm 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2328 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328_vm 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2336 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336_vm 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2337 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2600 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2600_fsm 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2600_vm 2023-10-05T15:53:51.352 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2601_fsm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601_vm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2602 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2602_fsm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2602_vm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2603 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2603_fsm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2603_vm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2604 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604_vm 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2605 2023-10-05T15:53:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2605_fsm 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2605_vm 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2606_fsm 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606_vm 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607_fsm 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2607_vm 2023-10-05T15:53:51.354 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 5 15:37 2608 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2608_fsm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2608_vm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 5 15:37 2609 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2609_fsm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2609_vm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610_fsm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2610_vm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2611 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611_vm 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612 2023-10-05T15:53:51.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2612_fsm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612_vm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2613 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613_vm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2615_fsm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615_vm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616_fsm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2616_vm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:37 2617 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2617_fsm 2023-10-05T15:53:51.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2617_vm 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 5 15:37 2618 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2618_fsm 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2618_vm 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 5 15:37 2619 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2619_fsm 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2619_vm 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2620 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620_vm 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2650 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2651 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2652 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2653 2023-10-05T15:53:51.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2654 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2655 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2656 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2657 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:37 2658 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2659 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2660 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2661 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2662 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2663 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2664 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2665 2023-10-05T15:53:51.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2666 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2667 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2668 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2669 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2670 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 5 15:37 2673 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 5 15:37 2674 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 5 15:37 2675 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2678 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2679 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2680 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2681 2023-10-05T15:53:51.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2682 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2683 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2684 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2685 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2686 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2687 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2688 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2689 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2690 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 5 15:37 2691 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2692 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2693 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2696 2023-10-05T15:53:51.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2699 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2701 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2702 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2703 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2704 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2753 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2753_fsm 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2753_vm 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2754 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2755 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2756 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2757 2023-10-05T15:53:51.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2830 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830_vm 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2831 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2832 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832_vm 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2833 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2834 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834_vm 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2835 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2836 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836_vm 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2837 2023-10-05T15:53:51.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 5 15:37 2838 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2838_fsm 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2838_vm 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2839 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840_fsm 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2840_vm 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2841 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2995 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995_vm 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2996 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3079_fsm 2023-10-05T15:53:51.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079_vm 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3080 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3081 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3085 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3118 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118_vm 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3119 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3164 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3256 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256_vm 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3257 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3258 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3350 2023-10-05T15:53:51.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350_vm 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3351 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3379 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3380 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3381 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381_vm 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3394 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3394_fsm 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3394_vm 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3395 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3439 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439_vm 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3440 2023-10-05T15:53:51.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 3455 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3456 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3456_fsm 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3456_vm 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3466 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466_vm 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3467 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3468 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3501 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501_vm 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3502 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3503 2023-10-05T15:53:51.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3534 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3541_fsm 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541_vm 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3542 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3574 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3575 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3576 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576_vm 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3596 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596_vm 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3597 2023-10-05T15:53:51.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3598 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598_vm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3599 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3600_fsm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600_vm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3601_fsm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601_vm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3602_fsm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602_vm 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3603 2023-10-05T15:53:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3603_fsm 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3603_vm 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3604 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3605 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3606 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3607 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3608 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 3609 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3712 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3764_fsm 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764_vm 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3766 2023-10-05T15:53:51.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3767 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3997 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 5002 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 548 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 549 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6102 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102_vm 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6104 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104_vm 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6106 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106_vm 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6110 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6111 2023-10-05T15:53:51.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6112 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6113 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6117 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 826 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826_vm 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 827 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 828 2023-10-05T15:53:51.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:37 PG_VERSION 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Oct 5 15:37 . 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 590995597 Oct 5 15:38 .. 2023-10-05T15:53:51.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 112 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 113 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:37 12182 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12182_fsm 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12182_vm 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12184 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12186 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12187_fsm 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187_vm 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12189 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12191 2023-10-05T15:53:51.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12192_fsm 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192_vm 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12194 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12196 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12197_fsm 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197_vm 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12199 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12201 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12202_fsm 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202_vm 2023-10-05T15:53:51.968 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12204 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12206 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12207_fsm 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207_vm 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12209 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12211 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12212 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12214 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12216 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 5 15:37 1247 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1247_fsm 2023-10-05T15:53:51.969 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1247_vm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 5 15:37 1249 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1249_fsm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1249_vm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 5 15:37 1255 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1255_fsm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1255_vm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 5 15:37 1259 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1259_fsm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1259_vm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417_vm 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418 2023-10-05T15:53:51.970 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418_vm 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 174 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 175 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2187 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224_vm 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328_vm 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336_vm 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2337 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2600 2023-10-05T15:53:51.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2600_fsm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2600_vm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2601_fsm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601_vm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2602 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2602_fsm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2602_vm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2603 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2603_fsm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2603_vm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604_vm 2023-10-05T15:53:51.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2605 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2605_fsm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2605_vm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2606_fsm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2606_vm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607_fsm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2607_vm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 5 15:37 2608 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2608_fsm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2608_vm 2023-10-05T15:53:51.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 5 15:37 2609 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2609_fsm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2609_vm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2610_fsm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2610_vm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611_vm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2612_fsm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612_vm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613_vm 2023-10-05T15:53:51.974 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2615_fsm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615_vm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616_fsm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2616_vm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:37 2617 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2617_fsm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2617_vm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 5 15:37 2618 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2618_fsm 2023-10-05T15:53:51.975 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2618_vm 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 5 15:37 2619 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2619_fsm 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2619_vm 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620_vm 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2650 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2651 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2652 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2653 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2654 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2655 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2656 2023-10-05T15:53:51.976 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2657 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:37 2658 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2659 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2660 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2661 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2662 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2663 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2664 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2665 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2666 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2667 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2668 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2669 2023-10-05T15:53:51.977 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2670 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 5 15:37 2673 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 5 15:37 2674 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 5 15:37 2675 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2678 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2679 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2680 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2681 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2682 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2683 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2684 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2685 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2686 2023-10-05T15:53:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2687 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2688 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2689 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2690 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 5 15:37 2691 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2692 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2693 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2696 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2699 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2701 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2702 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2703 2023-10-05T15:53:51.979 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2704 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2753 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2753_fsm 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2753_vm 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2754 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2755 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2756 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2757 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830_vm 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2831 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832_vm 2023-10-05T15:53:51.980 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2833 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834_vm 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2835 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836_vm 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2837 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 5 15:37 2838 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2838_fsm 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2838_vm 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2839 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840_fsm 2023-10-05T15:53:51.981 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2840_vm 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2841 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995_vm 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2996 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3079_fsm 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079_vm 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3080 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3081 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3085 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118_vm 2023-10-05T15:53:51.982 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3119 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3164 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256_vm 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3257 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3258 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350_vm 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3351 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3379 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3380 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381 2023-10-05T15:53:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381_vm 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3394 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3394_fsm 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3394_vm 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3395 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439_vm 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3440 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 3455 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3456 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3456_fsm 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3456_vm 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466 2023-10-05T15:53:51.984 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466_vm 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3467 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3468 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501_vm 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3502 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3503 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3534 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3541_fsm 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541_vm 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3542 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3574 2023-10-05T15:53:51.985 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3575 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576_vm 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596_vm 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3597 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598_vm 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3599 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3600_fsm 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600_vm 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601 2023-10-05T15:53:51.986 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3601_fsm 2023-10-05T15:53:51.987 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601_vm 2023-10-05T15:53:51.987 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602 2023-10-05T15:53:51.987 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3602_fsm 2023-10-05T15:53:51.987 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602_vm 2023-10-05T15:53:51.987 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3603 2023-10-05T15:53:51.989 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3603_fsm 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3603_vm 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3604 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3605 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3606 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3607 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3608 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 3609 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3712 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3764_fsm 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764_vm 2023-10-05T15:53:51.990 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3766 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3767 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3997 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 5002 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 548 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 549 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102_vm 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104_vm 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106_vm 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6110 2023-10-05T15:53:51.991 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6111 2023-10-05T15:53:51.992 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6112 2023-10-05T15:53:51.992 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6113 2023-10-05T15:53:51.992 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6117 2023-10-05T15:53:51.992 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826 2023-10-05T15:53:52.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:52 smithi017 ceph-mon[129107]: pgmap v887: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 881 op/s 2023-10-05T15:53:52.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:53:52.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:53:52.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:53:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:52 smithi167 ceph-mon[133366]: pgmap v887: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 881 op/s 2023-10-05T15:53:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:53:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:53:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:53:52.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:52 smithi079 ceph-mon[132936]: pgmap v887: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 881 op/s 2023-10-05T15:53:52.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:53:52.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:53:52.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826_vm 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 827 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 828 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:37 PG_VERSION 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:total 562761 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 576265351 Oct 5 15:39 . 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 590995597 Oct 5 15:38 .. 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 112 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 113 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:37 12182 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12182_fsm 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12182_vm 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12184 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12186 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187 2023-10-05T15:53:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12187_fsm 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12187_vm 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12189 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12191 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12192_fsm 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12192_vm 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12194 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12196 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12197_fsm 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12197_vm 2023-10-05T15:53:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12199 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12201 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12202_fsm 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12202_vm 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12204 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12206 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 12207_fsm 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12207_vm 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12209 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12211 2023-10-05T15:53:52.615 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12212 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 12214 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 12216 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 5 15:38 1247 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:38 1247_fsm 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 1247_vm 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 5 15:38 1249 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:38 1249_fsm 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 1249_vm 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 5 15:37 1255 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1255_fsm 2023-10-05T15:53:52.616 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1255_vm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 5 15:53 1259 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1259_fsm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 1259_vm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1417_vm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 1418_vm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8986624 Oct 5 15:53 16387 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:53 16387_fsm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:53 16387_vm 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8445952 Oct 5 15:53 16393 2023-10-05T15:53:52.617 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:53 16393_fsm 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:53 16393_vm 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 451715072 Oct 5 15:53 16396 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 5 15:53 16396_fsm 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:53 16396_vm 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 5 15:53 16397 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 237568 Oct 5 15:53 16399 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Oct 5 15:53 16401 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 27107328 Oct 5 15:53 16403 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:53 16403_fsm 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 174 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 175 2023-10-05T15:53:52.618 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2187 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2224_vm 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2328_vm 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2336_vm 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2337 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2600 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2600_fsm 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2600_vm 2023-10-05T15:53:52.619 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2601_fsm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2601_vm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2602 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2602_fsm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2602_vm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2603 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2603_fsm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2603_vm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2604_vm 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2605 2023-10-05T15:53:52.620 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2605_fsm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2605_vm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 2606 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2606_fsm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 2606_vm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2607_fsm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2607_vm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Oct 5 15:38 2608 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:38 2608_fsm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 2608_vm 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 5 15:37 2609 2023-10-05T15:53:52.621 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2609_fsm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2609_vm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:38 2610 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:38 2610_fsm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 2610_vm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2611_vm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2612_fsm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2612_vm 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613 2023-10-05T15:53:52.622 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2613_vm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2615_fsm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2615_vm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2616_fsm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2616_vm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:37 2617 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2617_fsm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2617_vm 2023-10-05T15:53:52.623 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 5 15:37 2618 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2618_fsm 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2618_vm 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Oct 5 15:53 2619 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:53 2619_fsm 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 2619_vm 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2620_vm 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2650 2023-10-05T15:53:52.624 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2651 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2652 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2653 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2654 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2655 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2656 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2657 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Oct 5 15:38 2658 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:38 2659 2023-10-05T15:53:52.625 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2660 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2661 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:38 2662 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:38 2663 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2664 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2665 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2666 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2667 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2668 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2669 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2670 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 5 15:38 2673 2023-10-05T15:53:52.626 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 5 15:38 2674 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 5 15:37 2675 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2678 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2679 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2680 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2681 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2682 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2683 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2684 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2685 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2686 2023-10-05T15:53:52.627 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2687 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:37 2688 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 5 15:37 2689 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 5 15:37 2690 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 5 15:37 2691 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2692 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2693 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:53 2696 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2699 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2701 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2702 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:38 2703 2023-10-05T15:53:52.628 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:38 2704 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2753 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2753_fsm 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2753_vm 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2754 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2755 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2756 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 2757 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2830_vm 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2831 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832 2023-10-05T15:53:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2832_vm 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2833 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2834_vm 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2835 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2836_vm 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2837 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 5 15:37 2838 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2838_fsm 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2838_vm 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2839 2023-10-05T15:53:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2840_fsm 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2840_vm 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2841 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2995_vm 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2996 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3079_fsm 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3079_vm 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3080 2023-10-05T15:53:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3081 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3085 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3118_vm 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3119 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3164 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3256_vm 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3257 2023-10-05T15:53:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3258 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3350_vm 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3351 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3379 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3380 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3381_vm 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3394 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3394_fsm 2023-10-05T15:53:52.637 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3394_vm 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3395 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3439_vm 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3440 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 5 15:38 3455 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3456 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3456_fsm 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3456_vm 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3466_vm 2023-10-05T15:53:52.638 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3467 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3468 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3501_vm 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3502 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3503 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3534 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3541_fsm 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3541_vm 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3542 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3574 2023-10-05T15:53:52.639 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3575 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3576_vm 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3596_vm 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3597 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3598_vm 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3599 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3600_fsm 2023-10-05T15:53:52.640 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3600_vm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3601_fsm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3601_vm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3602_fsm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3602_vm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3603 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3603_fsm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3603_vm 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3604 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3605 2023-10-05T15:53:52.641 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3606 2023-10-05T15:53:52.642 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3607 2023-10-05T15:53:52.642 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3608 2023-10-05T15:53:52.642 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 5 15:37 3609 2023-10-05T15:53:52.642 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3712 2023-10-05T15:53:52.642 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764 2023-10-05T15:53:52.642 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 3764_fsm 2023-10-05T15:53:52.722 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3764_vm 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3766 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 3767 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3997 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 5002 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 548 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 549 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6102_vm 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6104_vm 2023-10-05T15:53:52.723 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6106_vm 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6110 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6111 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6112 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6113 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6117 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 826_vm 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 827 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 828 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:53:52.724 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Oct 5 15:37 pg_internal.init 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 5 15:37 PG_VERSION 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:38 . 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 590995597 Oct 5 15:38 .. 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/global: 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:total 575 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Oct 5 15:37 . 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.725 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1136 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1136_fsm 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1136_vm 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 1137 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1213 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1213_fsm 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1213_vm 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1214 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1214_fsm 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1214_vm 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 1232 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 1233 2023-10-05T15:53:52.726 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1260 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1260_fsm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1260_vm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1261 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1261_fsm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1261_vm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1262 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 1262_fsm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 1262_vm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2396 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 5 15:37 2396_fsm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2396_vm 2023-10-05T15:53:52.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2397 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2671 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2672 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2676 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2677 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2694 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2695 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2697 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:37 2698 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2846 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2846_vm 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2847 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2964 2023-10-05T15:53:52.728 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2964_vm 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2965 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 2966 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 2966_vm 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 2967 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 3592 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 3592_vm 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 3593 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 4060 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 4060_vm 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 4061 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6000 2023-10-05T15:53:52.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6000_vm 2023-10-05T15:53:52.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6001 2023-10-05T15:53:52.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6002 2023-10-05T15:53:52.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 6100 2023-10-05T15:53:52.806 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:37 6100_vm 2023-10-05T15:53:52.806 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6114 2023-10-05T15:53:52.806 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 6115 2023-10-05T15:53:52.806 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:53 pg_control 2023-10-05T15:53:52.806 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 5 15:37 pg_filenode.map 2023-10-05T15:53:52.806 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Oct 5 15:37 pg_internal.init 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/log: 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 732 Oct 5 15:37 . 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 804 Oct 5 15:53 postgresql-Thu.log 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.807 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:53 . 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 mappings 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:53 replorigin_checkpoint 2023-10-05T15:53:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 snapshots 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:53 .. 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 5 15:53 .. 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-05T15:53:52.809 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 . 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 members 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 offsets 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 . 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 .. 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 0000 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:36 . 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 5 15:36 .. 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:38 0000 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 . 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 5 15:37 0000 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.811 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-05T15:53:52.812 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.812 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.960 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:total 14 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 5 15:53 . 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Oct 5 15:53 db_0.stat 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Oct 5 15:53 db_12347.stat 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Oct 5 15:53 global.stat 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 5 15:53 . 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.961 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:total 105 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:53 . 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 5 15:53 0007 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:total 1032194 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Oct 5 15:53 . 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 000000010000000000000097 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 000000010000000000000098 2023-10-05T15:53:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 000000010000000000000099 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 00000001000000000000009A 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 00000001000000000000009B 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 00000001000000000000009C 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 00000001000000000000009D 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 00000001000000000000009E 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 00000001000000000000009F 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 0000000100000000000000A0 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 0000000100000000000000A1 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 0000000100000000000000A2 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A3 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A4 2023-10-05T15:53:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A5 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A6 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A7 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A8 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000A9 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:52 0000000100000000000000AA 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:53 0000000100000000000000AB 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:53 0000000100000000000000AC 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:53 0000000100000000000000AD 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:53 0000000100000000000000AE 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:53 0000000100000000000000AF 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B0 2023-10-05T15:53:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B1 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B2 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B3 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B4 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B5 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B6 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:46 0000000100000000000000B7 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:48 0000000100000000000000B8 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:47 0000000100000000000000B9 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:48 0000000100000000000000BA 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:48 0000000100000000000000BB 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:47 0000000100000000000000BC 2023-10-05T15:53:52.966 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000BD 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000BE 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000BF 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000C0 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000C1 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000C2 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 0000000100000000000000C3 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000C4 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000C5 2023-10-05T15:53:52.967 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000C6 2023-10-05T15:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000C7 2023-10-05T15:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000C8 2023-10-05T15:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:51 0000000100000000000000C9 2023-10-05T15:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000CA 2023-10-05T15:53:52.971 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000CB 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000CC 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:48 0000000100000000000000CD 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000CE 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000CF 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000D0 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000D1 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:49 0000000100000000000000D2 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000D3 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000D4 2023-10-05T15:53:52.972 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 5 15:50 0000000100000000000000D5 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 archive_status 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 5 15:36 . 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Oct 5 15:53 .. 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:total 121 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:36 . 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1648854909 Oct 5 15:53 .. 2023-10-05T15:53:52.973 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 5 15:53 0000 2023-10-05T15:53:52.977 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-05T15:53:52.987 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:53:52.998 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-05T15:53:53.008 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-05T15:53:53.008 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-05T15:53:53.008 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-05T15:53:53.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 -- 172.21.15.17:0/4162965841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 msgr2=0x7f97401012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 --2- 172.21.15.17:0/4162965841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f97401012c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f973c009990 tx=0x7f973c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 -- 172.21.15.17:0/4162965841 shutdown_connections 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 --2- 172.21.15.17:0/4162965841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 0x7f9740109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 --2- 172.21.15.17:0/4162965841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f97401012c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 --2- 172.21.15.17:0/4162965841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9740102080 0x7f9740102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 -- 172.21.15.17:0/4162965841 >> 172.21.15.17:0/4162965841 conn(0x7f97400fc420 msgr2=0x7f97400fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:53.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 -- 172.21.15.17:0/4162965841 shutdown_connections 2023-10-05T15:53:53.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.321+0000 7f97483ff700 1 -- 172.21.15.17:0/4162965841 wait complete. 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.322+0000 7f97483ff700 1 Processor -- start 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 -- start start 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f9740196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9740102080 0x7f9740197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 0x7f974019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974019e650 con 0x7f9740100ea0 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974019e790 con 0x7f9740102a40 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f97483ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974019e920 con 0x7f9740102080 2023-10-05T15:53:53.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f974619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f9740196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f974619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f9740196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46248/0 (socket says 172.21.15.17:46248) 2023-10-05T15:53:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f974619b700 1 -- 172.21.15.17:0/615222308 learned_addr learned my addr 172.21.15.17:0/615222308 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f974599a700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9740102080 0x7f9740197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.323+0000 7f974699c700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 0x7f974019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974619b700 1 -- 172.21.15.17:0/615222308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9740102080 msgr2=0x7f9740197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974619b700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9740102080 0x7f9740197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974619b700 1 -- 172.21.15.17:0/615222308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 msgr2=0x7f974019e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974619b700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 0x7f974019e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974619b700 1 -- 172.21.15.17:0/615222308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0095f0 con 0x7f9740100ea0 2023-10-05T15:53:53.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974699c700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 0x7f974019e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f974619b700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f9740196b20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f973c0059d0 tx=0x7f973c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c01d070 con 0x7f9740100ea0 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f973c00be30 con 0x7f9740100ea0 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974019eba0 con 0x7f9740100ea0 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c00fe20 con 0x7f9740100ea0 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.324+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974019f0a0 con 0x7f9740100ea0 2023-10-05T15:53:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.325+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97401085e0 con 0x7f9740100ea0 2023-10-05T15:53:53.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.327+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f973c00f5f0 con 0x7f9740100ea0 2023-10-05T15:53:53.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.329+0000 7f97377fe700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f972c0a1550 0x7f972c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.329+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f973c0ce300 con 0x7f9740100ea0 2023-10-05T15:53:53.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.329+0000 7f974599a700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f972c0a1550 0x7f972c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.329+0000 7f974599a700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f972c0a1550 0x7f972c0a3a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9740100bc0 tx=0x7f9730009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:53.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.332+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f973c0975f0 con 0x7f9740100ea0 2023-10-05T15:53:53.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.546+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f974010c5c0 con 0x7f9740100ea0 2023-10-05T15:53:53.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.547+0000 7f97377fe700 1 -- 172.21.15.17:0/615222308 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7f973c09ac10 con 0x7f9740100ea0 2023-10-05T15:53:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:53.550 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:53:53.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f972c0a1550 msgr2=0x7f972c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f972c0a1550 0x7f972c0a3a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9740100bc0 tx=0x7f9730009260 comp rx=0 tx=0).stop 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 msgr2=0x7f9740196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f9740196b20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f973c0059d0 tx=0x7f973c0057c0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 shutdown_connections 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f972c0a1550 0x7f972c0a3a10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9740102a40 0x7f974019e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9740100ea0 0x7f9740196b20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 --2- 172.21.15.17:0/615222308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9740102080 0x7f9740197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 >> 172.21.15.17:0/615222308 conn(0x7f97400fc420 msgr2=0x7f9740105720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 shutdown_connections 2023-10-05T15:53:53.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.550+0000 7f97483ff700 1 -- 172.21.15.17:0/615222308 wait complete. 2023-10-05T15:53:53.570 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:53:53.571 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:53:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/1045673111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 msgr2=0x7fb9a4102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/1045673111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4102500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb998009990 tx=0x7fb998009ca0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/1045673111 shutdown_connections 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/1045673111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a4102a40 0x7fb9a4109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/1045673111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9a4100ea0 0x7fb9a41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/1045673111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4102500 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/1045673111 >> 172.21.15.17:0/1045673111 conn(0x7fb9a40fc460 msgr2=0x7fb9a40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/1045673111 shutdown_connections 2023-10-05T15:53:53.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.776+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/1045673111 wait complete. 2023-10-05T15:53:53.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.777+0000 7fb9aa3ff700 1 Processor -- start 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.777+0000 7fb9aa3ff700 1 -- start start 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9aa3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9a4100ea0 0x7fb9a4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9aa3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9aa3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a4102a40 0x7fb9a41a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9aa3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41a0880 con 0x7fb9a4100ea0 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9aa3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41a09f0 con 0x7fb9a4102080 2023-10-05T15:53:53.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9aa3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41a0bb0 con 0x7fb9a4102a40 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9a3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9a4100ea0 0x7fb9a4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:53320/0 (socket says 172.21.15.17:53320) 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9a37fe700 1 -- 172.21.15.17:0/3036983862 learned_addr learned my addr 172.21.15.17:0/3036983862 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.778+0000 7fb9a899c700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a4102a40 0x7fb9a41a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a37fe700 1 -- 172.21.15.17:0/3036983862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a4102a40 msgr2=0x7fb9a41a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a37fe700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a4102a40 0x7fb9a41a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a37fe700 1 -- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9a4100ea0 msgr2=0x7fb9a4198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a37fe700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9a4100ea0 0x7fb9a4198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a37fe700 1 -- 172.21.15.17:0/3036983862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980095f0 con 0x7fb9a4102080 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a37fe700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4199280 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb998006010 tx=0x7fb9980057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99801d070 con 0x7fb9a4102080 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb99800beb0 con 0x7fb9a4102080 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99800fe20 con 0x7fb9a4102080 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a41a0e30 con 0x7fb9a4102080 2023-10-05T15:53:53.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.779+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a41a11d0 con 0x7fb9a4102080 2023-10-05T15:53:53.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.780+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a410c5c0 con 0x7fb9a4102080 2023-10-05T15:53:53.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.782+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fb99800f460 con 0x7fb9a4102080 2023-10-05T15:53:53.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.784+0000 7fb9a17fa700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb98c0a1500 0x7fb98c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:53.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.784+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fb9980ce3e0 con 0x7fb9a4102080 2023-10-05T15:53:53.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.784+0000 7fb9a3fff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb98c0a1500 0x7fb98c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:53.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.784+0000 7fb9a3fff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb98c0a1500 0x7fb98c0a39c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb9a419a210 tx=0x7fb994009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.788+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb9980976d0 con 0x7fb9a4102080 2023-10-05T15:53:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.998+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9a41a13f0 con 0x7fb9a4102080 2023-10-05T15:53:54.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:53.999+0000 7fb9a17fa700 1 -- 172.21.15.17:0/3036983862 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb99809acf0 con 0x7fb9a4102080 2023-10-05T15:53:54.001 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:53:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb98c0a1500 msgr2=0x7fb98c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb98c0a1500 0x7fb98c0a39c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb9a419a210 tx=0x7fb994009260 comp rx=0 tx=0).stop 2023-10-05T15:53:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 msgr2=0x7fb9a4199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4199280 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb998006010 tx=0x7fb9980057c0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 shutdown_connections 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fb98c0a1500 0x7fb98c0a39c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9a4102a40 0x7fb9a41a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9a4100ea0 0x7fb9a4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.001+0000 7fb9aa3ff700 1 --2- 172.21.15.17:0/3036983862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9a4102080 0x7fb9a4199280 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.002+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 >> 172.21.15.17:0/3036983862 conn(0x7fb9a40fc460 msgr2=0x7fb9a40fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.002+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 shutdown_connections 2023-10-05T15:53:54.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.002+0000 7fb9aa3ff700 1 -- 172.21.15.17:0/3036983862 wait complete. 2023-10-05T15:53:54.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:53:54.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.225+0000 7f286ffff700 1 -- 172.21.15.17:0/4246339695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870101f50 msgr2=0x7f28701023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.225+0000 7f286ffff700 1 --2- 172.21.15.17:0/4246339695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870101f50 0x7f28701023b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f28640098f0 tx=0x7f2864009c00 comp rx=0 tx=0).stop 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.225+0000 7f286ffff700 1 -- 172.21.15.17:0/4246339695 shutdown_connections 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.225+0000 7f286ffff700 1 --2- 172.21.15.17:0/4246339695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28701028f0 0x7f28701091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.226+0000 7f286ffff700 1 --2- 172.21.15.17:0/4246339695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870100d60 0x7f2870101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.226+0000 7f286ffff700 1 --2- 172.21.15.17:0/4246339695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2870101f50 0x7f28701023b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.226+0000 7f286ffff700 1 -- 172.21.15.17:0/4246339695 >> 172.21.15.17:0/4246339695 conn(0x7f28700fc2f0 msgr2=0x7f28700fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.226+0000 7f286ffff700 1 -- 172.21.15.17:0/4246339695 shutdown_connections 2023-10-05T15:53:54.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.226+0000 7f286ffff700 1 -- 172.21.15.17:0/4246339695 wait complete. 2023-10-05T15:53:54.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 Processor -- start 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 -- start start 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 0x7f2870074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 0x7f28700732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28701028f0 0x7f28700737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870073f80 con 0x7f2870101f50 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700740f0 con 0x7f2870100d60 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286ffff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701a0900 con 0x7f28701028f0 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 0x7f28700732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.227+0000 7f286effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 0x7f2870074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 0x7f28700732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59820/0 (socket says 172.21.15.17:59820) 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 -- 172.21.15.17:0/2202408525 learned_addr learned my addr 172.21.15.17:0/2202408525 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 0x7f2870074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39418/0 (socket says 172.21.15.17:39418) 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286f7fe700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28701028f0 0x7f28700737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 -- 172.21.15.17:0/2202408525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28701028f0 msgr2=0x7f28700737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28701028f0 0x7f28700737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 -- 172.21.15.17:0/2202408525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 msgr2=0x7f2870074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 0x7f2870074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 -- 172.21.15.17:0/2202408525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009520 con 0x7f2870101f50 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286effd700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 0x7f2870074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286e7fc700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 0x7f28700732a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2864005e90 tx=0x7f286400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400f7d0 con 0x7f2870101f50 2023-10-05T15:53:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28701a0b80 con 0x7f2870101f50 2023-10-05T15:53:54.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28640054d0 con 0x7f2870101f50 2023-10-05T15:53:54.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.228+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864020410 con 0x7f2870101f50 2023-10-05T15:53:54.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.229+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28701a1000 con 0x7f2870101f50 2023-10-05T15:53:54.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.230+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28701082a0 con 0x7f2870101f50 2023-10-05T15:53:54.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.231+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f28640046d0 con 0x7f2870101f50 2023-10-05T15:53:54.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.233+0000 7f28749fd700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28580a1520 0x7f28580a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.233+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f28640cdfc0 con 0x7f2870101f50 2023-10-05T15:53:54.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.233+0000 7f286effd700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28580a1520 0x7f28580a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.234+0000 7f286effd700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28580a1520 0x7f28580a39e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2870101db0 tx=0x7f2860009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:54.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.237+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f28640972b0 con 0x7f2870101f50 2023-10-05T15:53:54.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:54 smithi017 ceph-mon[129107]: pgmap v888: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 760 op/s 2023-10-05T15:53:54.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:54 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/615222308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:53:54.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:54 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3036983862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:53:54.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.452+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f287002d180 con 0x7f2870101f50 2023-10-05T15:53:54.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.452+0000 7f28749fd700 1 -- 172.21.15.17:0/2202408525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f286409a8d0 con 0x7f2870101f50 2023-10-05T15:53:54.454 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28580a1520 msgr2=0x7f28580a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28580a1520 0x7f28580a39e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2870101db0 tx=0x7f2860009310 comp rx=0 tx=0).stop 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 msgr2=0x7f28700732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 0x7f28700732a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2864005e90 tx=0x7f286400b810 comp rx=0 tx=0).stop 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 shutdown_connections 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f28580a1520 0x7f28580a39e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28701028f0 0x7f28700737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2870100d60 0x7f2870074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 --2- 172.21.15.17:0/2202408525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2870101f50 0x7f28700732a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 >> 172.21.15.17:0/2202408525 conn(0x7f28700fc2f0 msgr2=0x7f28701053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 shutdown_connections 2023-10-05T15:53:54.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.455+0000 7f286ffff700 1 -- 172.21.15.17:0/2202408525 wait complete. 2023-10-05T15:53:54.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:53:54.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:54 smithi167 ceph-mon[133366]: pgmap v888: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 760 op/s 2023-10-05T15:53:54.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:54 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/615222308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:53:54.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:54 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3036983862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:53:54.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:54 smithi079 ceph-mon[132936]: pgmap v888: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 760 op/s 2023-10-05T15:53:54.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:54 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/615222308' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:53:54.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:54 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3036983862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:53:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 -- 172.21.15.17:0/2346731545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 msgr2=0x7ff45c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 --2- 172.21.15.17:0/2346731545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c1024f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff444009990 tx=0x7ff444009ca0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 -- 172.21.15.17:0/2346731545 shutdown_connections 2023-10-05T15:53:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 --2- 172.21.15.17:0/2346731545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c102a30 0x7ff45c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 --2- 172.21.15.17:0/2346731545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff45c100e90 0x7ff45c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 --2- 172.21.15.17:0/2346731545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c1024f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 -- 172.21.15.17:0/2346731545 >> 172.21.15.17:0/2346731545 conn(0x7ff45c0fc430 msgr2=0x7ff45c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 -- 172.21.15.17:0/2346731545 shutdown_connections 2023-10-05T15:53:54.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.679+0000 7ff4609ff700 1 -- 172.21.15.17:0/2346731545 wait complete. 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.680+0000 7ff4609ff700 1 Processor -- start 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.680+0000 7ff4609ff700 1 -- start start 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff4609ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c100e90 0x7ff45c196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff4609ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff4609ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff45c102a30 0x7ff45c19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff4609ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c19e6d0 con 0x7ff45c100e90 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff4609ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c19e810 con 0x7ff45c102070 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff4609ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c19e9a0 con 0x7ff45c102a30 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c100e90 0x7ff45c196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45ad9d700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff45c102a30 0x7ff45c19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39430/0 (socket says 172.21.15.17:39430) 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 -- 172.21.15.17:0/3503278524 learned_addr learned my addr 172.21.15.17:0/3503278524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 -- 172.21.15.17:0/3503278524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff45c102a30 msgr2=0x7ff45c19e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff45c102a30 0x7ff45c19e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 -- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c100e90 msgr2=0x7ff45c196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c100e90 0x7ff45c196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45a59c700 1 -- 172.21.15.17:0/3503278524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440095f0 con 0x7ff45c102070 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.681+0000 7ff45259c700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c100e90 0x7ff45c196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.682+0000 7ff45a59c700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c197090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff444005910 tx=0x7ff444005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.682+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44401d070 con 0x7ff45c102070 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.682+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff44400bdb0 con 0x7ff45c102070 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.682+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c19ec20 con 0x7ff45c102070 2023-10-05T15:53:54.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.682+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444022d40 con 0x7ff45c102070 2023-10-05T15:53:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.682+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c19f0a0 con 0x7ff45c102070 2023-10-05T15:53:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.683+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c107f80 con 0x7ff45c102070 2023-10-05T15:53:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.685+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7ff444022470 con 0x7ff45c102070 2023-10-05T15:53:54.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.686+0000 7ff453fff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4480a1500 0x7ff4480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:54.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.687+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7ff4440ce700 con 0x7ff45c102070 2023-10-05T15:53:54.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.687+0000 7ff45259c700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4480a1500 0x7ff4480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.687+0000 7ff45259c700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4480a1500 0x7ff4480a39c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff45c101be0 tx=0x7ff44c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.690+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff4440979f0 con 0x7ff45c102070 2023-10-05T15:53:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.902+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff45c10c790 con 0x7ff45c102070 2023-10-05T15:53:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.902+0000 7ff453fff700 1 -- 172.21.15.17:0/3503278524 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff444027020 con 0x7ff45c102070 2023-10-05T15:53:54.904 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:53:54.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.904+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4480a1500 msgr2=0x7ff4480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.904+0000 7ff4609ff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4480a1500 0x7ff4480a39c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff45c101be0 tx=0x7ff44c009260 comp rx=0 tx=0).stop 2023-10-05T15:53:54.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.904+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 msgr2=0x7ff45c197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.904+0000 7ff4609ff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c197090 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff444005910 tx=0x7ff444005740 comp rx=0 tx=0).stop 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 shutdown_connections 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7ff4480a1500 0x7ff4480a39c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff45c102a30 0x7ff45c19e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff45c100e90 0x7ff45c196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 --2- 172.21.15.17:0/3503278524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff45c102070 0x7ff45c197090 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 >> 172.21.15.17:0/3503278524 conn(0x7ff45c0fc430 msgr2=0x7ff45c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 shutdown_connections 2023-10-05T15:53:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:54.905+0000 7ff4609ff700 1 -- 172.21.15.17:0/3503278524 wait complete. 2023-10-05T15:53:54.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 -- 172.21.15.17:0/1993491047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102070 msgr2=0x7f004c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 --2- 172.21.15.17:0/1993491047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102070 0x7f004c1024f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f00400098f0 tx=0x7f0040009c00 comp rx=0 tx=0).stop 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 -- 172.21.15.17:0/1993491047 shutdown_connections 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 --2- 172.21.15.17:0/1993491047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102a30 0x7f004c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 --2- 172.21.15.17:0/1993491047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 --2- 172.21.15.17:0/1993491047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102070 0x7f004c1024f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 -- 172.21.15.17:0/1993491047 >> 172.21.15.17:0/1993491047 conn(0x7f004c0fc430 msgr2=0x7f004c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:55.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 -- 172.21.15.17:0/1993491047 shutdown_connections 2023-10-05T15:53:55.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.130+0000 7f0051fff700 1 -- 172.21.15.17:0/1993491047 wait complete. 2023-10-05T15:53:55.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 Processor -- start 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 -- start start 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102070 0x7f004c1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102a30 0x7f004c19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19e710 con 0x7f004c100e90 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19e850 con 0x7f004c102a30 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.131+0000 7f0051fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19e9e0 con 0x7f004c102070 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102070 0x7f004c1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59848/0 (socket says 172.21.15.17:59848) 2023-10-05T15:53:55.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004b7fe700 1 -- 172.21.15.17:0/751916674 learned_addr learned my addr 172.21.15.17:0/751916674 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004bfff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102a30 0x7f004c19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 -- 172.21.15.17:0/751916674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102a30 msgr2=0x7f004c19e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102a30 0x7f004c19e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 -- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 msgr2=0x7f004c196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 -- 172.21.15.17:0/751916674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0095f0 con 0x7f004c102070 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004b7fe700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004bfff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102a30 0x7f004c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.132+0000 7f004affd700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102070 0x7f004c1970d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0040000c00 tx=0x7f004000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.133+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004001c070 con 0x7f004c102070 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.133+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f004000f7b0 con 0x7f004c102070 2023-10-05T15:53:55.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.133+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400038e0 con 0x7f004c102070 2023-10-05T15:53:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.133+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040009520 con 0x7f004c102070 2023-10-05T15:53:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.133+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c19eea0 con 0x7f004c102070 2023-10-05T15:53:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.134+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c1081f0 con 0x7f004c102070 2023-10-05T15:53:55.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.136+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0040020070 con 0x7f004c102070 2023-10-05T15:53:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.137+0000 7f0048ff9700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00340a1500 0x7f00340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.137+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f00400cdd50 con 0x7f004c102070 2023-10-05T15:53:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.137+0000 7f004b7fe700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00340a1500 0x7f00340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.138+0000 7f004b7fe700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00340a1500 0x7f00340a39c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f003c005950 tx=0x7f003c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:55.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.140+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f00400970d0 con 0x7f004c102070 2023-10-05T15:53:55.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:55 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2202408525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:53:55.196 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:55 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3503278524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:53:55.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.349+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f004c02d090 con 0x7f004c102070 2023-10-05T15:53:55.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.350+0000 7f0048ff9700 1 -- 172.21.15.17:0/751916674 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f004009a6f0 con 0x7f004c102070 2023-10-05T15:53:55.352 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00340a1500 msgr2=0x7f00340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00340a1500 0x7f00340a39c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f003c005950 tx=0x7f003c009310 comp rx=0 tx=0).stop 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102070 msgr2=0x7f004c1970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102070 0x7f004c1970d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0040000c00 tx=0x7f004000b790 comp rx=0 tx=0).stop 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 shutdown_connections 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f00340a1500 0x7f00340a39c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f004c102a30 0x7f004c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f004c100e90 0x7f004c196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 --2- 172.21.15.17:0/751916674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f004c102070 0x7f004c1970d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 >> 172.21.15.17:0/751916674 conn(0x7f004c0fc430 msgr2=0x7f004c105330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 shutdown_connections 2023-10-05T15:53:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.352+0000 7f0051fff700 1 -- 172.21.15.17:0/751916674 wait complete. 2023-10-05T15:53:55.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-05T15:53:55.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 -- 172.21.15.17:0/43587692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941030f0 msgr2=0x7f4194103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 --2- 172.21.15.17:0/43587692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941030f0 0x7f4194103510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f41900099c0 tx=0x7f4190009cd0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 -- 172.21.15.17:0/43587692 shutdown_connections 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 --2- 172.21.15.17:0/43587692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4194104c80 0x7f419410b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 --2- 172.21.15.17:0/43587692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941030f0 0x7f4194103510 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 --2- 172.21.15.17:0/43587692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41941042e0 0x7f4194104740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.573+0000 7f419c3ff700 1 -- 172.21.15.17:0/43587692 >> 172.21.15.17:0/43587692 conn(0x7f41940fe6a0 msgr2=0x7f4194100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.574+0000 7f419c3ff700 1 -- 172.21.15.17:0/43587692 shutdown_connections 2023-10-05T15:53:55.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.574+0000 7f419c3ff700 1 -- 172.21.15.17:0/43587692 wait complete. 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.575+0000 7f419c3ff700 1 Processor -- start 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.575+0000 7f419c3ff700 1 -- start start 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419c3ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 0x7f4194198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419c3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941042e0 0x7f4194199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419c3ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194104c80 0x7f41941a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419c3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41941a0830 con 0x7f41941042e0 2023-10-05T15:53:55.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419c3ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41941a09a0 con 0x7f41941030f0 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419c3ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41941a0b60 con 0x7f4194104c80 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 0x7f4194198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941042e0 0x7f4194199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 0x7f4194198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:39474/0 (socket says 172.21.15.17:39474) 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 -- 172.21.15.17:0/1172928155 learned_addr learned my addr 172.21.15.17:0/1172928155 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a99c700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194104c80 0x7f41941a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 -- 172.21.15.17:0/1172928155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194104c80 msgr2=0x7f41941a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194104c80 0x7f41941a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 -- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941042e0 msgr2=0x7f4194199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:55.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941042e0 0x7f4194199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419a19b700 1 -- 172.21.15.17:0/1172928155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41900095f0 con 0x7f41941030f0 2023-10-05T15:53:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.576+0000 7f419999a700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941042e0 0x7f4194199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:53:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.577+0000 7f419a19b700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 0x7f4194198cf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4190000c00 tx=0x7f419000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.577+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419001d070 con 0x7f41941030f0 2023-10-05T15:53:55.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.577+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41941a0de0 con 0x7f41941030f0 2023-10-05T15:53:55.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.577+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f419000bcf0 con 0x7f41941030f0 2023-10-05T15:53:55.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.577+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900173f0 con 0x7f41941030f0 2023-10-05T15:53:55.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.577+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41941a11b0 con 0x7f41941030f0 2023-10-05T15:53:55.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.578+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419410e800 con 0x7f41941030f0 2023-10-05T15:53:55.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.580+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4190022470 con 0x7f41941030f0 2023-10-05T15:53:55.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:55 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2202408525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:53:55.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:55 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3503278524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:53:55.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.581+0000 7f418b7fe700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41800a1550 0x7f41800a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:53:55.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.581+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f41900ce150 con 0x7f41941030f0 2023-10-05T15:53:55.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.582+0000 7f419999a700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41800a1550 0x7f41800a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:53:55.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.582+0000 7f419999a700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41800a1550 0x7f41800a3a10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4184011490 tx=0x7f4184009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:53:55.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.583+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4190097440 con 0x7f41941030f0 2023-10-05T15:53:55.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:55 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2202408525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:53:55.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:55 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3503278524' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:53:55.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.860+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f419410a060 con 0x7f41941030f0 2023-10-05T15:53:55.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.872+0000 7f418b7fe700 1 -- 172.21.15.17:0/1172928155 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733876 (secure 0 0 0) 0x7f419009aa60 con 0x7f41941030f0 2023-10-05T15:53:55.886 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:53:55.886 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:53:55.886 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 18, 2023-10-05T15:53:55.886 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 14150, 2023-10-05T15:53:55.886 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2023-10-05T15:53:55.886 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1244004544 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1244004544 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:55.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/1244004544", 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2023-10-05T15:27:04.478008+0000", 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540138322906710015, 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 14211, 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540138322906710015, 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2023-10-05T15:53:55.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:55.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2023-10-05T15:53:55.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.891 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:55.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:55.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.892 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:55.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:55.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:55.897 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:55.898 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.899 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2023-10-05T15:53:55.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2023-10-05T15:53:55.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2023-10-05T15:53:55.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2023-10-05T15:53:55.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2023-10-05T15:53:55.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:55.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:55.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2023-10-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:55.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2023-10-05T15:53:55.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.917 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.918 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:53:55.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:55.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2023-10-05T15:53:55.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.929 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:55.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:55.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2023-10-05T15:53:55.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2023-10-05T15:53:55.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:55.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2023-10-05T15:53:55.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.951 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2023-10-05T15:53:55.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2023-10-05T15:53:55.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-05T15:53:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2023-10-05T15:53:55.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2023-10-05T15:53:55.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2023-10-05T15:53:55.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2023-10-05T15:53:55.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.969 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2023-10-05T15:53:55.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:55.977 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.981 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:55.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:55.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:55.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-05T15:53:55.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.984 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:55.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:55.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:55.985 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:55.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:55.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:55.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.988 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.989 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.992 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-10-05T15:53:55.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-05T15:53:55.996 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:55.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:55.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.001 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-05T15:53:56.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.005 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2023-10-05T15:53:56.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-05T15:53:56.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.013 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.015 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.016 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-05T15:53:56.019 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.021 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-05T15:53:56.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-05T15:53:56.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-05T15:53:56.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.037 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-05T15:53:56.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-05T15:53:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.041 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.041 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.042 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2023-10-05T15:53:56.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-05T15:53:56.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2023-10-05T15:53:56.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.051 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-05T15:53:56.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.061 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-05T15:53:56.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-05T15:53:56.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.061 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.061 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.065 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.067 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-05T15:53:56.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.072 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.075 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.080 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.085 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2023-10-05T15:53:56.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2023-10-05T15:53:56.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.088 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2023-10-05T15:53:56.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.089 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2023-10-05T15:53:56.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2023-10-05T15:53:56.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2023-10-05T15:53:56.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.091 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.093 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.094 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.095 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.095 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.096 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.096 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.096 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.096 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.096 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.097 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.097 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.097 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.097 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.097 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.098 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.098 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.099 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.099 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.100 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.101 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2023-10-05T15:53:56.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.106 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-10-05T15:53:56.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.112 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-10-05T15:53:56.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-10-05T15:53:56.115 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.117 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.122 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2023-10-05T15:53:56.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-05T15:53:56.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.127 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.127 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2023-10-05T15:53:56.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2023-10-05T15:53:56.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2023-10-05T15:53:56.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.130 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-10-05T15:53:56.130 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-05T15:53:56.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.132 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2023-10-05T15:53:56.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2023-10-05T15:53:56.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.133 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2023-10-05T15:53:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.136 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2023-10-05T15:53:56.148 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.149 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2023-10-05T15:53:56.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2023-10-05T15:53:56.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2023-10-05T15:53:56.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-05T15:53:56.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-05T15:53:56.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2023-10-05T15:53:56.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2023-10-05T15:53:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.156 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.157 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.160 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.162 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2023-10-05T15:53:56.164 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.171 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.174 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.176 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2023-10-05T15:53:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.185 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.187 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2023-10-05T15:53:56.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.189 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.197 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.198 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.199 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.200 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.201 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.205 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2023-10-05T15:53:56.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2023-10-05T15:53:56.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2023-10-05T15:53:56.211 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.212 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.213 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.217 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.218 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.219 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.222 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.224 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.225 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2023-10-05T15:53:56.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.232 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.233 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.236 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.238 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2023-10-05T15:53:56.239 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.240 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.241 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.244 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.247 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.249 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.250 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.251 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.253 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.258 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2023-10-05T15:53:56.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.266 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.267 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.271 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.272 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2023-10-05T15:53:56.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.280 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.284 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.286 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.287 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.288 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2023-10-05T15:53:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.289 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2023-10-05T15:53:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2023-10-05T15:53:56.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2023-10-05T15:53:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.295 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.300 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.303 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.306 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.311 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.315 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.316 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.319 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:56.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.322 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.323 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.330 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "drive_group_interval": { 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "drive_group_interval", 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300.0", 2023-10-05T15:53:56.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.332 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.334 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.336 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.338 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.340 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.341 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2023-10-05T15:53:56.342 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2023-10-05T15:53:56.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.342 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.342 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2023-10-05T15:53:56.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2023-10-05T15:53:56.344 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.344 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.345 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.345 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.346 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.346 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.346 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.346 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.347 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.347 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.347 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.347 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.347 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.348 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.349 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.350 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.352 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.352 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.352 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.352 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.352 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.352 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.353 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.353 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.353 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.353 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.353 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.354 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.355 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.355 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.356 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2023-10-05T15:53:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2023-10-05T15:53:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.358 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.358 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.358 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2023-10-05T15:53:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2023-10-05T15:53:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.360 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2023-10-05T15:53:56.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.360 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2023-10-05T15:53:56.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2023-10-05T15:53:56.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2023-10-05T15:53:56.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.368 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2023-10-05T15:53:56.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.372 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:56.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.374 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.376 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.377 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.382 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.385 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.386 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.388 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.393 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.397 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.399 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.400 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.402 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2023-10-05T15:53:56.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.409 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-05T15:53:56.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.414 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-10-05T15:53:56.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.424 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.427 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2023-10-05T15:53:56.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.440 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2023-10-05T15:53:56.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.453 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.456 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.459 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2023-10-05T15:53:56.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 24110, 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540138322906710015, 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.462 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2023-10-05T15:53:56.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.464 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.466 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2023-10-05T15:53:56.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2023-10-05T15:53:56.479 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.480 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2023-10-05T15:53:56.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-05T15:53:56.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.486 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.490 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.491 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.493 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.494 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.497 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.498 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.499 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.500 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-05T15:53:56.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.503 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2023-10-05T15:53:56.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.508 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2023-10-05T15:53:56.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.510 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-05T15:53:56.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.516 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2023-10-05T15:53:56.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.520 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2023-10-05T15:53:56.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.524 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-05T15:53:56.524 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2023-10-05T15:53:56.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2023-10-05T15:53:56.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-05T15:53:56.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.529 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.530 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.531 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:56.533 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2023-10-05T15:53:56.537 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.540 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2023-10-05T15:53:56.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2023-10-05T15:53:56.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2023-10-05T15:53:56.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2023-10-05T15:53:56.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.549 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.553 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.555 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-05T15:53:56.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.558 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2023-10-05T15:53:56.563 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2023-10-05T15:53:56.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.573 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2023-10-05T15:53:56.574 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-05T15:53:56.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.583 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2023-10-05T15:53:56.588 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2023-10-05T15:53:56.589 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.591 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2023-10-05T15:53:56.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.594 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-05T15:53:56.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.601 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-05T15:53:56.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-05T15:53:56.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.616 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-05T15:53:56.617 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.621 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-05T15:53:56.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.625 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-05T15:53:56.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2023-10-05T15:53:56.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.635 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-05T15:53:56.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-05T15:53:56.639 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.642 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.645 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-10-05T15:53:56.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.660 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.661 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2023-10-05T15:53:56.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.677 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2023-10-05T15:53:56.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.679 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.680 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.681 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.684 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2023-10-05T15:53:56.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.690 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-05T15:53:56.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2023-10-05T15:53:56.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.701 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.703 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2023-10-05T15:53:56.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:56.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2023-10-05T15:53:56.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.711 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.714 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.718 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.721 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2023-10-05T15:53:56.723 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2023-10-05T15:53:56.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.726 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.728 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.729 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2023-10-05T15:53:56.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.733 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.734 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.737 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2023-10-05T15:53:56.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.740 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2023-10-05T15:53:56.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.743 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2023-10-05T15:53:56.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.747 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.749 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.752 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.753 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.756 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.758 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.759 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.762 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.763 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.765 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.768 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.771 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.774 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.779 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.782 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.783 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.784 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.785 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.786 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.787 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.792 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2023-10-05T15:53:56.797 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.799 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.803 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.806 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:56.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2023-10-05T15:53:56.808 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.809 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.810 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2023-10-05T15:53:56.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.820 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:56.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.822 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2023-10-05T15:53:56.824 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.830 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.831 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.834 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.840 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.845 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:56.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.848 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.851 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "drive_group_interval": { 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "drive_group_interval", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300.0", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.855 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.859 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.860 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.864 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.866 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.867 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2023-10-05T15:53:56.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2023-10-05T15:53:56.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2023-10-05T15:53:56.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.883 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.887 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.890 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.892 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.893 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.894 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.896 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.898 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.902 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2023-10-05T15:53:56.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.906 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.907 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.908 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.910 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.910 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.912 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.914 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2023-10-05T15:53:56.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-05T15:53:56.918 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.919 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.924 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-10-05T15:53:56.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2023-10-05T15:53:56.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.931 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.937 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.943 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.945 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.948 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.951 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.952 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.955 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.960 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2023-10-05T15:53:56.961 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.968 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.969 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.971 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:56.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:56.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "restful" 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.976 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:56.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:56.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.984 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.989 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2023-10-05T15:53:56.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.993 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2023-10-05T15:53:56.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:56.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2023-10-05T15:53:56.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:56.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-05T15:53:56.999 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2023-10-05T15:53:57.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2023-10-05T15:53:57.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.004 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.006 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.009 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2023-10-05T15:53:57.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.018 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.019 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.020 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2023-10-05T15:53:57.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.025 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_log_destination": { 2023-10-05T15:53:57.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm_log_destination", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "file", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "file,syslog", 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "syslog" 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.028 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2023-10-05T15:53:57.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2023-10-05T15:53:57.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2023-10-05T15:53:57.034 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.035 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-05T15:53:57.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.037 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2023-10-05T15:53:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.042 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_nvmeof": { 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_nvmeof", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Nvme-of container image", 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.045 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.048 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2023-10-05T15:53:57.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "inventory_list_all": { 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "inventory_list_all", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.060 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2023-10-05T15:53:57.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.062 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.064 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-05T15:53:57.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.067 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2023-10-05T15:53:57.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.070 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-10-05T15:53:57.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.073 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.075 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2023-10-05T15:53:57.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2023-10-05T15:53:57.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2023-10-05T15:53:57.082 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.083 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.084 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.088 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.089 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2023-10-05T15:53:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-05T15:53:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-05T15:53:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2023-10-05T15:53:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-05T15:53:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "UNSAFE_TLS_v1_2": { 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-05T15:53:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2023-10-05T15:53:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-10-05T15:53:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2023-10-05T15:53:57.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2023-10-05T15:53:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2023-10-05T15:53:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2023-10-05T15:53:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-05T15:53:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2023-10-05T15:53:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2023-10-05T15:53:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.224 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.227 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2023-10-05T15:53:57.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.232 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.233 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.234 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.235 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.237 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.242 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.244 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.245 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.246 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2023-10-05T15:53:57.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.252 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.254 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.255 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.256 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.257 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.258 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.260 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.261 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.264 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.267 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.269 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.270 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.271 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.272 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2023-10-05T15:53:57.273 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.275 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.277 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.278 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.280 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2023-10-05T15:53:57.281 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.282 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.283 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.286 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2023-10-05T15:53:57.288 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.289 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.292 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.296 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.299 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2023-10-05T15:53:57.302 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.310 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.312 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.314 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.315 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.316 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.317 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.321 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.322 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.323 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.326 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.327 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:57.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.333 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-10-05T15:53:57.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.338 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.339 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.340 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2023-10-05T15:53:57.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2023-10-05T15:53:57.344 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.346 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.347 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.349 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.353 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.354 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.358 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.362 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "drive_group_interval": { 2023-10-05T15:53:57.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "drive_group_interval", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300.0", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.365 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.367 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.368 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.371 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.373 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.376 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.377 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.378 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2023-10-05T15:53:57.379 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.380 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.383 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2023-10-05T15:53:57.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2023-10-05T15:53:57.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.388 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.389 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.390 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.395 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.396 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.399 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.404 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.409 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.412 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.414 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.420 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.421 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.423 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2023-10-05T15:53:57.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2023-10-05T15:53:57.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.427 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2023-10-05T15:53:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2023-10-05T15:53:57.436 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.438 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.441 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.444 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.450 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.452 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-10-05T15:53:57.454 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.457 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.458 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.460 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "periodic_async_work": { 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "periodic_async_work", 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Periodically check for async work", 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.463 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-10-05T15:53:57.465 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.468 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.470 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-10-05T15:53:57.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-10-05T15:53:57.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-10-05T15:53:57.473 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.474 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2023-10-05T15:53:57.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.476 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-10-05T15:53:57.478 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-10-05T15:53:57.479 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-10-05T15:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-10-05T15:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-10-05T15:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 3, 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-10-05T15:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 587919469 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1092785870 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1297361438 2023-10-05T15:53:57.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 216411331 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:57.486 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:53:57.487 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-10-05T15:53:57.487 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:53:57.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:56 smithi079 ceph-mon[132936]: pgmap v889: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.5 MiB/s wr, 716 op/s 2023-10-05T15:53:57.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:56 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/751916674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:53:57.488 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:56 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1172928155' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-05T15:53:57.488 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:56 smithi167 ceph-mon[133366]: pgmap v889: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.5 MiB/s wr, 716 op/s 2023-10-05T15:53:57.489 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:56 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/751916674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:53:57.489 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:56 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1172928155' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-05T15:53:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41800a1550 msgr2=0x7f41800a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41800a1550 0x7f41800a3a10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4184011490 tx=0x7f4184009260 comp rx=0 tx=0).stop 2023-10-05T15:53:57.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 msgr2=0x7f4194198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 0x7f4194198cf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4190000c00 tx=0x7f419000fa00 comp rx=0 tx=0).stop 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 shutdown_connections 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f41800a1550 0x7f41800a3a10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4194104c80 0x7f41941a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41941030f0 0x7f4194198cf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 --2- 172.21.15.17:0/1172928155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41941042e0 0x7f4194199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.878+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 >> 172.21.15.17:0/1172928155 conn(0x7f41940fe6a0 msgr2=0x7f4194100960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.879+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 shutdown_connections 2023-10-05T15:53:57.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:53:55.879+0000 7f419c3ff700 1 -- 172.21.15.17:0/1172928155 wait complete. 2023-10-05T15:53:57.495 DEBUG:tasks.check_counter:Getting stats from a 2023-10-05T15:53:57.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-05T15:53:57.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:56 smithi017 ceph-mon[129107]: pgmap v889: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 9.5 MiB/s wr, 716 op/s 2023-10-05T15:53:57.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:56 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/751916674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:53:57.496 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:56 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1172928155' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-05T15:53:57.497 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:57 smithi017 ceph-mon[129107]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:53:57.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:57 smithi167 ceph-mon[133366]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:53:57.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:57 smithi079 ceph-mon[132936]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-05T15:53:58.255 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:53:58.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:53:58 smithi017 ceph-mon[129107]: pgmap v890: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 335 op/s 2023-10-05T15:53:58.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:53:58 smithi167 ceph-mon[133366]: pgmap v890: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 335 op/s 2023-10-05T15:53:58.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:53:58 smithi079 ceph-mon[132936]: pgmap v890: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.9 MiB/s wr, 335 op/s 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 316, 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 313, 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 500400, 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 188944, 2023-10-05T15:54:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.061086071, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.025486449, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.023356113, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.008858463, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 312, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.043534798, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000139534 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 500400, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 188944 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 6, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 242, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3264, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 195904, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-10-05T15:54:00.184 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.024249409, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.018689362, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003004874, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 241, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.033167384, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000137624 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:00.185 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 195904 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2023-10-05T15:54:00.186 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000866134, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000741157, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.187 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:00.189 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:00.189 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:00.189 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:00.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.189 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:00.189 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:00.190 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:00.191 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:00.192 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148761, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 31, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:00.193 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2023-10-05T15:54:00.194 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 318, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 455723, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:00.195 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 318, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 318, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 455723, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:00.196 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:54:00.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:00 smithi017 ceph-mon[129107]: pgmap v891: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 4.4 MiB/s wr, 222 op/s 2023-10-05T15:54:00.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:00 smithi167 ceph-mon[133366]: pgmap v891: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 4.4 MiB/s wr, 222 op/s 2023-10-05T15:54:00.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:00 smithi079 ceph-mon[132936]: pgmap v891: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 4.4 MiB/s wr, 222 op/s 2023-10-05T15:54:00.751 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-10-05T15:54:00.752 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-10-05T15:54:00.752 DEBUG:tasks.check_counter:Getting stats from d 2023-10-05T15:54:00.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-05T15:54:01.491 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:54:02.430 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:02 smithi017 ceph-mon[129107]: pgmap v892: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2023-10-05T15:54:02.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:02 smithi167 ceph-mon[133366]: pgmap v892: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2023-10-05T15:54:02.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:02 smithi079 ceph-mon[132936]: pgmap v892: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 2.5 MiB/s wr, 126 op/s 2023-10-05T15:54:03.627 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:54:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1414, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1416, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 2978175, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 439818, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.145259896, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.043240247, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.044006418, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.041292761, 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1414, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.209312410, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000148028 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1043, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1284, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 258474, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 814375, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 5, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.145419960, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.066417977, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.026616455, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.040571931, 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1283, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.166707493, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000129935 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 491552 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 1486, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 1466, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1011632, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 547991, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 3, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.206296776, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.082785060, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.056136812, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.052978120, 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1465, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.255368851, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000174313 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 629600, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 194384 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 5941, 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.183058116, 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000030812 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 0, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 0, 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2023-10-05T15:54:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 377, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 244, 2023-10-05T15:54:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 122, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 11, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 27, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 17, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:54:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 0 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2023-10-05T15:54:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 1265, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 3, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 2, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2023-10-05T15:54:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 6805756, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 6804347, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 1265 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2023-10-05T15:54:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 375, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 533, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 158, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 35, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 41, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 6, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 377, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 537, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 160, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 0, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 0, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 0, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 50620, 2023-10-05T15:54:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 207152 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 0, 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 0, 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 0, 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 0, 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2023-10-05T15:54:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2023-10-05T15:54:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2023-10-05T15:54:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 0, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 0, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 2840, 2023-10-05T15:54:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 190167, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 52, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 176, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-10-05T15:54:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 1068872, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2182, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 3589, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 21, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 3, 2023-10-05T15:54:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 3589, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3589, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 5.341951248, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001488423 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3589, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 3590 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 3589, 2023-10-05T15:54:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 3589, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 2173, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 1414, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2023-10-05T15:54:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 1, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2023-10-05T15:54:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2023-10-05T15:54:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 94, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2023-10-05T15:54:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 4, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 5, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 6, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 1, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 0, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 2, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 0 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 0, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 0, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 0, 2023-10-05T15:54:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 3939, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 3872915, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 3939, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 3939, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 3872915, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 3589, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 2611457, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 3589, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 2611457, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 3589, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 3589, 2023-10-05T15:54:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 3589, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 3589, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2023-10-05T15:54:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x563d6277ea00": { 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 0, 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 0, 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:03.684 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:54:04.194 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2023-10-05T15:54:04.194 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2023-10-05T15:54:04.194 DEBUG:tasks.check_counter:Getting stats from g 2023-10-05T15:54:04.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-05T15:54:04.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:04 smithi017 ceph-mon[129107]: pgmap v893: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 636 KiB/s wr, 38 op/s 2023-10-05T15:54:04.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:04 smithi167 ceph-mon[133366]: pgmap v893: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 636 KiB/s wr, 38 op/s 2023-10-05T15:54:04.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:04 smithi079 ceph-mon[132936]: pgmap v893: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 636 KiB/s wr, 38 op/s 2023-10-05T15:54:04.937 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:54:06.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:06 smithi017 ceph-mon[129107]: pgmap v894: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-05T15:54:06.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:06 smithi167 ceph-mon[133366]: pgmap v894: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-05T15:54:06.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:06 smithi079 ceph-mon[132936]: pgmap v894: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 8218, 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 7590, 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 2399685, 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 18938724, 2023-10-05T15:54:06.904 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 11, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.820100702, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.338484337, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.494193080, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.069082442, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 7588, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 1.086474328, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000143183 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:06.905 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 12130, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.002937190, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000242 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 22605, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 22832, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 8231245, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 11771764, 2023-10-05T15:54:06.906 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 14, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 5, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 3.019849654, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 1.596526533, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 1.915908938, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.015788998, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 22831, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 14.154842131, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000619983 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:06.907 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 34203, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.029411644, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000859 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 650736, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 197392 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 593, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 831, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 272099, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 5046062, 2023-10-05T15:54:06.908 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 13, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 9, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.105193648, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.050808930, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.027714559, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.021192235, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 830, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.184371972, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000222134 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:06.909 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 184, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000044837, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000243 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 498784 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 1, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-MDSRank": { 2023-10-05T15:54:06.910 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3851, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 4.012391950, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001041909 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "queue_len": 0, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "complete_latency": { 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 15, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000442136, 2023-10-05T15:54:06.911 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000029475 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "request": 5279, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "reply": 5245, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "reply_latency": { 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 5245, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 13.373044896, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002549674 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_reply": 0, 2023-10-05T15:54:06.912 INFO:teuthology.orchestra.run.smithi017.stdout: "forward": 34, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_commit": 11, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_split": 0, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_merge": 0, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes": 474, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_top": 0, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_bottom": 416, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pin_tail": 58, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_pinned": 474, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_expired": 118, 2023-10-05T15:54:06.913 INFO:teuthology.orchestra.run.smithi017.stdout: "inodes_with_caps": 74, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": 74, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "subtrees": 5, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse": 15978, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_hit": 12459, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_forward": 34, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_discover": 7, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "traverse_lock": 620, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "load_cent": 30841, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "q": 0, 2023-10-05T15:54:06.914 INFO:teuthology.orchestra.run.smithi017.stdout: "exported": 6, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "exported_inodes": 117, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "imported": 5, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "imported_inodes": 123, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_backtrace_fetch": 128, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rfiles": 1040, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rbytes": 1648855227, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "root_rsnaps": 0, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_fetch": 128, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:06.915 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_inodes": 5, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_dirfrag_rstats": 5, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_file_inodes": 123, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_revoke": 401, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_grant": 846, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:06.916 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps": 16576, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_caps_dirty": 15051, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_cap_release": 1, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "process_request_cap_release": 628 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache": { 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update": 0, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_try_discover": 0, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_send_discover": 7, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "dir_handle_discover": 8, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays": 0, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:06.917 INFO:teuthology.orchestra.run.smithi017.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_created": 209, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_enqueued": 1, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_reintegrated": 616, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "strays_migrated": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_started": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "recovery_completed": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:06.918 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_exportdir": 6, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_flush": 0, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "ireq_inodestats": 0 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log": { 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "evlrg": 0, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "evadd": 17579, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "evex": 0, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "evtrm": 0, 2023-10-05T15:54:06.919 INFO:teuthology.orchestra.run.smithi017.stdout: "ev": 17579, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "evexg": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "evexd": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "segadd": 23, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "segex": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "segtrm": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "seg": 23, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "segmjr": 3, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "segexg": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "segexd": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "expos": 4194304, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "wrpos": 26489072, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "rdpos": 0, 2023-10-05T15:54:06.920 INFO:teuthology.orchestra.run.smithi017.stdout: "jlat": { 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 1799, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 6.638622235, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003690173 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "replayed": 0 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mem": { 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 91, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "ino+": 203, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "ino-": 112, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "dir": 25, 2023-10-05T15:54:06.921 INFO:teuthology.orchestra.run.smithi017.stdout: "dir+": 30, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "dir-": 5, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "dn": 474, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "dn+": 593, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "dn-": 119, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "cap": 74, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "cap+": 188, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "cap-": 114, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "rss": 56120, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "heap": 198960 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.922 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server": { 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_client_request": 9994, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_request": 5279, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_client_session": 19, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "handle_peer_request": 878, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "req_create_latency": { 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 59, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.168775019, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.002860593 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getattr_latency": { 2023-10-05T15:54:06.923 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 6, 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.003946907, 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000657817 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "req_link_latency": { 2023-10-05T15:54:06.924 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 208, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.885503338, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.004257227 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookup_latency": { 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3604, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 2.746666530, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000762116 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.925 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupino_latency": { 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupname_latency": { 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.926 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: "req_lssnap_latency": { 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mkdir_latency": { 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mknod_latency": { 2023-10-05T15:54:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "req_mksnap_latency": { 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "req_open_latency": { 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 529, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.862991113, 2023-10-05T15:54:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001631363 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: "req_readdir_latency": { 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 14, 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.018120181, 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.001294298 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rename_latency": { 2023-10-05T15:54:06.930 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 617, 2023-10-05T15:54:06.933 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 7.964916796, 2023-10-05T15:54:06.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.012909103 2023-10-05T15:54:06.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.933 INFO:teuthology.orchestra.run.smithi017.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:06.933 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmdir_latency": { 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.934 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setattr_latency": { 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setlayout_latency": { 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "req_setxattr_latency": { 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.937 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "req_symlink_latency": { 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "req_unlink_latency": { 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 208, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.722125012, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003471754 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.938 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessions": { 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "session_count": 1, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "session_add": 1, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "session_remove": 0, 2023-10-05T15:54:06.939 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_open": 1, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "sessions_stale": 0, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "total_load": 1058, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "average_load": 1058, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "avg_session_uptime": 1043, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:06.940 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:06.941 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:06.942 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 329227, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 124, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:06.943 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 176, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-10-05T15:54:06.944 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 618040, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 17844, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter": { 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "op_active": 0, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "op_laggy": 0, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send": 2224, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "op_send_bytes": 22344634, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "op_resend": 27, 2023-10-05T15:54:06.945 INFO:teuthology.orchestra.run.smithi017.stdout: "op_reply": 2224, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "op_latency": { 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2224, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 8.557921063, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.003847986 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "op_inflight": 0, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "oplen_avg": { 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 2224, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 2529 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "op": 2224, 2023-10-05T15:54:06.946 INFO:teuthology.orchestra.run.smithi017.stdout: "op_r": 129, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "op_w": 2095, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "op_rmw": 0, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "op_pg": 0, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_stat": 0, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_create": 10, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_read": 1, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_write": 1800, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writefull": 74, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_writesame": 0, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_append": 0, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_zero": 0, 2023-10-05T15:54:06.947 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_truncate": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_delete": 19, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_mapext": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_getxattr": 128, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_setxattr": 20, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_call": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_watch": 0, 2023-10-05T15:54:06.948 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_notify": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "osdop_other": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_active": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_send": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_resend": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "linger_ping": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_active": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_send": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "poolop_resend": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_active": 0, 2023-10-05T15:54:06.949 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_send": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "poolstat_resend": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_active": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_send": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "statfs_resend": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "command_active": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "command_send": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "command_resend": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "map_epoch": 94, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "map_full": 0, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "map_inc": 4, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_sessions": 12, 2023-10-05T15:54:06.950 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_open": 12, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_session_close": 0, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_laggy": 0, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_wr": 339, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_rd": 0, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_del": 138 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "oft": { 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_objs": 1, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_updates": 0, 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: "omap_total_removes": 0 2023-10-05T15:54:06.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "osd-slow-ops": { 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "slow_ops_count": 0 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "purge_queue": { 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_ops_high_water": 2, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing": 0, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executing_high_water": 1, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_executed": 1, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:06.952 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 31412, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 8053873, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 31412, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 31412, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 8053873, 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:06.953 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2023-10-05T15:54:06.954 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 2224, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 22344743, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 2224, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 22344743, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.955 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 1024, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 0, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 0, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 2224, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 2224, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 2224, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 2224, 2023-10-05T15:54:06.956 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 1, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 109, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:06.957 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 1, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 109, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-write_buf_throttle-0x560cf05bc6e0": { 2023-10-05T15:54:06.958 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 3758096384, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 17579, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 22294768, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 17579, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 1799, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 22294768, 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:06.959 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:06.960 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:06.960 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:06.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:06.960 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:54:08.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:08 smithi079 ceph-mon[132936]: pgmap v895: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 16 op/s 2023-10-05T15:54:08.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:08 smithi017 ceph-mon[129107]: pgmap v895: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 16 op/s 2023-10-05T15:54:08.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:08 smithi167 ceph-mon[133366]: pgmap v895: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 16 op/s 2023-10-05T15:54:10.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:10 smithi017 ceph-mon[129107]: pgmap v896: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 14 op/s 2023-10-05T15:54:10.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:10 smithi167 ceph-mon[133366]: pgmap v896: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 14 op/s 2023-10-05T15:54:10.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:10 smithi079 ceph-mon[132936]: pgmap v896: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 KiB/s wr, 14 op/s 2023-10-05T15:54:12.053 INFO:tasks.check_counter:Daemon mds.g mds.exported=6 2023-10-05T15:54:12.053 INFO:tasks.check_counter:Daemon mds.g mds.imported=5 2023-10-05T15:54:12.053 DEBUG:tasks.check_counter:Getting stats from j 2023-10-05T15:54:12.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-05T15:54:12.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:12 smithi017 ceph-mon[129107]: pgmap v897: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 KiB/s wr, 16 op/s 2023-10-05T15:54:12.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:12 smithi167 ceph-mon[133366]: pgmap v897: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 KiB/s wr, 16 op/s 2023-10-05T15:54:12.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:12 smithi079 ceph-mon[132936]: pgmap v897: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.9 KiB/s wr, 16 op/s 2023-10-05T15:54:12.796 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-05T15:54:14.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:14 smithi017 ceph-mon[129107]: pgmap v898: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 330, 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 325, 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 506128, 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 195168, 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2023-10-05T15:54:14.551 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.062708720, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.027022808, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.022304893, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.008932263, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 325, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.046661431, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000143573 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:14.552 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 506128, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 195168 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 2, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 248, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 320, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 196864, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:14.553 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.024021513, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.019184458, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.002152427, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 246, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.035579976, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000144634 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:14.554 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 196864 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2023-10-05T15:54:14.555 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000572651, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000415570, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:14.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-10-05T15:54:14.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:14.558 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:14.559 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:14.560 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148721, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-10-05T15:54:14.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:14.562 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 328, 2023-10-05T15:54:14.563 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 457087, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 328, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 328, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 457087, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-10-05T15:54:14.564 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-10-05T15:54:14.565 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-10-05T15:54:14.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:14.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-10-05T15:54:14.565 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-10-05T15:54:14.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:14 smithi167 ceph-mon[133366]: pgmap v898: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2023-10-05T15:54:14.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:14 smithi079 ceph-mon[132936]: pgmap v898: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2023-10-05T15:54:15.290 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-05T15:54:15.290 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-05T15:54:15.291 DEBUG:tasks.check_counter:Getting stats from b 2023-10-05T15:54:15.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-05T15:54:16.261 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:54:16.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:16 smithi017 ceph-mon[129107]: pgmap v899: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 13 op/s 2023-10-05T15:54:16.564 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:16 smithi079 ceph-mon[132936]: pgmap v899: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 13 op/s 2023-10-05T15:54:16.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:16 smithi167 ceph-mon[133366]: pgmap v899: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 13 op/s 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 10305, 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 10941, 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 2936926, 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 17195418, 2023-10-05T15:54:17.999 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 11, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 5, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.818009618, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.312350684, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.382561625, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.114311144, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 10939, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2.555022423, 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000233570 2023-10-05T15:54:18.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 11853, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.002469030, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000208 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 110732, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 111413, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 19549597, 2023-10-05T15:54:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 20443536, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 8, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 5, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 6.057581122, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 2.514691651, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 4.142260308, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.076148718, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 111416, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3.165353537, 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000028410 2023-10-05T15:54:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 217878, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.029591649, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000135 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 663456, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 203024 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 121442, 2023-10-05T15:54:18.003 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 122185, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 22319694, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 33207932, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 247, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 9, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 8.546288383, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 3.862552366, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 5.600904703, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.224981864, 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:18.004 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 122180, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3.286306178, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000026897 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 235709, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.030343861, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000128 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 49120, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 515888 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.005 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 8676, 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3.533069675, 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000407223 2023-10-05T15:54:18.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 231, 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.010215293, 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000044222 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 7061, 2023-10-05T15:54:18.007 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 4647, 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 4647, 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 36.945314368, 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.007950358 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2023-10-05T15:54:18.008 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 2414, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 5, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 2, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 801, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 3, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 220, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 2, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 200, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 18, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 218, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 992, 2023-10-05T15:54:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 192, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 192, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 8, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 9007, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 6473, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 2399, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 3, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 23, 2023-10-05T15:54:18.010 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 8378, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 7, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 24, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 979, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 9, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 168, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 1284, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 1037, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 1648843456, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2023-10-05T15:54:18.011 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 1284, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 71, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 3, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 68, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 1213, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 1651, 2023-10-05T15:54:18.012 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 1443, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 5641, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 1347, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 22, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 1271 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2023-10-05T15:54:18.013 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 10, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 37, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 56, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 51, 2023-10-05T15:54:18.014 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 20, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 3, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 24, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 3, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2023-10-05T15:54:18.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 7448, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 7274, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 7274, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 174, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 52, 2023-10-05T15:54:18.016 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 83, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 82, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 82, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 1, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 1, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 1, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 21100211, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 21471196, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 0, 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2023-10-05T15:54:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3281, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 12.694028754, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.003868951 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 0 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 210, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 1238, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 1028, 2023-10-05T15:54:18.018 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 47, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 80, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 33, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 220, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 1281, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 1061, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 192, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 1219, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 1027, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 67716, 2023-10-05T15:54:18.019 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 207152 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 8423, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 1294, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 7061, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 65, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 2592, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1025, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 5.818361252, 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.005676450 2023-10-05T15:54:18.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 483, 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.122506344, 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000253636 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 5, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.008959767, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001791953 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1655, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 29.318833584, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.017715307 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.022 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2023-10-05T15:54:18.023 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.025 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 34, 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.052685303, 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001549567 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.026 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1273, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.857308551, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000673455 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.027 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 73, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.206771468, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.002832485 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 60, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.480066931, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.008001115 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.028 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2023-10-05T15:54:18.030 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.001600301, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000800150 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.031 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 7, 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.019801121, 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.002828731 2023-10-05T15:54:18.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 30, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.058419746, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001947324 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:18.033 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 3, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 2, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2023-10-05T15:54:18.034 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 287, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 287, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 1054, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 240, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 240, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:18.035 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:18.036 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:18.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 297308, 2023-10-05T15:54:18.038 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 115, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 176, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:18.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 734637, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 3992, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2023-10-05T15:54:18.040 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 8576, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 19988181, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 31, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 8576, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 8576, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 214.742201222, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.025039902 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.041 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 8576, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 13308 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 8576, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 1327, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 7249, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 731, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 2058, 2023-10-05T15:54:18.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 33, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 3311, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 278, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 3, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 622, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:18.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1294, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 3116, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2023-10-05T15:54:18.044 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2023-10-05T15:54:18.045 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 94, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 9, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 12, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 12, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2023-10-05T15:54:18.046 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 1763, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 14, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 85 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 1, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "osd-slow-ops": { 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2023-10-05T15:54:18.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 5, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 51, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:18.048 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 242475, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 22955334, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 242475, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 242475, 2023-10-05T15:54:18.049 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 22955334, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:18.050 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 8576, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 19993652, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 8576, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 19993652, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.051 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:18.052 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 8576, 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 8576, 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 8576, 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 8576, 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.053 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.054 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.054 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:18.054 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 51, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 5559, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 51, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:18.055 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 30, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 5559, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x56242f0386e0": { 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:18.056 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 7448, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 17276892, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 7448, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3281, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 17276892, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:18.058 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-05T15:54:18.297 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:18 smithi079 ceph-mon[132936]: pgmap v900: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2023-10-05T15:54:19.098 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:18 smithi167 ceph-mon[133366]: pgmap v900: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2023-10-05T15:54:19.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:18 smithi017 ceph-mon[129107]: pgmap v900: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2023-10-05T15:54:19.100 INFO:tasks.check_counter:Daemon mds.b mds.exported=24 2023-10-05T15:54:19.100 INFO:tasks.check_counter:Daemon mds.b mds.imported=9 2023-10-05T15:54:19.101 DEBUG:tasks.check_counter:Getting stats from e 2023-10-05T15:54:19.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-05T15:54:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:54:20.430 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:20 smithi079 ceph-mon[132936]: pgmap v901: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-10-05T15:54:20.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:20 smithi017 ceph-mon[129107]: pgmap v901: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-10-05T15:54:20.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:20 smithi167 ceph-mon[133366]: pgmap v901: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-10-05T15:54:21.390 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2920, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2922, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 17616411, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 908127, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.281922861, 2023-10-05T15:54:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.083224354, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.098270244, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.076534728, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2920, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.110915086, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000037984 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 546, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 790, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 4334634, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 634521, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 5, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.070272646, 2023-10-05T15:54:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.024096354, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.024135809, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.015103301, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 789, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.036318186, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000046030 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 466208 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 654, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 634, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 2029764, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 290491, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 5, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2023-10-05T15:54:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.082326329, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.032173337, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.031203532, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.015903433, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 633, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.038066757, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000060137 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 630688, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 196880 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 6378, 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.161781665, 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000025365 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 468, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 1, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 456, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 11, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 466, 2023-10-05T15:54:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 3, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2023-10-05T15:54:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:54:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2023-10-05T15:54:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2023-10-05T15:54:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 17579, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 23, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 3, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 26489072, 2023-10-05T15:54:21.407 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 26489024, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 17579 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 83, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 202, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 119, 2023-10-05T15:54:21.408 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 19, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 28, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 9, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 468, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 588, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 120, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 50804, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 207152 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.409 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2023-10-05T15:54:21.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2023-10-05T15:54:21.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.414 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2023-10-05T15:54:21.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.416 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.417 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.418 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2023-10-05T15:54:21.420 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.421 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.422 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 1, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 0, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2023-10-05T15:54:21.423 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 2859, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:21.424 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:21.425 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:21.426 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 199071, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 59, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:21.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 176, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 534904, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 14384, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:21.428 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 3762, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 3762, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3762, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 6.097867101, 2023-10-05T15:54:21.429 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001620910 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3762, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3763 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 3762, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 3762, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2023-10-05T15:54:21.430 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 2205, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 1555, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:21.431 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:21.432 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2023-10-05T15:54:21.433 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 94, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 4, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 6, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 7, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 1, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2023-10-05T15:54:21.434 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "osd-slow-ops": { 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2023-10-05T15:54:21.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:21.436 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 4116, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 23589305, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 4116, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 4116, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 23589305, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.437 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3762, 2023-10-05T15:54:21.438 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 22297907, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3762, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 22297907, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2023-10-05T15:54:21.439 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3762, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 3762, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3762, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 3762, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:21.441 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x55f47f712a00": { 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:21.442 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:21.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:21.444 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-05T15:54:22.254 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-05T15:54:22.255 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-05T15:54:22.255 DEBUG:tasks.check_counter:Getting stats from h 2023-10-05T15:54:22.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-05T15:54:22.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:22 smithi017 ceph-mon[129107]: pgmap v902: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-05T15:54:22.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:22 smithi167 ceph-mon[133366]: pgmap v902: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-05T15:54:22.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:22 smithi079 ceph-mon[132936]: pgmap v902: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-10-05T15:54:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:54:24.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:24 smithi017 ceph-mon[129107]: pgmap v903: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 8 op/s 2023-10-05T15:54:24.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:24 smithi167 ceph-mon[133366]: pgmap v903: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 8 op/s 2023-10-05T15:54:24.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:24 smithi079 ceph-mon[132936]: pgmap v903: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 8 op/s 2023-10-05T15:54:24.620 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-05T15:54:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 105349, 2023-10-05T15:54:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 104736, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 18065685, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 17066519, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 12, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 7.093183405, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 3.352112365, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 4.566735386, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.136413978, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 104737, 2023-10-05T15:54:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.741609183, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000016628 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 209384, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.026359796, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000125 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 448 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 513, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 760, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 227963, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 2080147, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 16, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 8, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.069827064, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.032275859, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.020951640, 2023-10-05T15:54:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.011721336, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 756, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.083138217, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000109971 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 165, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000032451, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000196 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:54:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 559424 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 3883766, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 3883372, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 645744534, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 614339520, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 13, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 6, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 213.592912255, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 86.918679404, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 151.442557438, 2023-10-05T15:54:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.007680630, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3883371, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 77.139384041, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000019864 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 7765902, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.064813371, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000137 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 645648, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 202016 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 915, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.174830938, 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000191072 2023-10-05T15:54:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 23, 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000705484, 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000030673 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 400, 2023-10-05T15:54:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 397, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 397, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.514144650, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001295074 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 3, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 11, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2023-10-05T15:54:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 234, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 0, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 234, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 234, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 217, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 217, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 9, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 659, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 392, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2023-10-05T15:54:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 4, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 971, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 6, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 209, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 76, 2023-10-05T15:54:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 1040, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 1648855227, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 76, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 76, 2023-10-05T15:54:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 6, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 173, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 956, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 308, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 2, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 15 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2023-10-05T15:54:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 4, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 8, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 2, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 2, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2023-10-05T15:54:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 1170, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 1170, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 3, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 3, 2023-10-05T15:54:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 5436548, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 0, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 355, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.758631303, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.004953890 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 0 2023-10-05T15:54:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 235, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 237, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 2, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 25, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 26, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 1, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 234, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 245, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 11, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 217, 2023-10-05T15:54:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 220, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 3, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 54848, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 198960 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 440, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 400, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 17, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 12, 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2023-10-05T15:54:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 8, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.028057744, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.003507218 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.001269827, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000634913 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 225, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.380021724, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001688985 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2023-10-05T15:54:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 154, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.092986240, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000603806 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2023-10-05T15:54:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 6, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.005899293, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000983215 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2023-10-05T15:54:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.005909822, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.002954911 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 2, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 1, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 22, 2023-10-05T15:54:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 22, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 1061, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 287415, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 118, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 176, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 765645, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 3419, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2023-10-05T15:54:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 608, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 1275301, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 27, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 608, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 608, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2.714940861, 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.004465363 2023-10-05T15:54:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 608, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 696 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 608, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 78, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 530, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 0, 2023-10-05T15:54:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 10, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 2, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 357, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 70, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 16, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 76, 2023-10-05T15:54:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 20, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2023-10-05T15:54:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2023-10-05T15:54:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 94, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 4, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 12, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 13, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 1, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 120, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 0, 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 25 2023-10-05T15:54:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 1, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd-slow-ops": { 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 2, 2023-10-05T15:54:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 1, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 2, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 3989626, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 304949604, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 3989626, 2023-10-05T15:54:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3989626, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 304949604, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 608, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 1275519, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 608, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1275519, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 608, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 608, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 608, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 608, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 2, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 218, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 2, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 218, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x55d88fdd26e0": { 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 1170, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 1242244, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 1170, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 355, 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1242244, 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:24.672 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-05T15:54:25.036 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-05T15:54:25.036 INFO:tasks.check_counter:Daemon mds.h mds.imported=6 2023-10-05T15:54:25.037 DEBUG:tasks.check_counter:Getting stats from k 2023-10-05T15:54:25.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-05T15:54:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-05T15:54:26.345 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:26 smithi079 ceph-mon[132936]: pgmap v904: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-05T15:54:26.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:26 smithi017 ceph-mon[129107]: pgmap v904: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-05T15:54:26.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:26 smithi167 ceph-mon[133366]: pgmap v904: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-05T15:54:27.383 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1229, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1231, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 409092, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 382220, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.132383106, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.051618452, 2023-10-05T15:54:27.384 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.029324908, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.036405661, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1229, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.063511526, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000051677 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.385 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 6, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 255, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1956, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 555136, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 7, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.016498438, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.010378856, 2023-10-05T15:54:27.386 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.003261798, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000121676, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 253, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.021488236, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000084933 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.387 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 553824 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2770, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2746, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 2487247, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 948401, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.233497004, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.085284512, 2023-10-05T15:54:27.388 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.067448204, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.067192130, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2746, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.147559557, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000053736 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.389 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 634720, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 199824 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 6105, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.154007459, 2023-10-05T15:54:27.390 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000025226 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2023-10-05T15:54:27.391 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2023-10-05T15:54:27.392 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 229, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 123, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 98, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 8, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 52, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 8, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2023-10-05T15:54:27.393 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:27.394 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:27.395 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2023-10-05T15:54:27.396 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2023-10-05T15:54:27.397 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.398 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 1170, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 3, 2023-10-05T15:54:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 5436548, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 5435974, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 1170 2023-10-05T15:54:27.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 226, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 228, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 2, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 16, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 16, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 0, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 229, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 229, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 0, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2023-10-05T15:54:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 49224, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 207152 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2023-10-05T15:54:27.402 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:27.404 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.405 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.406 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2023-10-05T15:54:27.409 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.410 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.411 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.412 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2023-10-05T15:54:27.414 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.415 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 2, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 1, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 2865, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2023-10-05T15:54:27.416 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:27.417 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:27.418 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 199318, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 58, 2023-10-05T15:54:27.419 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 176, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:27.420 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 639333, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 1423, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.421 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 3640, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 3640, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3640, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 5.502878596, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001511779 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.422 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3640, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 3641 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 3640, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 3640, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 2261, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2023-10-05T15:54:27.423 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 1377, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2023-10-05T15:54:27.424 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2023-10-05T15:54:27.425 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2023-10-05T15:54:27.426 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 94, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 4, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 6, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 7, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 1, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2023-10-05T15:54:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "osd-slow-ops": { 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2023-10-05T15:54:27.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 4001, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 2516890, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 4001, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:27.429 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 4001, 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2516890, 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3640, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 1242249, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3640, 2023-10-05T15:54:27.431 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1242249, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:27.432 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 3640, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 3640, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3640, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 3640, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.433 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2023-10-05T15:54:27.434 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x55a23e0e2a00": { 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:27.435 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-05T15:54:27.436 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-05T15:54:28.296 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-05T15:54:28.296 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-05T15:54:28.296 DEBUG:tasks.check_counter:Getting stats from c 2023-10-05T15:54:28.297 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-05T15:54:28.310 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:28 smithi079 ceph-mon[132936]: pgmap v905: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-05T15:54:28.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:28 smithi017 ceph-mon[129107]: pgmap v905: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-05T15:54:28.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:28 smithi167 ceph-mon[133366]: pgmap v905: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2023-10-05T15:54:29.303 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:54:30.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:30 smithi017 ceph-mon[129107]: pgmap v906: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-05T15:54:30.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:30 smithi167 ceph-mon[133366]: pgmap v906: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-05T15:54:30.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:30 smithi079 ceph-mon[132936]: pgmap v906: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2023-10-05T15:54:31.078 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T15:54:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 5584, 2023-10-05T15:54:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 5055, 2023-10-05T15:54:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1816680, 2023-10-05T15:54:31.078 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 3641119, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 11, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.453561652, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.175864527, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.269743677, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.040345485, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5053, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.295912270, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000058561 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.079 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8020, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001947771, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000242 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 3439, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 3871, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1136883, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 2500191, 2023-10-05T15:54:31.080 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 21, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.295884447, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.128522897, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.185010387, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.007884563, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3868, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.254701117, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000065848 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:31.081 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5671, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001298724, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000229 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 531008 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 919, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 894, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 978323, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 558493, 2023-10-05T15:54:31.082 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.108113065, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.045061074, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.046644965, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.017262922, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 895, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.092895111, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000103793 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:31.083 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 348, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000119021, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000342 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 638224, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 201872 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:31.084 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1592, 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.593320029, 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000372688 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 918, 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.041908386, 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000045651 2023-10-05T15:54:31.085 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 1551, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 1548, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1548, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.092027216, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001351438 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 3, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:31.086 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 11, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 252, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 0, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 0, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 252, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 252, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 6, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 235, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 235, 2023-10-05T15:54:31.087 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 9, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 4734, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 3288, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 3, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 3, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 3, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 169, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 1, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 6, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 7, 2023-10-05T15:54:31.088 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 239, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 232, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 1040, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 1648855227, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 232, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:31.089 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 232, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 252, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 629, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 1479, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 204, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 65, 2023-10-05T15:54:31.090 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 1026 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 4, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 6, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 207, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 207, 2023-10-05T15:54:31.091 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 1, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2023-10-05T15:54:31.092 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 1646, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 1646, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 3, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2023-10-05T15:54:31.093 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 3, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 6244811, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 679, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.984348338, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004395211 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2023-10-05T15:54:31.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 255, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 462, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 207, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 26, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 27, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 1, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 252, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 466, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 214, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 235, 2023-10-05T15:54:31.095 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 442, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 207, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 55152, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 198960 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 2822, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 1551, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 13, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 412, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 204, 2023-10-05T15:54:31.096 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.613028710, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003005042 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 34, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.021407931, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000629645 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1094, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.462860263, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000423089 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:31.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.099 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.100 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001298250, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000432750 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2023-10-05T15:54:31.102 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.005442925, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000907154 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 204, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.979713755, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004802518 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.103 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:31.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.105 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2023-10-05T15:54:31.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.107 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.008275382, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002758460 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 1, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 0, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 154, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 154, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 1068, 2023-10-05T15:54:31.109 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:31.110 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:31.111 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:31.112 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 310824, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 123, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:31.113 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 176, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 827893, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 3722, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.114 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 1770, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 2102237, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 27, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 1770, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1770, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8.144848801, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004601609 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2023-10-05T15:54:31.115 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1770, 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1841 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 1770, 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 359, 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 1411, 2023-10-05T15:54:31.116 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 127, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 806, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 112, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2023-10-05T15:54:31.118 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 426, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 232, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2023-10-05T15:54:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2023-10-05T15:54:31.120 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 4, 2023-10-05T15:54:31.121 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 87, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 21 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2023-10-05T15:54:31.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 10, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 5, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 207, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 9938, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 3015171, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 9938, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 9938, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 3015171, 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:31.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:31.125 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 1770, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2124800, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1770, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2124800, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:31.126 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 1770, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 1770, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1770, 2023-10-05T15:54:31.127 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1770, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 207, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 22563, 2023-10-05T15:54:31.128 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 207, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 127, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 22563, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x5566f006e6e0": { 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1646, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 2050507, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1646, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:31.130 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 679, 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2050507, 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:31.131 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T15:54:31.505 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2023-10-05T15:54:31.505 INFO:tasks.check_counter:Daemon mds.c mds.imported=7 2023-10-05T15:54:31.506 DEBUG:tasks.check_counter:Getting stats from f 2023-10-05T15:54:31.506 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-05T15:54:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:54:32.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:32 smithi017 ceph-mon[129107]: pgmap v907: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2023-10-05T15:54:32.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:32 smithi167 ceph-mon[133366]: pgmap v907: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2023-10-05T15:54:32.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:32 smithi079 ceph-mon[132936]: pgmap v907: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2023-10-05T15:54:34.280 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:34 smithi167 ceph-mon[133366]: pgmap v908: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:54:34.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:34 smithi017 ceph-mon[129107]: pgmap v908: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:54:34.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:34 smithi079 ceph-mon[132936]: pgmap v908: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2023-10-05T15:54:34.621 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T15:54:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2195, 2023-10-05T15:54:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 2195, 2023-10-05T15:54:34.621 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 5347572, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 681859, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.206473355, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.058555085, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.057226534, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.067987342, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2194, 2023-10-05T15:54:34.622 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.112575334, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000051310 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 448 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:34.623 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1619, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1599, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 5148288, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 591298, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.167067857, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.053207365, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.062997624, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.040165562, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1598, 2023-10-05T15:54:34.624 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.084042370, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000052592 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 631056, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 198128 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.625 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 565, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 813, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 8531881, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 701286, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.077599025, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.032746450, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.022236481, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.014564371, 2023-10-05T15:54:34.626 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 811, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.043699942, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000053884 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 526192 2023-10-05T15:54:34.627 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6796, 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.212169100, 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000031219 2023-10-05T15:54:34.628 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2023-10-05T15:54:34.629 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2023-10-05T15:54:34.630 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 267, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 134, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 92, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 41, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 75, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 23, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 6, 2023-10-05T15:54:34.631 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2023-10-05T15:54:34.632 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 1037, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 1648843456, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:34.633 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2023-10-05T15:54:34.634 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2023-10-05T15:54:34.635 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:34.636 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 7449, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2023-10-05T15:54:34.637 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 2, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 77, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 21100211, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 21473699, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 21471196, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.638 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 7449 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 211, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 1228, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 1017, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 42, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 75, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 33, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 267, 2023-10-05T15:54:34.639 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 1275, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 1008, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 51452, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 207152 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2023-10-05T15:54:34.640 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.641 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.642 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.643 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.644 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.645 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.646 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2023-10-05T15:54:34.647 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.648 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.649 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:34.650 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.651 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.652 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.653 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 3, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 2, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 2855, 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:34.654 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:34.655 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:34.656 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:34.657 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 207145, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 64, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:34.658 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 176, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 673674, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 2115, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:34.659 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 4018, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 26, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 4, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 4018, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4018, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.932926669, 2023-10-05T15:54:34.660 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000978826 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4018, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 4019 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 4018, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 4018, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2023-10-05T15:54:34.661 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 2340, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 1675, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2023-10-05T15:54:34.662 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 2, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2023-10-05T15:54:34.663 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2023-10-05T15:54:34.664 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 4, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 7, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 8, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 1, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2023-10-05T15:54:34.665 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2023-10-05T15:54:34.666 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:34.667 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 4375, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 18612786, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 4375, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 4375, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 18612786, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.668 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 4018, 2023-10-05T15:54:34.669 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 17279405, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 4018, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 17279405, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:34.670 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 4018, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 4018, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 4018, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 4018, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.671 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:34.672 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x55f53fbdea00": { 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:34.673 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:34.674 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:34.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:34.675 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T15:54:35.113 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-10-05T15:54:35.113 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-10-05T15:54:35.113 DEBUG:tasks.check_counter:Getting stats from i 2023-10-05T15:54:35.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-05T15:54:35.929 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:54:36.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:36 smithi017 ceph-mon[129107]: pgmap v909: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:54:36.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:36 smithi167 ceph-mon[133366]: pgmap v909: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:54:36.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:36 smithi079 ceph-mon[132936]: pgmap v909: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:54:38.116 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T15:54:38.116 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:38.116 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2273, 2023-10-05T15:54:38.116 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 3083, 2023-10-05T15:54:38.116 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 894265, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 4079783, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 16, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.381993617, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.086613052, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.104039828, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.194750922, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3082, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.200299381, 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000064990 2023-10-05T15:54:38.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3192, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000825033, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000258 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 448 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 3956122, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 3956217, 2023-10-05T15:54:38.118 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 625864434, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 657190279, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 13, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 221.104672977, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 92.177721659, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 153.316853250, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.010971871, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3956216, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 90.097707229, 2023-10-05T15:54:38.119 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000022773 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7910832, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.038679596, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000131 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 649664, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 203200 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 105474, 2023-10-05T15:54:38.120 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 105552, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 17876171, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 17953949, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 10, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 4.926868364, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 2.066245185, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 3.309862206, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.022606493, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 105550, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.680667922, 2023-10-05T15:54:38.121 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000015922 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 210377, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.022804482, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000108 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 533968 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2023-10-05T15:54:38.122 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1225, 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.459782682, 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000375332 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:38.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 26, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000881594, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000033907 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 361, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 255, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 255, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.290277551, 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001138343 2023-10-05T15:54:38.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 106, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 11, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 386, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 0, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 373, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 13, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 385, 2023-10-05T15:54:38.125 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 160, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 368, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 368, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 17, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 477, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 344, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 92, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 11, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 285, 2023-10-05T15:54:38.126 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 6, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 156, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 10, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 519, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 178, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 1040, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 1648855227, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 178, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:38.127 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 178, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 13, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 170, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:38.128 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 941, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 726, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 1, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 5 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 39, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 5, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:38.129 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 1, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 1, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 6, 2023-10-05T15:54:38.130 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 1266, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 1266, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2023-10-05T15:54:38.131 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 3, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 3, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 6806330, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 482, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.499208343, 2023-10-05T15:54:38.132 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.005185079 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 388, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 542, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 154, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 48, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 51, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 3, 2023-10-05T15:54:38.133 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 386, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 549, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 163, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 368, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 519, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 151, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 57144, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 198960 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 373, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 16, 2023-10-05T15:54:38.134 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 361, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 18, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 36, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.007414776, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002471592 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001984711, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000396942 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.135 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 96, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.047725718, 2023-10-05T15:54:38.136 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000497142 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.137 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.138 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001666303, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001666303 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.139 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 137, 2023-10-05T15:54:38.140 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.219392875, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001601407 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 12, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.010988682, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000915723 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2023-10-05T15:54:38.142 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.143 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:38.144 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.001104486, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001104486 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:38.146 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 1, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 0, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2023-10-05T15:54:38.147 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 17, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 17, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 1075, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:38.148 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:38.149 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2023-10-05T15:54:38.150 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 299234, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 122, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:38.151 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 176, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 1273519, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 5282, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2023-10-05T15:54:38.152 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 837, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 2644998, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 27, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 837, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 837, 2023-10-05T15:54:38.153 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.695931190, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004415688 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 837, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 919 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 837, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 179, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 658, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2023-10-05T15:54:38.154 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 1, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 483, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 69, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 29, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:38.155 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 178, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2023-10-05T15:54:38.156 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2023-10-05T15:54:38.157 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 4, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 106, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2023-10-05T15:54:38.158 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 23 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:38.159 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 17, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 1, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 1, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 68, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 4063866, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 278864537, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:38.160 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 4063866, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 4063866, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 278864537, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:38.161 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 837, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2645107, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 837, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2645107, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.162 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 837, 2023-10-05T15:54:38.163 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 837, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 837, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 837, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:38.164 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 109, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 109, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.165 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x558f8d5006e0": { 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 1266, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 2612026, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 1266, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:38.166 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 482, 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2612026, 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:38.167 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T15:54:38.354 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:38 smithi079 ceph-mon[132936]: pgmap v910: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-05T15:54:38.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:38 smithi017 ceph-mon[129107]: pgmap v910: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-05T15:54:38.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:38 smithi167 ceph-mon[133366]: pgmap v910: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-05T15:54:39.029 INFO:tasks.check_counter:Daemon mds.i mds.exported=6 2023-10-05T15:54:39.030 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2023-10-05T15:54:39.030 DEBUG:tasks.check_counter:Getting stats from l 2023-10-05T15:54:39.030 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:689b3d5ae1ed3e8efe9a65281cd9bd422749e95f shell --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-05T15:54:39.871 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-05T15:54:40.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:40 smithi017 ceph-mon[129107]: pgmap v911: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-05T15:54:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:40 smithi167 ceph-mon[133366]: pgmap v911: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-05T15:54:40.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:40 smithi079 ceph-mon[132936]: pgmap v911: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1180, 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1180, 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 398025, 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 366185, 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2023-10-05T15:54:41.451 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 2, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.121186480, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.036673820, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.030942164, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.038476802, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1179, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.072504741, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000061496 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:41.452 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 448 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2378, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 2630, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 2654273, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 1212456, 2023-10-05T15:54:41.453 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.205127812, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.074561655, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.051540429, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.062148363, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2628, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.135684450, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000051630 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:41.454 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 473152 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 365, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 345, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 634548, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 202976, 2023-10-05T15:54:41.455 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.057443478, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.022341327, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.026236646, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.008235786, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 344, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.022327848, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000064906 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.456 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 633200, 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 202032 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2023-10-05T15:54:41.457 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5951, 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.155619706, 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000026150 2023-10-05T15:54:41.458 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2023-10-05T15:54:41.459 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2023-10-05T15:54:41.460 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 451, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 163, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 280, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 8, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 218, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 8, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2023-10-05T15:54:41.461 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2023-10-05T15:54:41.462 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2023-10-05T15:54:41.463 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.464 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2023-10-05T15:54:41.465 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2023-10-05T15:54:41.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 1646, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2023-10-05T15:54:41.467 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 3, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 6244811, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 6238234, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.468 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 1646 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 246, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 454, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 208, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 17, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 18, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 1, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 451, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 458, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 7, 2023-10-05T15:54:41.469 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 49312, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 207152 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2023-10-05T15:54:41.470 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.471 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.472 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.473 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.475 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.476 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.477 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2023-10-05T15:54:41.478 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.479 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.480 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.481 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.482 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 1, 2023-10-05T15:54:41.483 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 2860, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2023-10-05T15:54:41.484 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2023-10-05T15:54:41.485 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-05T15:54:41.486 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 198304, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 58, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2023-10-05T15:54:41.487 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 9176, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 176, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2023-10-05T15:54:41.488 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 834589, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 2195, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2023-10-05T15:54:41.489 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 3556, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 21, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 3, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 3556, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3556, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 5.314900421, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001494628 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3556, 2023-10-05T15:54:41.490 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3557 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 3556, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 3556, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 2249, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 1305, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2023-10-05T15:54:41.491 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 1, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2023-10-05T15:54:41.492 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2023-10-05T15:54:41.493 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2023-10-05T15:54:41.494 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 4, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 6, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 8, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 2, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2023-10-05T15:54:41.495 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2023-10-05T15:54:41.496 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 3919, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 3312604, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 3919, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:41.497 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 3919, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 3312604, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2023-10-05T15:54:41.498 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 3556, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2050512, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 3556, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2050512, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.499 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 3556, 2023-10-05T15:54:41.500 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 3556, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 3556, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 3556, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:41.501 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.502 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x562af7686a00": { 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2023-10-05T15:54:41.503 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T15:54:41.504 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T15:54:42.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:42 smithi017 ceph-mon[129107]: pgmap v912: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:54:42.481 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:42 smithi167 ceph-mon[133366]: pgmap v912: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:54:42.484 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-05T15:54:42.485 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-05T15:54:42.485 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-05T15:54:42.495 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-05T15:54:42.496 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:54:42.496 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:54:42.554 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:54:42.554 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:54:42.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:54:42.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:42 smithi079 ceph-mon[132936]: pgmap v912: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 -- 172.21.15.17:0/999104165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102080 msgr2=0x7faf7c102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 --2- 172.21.15.17:0/999104165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102080 0x7faf7c102500 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009990 tx=0x7faf6c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 -- 172.21.15.17:0/999104165 shutdown_connections 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 --2- 172.21.15.17:0/999104165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102a40 0x7faf7c109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 --2- 172.21.15.17:0/999104165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 --2- 172.21.15.17:0/999104165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102080 0x7faf7c102500 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 -- 172.21.15.17:0/999104165 >> 172.21.15.17:0/999104165 conn(0x7faf7c0fc420 msgr2=0x7faf7c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 -- 172.21.15.17:0/999104165 shutdown_connections 2023-10-05T15:54:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.848+0000 7faf837ff700 1 -- 172.21.15.17:0/999104165 wait complete. 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.849+0000 7faf837ff700 1 Processor -- start 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.849+0000 7faf837ff700 1 -- start start 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf837ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf837ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 0x7faf7c197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf837ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102a40 0x7faf7c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf837ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c19e670 con 0x7faf7c102080 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf837ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c19e7b0 con 0x7faf7c100ea0 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf837ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c19e940 con 0x7faf7c102a40 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf80d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 0x7faf7c197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:42.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf80d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 0x7faf7c197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34398/0 (socket says 172.21.15.17:34398) 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:60868/0 (socket says 172.21.15.17:60868) 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf80d9a700 1 -- 172.21.15.17:0/2650872442 learned_addr learned my addr 172.21.15.17:0/2650872442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf81d9c700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102a40 0x7faf7c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 -- 172.21.15.17:0/2650872442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102a40 msgr2=0x7faf7c19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102a40 0x7faf7c19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 -- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 msgr2=0x7faf7c197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 0x7faf7c197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf8159b700 1 -- 172.21.15.17:0/2650872442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0095f0 con 0x7faf7c100ea0 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.850+0000 7faf80d9a700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 0x7faf7c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.851+0000 7faf8159b700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c196af0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faf7800e9c0 tx=0x7faf7800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:42.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.851+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78004220 con 0x7faf7c100ea0 2023-10-05T15:54:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.851+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c19ec20 con 0x7faf7c100ea0 2023-10-05T15:54:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.851+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf78004380 con 0x7faf7c100ea0 2023-10-05T15:54:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.851+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78003b40 con 0x7faf7c100ea0 2023-10-05T15:54:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.851+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c19f180 con 0x7faf7c100ea0 2023-10-05T15:54:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.852+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c10c5c0 con 0x7faf7c100ea0 2023-10-05T15:54:42.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.854+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7faf78003ca0 con 0x7faf7c100ea0 2023-10-05T15:54:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.855+0000 7faf727fc700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faf680a14d0 0x7faf680a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.856+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7faf78014070 con 0x7faf7c100ea0 2023-10-05T15:54:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.856+0000 7faf80d9a700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faf680a14d0 0x7faf680a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:42.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.856+0000 7faf80d9a700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faf680a14d0 0x7faf680a3990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faf6c005910 tx=0x7faf6c005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:42.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:42.859+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faf78096980 con 0x7faf7c100ea0 2023-10-05T15:54:43.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.071+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf7c10c750 con 0x7faf7c100ea0 2023-10-05T15:54:43.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.073+0000 7faf727fc700 1 -- 172.21.15.17:0/2650872442 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7faf78099fa0 con 0x7faf7c100ea0 2023-10-05T15:54:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:54:43.076 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faf680a14d0 msgr2=0x7faf680a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faf680a14d0 0x7faf680a3990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faf6c005910 tx=0x7faf6c005960 comp rx=0 tx=0).stop 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 msgr2=0x7faf7c196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c196af0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faf7800e9c0 tx=0x7faf7800ecd0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 shutdown_connections 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7faf680a14d0 0x7faf680a3990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf7c102a40 0x7faf7c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7c100ea0 0x7faf7c196af0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 --2- 172.21.15.17:0/2650872442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf7c102080 0x7faf7c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 >> 172.21.15.17:0/2650872442 conn(0x7faf7c0fc420 msgr2=0x7faf7c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 shutdown_connections 2023-10-05T15:54:43.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.076+0000 7faf837ff700 1 -- 172.21.15.17:0/2650872442 wait complete. 2023-10-05T15:54:43.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:54:43.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:54:43.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 -- 172.21.15.17:0/3559932259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74102a30 msgr2=0x7f4b74109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 --2- 172.21.15.17:0/3559932259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74102a30 0x7f4b74109350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00b0a0 tx=0x7f4b6c00b3b0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 -- 172.21.15.17:0/3559932259 shutdown_connections 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 --2- 172.21.15.17:0/3559932259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74102a30 0x7f4b74109350 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 --2- 172.21.15.17:0/3559932259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b74100e90 0x7f4b741012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 --2- 172.21.15.17:0/3559932259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b74102070 0x7f4b741024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 -- 172.21.15.17:0/3559932259 >> 172.21.15.17:0/3559932259 conn(0x7f4b740fc430 msgr2=0x7f4b740fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.305+0000 7f4b78fff700 1 -- 172.21.15.17:0/3559932259 shutdown_connections 2023-10-05T15:54:43.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.306+0000 7f4b78fff700 1 -- 172.21.15.17:0/3559932259 wait complete. 2023-10-05T15:54:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.306+0000 7f4b78fff700 1 Processor -- start 2023-10-05T15:54:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 -- start start 2023-10-05T15:54:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 0x7f4b74198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b74102070 0x7f4b74199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b74102a30 0x7f4b741a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741a0960 con 0x7f4b74100e90 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741a0aa0 con 0x7f4b74102070 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b78fff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741a0c30 con 0x7f4b74102a30 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b6a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 0x7f4b74198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b6a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 0x7f4b74198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34426/0 (socket says 172.21.15.17:34426) 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b6a59c700 1 -- 172.21.15.17:0/2191626344 learned_addr learned my addr 172.21.15.17:0/2191626344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b7259c700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b74102070 0x7f4b74199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.307+0000 7f4b72d9d700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b74102a30 0x7f4b741a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6a59c700 1 -- 172.21.15.17:0/2191626344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b74102a30 msgr2=0x7f4b741a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6a59c700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b74102a30 0x7f4b741a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6a59c700 1 -- 172.21.15.17:0/2191626344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b74102070 msgr2=0x7f4b74199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6a59c700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b74102070 0x7f4b74199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6a59c700 1 -- 172.21.15.17:0/2191626344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c009d00 con 0x7f4b74100e90 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6a59c700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 0x7f4b74198de0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400e970 tx=0x7f4b6400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64009790 con 0x7f4b74100e90 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b6400c7e0 con 0x7f4b74100e90 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64003bd0 con 0x7f4b74100e90 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b741a0f10 con 0x7f4b74100e90 2023-10-05T15:54:43.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.308+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b741a1330 con 0x7f4b74100e90 2023-10-05T15:54:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.309+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7410c620 con 0x7f4b74100e90 2023-10-05T15:54:43.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.311+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f4b6400c950 con 0x7f4b74100e90 2023-10-05T15:54:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.312+0000 7f4b6bfff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b600a1500 0x7f4b600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.313+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f4b64014070 con 0x7f4b74100e90 2023-10-05T15:54:43.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.313+0000 7f4b7259c700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b600a1500 0x7f4b600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.313+0000 7f4b7259c700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b600a1500 0x7f4b600a39c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b74100bb0 tx=0x7f4b5c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:43.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.317+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4b640964b0 con 0x7f4b74100e90 2023-10-05T15:54:43.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:43 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2650872442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:54:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.526+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b741a1b90 con 0x7f4b74100e90 2023-10-05T15:54:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.527+0000 7f4b6bfff700 1 -- 172.21.15.17:0/2191626344 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b64099ad0 con 0x7f4b74100e90 2023-10-05T15:54:43.529 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:54:43.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.529+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b600a1500 msgr2=0x7f4b600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.529+0000 7f4b78fff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b600a1500 0x7f4b600a39c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b74100bb0 tx=0x7f4b5c009260 comp rx=0 tx=0).stop 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.529+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 msgr2=0x7f4b74198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.529+0000 7f4b78fff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 0x7f4b74198de0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400e970 tx=0x7f4b6400ec80 comp rx=0 tx=0).stop 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 shutdown_connections 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f4b600a1500 0x7f4b600a39c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b74102a30 0x7f4b741a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b74100e90 0x7f4b74198de0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 --2- 172.21.15.17:0/2191626344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b74102070 0x7f4b74199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 >> 172.21.15.17:0/2191626344 conn(0x7f4b740fc430 msgr2=0x7f4b740fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 shutdown_connections 2023-10-05T15:54:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.530+0000 7f4b78fff700 1 -- 172.21.15.17:0/2191626344 wait complete. 2023-10-05T15:54:43.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:54:43.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:43 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2650872442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:54:43.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:43 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2650872442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:54:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.755+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/983065436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 msgr2=0x7fe1b41012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.755+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/983065436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b41012c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80098f0 tx=0x7fe1a8009c00 comp rx=0 tx=0).stop 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/983065436 shutdown_connections 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/983065436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b4102a40 0x7fe1b4109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/983065436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b41012c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/983065436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b4102080 0x7fe1b4102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/983065436 >> 172.21.15.17:0/983065436 conn(0x7fe1b40fc460 msgr2=0x7fe1b40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/983065436 shutdown_connections 2023-10-05T15:54:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.756+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/983065436 wait complete. 2023-10-05T15:54:43.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 Processor -- start 2023-10-05T15:54:43.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 -- start start 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b4198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b4102080 0x7fe1b41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b4102a40 0x7fe1b41a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41a08e0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41a0a50 con 0x7fe1b4102080 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1bb1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41a0c10 con 0x7fe1b4102a40 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b4198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b4198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34448/0 (socket says 172.21.15.17:34448) 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.757+0000 7fe1b8f9b700 1 -- 172.21.15.17:0/420739881 learned_addr learned my addr 172.21.15.17:0/420739881 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b3fff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b4102080 0x7fe1b41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b979c700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b4102a40 0x7fe1b41a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b8f9b700 1 -- 172.21.15.17:0/420739881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b4102a40 msgr2=0x7fe1b41a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b8f9b700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b4102a40 0x7fe1b41a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b8f9b700 1 -- 172.21.15.17:0/420739881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b4102080 msgr2=0x7fe1b41992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b8f9b700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b4102080 0x7fe1b41992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b8f9b700 1 -- 172.21.15.17:0/420739881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8009520 con 0x7fe1b4100ea0 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b8f9b700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b4198da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000c00 tx=0x7fe1a800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a801c070 con 0x7fe1b4100ea0 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1a800f7b0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b41a0e90 con 0x7fe1b4100ea0 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.758+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80038e0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.759+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b41a1250 con 0x7fe1b4100ea0 2023-10-05T15:54:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.760+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b410c5c0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.762+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fe1a8020030 con 0x7fe1b4100ea0 2023-10-05T15:54:43.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.763+0000 7fe1b1ffb700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a40a1500 0x7fe1a40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:43.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.763+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fe1a80ce3c0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.763+0000 7fe1b3fff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a40a1500 0x7fe1a40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:43.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.764+0000 7fe1b3fff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a40a1500 0x7fe1a40a39c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4100bc0 tx=0x7fe1a0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:43.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.765+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1a80976b0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.979+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1b41a1440 con 0x7fe1b4100ea0 2023-10-05T15:54:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.980+0000 7fe1b1ffb700 1 -- 172.21.15.17:0/420739881 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1a809acd0 con 0x7fe1b4100ea0 2023-10-05T15:54:43.982 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:54:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a40a1500 msgr2=0x7fe1a40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a40a1500 0x7fe1a40a39c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4100bc0 tx=0x7fe1a0009260 comp rx=0 tx=0).stop 2023-10-05T15:54:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 msgr2=0x7fe1b4198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b4198da0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8000c00 tx=0x7fe1a800b790 comp rx=0 tx=0).stop 2023-10-05T15:54:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 shutdown_connections 2023-10-05T15:54:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fe1a40a1500 0x7fe1a40a39c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b4102a40 0x7fe1b41a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1b4100ea0 0x7fe1b4198da0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 --2- 172.21.15.17:0/420739881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1b4102080 0x7fe1b41992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 >> 172.21.15.17:0/420739881 conn(0x7fe1b40fc460 msgr2=0x7fe1b40fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 shutdown_connections 2023-10-05T15:54:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:43.982+0000 7fe1bb1ff700 1 -- 172.21.15.17:0/420739881 wait complete. 2023-10-05T15:54:44.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:54:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 -- 172.21.15.17:0/4089218618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c100e90 msgr2=0x7fa39c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/4089218618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c100e90 0x7fa39c1012b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009990 tx=0x7fa38c009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 -- 172.21.15.17:0/4089218618 shutdown_connections 2023-10-05T15:54:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/4089218618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c102a30 0x7fa39c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/4089218618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c100e90 0x7fa39c1012b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/4089218618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa39c102070 0x7fa39c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 -- 172.21.15.17:0/4089218618 >> 172.21.15.17:0/4089218618 conn(0x7fa39c0fc430 msgr2=0x7fa39c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:44.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 -- 172.21.15.17:0/4089218618 shutdown_connections 2023-10-05T15:54:44.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.206+0000 7fa3a11ff700 1 -- 172.21.15.17:0/4089218618 wait complete. 2023-10-05T15:54:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.207+0000 7fa3a11ff700 1 Processor -- start 2023-10-05T15:54:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.207+0000 7fa3a11ff700 1 -- start start 2023-10-05T15:54:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa3a11ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 0x7fa39c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa3a11ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c102070 0x7fa39c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa3a11ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa39c102a30 0x7fa39c1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa3a11ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1a08f0 con 0x7fa39c102070 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa3a11ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1a0a30 con 0x7fa39c100e90 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa3a11ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1a0bc0 con 0x7fa39c102a30 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c102070 0x7fa39c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 0x7fa39c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 0x7fa39c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50512/0 (socket says 172.21.15.17:50512) 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 -- 172.21.15.17:0/98223053 learned_addr learned my addr 172.21.15.17:0/98223053 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39b59e700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa39c102a30 0x7fa39c1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 -- 172.21.15.17:0/98223053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa39c102a30 msgr2=0x7fa39c1a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa39c102a30 0x7fa39c1a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 -- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c102070 msgr2=0x7fa39c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c102070 0x7fa39c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.208+0000 7fa39ad9d700 1 -- 172.21.15.17:0/98223053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0095f0 con 0x7fa39c100e90 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.209+0000 7fa39ad9d700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 0x7fa39c198d70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0098e0 tx=0x7fa38c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.209+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c01d070 con 0x7fa39c100e90 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.209+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa38c00bdb0 con 0x7fa39c100e90 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.209+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c1a0e40 con 0x7fa39c100e90 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.209+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c022cf0 con 0x7fa39c100e90 2023-10-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.209+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c1a11b0 con 0x7fa39c100e90 2023-10-05T15:54:44.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.210+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c10c670 con 0x7fa39c100e90 2023-10-05T15:54:44.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.212+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa38c022470 con 0x7fa39c100e90 2023-10-05T15:54:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.213+0000 7fa383fff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3840a1480 0x7fa3840a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.213+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa38c0ce740 con 0x7fa39c100e90 2023-10-05T15:54:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.214+0000 7fa39a59c700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3840a1480 0x7fa3840a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.214+0000 7fa39a59c700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3840a1480 0x7fa3840a3940 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa39c100bb0 tx=0x7fa390009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:44.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.218+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa38c097a30 con 0x7fa39c100e90 2023-10-05T15:54:44.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.428+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa39c1a13a0 con 0x7fa39c100e90 2023-10-05T15:54:44.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.428+0000 7fa383fff700 1 -- 172.21.15.17:0/98223053 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa38c09b050 con 0x7fa39c100e90 2023-10-05T15:54:44.433 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:54:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3840a1480 msgr2=0x7fa3840a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3840a1480 0x7fa3840a3940 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa39c100bb0 tx=0x7fa390009260 comp rx=0 tx=0).stop 2023-10-05T15:54:44.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 msgr2=0x7fa39c198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 0x7fa39c198d70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0098e0 tx=0x7fa38c004730 comp rx=0 tx=0).stop 2023-10-05T15:54:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 shutdown_connections 2023-10-05T15:54:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa3840a1480 0x7fa3840a3940 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa39c102a30 0x7fa39c1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c100e90 0x7fa39c198d70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 --2- 172.21.15.17:0/98223053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa39c102070 0x7fa39c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 >> 172.21.15.17:0/98223053 conn(0x7fa39c0fc430 msgr2=0x7fa39c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 shutdown_connections 2023-10-05T15:54:44.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.431+0000 7fa3a11ff700 1 -- 172.21.15.17:0/98223053 wait complete. 2023-10-05T15:54:44.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:44 smithi017 ceph-mon[129107]: pgmap v913: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:54:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:44 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2191626344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:54:44.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:44 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/420739881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:54:44.451 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:54:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:44 smithi167 ceph-mon[133366]: pgmap v913: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:54:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:44 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2191626344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:54:44.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:44 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/420739881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:54:44.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:44 smithi079 ceph-mon[132936]: pgmap v913: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-05T15:54:44.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:44 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2191626344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:54:44.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:44 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/420739881' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 -- 172.21.15.17:0/371956875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 msgr2=0x7f03401024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 --2- 172.21.15.17:0/371956875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f03401024e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f03300098f0 tx=0x7f0330009c00 comp rx=0 tx=0).stop 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 -- 172.21.15.17:0/371956875 shutdown_connections 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 --2- 172.21.15.17:0/371956875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340102a20 0x7f0340109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 --2- 172.21.15.17:0/371956875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0340100f10 0x7f0340101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 --2- 172.21.15.17:0/371956875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f03401024e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 -- 172.21.15.17:0/371956875 >> 172.21.15.17:0/371956875 conn(0x7f03400fc460 msgr2=0x7f03400fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 -- 172.21.15.17:0/371956875 shutdown_connections 2023-10-05T15:54:44.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.657+0000 7f03477ff700 1 -- 172.21.15.17:0/371956875 wait complete. 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 Processor -- start 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 -- start start 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340100f10 0x7f0340198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f0340199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0340102a20 0x7f03401a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03401a0940 con 0x7f0340102060 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03401a0a80 con 0x7f0340102a20 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f03477ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03401a0c10 con 0x7f0340100f10 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.658+0000 7f0344d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f0340199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f0340199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60030/0 (socket says 172.21.15.17:60030) 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 -- 172.21.15.17:0/3574871096 learned_addr learned my addr 172.21.15.17:0/3574871096 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0345d9c700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0340102a20 0x7f03401a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f034559b700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340100f10 0x7f0340198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 -- 172.21.15.17:0/3574871096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340100f10 msgr2=0x7f0340198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340100f10 0x7f0340198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 -- 172.21.15.17:0/3574871096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0340102a20 msgr2=0x7f03401a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0340102a20 0x7f03401a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 -- 172.21.15.17:0/3574871096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0095f0 con 0x7f0340102060 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f0344d9a700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f0340199300 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0330009fd0 tx=0x7f033000bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:44.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033001c070 con 0x7f0340102060 2023-10-05T15:54:44.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0330009520 con 0x7f0340102060 2023-10-05T15:54:44.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.659+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f033000bb10 con 0x7f0340102060 2023-10-05T15:54:44.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.660+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0330004910 con 0x7f0340102060 2023-10-05T15:54:44.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.660+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03401a1130 con 0x7f0340102060 2023-10-05T15:54:44.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.661+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0340193400 con 0x7f0340102060 2023-10-05T15:54:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.662+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f0330020070 con 0x7f0340102060 2023-10-05T15:54:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.664+0000 7f03367fc700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f032c0a1480 0x7f032c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.664+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f03300cde80 con 0x7f0340102060 2023-10-05T15:54:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.664+0000 7f034559b700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f032c0a1480 0x7f032c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.665+0000 7f034559b700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f032c0a1480 0x7f032c0a3940 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f033c005fd0 tx=0x7f033c009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:44.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.668+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0330097170 con 0x7f0340102060 2023-10-05T15:54:44.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.885+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f034002d190 con 0x7f0340102060 2023-10-05T15:54:44.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.886+0000 7f03367fc700 1 -- 172.21.15.17:0/3574871096 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f033009a790 con 0x7f0340102060 2023-10-05T15:54:44.887 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:54:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f032c0a1480 msgr2=0x7f032c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f032c0a1480 0x7f032c0a3940 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f033c005fd0 tx=0x7f033c009310 comp rx=0 tx=0).stop 2023-10-05T15:54:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 msgr2=0x7f0340199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f0340199300 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0330009fd0 tx=0x7f033000bf80 comp rx=0 tx=0).stop 2023-10-05T15:54:44.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 shutdown_connections 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f032c0a1480 0x7f032c0a3940 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0340102a20 0x7f03401a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340100f10 0x7f0340198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 --2- 172.21.15.17:0/3574871096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0340102060 0x7f0340199300 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.888+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 >> 172.21.15.17:0/3574871096 conn(0x7f03400fc460 msgr2=0x7f0340107b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.889+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 shutdown_connections 2023-10-05T15:54:44.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:44.889+0000 7f03477ff700 1 -- 172.21.15.17:0/3574871096 wait complete. 2023-10-05T15:54:44.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 -- 172.21.15.17:0/814859836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102070 msgr2=0x7fa56c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 --2- 172.21.15.17:0/814859836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102070 0x7fa56c1024f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa554009990 tx=0x7fa554009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 -- 172.21.15.17:0/814859836 shutdown_connections 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 --2- 172.21.15.17:0/814859836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102a30 0x7fa56c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 --2- 172.21.15.17:0/814859836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56c100e90 0x7fa56c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 --2- 172.21.15.17:0/814859836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102070 0x7fa56c1024f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 -- 172.21.15.17:0/814859836 >> 172.21.15.17:0/814859836 conn(0x7fa56c0fc430 msgr2=0x7fa56c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:45.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 -- 172.21.15.17:0/814859836 shutdown_connections 2023-10-05T15:54:45.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.112+0000 7fa5721ff700 1 -- 172.21.15.17:0/814859836 wait complete. 2023-10-05T15:54:45.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 Processor -- start 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 -- start start 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56c100e90 0x7fa56c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 0x7fa56c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102a30 0x7fa56c1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1a08f0 con 0x7fa56c102070 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1a0a60 con 0x7fa56c102a30 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.113+0000 7fa5721ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c1a0c20 con 0x7fa56c100e90 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 0x7fa56c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa5637fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56c100e90 0x7fa56c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102a30 0x7fa56c1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 0x7fa56c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60034/0 (socket says 172.21.15.17:60034) 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 -- 172.21.15.17:0/266554343 learned_addr learned my addr 172.21.15.17:0/266554343 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 -- 172.21.15.17:0/266554343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56c100e90 msgr2=0x7fa56c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56c100e90 0x7fa56c198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 -- 172.21.15.17:0/266554343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102a30 msgr2=0x7fa56c1a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102a30 0x7fa56c1a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 -- 172.21.15.17:0/266554343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009c40 con 0x7fa56c102070 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.114+0000 7fa56b7fe700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 0x7fa56c1992f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa5540098e0 tx=0x7fa554004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.115+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55401d070 con 0x7fa56c102070 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.115+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa55400be30 con 0x7fa56c102070 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.115+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5540095f0 con 0x7fa56c102070 2023-10-05T15:54:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.115+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554022d80 con 0x7fa56c102070 2023-10-05T15:54:45.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.115+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c1a1190 con 0x7fa56c102070 2023-10-05T15:54:45.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.116+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c1933f0 con 0x7fa56c102070 2023-10-05T15:54:45.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.118+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fa554022470 con 0x7fa56c102070 2023-10-05T15:54:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.119+0000 7fa5697fa700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5580a1500 0x7fa5580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.120+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fa5540ce500 con 0x7fa56c102070 2023-10-05T15:54:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.120+0000 7fa5637fe700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5580a1500 0x7fa5580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.120+0000 7fa5637fe700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5580a1500 0x7fa5580a39c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa56c19a280 tx=0x7fa55c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:45.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.123+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa5540977f0 con 0x7fa56c102070 2023-10-05T15:54:45.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.357+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa56c10c600 con 0x7fa56c102070 2023-10-05T15:54:45.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.357+0000 7fa5697fa700 1 -- 172.21.15.17:0/266554343 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) v1 ==== 81+0+592 (secure 0 0 0) 0x7fa55409ae10 con 0x7fa56c102070 2023-10-05T15:54:45.359 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2395163877 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:45.359 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:45.360 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:45.360 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2135774582 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:45.360 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3151379810 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:45.360 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2053167755 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:45.360 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:45.361 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360652288 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:45.361 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4090412968 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:45.361 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:45.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5580a1500 msgr2=0x7fa5580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5580a1500 0x7fa5580a39c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa56c19a280 tx=0x7fa55c009260 comp rx=0 tx=0).stop 2023-10-05T15:54:45.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 msgr2=0x7fa56c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 0x7fa56c1992f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa5540098e0 tx=0x7fa554004730 comp rx=0 tx=0).stop 2023-10-05T15:54:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 shutdown_connections 2023-10-05T15:54:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fa5580a1500 0x7fa5580a39c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c102a30 0x7fa56c1a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa56c100e90 0x7fa56c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 --2- 172.21.15.17:0/266554343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa56c102070 0x7fa56c1992f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 >> 172.21.15.17:0/266554343 conn(0x7fa56c0fc430 msgr2=0x7fa56c107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 shutdown_connections 2023-10-05T15:54:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.360+0000 7fa5721ff700 1 -- 172.21.15.17:0/266554343 wait complete. 2023-10-05T15:54:45.364 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2023-10-05T15:54:45.379 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-10-05T15:54:45.380 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-05T15:54:45.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T15:54:45.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/98223053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:54:45.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:45 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3574871096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:54:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/98223053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:54:45.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:45 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3574871096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:54:45.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/98223053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:54:45.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:45 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3574871096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:54:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 -- 172.21.15.17:0/453458291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc102080 msgr2=0x7fcacc102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 --2- 172.21.15.17:0/453458291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc102080 0x7fcacc102500 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009990 tx=0x7fcac0009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 -- 172.21.15.17:0/453458291 shutdown_connections 2023-10-05T15:54:45.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 --2- 172.21.15.17:0/453458291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcacc102a40 0x7fcacc109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 --2- 172.21.15.17:0/453458291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc100ea0 0x7fcacc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 --2- 172.21.15.17:0/453458291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc102080 0x7fcacc102500 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 -- 172.21.15.17:0/453458291 >> 172.21.15.17:0/453458291 conn(0x7fcacc0fc420 msgr2=0x7fcacc0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 -- 172.21.15.17:0/453458291 shutdown_connections 2023-10-05T15:54:45.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.646+0000 7fcad21ff700 1 -- 172.21.15.17:0/453458291 wait complete. 2023-10-05T15:54:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.647+0000 7fcad21ff700 1 Processor -- start 2023-10-05T15:54:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.647+0000 7fcad21ff700 1 -- start start 2023-10-05T15:54:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcad21ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 0x7fcacc198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcad21ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 0x7fcacc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcad21ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcacc102a40 0x7fcacc1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcad21ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc1a08e0 con 0x7fcacc102080 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcad21ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc1a0a50 con 0x7fcacc102a40 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcad21ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc1a0c10 con 0x7fcacc100ea0 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 0x7fcacc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 0x7fcacc198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 0x7fcacc198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:49770/0 (socket says 172.21.15.17:49770) 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 0x7fcacc1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60044/0 (socket says 172.21.15.17:60044) 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 -- 172.21.15.17:0/2732922559 learned_addr learned my addr 172.21.15.17:0/2732922559 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacbfff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcacc102a40 0x7fcacc1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 -- 172.21.15.17:0/2732922559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcacc102a40 msgr2=0x7fcacc1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcacc102a40 0x7fcacc1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 -- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 msgr2=0x7fcacc1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 0x7fcacc1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.648+0000 7fcacb7fe700 1 -- 172.21.15.17:0/2732922559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00095f0 con 0x7fcacc100ea0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcacaffd700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 0x7fcacc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcacb7fe700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 0x7fcacc198da0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e970 tx=0x7fcabc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc009790 con 0x7fcacc100ea0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcabc00c7e0 con 0x7fcacc100ea0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc1a0ef0 con 0x7fcacc100ea0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc003bd0 con 0x7fcacc100ea0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.649+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc1a1310 con 0x7fcacc100ea0 2023-10-05T15:54:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.650+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc10c610 con 0x7fcacc100ea0 2023-10-05T15:54:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.652+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7fcabc00c950 con 0x7fcacc100ea0 2023-10-05T15:54:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.654+0000 7fcac8ff9700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcab40a14d0 0x7fcab40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.654+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7fcabc014070 con 0x7fcacc100ea0 2023-10-05T15:54:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.654+0000 7fcacaffd700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcab40a14d0 0x7fcab40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.655+0000 7fcacaffd700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcab40a14d0 0x7fcab40a3990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005910 tx=0x7fcac000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:45.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.657+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcabc096600 con 0x7fcacc100ea0 2023-10-05T15:54:45.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.870+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcacc10c820 con 0x7fcacc100ea0 2023-10-05T15:54:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.872+0000 7fcac8ff9700 1 -- 172.21.15.17:0/2732922559 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+24676 (secure 0 0 0) 0x7fcabc099c20 con 0x7fcacc100ea0 2023-10-05T15:54:45.874 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-05T15:54:45.874 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":94,"fsid":"6446904c-6393-11ee-8db5-212e2dc638e7","created":"2023-10-05T15:26:04.208122+0000","modified":"2023-10-05T15:36:06.637846+0000","last_up_change":"2023-10-05T15:33:35.294754+0000","last_in_change":"2023-10-05T15:33:14.943717+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T15:29:41.118470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-05T15:34:30.472178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-05T15:34:31.574258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-05T15:34:35.173843+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"85786796-98b0-494a-b862-5fa0b52d790c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6803","nonce":867902841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6805","nonce":867902841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6809","nonce":867902841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":867902841},{"type":"v1","addr":"172.21.15.17:6807","nonce":867902841}]},"public_addr":"172.21.15.17:6803/867902841","cluster_addr":"172.21.15.17:6805/867902841","heartbeat_back_addr":"172.21.15.17:6809/867902841","heartbeat_front_addr":"172.21.15.17:6807/867902841","state":["exists","up"]},{"osd":1,"uuid":"d310ac43-5077-4247-b05c-b9abb149b3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6801","nonce":1221166656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6803","nonce":1221166656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6807","nonce":1221166656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1221166656},{"type":"v1","addr":"172.21.15.79:6805","nonce":1221166656}]},"public_addr":"172.21.15.79:6801/1221166656","cluster_addr":"172.21.15.79:6803/1221166656","heartbeat_back_addr":"172.21.15.79:6807/1221166656","heartbeat_front_addr":"172.21.15.79:6805/1221166656","state":["exists","up"]},{"osd":2,"uuid":"8f6fd364-521b-41e1-861c-04fd2a5cb36c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6801","nonce":3358437232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6803","nonce":3358437232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6807","nonce":3358437232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3358437232},{"type":"v1","addr":"172.21.15.167:6805","nonce":3358437232}]},"public_addr":"172.21.15.167:6801/3358437232","cluster_addr":"172.21.15.167:6803/3358437232","heartbeat_back_addr":"172.21.15.167:6807/3358437232","heartbeat_front_addr":"172.21.15.167:6805/3358437232","state":["exists","up"]},{"osd":3,"uuid":"bb98ddec-27ee-4273-91c7-2178495341fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6811","nonce":33404576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6813","nonce":33404576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6817","nonce":33404576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":33404576},{"type":"v1","addr":"172.21.15.17:6815","nonce":33404576}]},"public_addr":"172.21.15.17:6811/33404576","cluster_addr":"172.21.15.17:6813/33404576","heartbeat_back_addr":"172.21.15.17:6817/33404576","heartbeat_front_addr":"172.21.15.17:6815/33404576","state":["exists","up"]},{"osd":4,"uuid":"11dee7d6-6a17-4531-8de5-323fd02055fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6809","nonce":1876046713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6811","nonce":1876046713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6815","nonce":1876046713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1876046713},{"type":"v1","addr":"172.21.15.79:6813","nonce":1876046713}]},"public_addr":"172.21.15.79:6809/1876046713","cluster_addr":"172.21.15.79:6811/1876046713","heartbeat_back_addr":"172.21.15.79:6815/1876046713","heartbeat_front_addr":"172.21.15.79:6813/1876046713","state":["exists","up"]},{"osd":5,"uuid":"4a0bd55e-6aec-46a3-8ce4-a3b18e9df728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6809","nonce":4076480812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6811","nonce":4076480812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6815","nonce":4076480812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4076480812},{"type":"v1","addr":"172.21.15.167:6813","nonce":4076480812}]},"public_addr":"172.21.15.167:6809/4076480812","cluster_addr":"172.21.15.167:6811/4076480812","heartbeat_back_addr":"172.21.15.167:6815/4076480812","heartbeat_front_addr":"172.21.15.167:6813/4076480812","state":["exists","up"]},{"osd":6,"uuid":"be4fc642-f0e3-47fd-91e9-1e589c8218cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6819","nonce":4099404166}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6821","nonce":4099404166}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6825","nonce":4099404166}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":4099404166},{"type":"v1","addr":"172.21.15.17:6823","nonce":4099404166}]},"public_addr":"172.21.15.17:6819/4099404166","cluster_addr":"172.21.15.17:6821/4099404166","heartbeat_back_addr":"172.21.15.17:6825/4099404166","heartbeat_front_addr":"172.21.15.17:6823/4099404166","state":["exists","up"]},{"osd":7,"uuid":"846db2d8-4524-4e02-8667-6a7d56e10453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6817","nonce":2170841881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6819","nonce":2170841881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6823","nonce":2170841881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2170841881},{"type":"v1","addr":"172.21.15.79:6821","nonce":2170841881}]},"public_addr":"172.21.15.79:6817/2170841881","cluster_addr":"172.21.15.79:6819/2170841881","heartbeat_back_addr":"172.21.15.79:6823/2170841881","heartbeat_front_addr":"172.21.15.79:6821/2170841881","state":["exists","up"]},{"osd":8,"uuid":"207e8b8a-3383-4888-ab40-8f8117eba824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6817","nonce":3580182047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6819","nonce":3580182047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6823","nonce":3580182047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3580182047},{"type":"v1","addr":"172.21.15.167:6821","nonce":3580182047}]},"public_addr":"172.21.15.167:6817/3580182047","cluster_addr":"172.21.15.167:6819/3580182047","heartbeat_back_addr":"172.21.15.167:6823/3580182047","heartbeat_front_addr":"172.21.15.167:6821/3580182047","state":["exists","up"]},{"osd":9,"uuid":"e6012aed-94f6-4c37-bcf7-82dc08b176f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6827","nonce":1313927132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6829","nonce":1313927132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6833","nonce":1313927132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":1313927132},{"type":"v1","addr":"172.21.15.17:6831","nonce":1313927132}]},"public_addr":"172.21.15.17:6827/1313927132","cluster_addr":"172.21.15.17:6829/1313927132","heartbeat_back_addr":"172.21.15.17:6833/1313927132","heartbeat_front_addr":"172.21.15.17:6831/1313927132","state":["exists","up"]},{"osd":10,"uuid":"f0d1cd24-7df4-47a3-8143-247ffd402689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6825","nonce":1370861812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6827","nonce":1370861812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6831","nonce":1370861812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1370861812},{"type":"v1","addr":"172.21.15.79:6829","nonce":1370861812}]},"public_addr":"172.21.15.79:6825/1370861812","cluster_addr":"172.21.15.79:6827/1370861812","heartbeat_back_addr":"172.21.15.79:6831/1370861812","heartbeat_front_addr":"172.21.15.79:6829/1370861812","state":["exists","up"]},{"osd":11,"uuid":"e961ada4-773e-40ad-8dfb-30356919eedc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6825","nonce":1885248558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6827","nonce":1885248558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6831","nonce":1885248558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1885248558},{"type":"v1","addr":"172.21.15.167:6829","nonce":1885248558}]},"public_addr":"172.21.15.167:6825/1885248558","cluster_addr":"172.21.15.167:6827/1885248558","heartbeat_back_addr":"172.21.15.167:6831/1885248558","heartbeat_front_addr":"172.21.15.167:6829/1885248558","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:28:45.953239+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:11.611392+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:29:37.581075+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:05.334414+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:30.723528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:30:56.774172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:23.195805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:31:49.086421+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:15.063274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:32:41.386634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:07.156399+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T15:33:33.598042+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/2395163877":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6801/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:6800/2369336529":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/2135774582":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/3151379810":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/2053167755":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6800/3129756101":"2023-10-06T15:26:37.743145+0000","172.21.15.17:0/3360652288":"2023-10-06T15:27:04.477848+0000","172.21.15.17:0/4090412968":"2023-10-06T15:26:37.743145+0000","172.21.15.17:6801/3129756101":"2023-10-06T15:26:37.743145+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T15:54:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcab40a14d0 msgr2=0x7fcab40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcab40a14d0 0x7fcab40a3990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcac0005910 tx=0x7fcac000b260 comp rx=0 tx=0).stop 2023-10-05T15:54:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 msgr2=0x7fcacc198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:45.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 0x7fcacc198da0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e970 tx=0x7fcabc00ec80 comp rx=0 tx=0).stop 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 shutdown_connections 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7fcab40a14d0 0x7fcab40a3990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcacc102a40 0x7fcacc1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc100ea0 0x7fcacc198da0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 --2- 172.21.15.17:0/2732922559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcacc102080 0x7fcacc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 >> 172.21.15.17:0/2732922559 conn(0x7fcacc0fc420 msgr2=0x7fcacc0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 shutdown_connections 2023-10-05T15:54:45.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:45.874+0000 7fcad21ff700 1 -- 172.21.15.17:0/2732922559 wait complete. 2023-10-05T15:54:45.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-05T15:29:41.118470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-05T15:34:30.472178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-05T15:34:31.574258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-05T15:34:35.173843+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-05T15:54:45.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-05T15:54:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 -- 172.21.15.17:0/2809997862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c074ef0 msgr2=0x7f572c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 --2- 172.21.15.17:0/2809997862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c074ef0 0x7f572c073340 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5720009990 tx=0x7f5720009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 -- 172.21.15.17:0/2809997862 shutdown_connections 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 --2- 172.21.15.17:0/2809997862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 0x7f572c10b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 --2- 172.21.15.17:0/2809997862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c074ef0 0x7f572c073340 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 --2- 172.21.15.17:0/2809997862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572c073910 0x7f572c073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.098+0000 7f5732dff700 1 -- 172.21.15.17:0/2809997862 >> 172.21.15.17:0/2809997862 conn(0x7f572c0fc430 msgr2=0x7f572c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.099+0000 7f5732dff700 1 -- 172.21.15.17:0/2809997862 shutdown_connections 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.099+0000 7f5732dff700 1 -- 172.21.15.17:0/2809997862 wait complete. 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.099+0000 7f5732dff700 1 Processor -- start 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 -- start start 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 0x7f572c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572c074ef0 0x7f572c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 0x7f572c1a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1a0890 con 0x7f572c108da0 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1a0a00 con 0x7f572c073910 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5732dff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1a0bc0 con 0x7f572c074ef0 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5730b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 0x7f572c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f573139c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 0x7f572c1a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5730b9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 0x7f572c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50586/0 (socket says 172.21.15.17:50586) 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f5730b9b700 1 -- 172.21.15.17:0/1325101674 learned_addr learned my addr 172.21.15.17:0/1325101674 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.100+0000 7f572bfff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572c074ef0 0x7f572c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5730b9b700 1 -- 172.21.15.17:0/1325101674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572c074ef0 msgr2=0x7f572c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5730b9b700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572c074ef0 0x7f572c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5730b9b700 1 -- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 msgr2=0x7f572c1a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5730b9b700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 0x7f572c1a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5730b9b700 1 -- 172.21.15.17:0/1325101674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200095f0 con 0x7f572c073910 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f573139c700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 0x7f572c1a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5730b9b700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 0x7f572c198d50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f57200098e0 tx=0x7f5720004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572001d070 con 0x7f572c073910 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f572000bdb0 con 0x7f572c073910 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720022d20 con 0x7f572c073910 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c1a0e40 con 0x7f572c073910 2023-10-05T15:54:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.101+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c1a11b0 con 0x7f572c073910 2023-10-05T15:54:46.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.102+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c107450 con 0x7f572c073910 2023-10-05T15:54:46.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.104+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f572000b920 con 0x7f572c073910 2023-10-05T15:54:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.106+0000 7f5729ffb700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f571c0a1500 0x7f571c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.106+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f57200ce6e0 con 0x7f572c073910 2023-10-05T15:54:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.106+0000 7f572bfff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f571c0a1500 0x7f571c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.106+0000 7f572bfff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f571c0a1500 0x7f571c0a39c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f572c074c10 tx=0x7f5718009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.108+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57200979d0 con 0x7f572c073910 2023-10-05T15:54:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.318+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f572c10ea20 con 0x7f572c073910 2023-10-05T15:54:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.319+0000 7f5729ffb700 1 -- 172.21.15.17:0/1325101674 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f572009aff0 con 0x7f572c073910 2023-10-05T15:54:46.321 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-10-05T15:54:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.321+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f571c0a1500 msgr2=0x7f571c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.321+0000 7f5732dff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f571c0a1500 0x7f571c0a39c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f572c074c10 tx=0x7f5718009260 comp rx=0 tx=0).stop 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 msgr2=0x7f572c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 0x7f572c198d50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f57200098e0 tx=0x7f5720004730 comp rx=0 tx=0).stop 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 shutdown_connections 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f571c0a1500 0x7f571c0a39c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f572c108da0 0x7f572c1a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572c073910 0x7f572c198d50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 --2- 172.21.15.17:0/1325101674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f572c074ef0 0x7f572c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 >> 172.21.15.17:0/1325101674 conn(0x7f572c0fc430 msgr2=0x7f572c0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 shutdown_connections 2023-10-05T15:54:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.322+0000 7f5732dff700 1 -- 172.21.15.17:0/1325101674 wait complete. 2023-10-05T15:54:46.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-05T15:54:46.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:46 smithi017 ceph-mon[129107]: pgmap v914: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:54:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:46 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/266554343' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:54:46.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:46 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/2732922559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:54:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 -- 172.21.15.17:0/83980267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38104270 msgr2=0x7f5a38106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/83980267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38104270 0x7f5a38106660 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009990 tx=0x7f5a28009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 -- 172.21.15.17:0/83980267 shutdown_connections 2023-10-05T15:54:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/83980267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a38106ba0 0x7f5a38109010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/83980267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38101940 0x7f5a38103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/83980267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38104270 0x7f5a38106660 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 -- 172.21.15.17:0/83980267 >> 172.21.15.17:0/83980267 conn(0x7f5a380fb330 msgr2=0x7f5a380fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.546+0000 7f5a3ffff700 1 -- 172.21.15.17:0/83980267 shutdown_connections 2023-10-05T15:54:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.547+0000 7f5a3ffff700 1 -- 172.21.15.17:0/83980267 wait complete. 2023-10-05T15:54:46.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.547+0000 7f5a3ffff700 1 Processor -- start 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 -- start start 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 0x7f5a38196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a38104270 0x7f5a38197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38106ba0 0x7f5a3819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3819e6a0 con 0x7f5a38101940 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3819e7e0 con 0x7f5a38106ba0 2023-10-05T15:54:46.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3ffff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3819e970 con 0x7f5a38104270 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 0x7f5a38196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 0x7f5a38196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60090/0 (socket says 172.21.15.17:60090) 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3dd9b700 1 -- 172.21.15.17:0/318915707 learned_addr learned my addr 172.21.15.17:0/318915707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3e59c700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38106ba0 0x7f5a3819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.548+0000 7f5a3d59a700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a38104270 0x7f5a38197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3dd9b700 1 -- 172.21.15.17:0/318915707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a38104270 msgr2=0x7f5a38197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3dd9b700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a38104270 0x7f5a38197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3dd9b700 1 -- 172.21.15.17:0/318915707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38106ba0 msgr2=0x7f5a3819e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3dd9b700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38106ba0 0x7f5a3819e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3dd9b700 1 -- 172.21.15.17:0/318915707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280095f0 con 0x7f5a38101940 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3dd9b700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 0x7f5a38196b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400e9a0 tx=0x7f5a3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34009790 con 0x7f5a38101940 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a34010430 con 0x7f5a38101940 2023-10-05T15:54:46.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3819ec50 con 0x7f5a38101940 2023-10-05T15:54:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400cea0 con 0x7f5a38101940 2023-10-05T15:54:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.549+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3819f1b0 con 0x7f5a38101940 2023-10-05T15:54:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.550+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a380fceb0 con 0x7f5a38101940 2023-10-05T15:54:46.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.552+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f5a340105a0 con 0x7f5a38101940 2023-10-05T15:54:46.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.554+0000 7f5a2effd700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a240a1500 0x7f5a240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:46.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.554+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f5a34014070 con 0x7f5a38101940 2023-10-05T15:54:46.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.554+0000 7f5a3d59a700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a240a1500 0x7f5a240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:46.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.554+0000 7f5a3d59a700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a240a1500 0x7f5a240a39c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006010 tx=0x7f5a2800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:46.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.557+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5a34052100 con 0x7f5a38101940 2023-10-05T15:54:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:46 smithi167 ceph-mon[133366]: pgmap v914: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:54:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:46 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/266554343' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:54:46.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:46 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/2732922559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:54:46.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:46 smithi079 ceph-mon[132936]: pgmap v914: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-05T15:54:46.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:46 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/266554343' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:54:46.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:46 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/2732922559' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-05T15:54:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.768+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a3802d1a0 con 0x7f5a38101940 2023-10-05T15:54:46.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.769+0000 7f5a2effd700 1 -- 172.21.15.17:0/318915707 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a340964b0 con 0x7f5a38101940 2023-10-05T15:54:46.771 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:54:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a240a1500 msgr2=0x7f5a240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a240a1500 0x7f5a240a39c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006010 tx=0x7f5a2800b260 comp rx=0 tx=0).stop 2023-10-05T15:54:46.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 msgr2=0x7f5a38196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 0x7f5a38196b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400e9a0 tx=0x7f5a3400ecb0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 shutdown_connections 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f5a240a1500 0x7f5a240a39c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38106ba0 0x7f5a3819e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a38101940 0x7f5a38196b20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 --2- 172.21.15.17:0/318915707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a38104270 0x7f5a38197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.771+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 >> 172.21.15.17:0/318915707 conn(0x7f5a380fb330 msgr2=0x7f5a381025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.772+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 shutdown_connections 2023-10-05T15:54:46.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.772+0000 7f5a3ffff700 1 -- 172.21.15.17:0/318915707 wait complete. 2023-10-05T15:54:46.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-05T15:54:46.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 -- 172.21.15.17:0/757575746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 msgr2=0x7f08b41024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:46.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/757575746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41024f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009990 tx=0x7f08a4009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 -- 172.21.15.17:0/757575746 shutdown_connections 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/757575746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102a30 0x7f08b4109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/757575746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 0x7f08b41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/757575746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41024f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 -- 172.21.15.17:0/757575746 >> 172.21.15.17:0/757575746 conn(0x7f08b40fc430 msgr2=0x7f08b40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 -- 172.21.15.17:0/757575746 shutdown_connections 2023-10-05T15:54:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.995+0000 7f08bb7ff700 1 -- 172.21.15.17:0/757575746 wait complete. 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.996+0000 7f08bb7ff700 1 Processor -- start 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 -- start start 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 0x7f08b4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102a30 0x7f08b41a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41a08f0 con 0x7f08b4100e90 2023-10-05T15:54:47.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41a0a60 con 0x7f08b4102070 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08bb7ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41a0c20 con 0x7f08b4102a30 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08b959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 0x7f08b4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08b8d9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08b8d9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.17:50634/0 (socket says 172.21.15.17:50634) 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08b8d9a700 1 -- 172.21.15.17:0/279773716 learned_addr learned my addr 172.21.15.17:0/279773716 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08b959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 0x7f08b4198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60098/0 (socket says 172.21.15.17:60098) 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.997+0000 7f08b9d9c700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102a30 0x7f08b41a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08b8d9a700 1 -- 172.21.15.17:0/279773716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102a30 msgr2=0x7f08b41a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08b8d9a700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102a30 0x7f08b41a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08b8d9a700 1 -- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 msgr2=0x7f08b4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08b8d9a700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 0x7f08b4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08b8d9a700 1 -- 172.21.15.17:0/279773716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0009520 con 0x7f08b4102070 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08b8d9a700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41992f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f08a4005910 tx=0x7f08a4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a401d070 con 0x7f08b4102070 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08a400bdb0 con 0x7f08b4102070 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a40095f0 con 0x7f08b4102070 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4022d40 con 0x7f08b4102070 2023-10-05T15:54:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.998+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b41a1130 con 0x7f08b4102070 2023-10-05T15:54:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:46.999+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b410c600 con 0x7f08b4102070 2023-10-05T15:54:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.001+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f08a4022470 con 0x7f08b4102070 2023-10-05T15:54:47.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.003+0000 7f08aa7fc700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08a00a1480 0x7f08a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.003+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f08a40ce790 con 0x7f08b4102070 2023-10-05T15:54:47.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.003+0000 7f08b959b700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08a00a1480 0x7f08a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.003+0000 7f08b959b700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08a00a1480 0x7f08a00a3940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08b419a280 tx=0x7f08b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:47.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.005+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f08a4097a80 con 0x7f08b4102070 2023-10-05T15:54:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.219+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08b41a12c0 con 0x7f08b4102070 2023-10-05T15:54:47.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.220+0000 7f08aa7fc700 1 -- 172.21.15.17:0/279773716 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08a409b0a0 con 0x7f08b4102070 2023-10-05T15:54:47.222 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-10-05T15:54:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08a00a1480 msgr2=0x7f08a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08a00a1480 0x7f08a00a3940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08b419a280 tx=0x7f08b0009260 comp rx=0 tx=0).stop 2023-10-05T15:54:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 msgr2=0x7f08b41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41992f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f08a4005910 tx=0x7f08a4005740 comp rx=0 tx=0).stop 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 shutdown_connections 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f08a00a1480 0x7f08a00a3940 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102a30 0x7f08b41a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b4100e90 0x7f08b4198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 --2- 172.21.15.17:0/279773716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08b4102070 0x7f08b41992f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 >> 172.21.15.17:0/279773716 conn(0x7f08b40fc430 msgr2=0x7f08b40fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 shutdown_connections 2023-10-05T15:54:47.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.222+0000 7f08bb7ff700 1 -- 172.21.15.17:0/279773716 wait complete. 2023-10-05T15:54:47.243 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-05T15:54:47.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:47 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/1325101674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:54:47.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:47 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/318915707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 -- 172.21.15.17:0/1500959415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec100ea0 msgr2=0x7f52ec1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 --2- 172.21.15.17:0/1500959415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec100ea0 0x7f52ec1012c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009990 tx=0x7f52e8009ca0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 -- 172.21.15.17:0/1500959415 shutdown_connections 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 --2- 172.21.15.17:0/1500959415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102a40 0x7f52ec109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 --2- 172.21.15.17:0/1500959415 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec100ea0 0x7f52ec1012c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 --2- 172.21.15.17:0/1500959415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec102080 0x7f52ec102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 -- 172.21.15.17:0/1500959415 >> 172.21.15.17:0/1500959415 conn(0x7f52ec0fc460 msgr2=0x7f52ec0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 -- 172.21.15.17:0/1500959415 shutdown_connections 2023-10-05T15:54:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.448+0000 7f52f47ff700 1 -- 172.21.15.17:0/1500959415 wait complete. 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.449+0000 7f52f47ff700 1 Processor -- start 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.449+0000 7f52f47ff700 1 -- start start 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f47ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec100ea0 0x7f52ec196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f47ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102080 0x7f52ec1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f47ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec102a40 0x7f52ec19e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f47ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec19e6f0 con 0x7f52ec102080 2023-10-05T15:54:47.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f47ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec19e830 con 0x7f52ec102a40 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f47ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec19e9c0 con 0x7f52ec100ea0 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f1d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102080 0x7f52ec1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f259b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec100ea0 0x7f52ec196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f259b700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec100ea0 0x7f52ec196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.17:49854/0 (socket says 172.21.15.17:49854) 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f259b700 1 -- 172.21.15.17:0/4148511387 learned_addr learned my addr 172.21.15.17:0/4148511387 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f2d9c700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec102a40 0x7f52ec19e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f1d9a700 1 -- 172.21.15.17:0/4148511387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec100ea0 msgr2=0x7f52ec196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f1d9a700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec100ea0 0x7f52ec196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f1d9a700 1 -- 172.21.15.17:0/4148511387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec102a40 msgr2=0x7f52ec19e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f1d9a700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec102a40 0x7f52ec19e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.450+0000 7f52f1d9a700 1 -- 172.21.15.17:0/4148511387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e80095f0 con 0x7f52ec102080 2023-10-05T15:54:47.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.451+0000 7f52f1d9a700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102080 0x7f52ec1970b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e9c0 tx=0x7f52dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:47.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.451+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc004220 con 0x7f52ec102080 2023-10-05T15:54:47.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.451+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52dc004380 con 0x7f52ec102080 2023-10-05T15:54:47.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.451+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec19eca0 con 0x7f52ec102080 2023-10-05T15:54:47.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.451+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc003b40 con 0x7f52ec102080 2023-10-05T15:54:47.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.451+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec19f1b0 con 0x7f52ec102080 2023-10-05T15:54:47.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.452+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec10c610 con 0x7f52ec102080 2023-10-05T15:54:47.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.454+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f52dc003ca0 con 0x7f52ec102080 2023-10-05T15:54:47.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.456+0000 7f52e37fe700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52d80a1480 0x7f52d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.457+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f52dc014070 con 0x7f52ec102080 2023-10-05T15:54:47.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.457+0000 7f52f259b700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52d80a1480 0x7f52d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.457+0000 7f52f259b700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52d80a1480 0x7f52d80a3940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52e8006010 tx=0x7f52e800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:47.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.461+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f52dc096570 con 0x7f52ec102080 2023-10-05T15:54:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:47 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/1325101674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:54:47.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:47 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/318915707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:54:47.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:47 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/1325101674' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-05T15:54:47.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:47 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/318915707' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-05T15:54:47.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.673+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f52ec107ef0 con 0x7f52ec102080 2023-10-05T15:54:47.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.673+0000 7f52e37fe700 1 -- 172.21.15.17:0/4148511387 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52dc099b90 con 0x7f52ec102080 2023-10-05T15:54:47.675 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52d80a1480 msgr2=0x7f52d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52d80a1480 0x7f52d80a3940 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f52e8006010 tx=0x7f52e800b260 comp rx=0 tx=0).stop 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102080 msgr2=0x7f52ec1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102080 0x7f52ec1970b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e9c0 tx=0x7f52dc00ecd0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 shutdown_connections 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f52d80a1480 0x7f52d80a3940 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52ec102a40 0x7f52ec19e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ec100ea0 0x7f52ec196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 --2- 172.21.15.17:0/4148511387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec102080 0x7f52ec1970b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 >> 172.21.15.17:0/4148511387 conn(0x7f52ec0fc460 msgr2=0x7f52ec0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 shutdown_connections 2023-10-05T15:54:47.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.676+0000 7f52f47ff700 1 -- 172.21.15.17:0/4148511387 wait complete. 2023-10-05T15:54:47.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-05T15:54:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 -- 172.21.15.17:0/337759462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102a30 msgr2=0x7f40e4109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/337759462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102a30 0x7f40e4109350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009f90 tx=0x7f40dc00b330 comp rx=0 tx=0).stop 2023-10-05T15:54:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 -- 172.21.15.17:0/337759462 shutdown_connections 2023-10-05T15:54:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/337759462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102a30 0x7f40e4109350 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/337759462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e4100e90 0x7f40e41012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/337759462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102070 0x7f40e41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 -- 172.21.15.17:0/337759462 >> 172.21.15.17:0/337759462 conn(0x7f40e40fc430 msgr2=0x7f40e40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 -- 172.21.15.17:0/337759462 shutdown_connections 2023-10-05T15:54:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.901+0000 7f40ea1ff700 1 -- 172.21.15.17:0/337759462 wait complete. 2023-10-05T15:54:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.902+0000 7f40ea1ff700 1 Processor -- start 2023-10-05T15:54:47.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 -- start start 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e4100e90 0x7f40e4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 0x7f40e40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102a30 0x7f40e40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4073f80 con 0x7f40e4102070 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40740f0 con 0x7f40e4102a30 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40ea1ff700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41a0c50 con 0x7f40e4100e90 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40e2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 0x7f40e40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40e2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 0x7f40e40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60120/0 (socket says 172.21.15.17:60120) 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40e2ffd700 1 -- 172.21.15.17:0/3286630463 learned_addr learned my addr 172.21.15.17:0/3286630463 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-10-05T15:54:47.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.903+0000 7f40e37fe700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e4100e90 0x7f40e4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e3fff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102a30 0x7f40e40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e2ffd700 1 -- 172.21.15.17:0/3286630463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e4100e90 msgr2=0x7f40e4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e2ffd700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e4100e90 0x7f40e4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e2ffd700 1 -- 172.21.15.17:0/3286630463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102a30 msgr2=0x7f40e40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e2ffd700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102a30 0x7f40e40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e2ffd700 1 -- 172.21.15.17:0/3286630463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40095f0 con 0x7f40e4102070 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e3fff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102a30 0x7f40e40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e2ffd700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 0x7f40e40732a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f40d800e970 tx=0x7f40d800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8009790 con 0x7f40e4102070 2023-10-05T15:54:47.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc009c40 con 0x7f40e4102070 2023-10-05T15:54:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40d800c7e0 con 0x7f40e4102070 2023-10-05T15:54:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.904+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8003bd0 con 0x7f40e4102070 2023-10-05T15:54:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.905+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e41a1220 con 0x7f40e4102070 2023-10-05T15:54:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.905+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4107e90 con 0x7f40e4102070 2023-10-05T15:54:47.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.907+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 136003+0+0 (secure 0 0 0) 0x7f40d800c950 con 0x7f40e4102070 2023-10-05T15:54:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.909+0000 7f40e0ff9700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40cc0a1480 0x7f40cc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T15:54:47.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.909+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9165+0+0 (secure 0 0 0) 0x7f40d8014070 con 0x7f40e4102070 2023-10-05T15:54:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.909+0000 7f40e37fe700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40cc0a1480 0x7f40cc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T15:54:47.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.910+0000 7f40e37fe700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40cc0a1480 0x7f40cc0a3940 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40e4101be0 tx=0x7f40d4009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T15:54:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:47.912+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f40d8096570 con 0x7f40e4102070 2023-10-05T15:54:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.140+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f40e402d020 con 0x7f40e4102070 2023-10-05T15:54:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.141+0000 7f40e0ff9700 1 -- 172.21.15.17:0/3286630463 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v94) v1 ==== 81+0+592 (secure 0 0 0) 0x7f40d8099b90 con 0x7f40e4102070 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2395163877 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2369336529 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2135774582 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3151379810 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2053167755 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3360652288 2023-10-06T15:27:04.477848+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/4090412968 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:48.143 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3129756101 2023-10-06T15:26:37.743145+0000 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40cc0a1480 msgr2=0x7f40cc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40cc0a1480 0x7f40cc0a3940 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40e4101be0 tx=0x7f40d4009310 comp rx=0 tx=0).stop 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 msgr2=0x7f40e40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 0x7f40e40732a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f40d800e970 tx=0x7f40d800ec80 comp rx=0 tx=0).stop 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 shutdown_connections 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:6800/1244004544,v1:172.21.15.17:6801/1244004544] conn(0x7f40cc0a1480 0x7f40cc0a3940 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e4102a30 0x7f40e40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e4100e90 0x7f40e4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 --2- 172.21.15.17:0/3286630463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40e4102070 0x7f40e40732a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T15:54:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 >> 172.21.15.17:0/3286630463 conn(0x7f40e40fc430 msgr2=0x7f40e40fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T15:54:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 shutdown_connections 2023-10-05T15:54:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-10-05T15:54:48.143+0000 7f40ea1ff700 1 -- 172.21.15.17:0/3286630463 wait complete. 2023-10-05T15:54:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:listed 10 entries 2023-10-05T15:54:48.163 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2023-10-05T15:54:48.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:54:48.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /tmp/cephfs 2023-10-05T15:54:48.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[196675]: fuse finished with error 0 and tester_r 0 2023-10-05T15:54:48.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:48 smithi017 ceph-mon[129107]: pgmap v915: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:54:48.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:48 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/279773716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:54:48.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:48 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/4148511387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:54:48.447 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:48 smithi017 ceph-mon[129107]: from='client.? 172.21.15.17:0/3286630463' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:54:48.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T15:54:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:48 smithi167 ceph-mon[133366]: pgmap v915: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:54:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:48 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/279773716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:54:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:48 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/4148511387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:54:48.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:48 smithi167 ceph-mon[133366]: from='client.? 172.21.15.17:0/3286630463' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:54:48.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:48 smithi079 ceph-mon[132936]: pgmap v915: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-05T15:54:48.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:48 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/279773716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-05T15:54:48.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:48 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/4148511387' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-05T15:54:48.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:48 smithi079 ceph-mon[132936]: from='client.? 172.21.15.17:0/3286630463' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-05T15:54:50.446 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:50 smithi017 ceph-mon[129107]: pgmap v916: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:54:50.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:50 smithi167 ceph-mon[133366]: pgmap v916: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:54:50.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:50 smithi079 ceph-mon[132936]: pgmap v916: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-05T15:54:52.449 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:52 smithi017 ceph-mon[129107]: pgmap v917: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-10-05T15:54:52.450 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:52 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:54:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:52 smithi167 ceph-mon[133366]: pgmap v917: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-10-05T15:54:52.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:52 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:54:52.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:52 smithi079 ceph-mon[132936]: pgmap v917: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2023-10-05T15:54:52.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:52 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-05T15:54:53.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.583 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi167 to 220.9M 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: Adjusting osd_memory_target on smithi079 to 220.9M 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: Unable to set osd_memory_target on smithi167 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: Unable to set osd_memory_target on smithi079 to 231673344: error parsing value: Value '231673344' is below minimum 939524096 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:54:53.584 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:54:53.585 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:53 smithi167 ceph-mon[133366]: pgmap v918: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2023-10-05T15:54:53.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi167 to 220.9M 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: Adjusting osd_memory_target on smithi079 to 220.9M 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: Unable to set osd_memory_target on smithi167 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: Unable to set osd_memory_target on smithi079 to 231673344: error parsing value: Value '231673344' is below minimum 939524096 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:54:53.605 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:53 smithi079 ceph-mon[132936]: pgmap v918: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2023-10-05T15:54:53.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi167 to 220.9M 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: Adjusting osd_memory_target on smithi079 to 220.9M 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: Unable to set osd_memory_target on smithi167 to 231676211: error parsing value: Value '231676211' is below minimum 939524096 2023-10-05T15:54:53.697 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: Unable to set osd_memory_target on smithi079 to 231673344: error parsing value: Value '231673344' is below minimum 939524096 2023-10-05T15:54:53.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-05T15:54:53.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-05T15:54:53.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: from='mgr.14150 172.21.15.17:0/4052689221' entity='mgr.x' 2023-10-05T15:54:53.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:53 smithi017 ceph-mon[129107]: pgmap v918: 129 pgs: 129 active+clean; 1.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2023-10-05T15:54:54.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T15:54:54.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:54:54.715 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-10-05T15:54:54.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:54:54.792 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-10-05T15:54:54.864 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-10-05T15:54:54.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:54:54.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-10-05T15:54:54.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-05T15:54:54.940 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-10-05T15:54:55.052 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-05T15:54:55.062 INFO:tasks.cephadm:Teardown begin 2023-10-05T15:54:55.063 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/cephadm.py", line 1756, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-05T15:54:55.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:54:55.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:54:55.237 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:54:55.333 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-05T15:54:55.334 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:54:55.378 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:54:55.425 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-05T15:54:55.490 INFO:tasks.cephadm:Stopping all daemons... 2023-10-05T15:54:55.491 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-05T15:54:55.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a 2023-10-05T15:54:55.947 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:55 smithi017 systemd[1]: Stopping Ceph mon.a for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:54:56.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-a[129083]: 2023-10-05T15:54:56.014+0000 7fcff3e81700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:54:56.272 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-a[129083]: 2023-10-05T15:54:56.014+0000 7fcff3e81700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-05T15:54:56.696 INFO:journalctl@ceph.mon.a.smithi017.stdout:Oct 05 15:54:56 smithi017 bash[213895]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-a 2023-10-05T15:54:56.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-05T15:54:57.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:54:57.039 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-05T15:54:57.039 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-05T15:54:57.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.b 2023-10-05T15:54:57.604 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:57 smithi079 systemd[1]: Stopping Ceph mon.b for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:54:58.213 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-b[132912]: 2023-10-05T15:54:57.935+0000 7f6ab2a50700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:54:58.213 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-b[132912]: 2023-10-05T15:54:57.935+0000 7f6ab2a50700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-05T15:54:58.852 INFO:journalctl@ceph.mon.b.smithi079.stdout:Oct 05 15:54:58 smithi079 bash[176376]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-b 2023-10-05T15:54:58.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-05T15:54:58.982 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:54:58.982 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-05T15:54:58.982 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-05T15:54:58.982 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.c 2023-10-05T15:54:59.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:59 smithi167 systemd[1]: Stopping Ceph mon.c for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:00.046 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-c[133342]: 2023-10-05T15:54:59.631+0000 7f136adf6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:00.046 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:54:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-c[133342]: 2023-10-05T15:54:59.631+0000 7f136adf6700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-05T15:55:00.333 INFO:journalctl@ceph.mon.c.smithi167.stdout:Oct 05 15:55:00 smithi167 bash[177697]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mon-c 2023-10-05T15:55:00.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-05T15:55:00.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:00.732 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-05T15:55:00.732 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-05T15:55:00.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x 2023-10-05T15:55:01.197 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:55:00 smithi017 systemd[1]: Stopping Ceph mgr.x for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:01.532 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:55:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:55:01.254+0000 7f32b7244700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:01.533 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:55:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x[129352]: 2023-10-05T15:55:01.254+0000 7f32b7244700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-05T15:55:01.946 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Oct 05 15:55:01 smithi017 bash[214050]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-x 2023-10-05T15:55:02.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-05T15:55:02.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:02.162 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-05T15:55:02.163 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-05T15:55:02.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.y 2023-10-05T15:55:02.605 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:55:02 smithi079 systemd[1]: Stopping Ceph mgr.y for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:03.211 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:55:03 smithi079 bash[176525]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-y 2023-10-05T15:55:03.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-05T15:55:03.591 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:55:03 smithi079 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-05T15:55:03.591 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:55:03 smithi079 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.y.service: Failed with result 'exit-code'. 2023-10-05T15:55:03.591 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Oct 05 15:55:03 smithi079 systemd[1]: Stopped Ceph mgr.y for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:55:03.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:03.618 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-05T15:55:03.618 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-05T15:55:03.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.z 2023-10-05T15:55:04.083 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:55:03 smithi167 systemd[1]: Stopping Ceph mgr.z for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:04.801 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:55:04 smithi167 bash[177856]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mgr-z 2023-10-05T15:55:04.981 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-05T15:55:05.053 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:55:04 smithi167 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-05T15:55:05.054 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:55:04 smithi167 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mgr.z.service: Failed with result 'exit-code'. 2023-10-05T15:55:05.055 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Oct 05 15:55:04 smithi167 systemd[1]: Stopped Ceph mgr.z for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:55:05.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:05.077 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-05T15:55:05.077 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-05T15:55:05.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.0 2023-10-05T15:55:05.447 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:55:05 smithi017 systemd[1]: Stopping Ceph osd.0 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:05.946 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:55:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0[147863]: 2023-10-05T15:55:05.603+0000 7f650a3e0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:05.947 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:55:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0[147863]: 2023-10-05T15:55:05.603+0000 7f650a3e0700 -1 osd.0 94 *** Got signal Terminated *** 2023-10-05T15:55:05.947 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:55:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0[147863]: 2023-10-05T15:55:05.603+0000 7f650a3e0700 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:11.947 INFO:journalctl@ceph.osd.0.smithi017.stdout:Oct 05 15:55:11 smithi017 bash[214199]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-0 2023-10-05T15:55:14.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-05T15:55:14.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:14.572 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-05T15:55:14.572 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-05T15:55:14.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.1 2023-10-05T15:55:15.078 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:55:14 smithi079 systemd[1]: Stopping Ceph osd.1 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:15.354 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:55:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1[138023]: 2023-10-05T15:55:15.075+0000 7fca6c724700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:15.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:55:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1[138023]: 2023-10-05T15:55:15.075+0000 7fca6c724700 -1 osd.1 94 *** Got signal Terminated *** 2023-10-05T15:55:15.355 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:55:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1[138023]: 2023-10-05T15:55:15.075+0000 7fca6c724700 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:21.354 INFO:journalctl@ceph.osd.1.smithi079.stdout:Oct 05 15:55:21 smithi079 bash[176677]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-1 2023-10-05T15:55:23.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-05T15:55:23.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:23.108 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-05T15:55:23.108 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-05T15:55:23.108 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.2 2023-10-05T15:55:23.583 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:55:23 smithi167 systemd[1]: Stopping Ceph osd.2 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:24.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:55:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-2[139216]: 2023-10-05T15:55:23.621+0000 7fbddc09c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:24.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:55:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-2[139216]: 2023-10-05T15:55:23.621+0000 7fbddc09c700 -1 osd.2 94 *** Got signal Terminated *** 2023-10-05T15:55:24.083 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:55:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-2[139216]: 2023-10-05T15:55:23.621+0000 7fbddc09c700 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:29.833 INFO:journalctl@ceph.osd.2.smithi167.stdout:Oct 05 15:55:29 smithi167 bash[178018]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-2 2023-10-05T15:55:31.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-05T15:55:31.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:31.649 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-05T15:55:31.650 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-05T15:55:31.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.3 2023-10-05T15:55:32.195 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:31 smithi017 systemd[1]: Stopping Ceph osd.3 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:32.195 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:31 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:31.858+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:32.446 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:32 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:32.192+0000 7f475d680700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:32.446 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:32 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:32.192+0000 7f475d680700 -1 osd.3 94 *** Got signal Terminated *** 2023-10-05T15:55:32.447 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:32 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:32.192+0000 7f475d680700 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:32.365+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:33.196 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:32 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:32.882+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:33.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:33.319+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:33.675 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:33.298+0000 7f4757471700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.659406+0000 front 2023-10-05T15:55:06.659754+0000 (oldest deadline 2023-10-05T15:55:32.559611+0000) 2023-10-05T15:55:33.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:33.865+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:33.947 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:33 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:33.673+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:34.334 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:33.857+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:34.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:34.283+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:34.605 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:34.324+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:34.697 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:34 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:34.310+0000 7f4757471700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.659406+0000 front 2023-10-05T15:55:06.659754+0000 (oldest deadline 2023-10-05T15:55:32.559611+0000) 2023-10-05T15:55:35.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:34.809+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:35.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:34.778+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:35.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:34 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:34.698+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:35.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:34 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:34.870+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:35.604 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:35.286+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:35.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:35.311+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:35.691 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:35 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:35.317+0000 7f4757471700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.659406+0000 front 2023-10-05T15:55:06.659754+0000 (oldest deadline 2023-10-05T15:55:32.559611+0000) 2023-10-05T15:55:35.801 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:35.525+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:35.946 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:35 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:35.689+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:35.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:35 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:35.854+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:36.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:35.798+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:36.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:35.827+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:36.604 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:36.283+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:36.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:36.349+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:36.696 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:36 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3[156439]: 2023-10-05T15:55:36.322+0000 7f4757471700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.659406+0000 front 2023-10-05T15:55:06.659754+0000 (oldest deadline 2023-10-05T15:55:32.559611+0000) 2023-10-05T15:55:36.786 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:36.483+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:37.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:36.784+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:37.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:36.817+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:37.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:36 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:36.730+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:37.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:36 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:36.836+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:37.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:37 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:37.357+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:37.605 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:37 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:37.287+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:37.761 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:37.484+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:38.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:37.759+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:38.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:37.866+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:38.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:37 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:37.762+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:38.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:37 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:37.851+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:38.604 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:38 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:38.240+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:38.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:38 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:38.398+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:38.696 INFO:journalctl@ceph.osd.3.smithi017.stdout:Oct 05 15:55:38 smithi017 bash[214476]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-3 2023-10-05T15:55:38.713 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:38.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:39.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:38.711+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:39.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:38.823+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:39.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:38 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:38.783+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:39.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:38 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:38.833+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:39.604 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:39 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:39.200+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:39.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:39 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:39.411+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:39.679 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:39.419+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:40.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:39.677+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:40.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:39.856+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:40.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:39 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:39.832+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:40.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:39 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:39.839+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:40.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-05T15:55:40.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:40.344 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-05T15:55:40.344 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-05T15:55:40.344 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.4 2023-10-05T15:55:40.428 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:40 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:40.391+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:40.428 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:40 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:40.173+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:40.701 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:40.401+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:40.848 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:40 smithi079 systemd[1]: Stopping Ceph osd.4 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:41.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:40.699+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:41.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:40.875+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:41.104 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:40 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:40.845+0000 7f3887a1b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:41.105 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:40 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:40.845+0000 7f3887a1b700 -1 osd.4 94 *** Got signal Terminated *** 2023-10-05T15:55:41.105 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:40 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:40.845+0000 7f3887a1b700 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:41.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:40 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:40.807+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:41.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:40 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:40.864+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:41.604 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:41 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:41.223+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:41.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:41 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:41.403+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:41.434+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:41.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:41.682+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:42.196 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:41 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:41.865+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:42.196 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:41 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:41.865+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:42.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:41 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:41.822+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:42.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:41 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:41.822+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:42.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:41.914+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:42.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:42 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:42.423+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:42.605 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:42 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:42.203+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:42.679 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:42.412+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:42.932 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:42.677+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:43.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:42.897+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:43.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:42.897+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:43.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:42.871+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:43.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:42 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:42.871+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:43.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:42.929+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:43.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:42.929+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:43.471 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:43 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:43.214+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:43.471 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:43 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:43.214+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.376182+0000 front 2023-10-05T15:55:19.376245+0000 (oldest deadline 2023-10-05T15:55:42.876464+0000) 2023-10-05T15:55:43.665 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:43.371+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:43.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:43 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:43.469+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:43.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:43 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:43.469+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:43.945 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:43.662+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:44.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:43 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:43.858+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:44.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:43 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:43.858+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:44.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:43 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:43.863+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:44.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:43 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:43.863+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:44.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:43.943+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:44.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:43.943+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:44.499 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:44 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:44.187+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:44.500 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:44 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:44.187+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.376182+0000 front 2023-10-05T15:55:19.376245+0000 (oldest deadline 2023-10-05T15:55:42.876464+0000) 2023-10-05T15:55:44.658 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:44.400+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:44.658 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:44.400+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:44.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:44 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:44.498+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:44.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:44 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:44.498+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:44.971 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:44.656+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:44.971 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:44.656+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:45.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:44 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:44.874+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:45.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:44 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:44.874+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:45.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:44 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:44.899+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:45.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:44 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:44.899+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:45.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:44.968+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:45.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:44.968+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:45.491 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:45 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:45.233+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.374948+0000 front 2023-10-05T15:55:09.374805+0000 (oldest deadline 2023-10-05T15:55:34.074958+0000) 2023-10-05T15:55:45.491 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:45 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4[145990]: 2023-10-05T15:55:45.233+0000 7f388180c700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.376182+0000 front 2023-10-05T15:55:19.376245+0000 (oldest deadline 2023-10-05T15:55:42.876464+0000) 2023-10-05T15:55:45.659 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:45.406+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:45.659 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:45.406+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:45.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:45 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:45.489+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:45.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:45 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:45.489+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:45.947 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:45.657+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:45.947 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:45.657+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:46.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:45 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:45.879+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:46.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:45 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:45.879+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:46.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:45 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:45.910+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:46.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:45 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:45.910+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:46.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:45.944+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:46.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:45.944+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:46.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:46 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:46.102+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:46.699 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:46.437+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:46.699 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:46.437+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:46.713 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:46 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:46.449+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:46.713 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:46 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:46.449+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:47.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:46.697+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:47.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:46.697+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:47.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:46.920+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:47.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:46.920+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:47.104 INFO:journalctl@ceph.osd.4.smithi079.stdout:Oct 05 15:55:46 smithi079 bash[176949]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-4 2023-10-05T15:55:47.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:46 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:46.906+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:47.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:46 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:46.906+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:47.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:46 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:46.952+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:47.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:46 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:46.952+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:47.403 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:47 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:47.124+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:47.726 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:47 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:47.472+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:47.726 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:47 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:47.472+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:47.753 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:47 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:47.401+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:47.754 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:47 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:47.401+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:48.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:47 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:47.724+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:48.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:47 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:47.724+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:48.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:47 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:47.890+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:48.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:47 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:47.890+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:48.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:47 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:47.928+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:48.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:47 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:47.928+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:48.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:47 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:47.965+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:48.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:47 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:47.965+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:48.377 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:48 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:48.122+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:48.635 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:48 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:48.383+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:48.635 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:48 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:48.383+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:48.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-05T15:55:48.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:48.746 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-05T15:55:48.746 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-05T15:55:48.746 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.5 2023-10-05T15:55:48.814 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:48 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:48.708+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:48.814 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:48 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:48.708+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:48.814 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:48 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:48.500+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:48.815 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:48 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:48.500+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:49.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:48 smithi167 systemd[1]: Stopping Ceph osd.5 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:49.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:48 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:48.911+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:49.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:48 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:48.911+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:49.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:48 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:48.926+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:49.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:48 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:48.926+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:49.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:48 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:48.996+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:49.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:48 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:48.996+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:49.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:49 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:49.076+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:49.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:49.502+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:49.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:49.502+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:49.583 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:49.259+0000 7ff2e31a9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:49.584 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:49.259+0000 7ff2e31a9700 -1 osd.5 94 *** Got signal Terminated *** 2023-10-05T15:55:49.584 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:49.259+0000 7ff2e31a9700 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:49.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:49 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:49.360+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:49.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:49 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:49.360+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:50.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:49.864+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:50.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:49.864+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:50.084 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:49.688+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:50.084 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:49.688+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:50.084 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:49 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:49.688+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:24.215296+0000 front 2023-10-05T15:55:24.215319+0000 (oldest deadline 2023-10-05T15:55:49.515471+0000) 2023-10-05T15:55:50.446 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:49 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:49.945+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:50.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:49 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:49.945+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:50.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:50 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:50.045+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:50.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:50 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:50.045+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:50.604 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:50 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:50.107+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:50.604 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:50 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:50.107+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:50.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:50 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:50.337+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:50.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:50 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:50.337+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:50.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:50 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:50.337+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:50.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:50.475+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:50.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:50.475+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:50.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:50.664+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:50.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:50.664+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:50.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:50.664+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:24.215296+0000 front 2023-10-05T15:55:24.215319+0000 (oldest deadline 2023-10-05T15:55:49.515471+0000) 2023-10-05T15:55:51.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:50 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:50.940+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:51.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:50 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:50.940+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:51.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:51 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:51.083+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:51.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:51 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:51.083+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:51.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:51 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:51.083+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:51.327 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:51 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:51.071+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:51.328 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:51 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:51.071+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:51.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:50.875+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:51.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:50 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:50.875+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:51.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:51 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:51.326+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:51.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:51 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:51.326+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:51.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:51 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:51.326+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:51.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:51.697+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:51.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:51.697+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:51.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:51.697+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:24.215296+0000 front 2023-10-05T15:55:24.215319+0000 (oldest deadline 2023-10-05T15:55:49.515471+0000) 2023-10-05T15:55:51.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:51.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:51.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:51.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:52.196 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:51 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:51.901+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:52.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:51 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:51.901+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:52.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:51 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:51.901+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:52.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:52 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:52.126+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:52.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:52 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:52.126+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:52.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:52 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:52.126+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:52.331 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:52 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:52.036+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:52.331 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:52 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:52.036+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:52.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:51.869+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:52.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:51.869+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:52.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:51 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:51.869+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:52.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:52 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:52.330+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:52.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:52 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:52.330+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:52.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:52 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:52.330+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:52.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:52.464+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:52.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:52.464+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:52.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:52.713+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:52.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:52.713+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:52.834 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:52.713+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:24.215296+0000 front 2023-10-05T15:55:24.215319+0000 (oldest deadline 2023-10-05T15:55:49.515471+0000) 2023-10-05T15:55:53.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:52 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:52.933+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:53.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:52 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:52.933+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:53.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:52 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:52.933+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:53.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:53.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:53.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:53.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:53.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:53.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:53.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:52.896+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:53.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:52.896+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:53.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:52 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:52.896+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:53.344 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:53 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:53.032+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:53.344 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:53 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:53.032+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:53.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:53 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:53.342+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:53.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:53 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:53.342+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:53.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:53 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:53.342+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:53.695 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:53.440+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:53.695 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:53.440+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:54.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:53.692+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.709247+0000 front 2023-10-05T15:55:08.709373+0000 (oldest deadline 2023-10-05T15:55:33.310232+0000) 2023-10-05T15:55:54.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:53.692+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.614094+0000 front 2023-10-05T15:55:19.614072+0000 (oldest deadline 2023-10-05T15:55:44.214759+0000) 2023-10-05T15:55:54.083 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5[147736]: 2023-10-05T15:55:53.692+0000 7ff2dcf9a700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:24.215296+0000 front 2023-10-05T15:55:24.215319+0000 (oldest deadline 2023-10-05T15:55:49.515471+0000) 2023-10-05T15:55:54.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:53.903+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:54.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:53.903+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:54.084 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:53 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:53.903+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:54.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:53.930+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:54.198 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:53.930+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:54.198 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:53.930+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:54.198 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:54 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:54.126+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:54.198 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:54 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:54.126+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:54.198 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:54 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:54.126+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:54.315 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:54 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:54.034+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:54.315 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:54 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:54.034+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:54.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:54 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:54.314+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:54.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:54 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:54.314+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:54.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:54 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:54.314+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:54.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:54 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:54.433+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:54.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:54 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:54.433+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:54.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:54 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:54.433+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:55:55.287 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:55.026+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:55.287 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:55.026+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:55.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:54 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:54.877+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:55.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:54 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:54.877+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:55.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:54 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:54.877+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:55.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:54 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:54.953+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:55.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:54 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:54.953+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:55.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:54 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:54.953+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:55.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:55.128+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:55.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:55.128+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:55.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:55.128+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:55.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:55.285+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:55.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:55.285+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:55.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:55.285+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:55.833 INFO:journalctl@ceph.osd.5.smithi167.stdout:Oct 05 15:55:55 smithi167 bash[178290]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-5 2023-10-05T15:55:55.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:55 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:55.398+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:55.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:55 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:55.398+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:55.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:55 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:55.398+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:55:56.291 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:55.993+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:56.291 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:55 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:55.993+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:56.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:55 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:55.911+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:56.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:55 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:55.911+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:56.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:55 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:55.911+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:56.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:55.966+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:56.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:55.966+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:56.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:55 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:55.966+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:56.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:56.102+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:56.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:56.102+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:56.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:56 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:56.102+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:56.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:56 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:56.289+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:56.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:56 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:56.289+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:56.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:56 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:56.289+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:56 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:56.411+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:56 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:56.411+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:56.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:56 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:56.411+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:55:57.272 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:56 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:56.949+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:57.272 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:56 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:56.949+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:57.272 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:56 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:56.949+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:57.276 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:56 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:56.960+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:57.276 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:56 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:56.960+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:57.295 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-05T15:55:57.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:55:57.384 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-05T15:55:57.384 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-05T15:55:57.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.6 2023-10-05T15:55:57.446 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:57.013+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:57.446 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:57.013+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:57.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:57.013+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:57.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:57.079+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:57.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:57.079+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:57.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:57.079+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:57.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:57.417+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:57.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:57.417+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:57.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:57.417+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:55:57.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:57.274+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:57.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:57.274+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:57.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:57.274+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:57.908 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 systemd[1]: Stopping Ceph osd.6 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:55:57.908 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:57.905+0000 7ffb78e21700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:55:57.909 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:57.905+0000 7ffb78e21700 -1 osd.6 94 *** Got signal Terminated *** 2023-10-05T15:55:58.196 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:58.093+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:58.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:58.093+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:58.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:58.093+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:58.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:57 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:57.905+0000 7ffb78e21700 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:55:58.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:58.028+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:58.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:58.028+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:58.197 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:58.028+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:58.271 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:57.921+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:58.272 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:57 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:57.921+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:58.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:57.926+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:58.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:57.926+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:58.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:57 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:57.926+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:58.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:58 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:58.270+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:58.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:58 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:58.270+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:58.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:58 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:58.270+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:58.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:58 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:58.414+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:58.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:58 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:58.414+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:58.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:58 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:58.414+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:55:59.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:58 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:58.939+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:55:59.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:58 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:58.939+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:55:59.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:58 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:58.939+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:55:59.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:58 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:58.927+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:55:59.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:58 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:58.927+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:55:59.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:58 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:58.927+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:55:59.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:59.139+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:55:59.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:59.139+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:55:59.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:55:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:55:59.139+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:55:59.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:59.037+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:55:59.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:59.037+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:55:59.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:55:59 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:55:59.037+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:55:59.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:59 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:59.316+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:55:59.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:59 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:59.316+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:55:59.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:55:59 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:55:59.316+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:55:59.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:59.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:55:59.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:59.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:55:59.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:55:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:55:59.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:00.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:59.887+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:00.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:59.887+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:00.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:55:59 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:55:59.887+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:00.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:59 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:59.905+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:00.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:59 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:59.905+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:00.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:55:59 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:55:59.905+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:00.446 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:00.028+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:56:00.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:00.028+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:56:00.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:00.028+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:56:00.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:00.159+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:00.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:00.159+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:00.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:00.159+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:00.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:00 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:00.159+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:00 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:00.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:00 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:00.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:00.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:00 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:00.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:00.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:00 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:00.361+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:00.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:00 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:00.361+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:00.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:00 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:00.361+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:01.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:00 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:00.885+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:01.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:00 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:00.885+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:01.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:00 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:00.885+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:01.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:00 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:00.923+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:01.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:00 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:00.923+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:01.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:00 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:00.923+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:01.446 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:01.071+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:56:01.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:01.071+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:56:01.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:01.071+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:56:01.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:01.189+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:01.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:01.189+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:01.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:01.189+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:01.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:01 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:01.189+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:01 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:01.486+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:01 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:01.486+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:01.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:01 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:01.486+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:01.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:01 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:01.406+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:01.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:01 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:01.406+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:01.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:01 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:01.406+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:02.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:01 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:01.840+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:02.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:01 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:01.840+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:02.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:01 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:01.840+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:02.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:01 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:01.885+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:02.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:01 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:01.885+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:02.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:01 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:01.885+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:02.446 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:02.181+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:02.181+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:02.181+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:02.181+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:02.080+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.899648+0000 front 2023-10-05T15:55:08.899512+0000 (oldest deadline 2023-10-05T15:55:32.999812+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:02.080+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.301408+0000 front 2023-10-05T15:55:18.301426+0000 (oldest deadline 2023-10-05T15:55:41.201468+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:02.080+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.104372+0000 front 2023-10-05T15:55:28.104355+0000 (oldest deadline 2023-10-05T15:55:51.604390+0000) 2023-10-05T15:56:02.447 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:02 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6[164421]: 2023-10-05T15:56:02.080+0000 7ffb73413700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.306123+0000 front 2023-10-05T15:55:36.306091+0000 (oldest deadline 2023-10-05T15:56:01.606317+0000) 2023-10-05T15:56:02.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:02 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:02.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:02.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:02 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:02.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:02.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:02 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:02.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:02.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:02.383+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:02.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:02.383+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:02.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:02.383+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:02.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:02.383+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:03.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:02 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:02.829+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:03.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:02 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:02.829+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:03.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:02 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:02.829+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:03.341 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:02.885+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:03.341 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:02.885+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:03.341 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:02 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:02.885+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:03.446 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:03 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:03.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:03.446 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:03 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:03.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:03.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:03 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:03.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:03.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:03 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:03.167+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:03.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:03.339+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:03.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:03.339+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:03.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:03.339+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:03.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:03.339+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:03 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:03.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:03 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:03.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:03.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:03 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:03.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:04.190 INFO:journalctl@ceph.osd.6.smithi017.stdout:Oct 05 15:56:03 smithi017 bash[214759]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-6 2023-10-05T15:56:04.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:03 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:03.850+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:04.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:03 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:03.850+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:04.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:03 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:03.850+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:04.340 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:03.907+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:04.340 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:03.907+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:04.341 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:03 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:03.907+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:04.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:04.338+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:04.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:04.338+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:04.604 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:04.338+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:04.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:04.338+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:04.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:04.206+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:04.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:04.206+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:04.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:04.206+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:04.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:04.206+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:04 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:04.508+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:04 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:04.508+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:04.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:04 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:04.508+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:05.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:04 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:04.887+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:05.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:04 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:04.887+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:05.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:04 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:04.887+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:05.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:04.876+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:05.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:04.876+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:05.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:04 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:04.876+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:05.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:05.220+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:05.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:05.220+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:05.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:05.220+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:05.448 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:05 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:05.220+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:05 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:05.535+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:05 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:05.535+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:05.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:05 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:05.535+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:05.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:05.388+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:05.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:05.388+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:05.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:05.388+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:05.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:05.388+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:06.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-05T15:56:06.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:06.237 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-05T15:56:06.237 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-05T15:56:06.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.7 2023-10-05T15:56:06.304 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:05.883+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:06.304 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:05.883+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:06.304 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:05 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:05.883+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:06.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:05 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:05.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:06.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:05 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:05.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:06.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:05 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:05.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:06.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:06 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:06.264+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:06.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:06 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:06.264+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:06.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:06 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:06.264+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:06.447 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:06 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:06.264+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:06.605 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 systemd[1]: Stopping Ceph osd.7 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:06.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:06.423+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:06.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:06.423+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:06.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:06.423+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:06.605 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:06.423+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:06.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:06 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:06.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:06.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:06 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:06.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:06.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:06 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:06.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:07.104 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:06.764+0000 7f6bcc7ce700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:07.104 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:06.764+0000 7f6bcc7ce700 -1 osd.7 94 *** Got signal Terminated *** 2023-10-05T15:56:07.105 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:06.764+0000 7f6bcc7ce700 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:56:07.105 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:06.865+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:07.105 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:06.865+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:07.105 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:06 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:06.865+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:07.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:06 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:06.907+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:07.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:06 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:06.907+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:07.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:06 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:06.907+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:07.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:07 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:07.303+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:07.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:07 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:07.303+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:07.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:07 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:07.303+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:07.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:07 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:07.303+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:07.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:07.505+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:07.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:07.505+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:07.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:07.505+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:07.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:07.465+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:07.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:07.465+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:07.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:07.465+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:07.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:07.465+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:08.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:07.885+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:08.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:07.885+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:08.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:07 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:07.885+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:08.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:07.912+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:08.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:07.912+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:08.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:07.912+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:08.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:08 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:08.337+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:08.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:08 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:08.337+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:08.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:08 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:08.337+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:08.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:08 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:08.337+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:08.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:08 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:08.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:08.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:08 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:08.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:08.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:08 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:08.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:08.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:08.479+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:08.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:08.479+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:08.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:08.479+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:08.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:08.479+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:09.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:08 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:08.869+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:09.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:08 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:08.869+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:09.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:08 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:08.869+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:09.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:08.884+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:09.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:08.884+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:09.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:08 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:08.884+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:09.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:09 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:09.353+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:09.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:09 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:09.353+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:09.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:09 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:09.353+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:09.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:09 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:09.353+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:09.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:09.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:09.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:09.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:09.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:09.525+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:09.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:09.525+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:09.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:09.525+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:09.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:09.525+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:09.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:09.525+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:10.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:09.905+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:10.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:09.905+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:10.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:09 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:09.905+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:10.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:09.875+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:10.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:09.875+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:10.355 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:09 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:09.875+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:10.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:10 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:10.324+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:10.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:10 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:10.324+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:10.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:10 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:10.324+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:10.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:10 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:10.324+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:10.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:10.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:10.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:10.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:10.834 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:10.534+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:10.835 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:10.534+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:10.835 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:10.534+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:10.835 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:10.534+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:10.835 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:10.534+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:11.104 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:10.832+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:19.356144+0000 front 2023-10-05T15:55:19.356429+0000 (oldest deadline 2023-10-05T15:55:45.757145+0000) 2023-10-05T15:56:11.104 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:10.832+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.758041+0000 front 2023-10-05T15:55:25.758015+0000 (oldest deadline 2023-10-05T15:55:49.759369+0000) 2023-10-05T15:56:11.104 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:10.832+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.362421+0000 front 2023-10-05T15:55:34.362444+0000 (oldest deadline 2023-10-05T15:55:58.462469+0000) 2023-10-05T15:56:11.105 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:10 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7[154547]: 2023-10-05T15:56:10.832+0000 7f6bc6dc0700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.864154+0000 front 2023-10-05T15:55:44.864233+0000 (oldest deadline 2023-10-05T15:56:10.164325+0000) 2023-10-05T15:56:11.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:10.876+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:11.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:10.876+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:11.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:10.876+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:11.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:10 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:10.876+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:11.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:11 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:11.330+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:11.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:11 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:11.330+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:11.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:11 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:11.330+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:11.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:11 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:11.330+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:11.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:11.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:11.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:11.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:11.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:11 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:11.571+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:11.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:11 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:11.571+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:11.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:11 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:11.571+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:11.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:11 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:11.571+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:11.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:11 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:11.571+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:12.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:11.919+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:12.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:11.919+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:12.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:11.919+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:12.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:11 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:11.919+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:12.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:12 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:12.352+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:12.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:12 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:12.352+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:12.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:12 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:12.352+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:12.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:12 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:12.352+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:12.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:12 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:12.352+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:12.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:12.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:12.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:12.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:12.866 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:12.611+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:12.866 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:12.611+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:12.867 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:12.611+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:12.867 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:12.611+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:12.867 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:12 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:12.611+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:13.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:12.894+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:13.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:12.894+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:13.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:12.894+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:13.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:12 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:12.894+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:13.354 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:12 smithi079 bash[177232]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-7 2023-10-05T15:56:13.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:13.344+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:13.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:13.344+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:13.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:13.344+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:13.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:13.344+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:13.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:13 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:13.344+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:13.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:13.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:13.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:13.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:13.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:13 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:13.598+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:13.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:13 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:13.598+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:13.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:13 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:13.598+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:13.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:13 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:13.598+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:13.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:13 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:13.598+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:14.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:13.844+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:14.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:13.844+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:14.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:13.844+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:14.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:13 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:13.844+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:14.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:14.377+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:14.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:14.377+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:14.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:14.377+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:14.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:14.377+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:14.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:14 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:14.377+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:14.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-05T15:56:14.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:14.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:14.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:14.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:14.844 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:14 smithi079 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.7.service: Succeeded. 2023-10-05T15:56:14.844 INFO:journalctl@ceph.osd.7.smithi079.stdout:Oct 05 15:56:14 smithi079 systemd[1]: Stopped Ceph osd.7 for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:56:14.844 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:14 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:14.582+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:14.844 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:14 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:14.582+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:14.845 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:14 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:14.582+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:14.845 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:14 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:14.583+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:14.845 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:14 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:14.583+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:14.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:14.871 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-05T15:56:14.871 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-05T15:56:14.871 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.8 2023-10-05T15:56:15.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:14.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:15.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:14.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:15.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:14.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:15.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:14 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:14.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:15.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:14 smithi167 systemd[1]: Stopping Ceph osd.8 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:15.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:15 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:15.403+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:15.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:15 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:15.403+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:15.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:15 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:15.403+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:15.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:15 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:15.403+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:15.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:15 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:15.403+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:15.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:15.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:15.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:15.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:15.834 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.427+0000 7f0faabef700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:15.834 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.427+0000 7f0faabef700 -1 osd.8 94 *** Got signal Terminated *** 2023-10-05T15:56:15.834 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.427+0000 7f0faabef700 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:56:15.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:15.594+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:15.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:15.594+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:15.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:15.594+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:15.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:15.594+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:15.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:15 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:15.594+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:16.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.846+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:16.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.846+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:16.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.846+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:16.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:15 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:15.846+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:16.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:16.383+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:16.823 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:16.383+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:16.823 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:16.383+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:16.823 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:16.383+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:16.824 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:16.383+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:16.824 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:16 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:16.383+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:16.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:16.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:16.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:16.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:17.083 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:16.813+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:17.241 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:16.813+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:17.241 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:16.813+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:17.241 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:16 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:16.813+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:17.242 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:16 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:16.625+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:17.242 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:16 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:16.625+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:17.242 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:16 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:16.625+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:17.242 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:16 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:16.625+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:17.242 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:16 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:16.625+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:17.242 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:16 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:16.625+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:17.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:17.412+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:17.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:17.412+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:17.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:17.412+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:17.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:17.412+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:17.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:17.412+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:17.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:17 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:17.412+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:17.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:17.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:17.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:17.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:17.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:17 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:17.592+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:17.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:17 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:17.592+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:17.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:17 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:17.592+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:17.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:17 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:17.592+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:17.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:17 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:17.592+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:17.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:17 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:17.592+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:18.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:17.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:18.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:17.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:18.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:17.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:18.334 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:17 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:17.861+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:18.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:18.420+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:18.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:18.420+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:18.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:18.420+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:18.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:18.420+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:18.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:18.420+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:18.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:18 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:18.420+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:18.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:18.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:18.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:18.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:19.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:18 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:18.629+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:19.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:18 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:18.629+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:19.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:18 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:18.629+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:19.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:18 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:18.629+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:19.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:18 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:18.629+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:19.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:18 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:18.629+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:19.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:18.904+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:19.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:18.904+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:19.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:18.904+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:19.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:18 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:18.904+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:19.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:19.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:19.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:19.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:19.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:19.946 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:19.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:19.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:19.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:19.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:19.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:19.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:19.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:19.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:19.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:19.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:19 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:19.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:20.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:19.616+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:20.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:19.616+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:20.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:19.616+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:20.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:19.616+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:20.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:19.616+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:20.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:19.616+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:20.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:19.900+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:10.017290+0000 front 2023-10-05T15:55:10.017320+0000 (oldest deadline 2023-10-05T15:55:34.117296+0000) 2023-10-05T15:56:20.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:19.900+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.818612+0000 front 2023-10-05T15:55:18.818814+0000 (oldest deadline 2023-10-05T15:55:42.318788+0000) 2023-10-05T15:56:20.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:19.900+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.721054+0000 front 2023-10-05T15:55:25.721086+0000 (oldest deadline 2023-10-05T15:55:51.021206+0000) 2023-10-05T15:56:20.333 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:19 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8[156291]: 2023-10-05T15:56:19.900+0000 7f0fa71e5700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:42.723754+0000 front 2023-10-05T15:55:42.723724+0000 (oldest deadline 2023-10-05T15:56:10.324553+0000) 2023-10-05T15:56:20.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:20 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:20.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:20 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:20.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:20 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:20.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:20 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:20.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:20 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:20.946 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:20.465+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:20.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:20.465+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:20.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:20.465+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:20.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:20.465+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:20.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:20.465+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:20.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:20 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:20.465+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:21.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:20 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:20.666+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:21.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:20 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:20.666+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:21.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:20 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:20.666+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:21.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:20 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:20.666+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:21.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:20 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:20.666+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:21.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:20 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:20.666+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:21.552 INFO:journalctl@ceph.osd.8.smithi167.stdout:Oct 05 15:56:21 smithi167 bash[178564]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-8 2023-10-05T15:56:21.553 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:21.553 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:21.553 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:21.553 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:21.553 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:21 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:21.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:21 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:21.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:21.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:21 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:21.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:21.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:21 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:21.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:21.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:21 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:21.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:21.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:21 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:21.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:21.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:21 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:21.461+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:22.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:21.693+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:22.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:21.693+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:22.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:21.693+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:22.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:21.693+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:22.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:21.693+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:22.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:21 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:21.693+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:22.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:22.416+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:22.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:22.416+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:22.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:22.416+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:22.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:22.416+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:22.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:22.416+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:22.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:22 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:22.416+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:22.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:22.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:22.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:22.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:22.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:22 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:23.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:22.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:23.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:22.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:23.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:22.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:23.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:22.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:23.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:22.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:23.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:22.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:23.287 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-05T15:56:23.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:23.380 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-05T15:56:23.380 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-05T15:56:23.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.9 2023-10-05T15:56:23.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:23.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:23.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:23.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:23.583 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:23 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.433+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.433+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.433+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.433+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.433+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.433+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:23.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 systemd[1]: Stopping Ceph osd.9 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:24.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:23.732+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:24.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:23.732+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:24.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:23.732+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:24.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:23.732+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:24.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:23.732+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:24.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:23 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:23.732+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:24.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.919+0000 7f4f69648700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:24.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.919+0000 7f4f69648700 -1 osd.9 94 *** Got signal Terminated *** 2023-10-05T15:56:24.197 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:23 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:23.919+0000 7f4f69648700 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:56:24.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:24 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:24.434+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:24.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:24 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:24.434+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:24.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:24 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:24.434+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:24.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:24 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:24.434+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:24.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:24 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:24.434+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:24.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:24 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:24.434+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:24.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:24.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:24.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:24.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:24.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:24 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:25.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:24 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:24.773+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:25.696 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:25 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:25.443+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:25.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:25 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:25.443+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:25.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:25 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:25.443+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:25.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:25 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:25.443+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:25.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:25 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:25.443+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:25.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:25 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:25.443+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:25.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:25.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:25.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:25.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:25.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:25 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:26.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:26.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:26.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:26.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:26.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:26.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:26.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:25 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:25.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:26.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:26 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:26.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:26 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:26.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:26 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:26.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:26 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:26.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:26 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:26.946 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:26 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:26.469+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:26.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:26 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:26.469+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:26.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:26 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:26.469+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:26.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:26 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:26.469+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:26.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:26 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:26.469+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:26.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:26 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:26.469+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:27.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.758+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:27.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:27.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:27.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:27.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:27.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:27.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:26.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:27.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:27 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:27.423+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:27.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:27 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:27.423+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:27.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:27 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:27.423+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:27.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:27 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:27.423+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:27.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:27 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:27.423+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:27.697 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:27 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:27.423+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:27.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:27 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:27.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:27 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:27.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:27 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:27.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:27 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:27.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:27 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:28.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:28.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:28.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:28.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:28.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:28.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:28.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:27 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:27.723+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:28.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:28 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:28.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:28 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:28.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:28 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:28.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:28 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:28.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:28 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:28.946 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:28.451+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:08.700235+0000 front 2023-10-05T15:55:08.700117+0000 (oldest deadline 2023-10-05T15:55:31.501090+0000) 2023-10-05T15:56:28.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:28.451+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:18.503250+0000 front 2023-10-05T15:55:18.503276+0000 (oldest deadline 2023-10-05T15:55:41.403187+0000) 2023-10-05T15:56:28.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:28.451+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:27.706234+0000 front 2023-10-05T15:55:27.706173+0000 (oldest deadline 2023-10-05T15:55:50.606233+0000) 2023-10-05T15:56:28.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:28.451+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:34.008415+0000 front 2023-10-05T15:55:34.008472+0000 (oldest deadline 2023-10-05T15:55:59.809258+0000) 2023-10-05T15:56:28.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:28.451+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:43.310810+0000 front 2023-10-05T15:55:43.310714+0000 (oldest deadline 2023-10-05T15:56:12.110964+0000) 2023-10-05T15:56:28.947 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:28 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9[172477]: 2023-10-05T15:56:28.451+0000 7f4f62437700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:53.812283+0000 front 2023-10-05T15:55:53.812318+0000 (oldest deadline 2023-10-05T15:56:15.512027+0000) 2023-10-05T15:56:29.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.729+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:29.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.729+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:29.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.730+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:29.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.730+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:29.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.730+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:29.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.730+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:29.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:28 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:28.730+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:29.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:29 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:29.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:29 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:29.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:29 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:29.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:29 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:29.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:29 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:29.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:29 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:30.094 INFO:journalctl@ceph.osd.9.smithi017.stdout:Oct 05 15:56:29 smithi017 bash[215034]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-9 2023-10-05T15:56:30.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:30.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:30.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:30.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:30.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:30.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:30.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:29 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:29.704+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:30.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:30 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:30.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:30 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:30.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:30 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:30.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:30 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:30.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:30 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:30.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:30 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:30.511+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:31.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:31.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:31.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:31.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:31.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:31.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:31.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:30 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:30.710+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:31.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:31.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:31.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:31.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:31.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:31.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:31.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-05T15:56:32.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:32.041 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-05T15:56:32.041 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-05T15:56:32.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.10 2023-10-05T15:56:32.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:32.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:32.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:32.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:32.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:32.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:32.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:31 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:31.748+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:32.560 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 systemd[1]: Stopping Ceph osd.10 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:32.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:32 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:32.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:32 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:32.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:32 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:32.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:32 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:32.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:32 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:32.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:32 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:32.854 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.558+0000 7f26a000d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.558+0000 7f26a000d700 -1 osd.10 94 *** Got signal Terminated *** 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.558+0000 7f26a000d700 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:32.855 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:32 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:32.736+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:33.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:33.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:33.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:33.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:33.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:33.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:33.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:33 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:34.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:34.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:34.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:34.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:34.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:34.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:34.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:33 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:33.740+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:34.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:34.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:34.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:34.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:34.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:34.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:34.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:34 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:35.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:35.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:35.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:35.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:35.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:35.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:35.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:34 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:34.759+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:35.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:35.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:35.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:35.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:35.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:35.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:35.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:36.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:36.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:36.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:36.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:36.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:36.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:36.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:35 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:35.769+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:36.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:36.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:36.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:36.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:36.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:36.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:36.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:36 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:37.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:06.294661+0000 front 2023-10-05T15:55:06.294596+0000 (oldest deadline 2023-10-05T15:55:31.495605+0000) 2023-10-05T15:56:37.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.897523+0000 front 2023-10-05T15:55:14.897429+0000 (oldest deadline 2023-10-05T15:55:42.498107+0000) 2023-10-05T15:56:37.104 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:25.399369+0000 front 2023-10-05T15:55:25.399405+0000 (oldest deadline 2023-10-05T15:55:50.099280+0000) 2023-10-05T15:56:37.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-10-05T15:55:36.000441+0000 front 2023-10-05T15:55:36.000571+0000 (oldest deadline 2023-10-05T15:56:01.900307+0000) 2023-10-05T15:56:37.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:44.201294+0000 front 2023-10-05T15:55:44.201320+0000 (oldest deadline 2023-10-05T15:56:09.401961+0000) 2023-10-05T15:56:37.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.803664+0000 front 2023-10-05T15:55:52.803740+0000 (oldest deadline 2023-10-05T15:56:16.303461+0000) 2023-10-05T15:56:37.105 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:36 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10[163204]: 2023-10-05T15:56:36.755+0000 7f26985fb700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:59.804783+0000 front 2023-10-05T15:55:59.804634+0000 (oldest deadline 2023-10-05T15:56:24.504606+0000) 2023-10-05T15:56:37.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:37.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:37.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:37.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:37.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:37.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:37.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:37 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:38.450 INFO:journalctl@ceph.osd.10.smithi079.stdout:Oct 05 15:56:38 smithi079 bash[177505]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-10 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:38.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:38 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:39.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:39.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:39.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:39.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:39.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:39.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:39.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:39 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:40.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-05T15:56:40.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:40.273 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-05T15:56:40.273 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-05T15:56:40.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.11 2023-10-05T15:56:40.786 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 systemd[1]: Stopping Ceph osd.11 for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:40.787 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.784+0000 7f2173a1b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:41.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.784+0000 7f2173a1b700 -1 osd.11 94 *** Got signal Terminated *** 2023-10-05T15:56:41.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:40.784+0000 7f2173a1b700 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:56:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:41.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:41.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:41.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:41 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:42.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:42.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:42.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:42.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:42.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:42.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:42.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:42.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:42 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:43.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:43.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:43.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:43.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:43.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:43.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:43.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:43.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:43 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:43.568+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:45.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:45.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:45.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:45.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:45.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:44 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:45.824 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.824 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6578-g689b3d5a/rpm/el8/BUILD/ceph-18.0.0-6578-g689b3d5a/src/os/bluestore/BlueFS.cc: In function 'uint64_t BlueFS::_log_advance_seq()' thread 7f2173a1b700 time 2023-10-05T15:56:45.789860+0000 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6578-g689b3d5a/rpm/el8/BUILD/ceph-18.0.0-6578-g689b3d5a/src/os/bluestore/BlueFS.cc: 3042: FAILED ceph_assert(log.t.seq == log.seq_live) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x5569328b015f] 2023-10-05T15:56:45.825 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2: /usr/bin/ceph-osd(+0x64a325) [0x5569328b0325] 2023-10-05T15:56:45.826 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 3: /usr/bin/ceph-osd(+0xd91e1b) [0x556932ff7e1b] 2023-10-05T15:56:45.827 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 4: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55693300d62c] 2023-10-05T15:56:45.827 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 5: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55693301b290] 2023-10-05T15:56:45.827 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 6: (BlueStore::store_allocator(Allocator*)+0xb7) [0x556932f43017] 2023-10-05T15:56:45.827 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 7: (BlueStore::_close_db()+0x4e2) [0x556932f44272] 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 8: (BlueStore::_close_db_and_around()+0x17) [0x556932f44bd7] 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 9: (BlueStore::umount()+0xfa) [0x556932f98cfa] 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 10: (OSD::shutdown()+0x2ee) [0x5569329e223e] 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 11: (SignalHandler::entry()+0x659) [0x556933061b29] 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f217ae561ca] 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 13: clone() 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.793+0000 7f2173a1b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6578-g689b3d5a/rpm/el8/BUILD/ceph-18.0.0-6578-g689b3d5a/src/os/bluestore/BlueFS.cc: In function 'uint64_t BlueFS::_log_advance_seq()' thread 7f2173a1b700 time 2023-10-05T15:56:45.789860+0000 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6578-g689b3d5a/rpm/el8/BUILD/ceph-18.0.0-6578-g689b3d5a/src/os/bluestore/BlueFS.cc: 3042: FAILED ceph_assert(log.t.seq == log.seq_live) 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.828 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:56:45.829 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x5569328b015f] 2023-10-05T15:56:45.829 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2: /usr/bin/ceph-osd(+0x64a325) [0x5569328b0325] 2023-10-05T15:56:45.829 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 3: /usr/bin/ceph-osd(+0xd91e1b) [0x556932ff7e1b] 2023-10-05T15:56:45.829 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 4: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55693300d62c] 2023-10-05T15:56:45.829 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 5: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55693301b290] 2023-10-05T15:56:45.829 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 6: (BlueStore::store_allocator(Allocator*)+0xb7) [0x556932f43017] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 7: (BlueStore::_close_db()+0x4e2) [0x556932f44272] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 8: (BlueStore::_close_db_and_around()+0x17) [0x556932f44bd7] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 9: (BlueStore::umount()+0xfa) [0x556932f98cfa] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 10: (OSD::shutdown()+0x2ee) [0x5569329e223e] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 11: (SignalHandler::entry()+0x659) [0x556933061b29] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f217ae561ca] 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 13: clone() 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: *** Caught signal (Aborted) ** 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: in thread 7f2173a1b700 thread_name:signal_handler 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:56:45.830 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f217ae60cf0] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2: gsignal() 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 3: abort() 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x5569328b01b9] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 5: /usr/bin/ceph-osd(+0x64a325) [0x5569328b0325] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 6: /usr/bin/ceph-osd(+0xd91e1b) [0x556932ff7e1b] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 7: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55693300d62c] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 8: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55693301b290] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 9: (BlueStore::store_allocator(Allocator*)+0xb7) [0x556932f43017] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 10: (BlueStore::_close_db()+0x4e2) [0x556932f44272] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 11: (BlueStore::_close_db_and_around()+0x17) [0x556932f44bd7] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 12: (BlueStore::umount()+0xfa) [0x556932f98cfa] 2023-10-05T15:56:45.831 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 13: (OSD::shutdown()+0x2ee) [0x5569329e223e] 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 14: (SignalHandler::entry()+0x659) [0x556933061b29] 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f217ae561ca] 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 16: clone() 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.798+0000 7f2173a1b700 -1 *** Caught signal (Aborted) ** 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: in thread 7f2173a1b700 thread_name:signal_handler 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f217ae60cf0] 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2: gsignal() 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 3: abort() 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x5569328b01b9] 2023-10-05T15:56:45.832 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 5: /usr/bin/ceph-osd(+0x64a325) [0x5569328b0325] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 6: /usr/bin/ceph-osd(+0xd91e1b) [0x556932ff7e1b] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 7: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55693300d62c] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 8: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55693301b290] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 9: (BlueStore::store_allocator(Allocator*)+0xb7) [0x556932f43017] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 10: (BlueStore::_close_db()+0x4e2) [0x556932f44272] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 11: (BlueStore::_close_db_and_around()+0x17) [0x556932f44bd7] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 12: (BlueStore::umount()+0xfa) [0x556932f98cfa] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 13: (OSD::shutdown()+0x2ee) [0x5569329e223e] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 14: (SignalHandler::entry()+0x659) [0x556933061b29] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f217ae561ca] 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 16: clone() 2023-10-05T15:56:45.833 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9872> 2023-10-05T15:55:43.371+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9808> 2023-10-05T15:55:44.400+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9807> 2023-10-05T15:55:44.400+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9446> 2023-10-05T15:55:45.406+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9445> 2023-10-05T15:55:45.406+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9316> 2023-10-05T15:55:46.437+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9315> 2023-10-05T15:55:46.437+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9075> 2023-10-05T15:55:47.472+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9074> 2023-10-05T15:55:47.472+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9004> 2023-10-05T15:55:48.500+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.834 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -9003> 2023-10-05T15:55:48.500+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8552> 2023-10-05T15:55:49.502+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8551> 2023-10-05T15:55:49.502+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8473> 2023-10-05T15:55:50.475+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8472> 2023-10-05T15:55:50.475+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8359> 2023-10-05T15:55:51.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8358> 2023-10-05T15:55:51.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8246> 2023-10-05T15:55:52.464+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -8245> 2023-10-05T15:55:52.464+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7796> 2023-10-05T15:55:53.440+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7795> 2023-10-05T15:55:53.440+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7688> 2023-10-05T15:55:54.433+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.835 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7687> 2023-10-05T15:55:54.433+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7686> 2023-10-05T15:55:54.433+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7451> 2023-10-05T15:55:55.398+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7450> 2023-10-05T15:55:55.398+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7449> 2023-10-05T15:55:55.398+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7327> 2023-10-05T15:55:56.411+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7326> 2023-10-05T15:55:56.411+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7325> 2023-10-05T15:55:56.411+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7006> 2023-10-05T15:55:57.417+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7005> 2023-10-05T15:55:57.417+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -7004> 2023-10-05T15:55:57.417+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6939> 2023-10-05T15:55:58.414+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.836 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6938> 2023-10-05T15:55:58.414+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6937> 2023-10-05T15:55:58.414+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6736> 2023-10-05T15:55:59.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6735> 2023-10-05T15:55:59.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6734> 2023-10-05T15:55:59.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6627> 2023-10-05T15:56:00.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6626> 2023-10-05T15:56:00.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6625> 2023-10-05T15:56:00.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6294> 2023-10-05T15:56:01.486+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6293> 2023-10-05T15:56:01.486+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6292> 2023-10-05T15:56:01.486+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.837 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6189> 2023-10-05T15:56:02.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6188> 2023-10-05T15:56:02.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6187> 2023-10-05T15:56:02.442+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6052> 2023-10-05T15:56:03.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6051> 2023-10-05T15:56:03.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -6050> 2023-10-05T15:56:03.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5941> 2023-10-05T15:56:04.508+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5940> 2023-10-05T15:56:04.508+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5939> 2023-10-05T15:56:04.508+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5690> 2023-10-05T15:56:05.535+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5689> 2023-10-05T15:56:05.535+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5688> 2023-10-05T15:56:05.535+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.838 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5582> 2023-10-05T15:56:06.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5581> 2023-10-05T15:56:06.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5580> 2023-10-05T15:56:06.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5445> 2023-10-05T15:56:07.505+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5444> 2023-10-05T15:56:07.505+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5443> 2023-10-05T15:56:07.505+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5374> 2023-10-05T15:56:08.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.839 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5373> 2023-10-05T15:56:08.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5372> 2023-10-05T15:56:08.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5032> 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5031> 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5030> 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -5029> 2023-10-05T15:56:09.427+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4951> 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4950> 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4949> 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4948> 2023-10-05T15:56:10.407+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4885> 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:45.840 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4884> 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:45.841 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4883> 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:45.841 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4882> 2023-10-05T15:56:11.446+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:45.841 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4683> 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4682> 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4681> 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4680> 2023-10-05T15:56:12.449+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4332> 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4331> 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.084 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4329> 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4327> 2023-10-05T15:56:13.421+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4274> 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4273> 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4272> 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4271> 2023-10-05T15:56:14.391+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4141> 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4140> 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4139> 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4138> 2023-10-05T15:56:15.385+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.085 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4037> 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4036> 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4035> 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -4034> 2023-10-05T15:56:16.386+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3680> 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3679> 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3678> 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3677> 2023-10-05T15:56:17.429+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3553> 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3552> 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3551> 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3550> 2023-10-05T15:56:18.458+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3453> 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3452> 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3451> 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3450> 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3449> 2023-10-05T15:56:19.413+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3395> 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3394> 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3393> 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3392> 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3391> 2023-10-05T15:56:20.462+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3116> 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.087 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3115> 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3114> 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3113> 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -3112> 2023-10-05T15:56:21.496+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2991> 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2990> 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2989> 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2988> 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2987> 2023-10-05T15:56:22.451+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2874> 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2873> 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.088 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2872> 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2871> 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2870> 2023-10-05T15:56:23.463+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2834> 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2833> 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2832> 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2831> 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2830> 2023-10-05T15:56:24.455+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2560> 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2559> 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2558> 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.089 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2557> 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.093 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2556> 2023-10-05T15:56:25.470+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.093 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2436> 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.093 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2435> 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2434> 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2433> 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2432> 2023-10-05T15:56:26.492+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2294> 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2293> 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2292> 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2291> 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2290> 2023-10-05T15:56:27.506+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2216> 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.094 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2215> 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2214> 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2213> 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2212> 2023-10-05T15:56:28.461+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2053> 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2052> 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2051> 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2050> 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2049> 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -2048> 2023-10-05T15:56:29.476+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1960> 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.095 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1959> 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1958> 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1957> 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1956> 2023-10-05T15:56:30.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1955> 2023-10-05T15:56:30.511+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1824> 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1823> 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.096 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1822> 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.097 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1821> 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.097 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1820> 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.097 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1819> 2023-10-05T15:56:31.468+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.097 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1745> 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.097 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1744> 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.097 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1743> 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.098 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1742> 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.098 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1741> 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.098 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1740> 2023-10-05T15:56:32.490+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.098 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1548> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.098 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1547> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.099 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1546> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.099 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1545> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.099 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1544> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.099 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1543> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.099 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1542> 2023-10-05T15:56:33.473+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.100 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1445> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.100 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1444> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.100 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1443> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.100 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1442> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.100 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1441> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1440> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1439> 2023-10-05T15:56:34.514+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1403> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1402> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1401> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1400> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.101 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1399> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.102 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1398> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.102 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1397> 2023-10-05T15:56:35.491+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.102 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1321> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.102 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1320> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.103 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1319> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.103 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1318> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.103 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1317> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.103 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1316> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.103 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1315> 2023-10-05T15:56:36.510+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.103 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1137> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.104 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1136> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.104 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1135> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.104 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1134> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.104 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1133> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.104 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1132> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1131> 2023-10-05T15:56:37.557+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1012> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1011> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1010> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1009> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1008> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1007> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.105 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1006> 2023-10-05T15:56:38.528+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -919> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -918> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -917> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -916> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -915> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -914> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -913> 2023-10-05T15:56:39.574+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -872> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -871> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -870> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.106 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -869> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -868> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -867> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -866> 2023-10-05T15:56:40.572+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -855> 2023-10-05T15:56:40.784+0000 7f2173a1b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -854> 2023-10-05T15:56:40.784+0000 7f2173a1b700 -1 osd.11 94 *** Got signal Terminated *** 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -852> 2023-10-05T15:56:40.784+0000 7f2173a1b700 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -679> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -678> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -677> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -676> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -675> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.107 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -674> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -673> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -672> 2023-10-05T15:56:41.580+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -576> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -575> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -574> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -573> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -572> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -571> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -570> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.108 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -569> 2023-10-05T15:56:42.575+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -538> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -537> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -536> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -535> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -534> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -533> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -532> 2023-10-05T15:56:43.567+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -531> 2023-10-05T15:56:43.568+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -443> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -442> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -441> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.109 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -440> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -439> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -438> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -437> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -436> 2023-10-05T15:56:44.613+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -271> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-10-05T15:55:09.491397+0000 front 2023-10-05T15:55:09.491287+0000 (oldest deadline 2023-10-05T15:55:34.791343+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -270> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2023-10-05T15:55:14.792143+0000 front 2023-10-05T15:55:14.791993+0000 (oldest deadline 2023-10-05T15:55:44.192636+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -269> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2023-10-05T15:55:28.293907+0000 front 2023-10-05T15:55:28.294018+0000 (oldest deadline 2023-10-05T15:55:53.594232+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -268> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2023-10-05T15:55:40.596499+0000 front 2023-10-05T15:55:40.596470+0000 (oldest deadline 2023-10-05T15:56:08.797372+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -267> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2023-10-05T15:55:52.898317+0000 front 2023-10-05T15:55:52.898268+0000 (oldest deadline 2023-10-05T15:56:18.699152+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -266> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-10-05T15:55:58.699821+0000 front 2023-10-05T15:55:58.699692+0000 (oldest deadline 2023-10-05T15:56:29.300510+0000) 2023-10-05T15:56:46.110 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -265> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2023-10-05T15:56:11.601833+0000 front 2023-10-05T15:56:11.601855+0000 (oldest deadline 2023-10-05T15:56:32.701680+0000) 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -264> 2023-10-05T15:56:45.639+0000 7f2170011700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.167:6820 osd.8 since back 2023-10-05T15:56:17.303592+0000 front 2023-10-05T15:56:17.303552+0000 (oldest deadline 2023-10-05T15:56:41.403729+0000) 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: -1> 2023-10-05T15:56:45.793+0000 7f2173a1b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6578-g689b3d5a/rpm/el8/BUILD/ceph-18.0.0-6578-g689b3d5a/src/os/bluestore/BlueFS.cc: In function 'uint64_t BlueFS::_log_advance_seq()' thread 7f2173a1b700 time 2023-10-05T15:56:45.789860+0000 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6578-g689b3d5a/rpm/el8/BUILD/ceph-18.0.0-6578-g689b3d5a/src/os/bluestore/BlueFS.cc: 3042: FAILED ceph_assert(log.t.seq == log.seq_live) 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x5569328b015f] 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2: /usr/bin/ceph-osd(+0x64a325) [0x5569328b0325] 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 3: /usr/bin/ceph-osd(+0xd91e1b) [0x556932ff7e1b] 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 4: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55693300d62c] 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 5: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55693301b290] 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 6: (BlueStore::store_allocator(Allocator*)+0xb7) [0x556932f43017] 2023-10-05T15:56:46.111 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 7: (BlueStore::_close_db()+0x4e2) [0x556932f44272] 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 8: (BlueStore::_close_db_and_around()+0x17) [0x556932f44bd7] 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 9: (BlueStore::umount()+0xfa) [0x556932f98cfa] 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 10: (OSD::shutdown()+0x2ee) [0x5569329e223e] 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 11: (SignalHandler::entry()+0x659) [0x556933061b29] 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f217ae561ca] 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 13: clone() 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 0> 2023-10-05T15:56:45.798+0000 7f2173a1b700 -1 *** Caught signal (Aborted) ** 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: in thread 7f2173a1b700 thread_name:signal_handler 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: ceph version 18.0.0-6578-g689b3d5a (689b3d5ae1ed3e8efe9a65281cd9bd422749e95f) reef (dev) 2023-10-05T15:56:46.112 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f217ae60cf0] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2: gsignal() 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 3: abort() 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x5569328b01b9] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 5: /usr/bin/ceph-osd(+0x64a325) [0x5569328b0325] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 6: /usr/bin/ceph-osd(+0xd91e1b) [0x556932ff7e1b] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 7: (BlueFS::_flush_and_sync_log_jump_D(unsigned long)+0x5c) [0x55693300d62c] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 8: (BlueFS::_compact_log_async_LD_LNF_D()+0x660) [0x55693301b290] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 9: (BlueStore::store_allocator(Allocator*)+0xb7) [0x556932f43017] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 10: (BlueStore::_close_db()+0x4e2) [0x556932f44272] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 11: (BlueStore::_close_db_and_around()+0x17) [0x556932f44bd7] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 12: (BlueStore::umount()+0xfa) [0x556932f98cfa] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 13: (OSD::shutdown()+0x2ee) [0x5569329e223e] 2023-10-05T15:56:46.113 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 14: (SignalHandler::entry()+0x659) [0x556933061b29] 2023-10-05T15:56:46.114 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f217ae561ca] 2023-10-05T15:56:46.114 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 16: clone() 2023-10-05T15:56:46.114 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T15:56:46.114 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:45 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11[164326]: 2023-10-05T15:56:46.677 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:46 smithi167 bash[178828]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-osd-11 2023-10-05T15:56:47.083 INFO:journalctl@ceph.osd.11.smithi167.stdout:Oct 05 15:56:46 smithi167 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.11.service: Main process exited, code=exited, status=139/n/a 2023-10-05T15:56:48.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-05T15:56:48.499 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:48.499 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-05T15:56:48.499 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-05T15:56:48.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.a 2023-10-05T15:56:48.946 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:56:48 smithi017 systemd[1]: Stopping Ceph mds.a for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:49.446 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:56:49 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-a[180999]: 2023-10-05T15:56:49.048+0000 7fa0226ee700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:49.446 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:56:49 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-a[180999]: 2023-10-05T15:56:49.048+0000 7fa0226ee700 -1 mds.a *** got signal Terminated *** 2023-10-05T15:56:52.197 INFO:journalctl@ceph.mds.a.smithi017.stdout:Oct 05 15:56:51 smithi017 bash[215303]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-a 2023-10-05T15:56:52.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-05T15:56:52.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:52.593 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-05T15:56:52.593 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-05T15:56:52.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.d 2023-10-05T15:56:52.946 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:56:52 smithi017 systemd[1]: Stopping Ceph mds.d for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:53.450 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:56:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-d[179906]: 2023-10-05T15:56:53.089+0000 7f072cd3e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:53.450 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:56:53 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-d[179906]: 2023-10-05T15:56:53.089+0000 7f072cd3e700 -1 mds.d *** got signal Terminated *** 2023-10-05T15:56:57.697 INFO:journalctl@ceph.mds.d.smithi017.stdout:Oct 05 15:56:57 smithi017 bash[215451]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-d 2023-10-05T15:56:58.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-05T15:56:58.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:56:58.130 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-05T15:56:58.130 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-05T15:56:58.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.g 2023-10-05T15:56:58.446 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:56:58 smithi017 systemd[1]: Stopping Ceph mds.g for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:56:58.946 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:56:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-g[180611]: 2023-10-05T15:56:58.630+0000 7fbcd9650700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:56:58.947 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:56:58 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-g[180611]: 2023-10-05T15:56:58.630+0000 7fbcd9650700 -1 mds.g *** got signal Terminated *** 2023-10-05T15:57:03.527 INFO:journalctl@ceph.mds.g.smithi017.stdout:Oct 05 15:57:03 smithi017 bash[215603]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-g 2023-10-05T15:57:03.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-05T15:57:03.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:03.920 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-05T15:57:03.921 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-05T15:57:03.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.j 2023-10-05T15:57:04.197 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:57:04 smithi017 systemd[1]: Stopping Ceph mds.j for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:04.946 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:57:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-j[179522]: 2023-10-05T15:57:04.471+0000 7f7804fb3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:04.947 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:57:04 smithi017 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-j[179522]: 2023-10-05T15:57:04.471+0000 7f7804fb3700 -1 mds.j *** got signal Terminated *** 2023-10-05T15:57:07.125 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:57:06 smithi017 bash[215741]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-j 2023-10-05T15:57:07.348 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-05T15:57:07.408 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:57:07 smithi017 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.j.service: Succeeded. 2023-10-05T15:57:07.408 INFO:journalctl@ceph.mds.j.smithi017.stdout:Oct 05 15:57:07 smithi017 systemd[1]: Stopped Ceph mds.j for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:57:07.436 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:07.437 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-05T15:57:07.437 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-05T15:57:07.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.b 2023-10-05T15:57:07.854 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:57:07 smithi079 systemd[1]: Stopping Ceph mds.b for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:08.354 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:57:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:57:07.950+0000 7f8de1cae700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:08.355 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:57:07 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b[170012]: 2023-10-05T15:57:07.950+0000 7f8de1cae700 -1 mds.b *** got signal Terminated *** 2023-10-05T15:57:18.288 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:57:17 smithi079 bash[177781]: time="2023-10-05T15:57:17Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b in 10 seconds, resorting to SIGKILL" 2023-10-05T15:57:18.604 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:57:18 smithi079 bash[177781]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-b 2023-10-05T15:57:18.605 INFO:journalctl@ceph.mds.b.smithi079.stdout:Oct 05 15:57:18 smithi079 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.b.service: Main process exited, code=exited, status=137/n/a 2023-10-05T15:57:18.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-05T15:57:18.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:18.758 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-05T15:57:18.758 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-05T15:57:18.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.e 2023-10-05T15:57:19.104 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:57:18 smithi079 systemd[1]: Stopping Ceph mds.e for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:19.604 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:57:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-e[169323]: 2023-10-05T15:57:19.256+0000 7f6b73ad5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:19.604 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:57:19 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-e[169323]: 2023-10-05T15:57:19.256+0000 7f6b73ad5700 -1 mds.e *** got signal Terminated *** 2023-10-05T15:57:21.604 INFO:journalctl@ceph.mds.e.smithi079.stdout:Oct 05 15:57:21 smithi079 bash[177926]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-e 2023-10-05T15:57:21.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-05T15:57:21.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:21.804 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-05T15:57:21.804 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-05T15:57:21.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.h 2023-10-05T15:57:22.104 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:57:21 smithi079 systemd[1]: Stopping Ceph mds.h for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:22.604 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:57:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-h[169666]: 2023-10-05T15:57:22.289+0000 7fab0cfbd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:22.604 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:57:22 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-h[169666]: 2023-10-05T15:57:22.289+0000 7fab0cfbd700 -1 mds.h *** got signal Terminated *** 2023-10-05T15:57:25.588 INFO:journalctl@ceph.mds.h.smithi079.stdout:Oct 05 15:57:25 smithi079 bash[178072]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-h 2023-10-05T15:57:25.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-05T15:57:25.692 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:25.693 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-05T15:57:25.693 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-05T15:57:25.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.k 2023-10-05T15:57:25.854 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:57:25 smithi079 systemd[1]: Stopping Ceph mds.k for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:26.604 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:57:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-k[168977]: 2023-10-05T15:57:26.181+0000 7f7ba1f23700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:26.604 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:57:26 smithi079 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-k[168977]: 2023-10-05T15:57:26.181+0000 7f7ba1f23700 -1 mds.k *** got signal Terminated *** 2023-10-05T15:57:30.712 INFO:journalctl@ceph.mds.k.smithi079.stdout:Oct 05 15:57:30 smithi079 bash[178217]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-k 2023-10-05T15:57:31.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-05T15:57:31.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:31.108 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-05T15:57:31.108 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-05T15:57:31.108 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.c 2023-10-05T15:57:31.583 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:57:31 smithi167 systemd[1]: Stopping Ceph mds.c for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:32.083 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:57:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-c[171124]: 2023-10-05T15:57:31.619+0000 7f292b137700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:32.083 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:57:31 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-c[171124]: 2023-10-05T15:57:31.619+0000 7f292b137700 -1 mds.c *** got signal Terminated *** 2023-10-05T15:57:34.584 INFO:journalctl@ceph.mds.c.smithi167.stdout:Oct 05 15:57:34 smithi167 bash[179104]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-c 2023-10-05T15:57:34.648 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-05T15:57:34.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:34.733 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-05T15:57:34.733 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-05T15:57:34.734 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.f 2023-10-05T15:57:35.083 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:57:34 smithi167 systemd[1]: Stopping Ceph mds.f for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:35.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:57:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-f[170772]: 2023-10-05T15:57:35.218+0000 7f56f0003700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:35.583 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:57:35 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-f[170772]: 2023-10-05T15:57:35.218+0000 7f56f0003700 -1 mds.f *** got signal Terminated *** 2023-10-05T15:57:39.833 INFO:journalctl@ceph.mds.f.smithi167.stdout:Oct 05 15:57:39 smithi167 bash[179249]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-f 2023-10-05T15:57:39.979 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-05T15:57:40.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:40.063 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-05T15:57:40.063 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-05T15:57:40.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.i 2023-10-05T15:57:40.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:57:40 smithi167 systemd[1]: Stopping Ceph mds.i for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:40.833 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:57:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-i[171464]: 2023-10-05T15:57:40.551+0000 7fca17c43700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:40.833 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:57:40 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-i[171464]: 2023-10-05T15:57:40.551+0000 7fca17c43700 -1 mds.i *** got signal Terminated *** 2023-10-05T15:57:45.333 INFO:journalctl@ceph.mds.i.smithi167.stdout:Oct 05 15:57:45 smithi167 bash[179395]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-i 2023-10-05T15:57:45.545 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-05T15:57:45.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:45.627 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-05T15:57:45.627 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-05T15:57:45.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.l 2023-10-05T15:57:45.833 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:57:45 smithi167 systemd[1]: Stopping Ceph mds.l for 6446904c-6393-11ee-8db5-212e2dc638e7... 2023-10-05T15:57:46.585 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:57:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-l[170430]: 2023-10-05T15:57:46.152+0000 7f837a157700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-05T15:57:46.586 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:57:46 smithi167 ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-l[170430]: 2023-10-05T15:57:46.152+0000 7f837a157700 -1 mds.l *** got signal Terminated *** 2023-10-05T15:57:48.333 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:57:48 smithi167 bash[179539]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7-mds-l 2023-10-05T15:57:48.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-05T15:57:48.653 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:57:48 smithi167 systemd[1]: ceph-6446904c-6393-11ee-8db5-212e2dc638e7@mds.l.service: Succeeded. 2023-10-05T15:57:48.653 INFO:journalctl@ceph.mds.l.smithi167.stdout:Oct 05 15:57:48 smithi167 systemd[1]: Stopped Ceph mds.l for 6446904c-6393-11ee-8db5-212e2dc638e7. 2023-10-05T15:57:48.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-05T15:57:48.676 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-05T15:57:48.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-05T15:57:49.079 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:57:52.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-05T15:57:52.836 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:57:56.010 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-05T15:57:56.402 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T15:57:59.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:57:59.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:57:59.883 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-05T15:57:59.954 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-05T15:57:59.956 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi017/crash 2023-10-05T15:57:59.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash -- . 2023-10-05T15:58:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-05T15:58:00.045 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2023-10-05T15:58:00.049 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi079/crash 2023-10-05T15:58:00.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash -- . 2023-10-05T15:58:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-05T15:58:00.162 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2023-10-05T15:58:00.166 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi167/crash 2023-10-05T15:58:00.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash -- . 2023-10-05T15:58:00.254 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-05T15:58:00.254 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2023-10-05T15:58:00.256 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-05T15:58:00.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-05T15:58:00.340 INFO:teuthology.orchestra.run.smithi017.stderr:grep: /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-05T15:58:00.345 INFO:tasks.cephadm:Compressing logs... 2023-10-05T15:58:00.345 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T15:58:00.349 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T15:58:00.354 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T15:58:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- : No such file or directory/var/log/ceph/cephadm.log 2023-10-05T15:58:00.420 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-10-05T15:58:00.425 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-10-05T15:58:00.426 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-10-05T15:58:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-05T15:58:00.427 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-05T15:58:00.428 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-05T15:58:00.429 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-05T15:58:00.429 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-05T15:58:00.430 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-05T15:58:00.430 INFO:teuthology.orchestra.run.smithi079.stderr:: No such file or directory 2023-10-05T15:58:00.430 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-05T15:58:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-05T15:58:00.431 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-05T15:58:00.432 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-05T15:58:00.433 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-05T15:58:00.434 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: 94.5% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-05T15:58:00.435 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-05T15:58:00.436 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-05T15:58:00.437 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-05T15:58:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-05T15:58:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-05T15:58:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-05T15:58:00.451 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-05T15:58:00.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-05T15:58:00.453 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.j.log: /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.a.log: 94.4% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-05T15:58:00.453 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-05T15:58:00.454 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-05T15:58:00.454 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-05T15:58:00.454 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-05T15:58:00.454 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-05T15:58:00.454 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-05T15:58:00.455 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-05T15:58:00.455 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-05T15:58:00.455 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-05T15:58:00.455 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-05T15:58:00.455 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-05T15:58:00.455 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log: 93.3% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-05T15:58:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.b.log: /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 93.2% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-05T15:58:00.502 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-10-05T15:58:00.615 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 90.9% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-05T15:58:00.681 INFO:teuthology.orchestra.run.smithi167.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-05T15:58:00.688 INFO:teuthology.orchestra.run.smithi017.stderr: 90.9% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-05T15:58:00.754 INFO:teuthology.orchestra.run.smithi017.stderr: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-05T15:58:00.864 INFO:teuthology.orchestra.run.smithi079.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-05T15:58:00.988 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-05T15:58:01.055 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-05T15:58:01.123 INFO:teuthology.orchestra.run.smithi017.stderr: 94.4% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-05T15:58:01.143 INFO:teuthology.orchestra.run.smithi167.stderr: 95.0% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-05T15:58:01.339 INFO:teuthology.orchestra.run.smithi079.stderr: 91.8% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-05T15:58:01.458 INFO:teuthology.orchestra.run.smithi017.stderr: 90.3% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-05T15:58:01.593 INFO:teuthology.orchestra.run.smithi167.stderr: 94.3% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-05T15:58:02.329 INFO:teuthology.orchestra.run.smithi167.stderr: 92.0% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-05T15:58:02.868 INFO:teuthology.orchestra.run.smithi079.stderr: 96.6% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-05T15:58:04.002 INFO:teuthology.orchestra.run.smithi017.stderr: 90.2% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-05T15:58:04.810 INFO:teuthology.orchestra.run.smithi167.stderr: 94.0% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-05T15:58:18.506 INFO:teuthology.orchestra.run.smithi079.stderr: 95.4% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-05T15:58:21.119 INFO:teuthology.orchestra.run.smithi017.stderr: 95.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-05T15:59:24.657 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-05T15:59:25.082 INFO:teuthology.orchestra.run.smithi079.stderr: 97.8% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-05T15:59:41.242 INFO:teuthology.orchestra.run.smithi167.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-05T15:59:56.615 INFO:teuthology.orchestra.run.smithi079.stderr: 90.6% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-05T16:00:01.880 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-05T16:00:25.058 INFO:teuthology.orchestra.run.smithi167.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-05T16:00:30.384 INFO:teuthology.orchestra.run.smithi079.stderr: 90.8% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-05T16:00:30.408 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-05T16:00:30.408 INFO:teuthology.orchestra.run.smithi079.stderr:real 2m30.016s 2023-10-05T16:00:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:user 4m48.382s 2023-10-05T16:00:30.409 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m32.440s 2023-10-05T16:00:50.572 INFO:teuthology.orchestra.run.smithi167.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-05T16:01:12.801 INFO:teuthology.orchestra.run.smithi167.stderr: 98.3% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-05T16:01:17.691 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-05T16:01:21.585 INFO:teuthology.orchestra.run.smithi017.stderr: 90.6% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-05T16:01:28.163 INFO:teuthology.orchestra.run.smithi017.stderr: 90.6% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-05T16:01:28.721 INFO:teuthology.orchestra.run.smithi167.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-05T16:01:28.738 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T16:01:28.738 INFO:teuthology.orchestra.run.smithi167.stderr:real 3m28.343s 2023-10-05T16:01:28.738 INFO:teuthology.orchestra.run.smithi167.stderr:user 5m25.308s 2023-10-05T16:01:28.738 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m40.146s 2023-10-05T16:01:50.574 INFO:teuthology.orchestra.run.smithi017.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-10-05T16:02:00.779 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/6446904c-6393-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-05T16:02:00.783 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-10-05T16:02:00.783 INFO:teuthology.orchestra.run.smithi017.stderr:real 4m0.398s 2023-10-05T16:02:00.783 INFO:teuthology.orchestra.run.smithi017.stderr:user 6m48.825s 2023-10-05T16:02:00.783 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m52.968s 2023-10-05T16:02:00.784 INFO:tasks.cephadm:Archiving logs... 2023-10-05T16:02:00.785 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi017/log 2023-10-05T16:02:00.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T16:03:06.997 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi079/log 2023-10-05T16:03:06.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T16:03:54.794 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi167/log 2023-10-05T16:03:54.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T16:04:46.876 INFO:tasks.cephadm:Removing cluster... 2023-10-05T16:04:46.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --force 2023-10-05T16:04:47.571 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T16:04:49.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --force 2023-10-05T16:04:50.329 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T16:04:52.109 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6446904c-6393-11ee-8db5-212e2dc638e7 --force 2023-10-05T16:04:53.139 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 6446904c-6393-11ee-8db5-212e2dc638e7 2023-10-05T16:04:54.956 INFO:tasks.cephadm:Removing cephadm ... 2023-10-05T16:04:54.956 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-05T16:04:55.007 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-05T16:04:55.056 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-05T16:04:55.100 INFO:tasks.cephadm:Teardown complete 2023-10-05T16:04:55.100 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-05T16:04:55.113 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_689b3d5ae1ed3e8efe9a65281cd9bd422749e95f/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-05T16:04:55.114 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-05T16:04:55.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T16:04:55.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T16:04:55.124 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T16:04:55.301 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-05T16:04:55.312 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-05T16:04:55.312 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T16:04:55.317 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T16:04:55.321 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T16:04:55.356 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-10-05T16:04:55.359 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2023-10-05T16:04:55.362 INFO:teuthology.orchestra.run.smithi167.stderr:bash: ntpq: command not found 2023-10-05T16:04:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T16:04:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-10-05T16:04:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 -494us[ -495us] +/- 81ms 2023-10-05T16:04:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 +329us[ +329us] +/- 61ms 2023-10-05T16:04:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +29us[ +29us] +/- 89ms 2023-10-05T16:04:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T16:04:55.398 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T16:04:55.399 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-10-05T16:04:55.399 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 -488us[ -478us] +/- 81ms 2023-10-05T16:04:55.399 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 +353us[ +362us] +/- 61ms 2023-10-05T16:04:55.399 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 +69us[ +78us] +/- 89ms 2023-10-05T16:04:55.399 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T16:04:55.401 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T16:04:55.401 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2023-10-05T16:04:55.401 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 -485us[ -485us] +/- 81ms 2023-10-05T16:04:55.401 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 +335us[ +329us] +/- 61ms 2023-10-05T16:04:55.401 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +22us[ +22us] +/- 89ms 2023-10-05T16:04:55.401 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T16:04:55.402 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-05T16:04:55.413 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-05T16:04:55.414 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-05T16:04:55.452 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T16:04:55.681 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T16:04:55.927 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T16:04:56.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T16:04:56.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T16:04:56.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T16:04:56.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T16:04:56.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T16:04:56.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T16:04:56.414 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-05T16:04:56.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-05T16:04:56.438 INFO:teuthology.task.internal:Duration was 3442.450068 seconds 2023-10-05T16:04:56.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-05T16:04:56.449 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-05T16:04:56.450 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T16:04:56.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T16:04:56.460 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T16:04:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T16:04:56.595 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T16:04:56.608 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T16:04:57.175 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-05T16:04:57.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2023-10-05T16:04:57.175 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T16:04:57.238 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2023-10-05T16:04:57.239 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T16:04:57.309 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T16:04:57.309 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T16:04:57.375 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-05T16:04:57.375 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T16:04:57.380 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T16:04:57.385 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T16:04:57.511 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-05T16:04:57.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T16:04:57.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T16:04:57.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T16:04:57.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-05T16:04:57.714 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-05T16:04:57.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T16:04:57.785 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T16:04:57.854 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T16:04:57.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-05T16:04:57.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T16:04:57.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T16:04:57.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T16:04:58.015 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2023-10-05T16:04:58.024 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2023-10-05T16:04:58.081 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2023-10-05T16:04:58.119 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T16:04:58.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T16:04:58.161 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T16:04:58.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T16:04:58.203 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T16:04:58.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T16:04:58.245 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-05T16:04:58.259 INFO:teuthology.task.internal:Transferring archived files... 2023-10-05T16:04:58.260 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi017 2023-10-05T16:04:58.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T16:04:58.348 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi079 2023-10-05T16:04:58.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T16:04:58.430 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983/remote/smithi167 2023-10-05T16:04:58.431 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T16:04:58.513 INFO:teuthology.task.internal:Removing archive directory... 2023-10-05T16:04:58.513 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T16:04:58.518 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T16:04:58.523 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T16:04:58.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-05T16:04:58.582 INFO:teuthology.task.internal:Not uploading archives. 2023-10-05T16:04:58.583 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-05T16:04:58.594 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-05T16:04:58.595 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T16:04:58.602 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T16:04:58.607 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T16:04:58.641 INFO:teuthology.orchestra.run.smithi017.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 16:04 /home/ubuntu/cephtest 2023-10-05T16:04:58.645 INFO:teuthology.orchestra.run.smithi079.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 16:04 /home/ubuntu/cephtest 2023-10-05T16:04:58.651 INFO:teuthology.orchestra.run.smithi167.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 16:04 /home/ubuntu/cephtest 2023-10-05T16:04:58.654 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-05T16:04:58.667 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-05T16:04:58.680 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-05T16:04:58.680 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T16:04:58.704 DEBUG:teuthology.nuke:shortname: smithi017 2023-10-05T16:04:58.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T16:04:58.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:58:01.806933', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T16:04:58.736 DEBUG:teuthology.nuke:shortname: smithi079 2023-10-05T16:04:58.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T16:04:58.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:58:01.809456', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T16:04:58.762 DEBUG:teuthology.nuke:shortname: smithi167 2023-10-05T16:04:58.762 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T16:04:58.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-05_14:37:31-fs:workload-wip-61009-wo-1-testing-default-smithi/7411983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 14:58:01.808281', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-05T16:04:58.798 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-05T16:04:58.798 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T16:04:58.820 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-05T16:04:58.821 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:04:58.843 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-05T16:04:58.843 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T16:04:58.854 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-05T16:04:58.866 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-05T16:04:58.867 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:04:58.883 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-05T16:04:58.883 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T16:04:58.893 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-05T16:04:58.908 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-05T16:04:58.908 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:04:58.931 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-05T16:05:02.855 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:02.895 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:02.933 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:02.966 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-05T16:05:03.007 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-05T16:05:03.043 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-05T16:05:06.970 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:07.008 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:07.044 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:07.080 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-05T16:05:07.118 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-05T16:05:07.154 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-05T16:05:07.182 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-05T16:05:07.255 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-05T16:05:11.122 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T16:05:11.232 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-05T16:05:11.334 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-05T16:05:11.645 INFO:teuthology.run:Summary data: description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} duration: 3442.4500682353973 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default mon.a-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.b-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c mon.c-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c owner: scheduled_vshankar@teuthology status: fail success: false 2023-10-05T16:05:11.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T16:05:11.730 INFO:teuthology.run:FAIL